TestSpecifications

(Difference between revisions)
(List Of Test Specifications: added TS_71_APISupport_Ant_Harness)
m (Ant and JPDA Interface Debuggers have new TS for 8.0.)
 
(113 intermediate revisions not shown)
Line 4: Line 4:
Test specifications are documents containing description of test scenarios.
Test specifications are documents containing description of test scenarios.
These scenarios help QE with execution of manual tests.
These scenarios help QE with execution of manual tests.
-
 
+
* [[NetBeans_73_TestingProgress| NetBeans 7.3 Test Specifications & Progress]]
 +
* [[NetBeans_72_TestingProgress| NetBeans 7.2 Test Specifications & Progress]]
* [[NB71TestingProgress| NetBeans 7.1 Test Specifications & Progress]]
* [[NB71TestingProgress| NetBeans 7.1 Test Specifications & Progress]]
* [[NB70TestingProgress| NetBeans 7.0 Test Specifications & Progress]]
* [[NB70TestingProgress| NetBeans 7.0 Test Specifications & Progress]]
Line 18: Line 19:
* [http://qa.netbeans.org/modules/test-specs-41.html NetBeans 4.1 Test Specifications]
* [http://qa.netbeans.org/modules/test-specs-41.html NetBeans 4.1 Test Specifications]
-
===List Of Test Specifications===
+
==List Of Test Specifications==
 +
 
 +
STARTOF work in progress
 +
 
 +
see for platform [[User:Skygo#TS| history track]]
 +
start categorizing of some TS [[:Category:TestSpecification:Core]]
 +
[[:Category:TestSpecification:Obsolete]]
 +
ENDOF
*Platform:
*Platform:
-
**Apisupport - [[TS_71_APISupport_Ant_ProjectOperations]], [[TS_70_ProjectsWizard]], [[TS_70_Appisupport_Sanity]], [[TS_69_Apisupport_OSGI]], [[TS_71_XMLLayer]], [[TS_71_SeparateCache]], [[TS_71_WindowWizard]], [[TS_71_Templates]], [[TS_71_APISupport_Ant_Harness]]
+
**Apisupport - [[TS_71_APISupport_Ant_ProjectOperations]], [[TS_74_ProjectsWizard]], [[TS_73_Apisupport_Sanity]], [[TS_73_Apisupport_OSGI]], [[TS_71_XMLLayer]], [[TS_71_SeparateCache]], [[TS_71_WindowWizard]], [[TS_74_Templates]], [[TS_73_APISupport_Ant_Harness]]
-
**Ant - [[TS_61_Ant]]
+
**Ant - [[TS_74_Ant]]
-
**Maven - [[STS_70_Maven]], [[TS_70_JavaEE_Sanity]], [[STS_69_Maven_OSGI]], [[TS_71_Maven]]
+
**Maven - [[STS_73_Maven]], [[TS_73_Maven]], [[TS_70_JavaEE_Sanity]], [[STS_69_Maven_OSGI]]
-
**Window System - [[TS_65_WindowSystem]], [[TS_61_MainWindow]], [[TS_61_StartPage]], [[TS_65_Palette]]
+
**Window System - [[TS_7_WindowSystem]], [[TS_7_MainWindow]], [[TS_7_StartPage]], [[TS_7_Palette]]
-
**UI - [[TS_60_Wizards]], [[TS_60_Favorites]]
+
**UI - [[TS_60_Wizards]], [[TS_60_FavoritesAndTemplates]]
**Quick Search - [[TS_65_QuickSearch]]
**Quick Search - [[TS_65_QuickSearch]]
-
**Projects - [[TS_71_ProjectsGroupCommandLine]], [[TS_61_ProjectsActions]], [[TS_61_ProjectsProperties]], [[TS_61_ProjectsLibraries]], [[TS_61_ProjectsWizardsAndFreeform]], [[TS_65_J2SEWebstart]]
+
**Projects - [[TS_71_ProjectsGroupCommandLine]], [[TS_72_ProjectsActions]], [[TS_61_ProjectsProperties]], [[TS_72_ProjectsLibraries]], [[TS_72_ProjectsWizardsAndFreeform]], [[TS_65_J2SEWebstart]]
**Property Sheet/Editors - [[TS_60_PropertySheet]], [[TS_60_PropertyEditors]]
**Property Sheet/Editors - [[TS_60_PropertySheet]], [[TS_60_PropertyEditors]]
**Options - [[TS_65_OptionsDialog]]
**Options - [[TS_65_OptionsDialog]]
-
**Output Window - [[TS_61_OutputWindow]]
+
**Output Window - [[TS_74_OutputWindow]]
-
**Explorer - [[TS_61_FilesAndProjectsView]]
+
**Explorer - [[TS_72_FilesAndProjectsView]]
-
**Tasklist - [[TS_65_Tasklist]]
+
**Tasklist - [[TS_74_Tasklist]]
-
**JavaHelp - [[TS_65_JavaHelp]]
+
**JavaHelp - [[TS_74_JavaHelp]]
**Plugin Manager -  [[TS_70_PluginManager]]
**Plugin Manager -  [[TS_70_PluginManager]]
**Platform other : [[TS_EmbeddedBrowser_Sanity | Embedded Browser]], [[TS_65_PatchesTesting | Patches ]], [[TS_61_PluginPortal | Plugin Portal]], [[TS_60_Clusters Clusters]], [[TS_65_CLI CLI]], [[TS_61_Collaboration | Collaboration]], [[TS_61_SatisfactionSurvey | Satisfaction Survey]], [[TS_61_UserRegistration | Users Registration]]
**Platform other : [[TS_EmbeddedBrowser_Sanity | Embedded Browser]], [[TS_65_PatchesTesting | Patches ]], [[TS_61_PluginPortal | Plugin Portal]], [[TS_60_Clusters Clusters]], [[TS_65_CLI CLI]], [[TS_61_Collaboration | Collaboration]], [[TS_61_SatisfactionSurvey | Satisfaction Survey]], [[TS_61_UserRegistration | Users Registration]]
*Life Cycle Tools:
*Life Cycle Tools:
-
** Debugger - [[TS_71_Debugger_Sanity]], [[TS_67_JPDAdbg]], [[TS_67_JPDAdbg_Interface]], [[TS_67_JPDAdbg_Functionality]], [[TS_67_JPDAdbg_DebuggingViews]], [[TS 67 JPDAdbg DebuggingAndBreakpoints]], [[TS_67_JPDAdbg_Miscellaneous]], [[TS_67_ANTdbg]], [[TS_67_MultiThreadedDebugging]]  
+
** Debugger - [[TS_73_Debugger_Sanity]], [[TS_80_JPDAdbg_Interface]], [[TS_74_JPDAdbg_Functionality]], [[TS_74_JPDAdbg_DebuggingViews]], [[TS 74 JPDAdbg DebuggingAndBreakpoints]], [[TS_74_JPDAdbg_Miscellaneous]], [[TS_80_ANTdbg]], [[TS_74_MultiThreadedDebugging]]  
-
**GUI Editing - [[TS_68_FormAndSupportSanity]], [[TS_65_Form]], [[TS_71_Form]]
+
**GUI Editing - [[TS_73_FormAndSupportSanity]], [[TS_72_Form]]
-
**Git - [[TS_71_Git]]
+
**Git - [[TS_74_Git]]
-
**Subversion - [[TS_71_Subversion_Sanity]], [[TS_71_SVN]]
+
**Subversion - [[TS_74_Subversion_Sanity]], [[TS_74_SVN]]
-
**Mercurial - [[TS_68_Mercurial_Sanity]], [[TS_71_HG]]
+
**Mercurial - [[TS_68_Mercurial_Sanity]], [[TS_74_HG]]
-
**Local History - [[TS_71_LocalHistory]]
+
**Local History - [[TS_72_LocalHistory]]
-
**Editable Diff - [[TS_61_Diff]]
+
**Editable Diff - [[TS_72_Diff]]
-
**CVS - [[NB68CVSTesting]]???, [[TS_61_CVS]]
+
**CVS - [[TS_74_CVS]]
**ClearCase - [[TS_61_CC]]
**ClearCase - [[TS_61_CC]]
-
**C-dev - [[TS_67_CDevGround]], [[TS_71_CDevBugtracking]], [[TS_67_CDevChat]], [[TS_67_CDevProjects]], [[TS_67_CDevContinuousIntegration]]
+
**C-dev - [[TS_73_CDevGround]], [[TS_73_CDevProjects]], [[TS_71_CDevBugtracking]], [[TS_67_CDevChat]], [[TS_67_CDevContinuousIntegration]]
-
**Utilities - [[TS_60_Utilities]]
+
**Utilities - [[TS_73_Utilities]]
**Properties - [[TS_61_Properties]]
**Properties - [[TS_61_Properties]]
-
**jUnit - [[TS_60_JUnit]]<br>[[TS_68_JUnit]] ???
+
**jUnit - [[TS_71_JUnit]] [[TS_72_UnitTesting]] [[TS_74_UnitTesting]] (covers also TestNG)
**I18N support - [[TS_61_Internationalization]]
**I18N support - [[TS_61_Internationalization]]
*JavaSE:
*JavaSE:
-
**Editor - [[TS_71_Editor]], [[TS_71_EditroCodeFolding]], [[TS_68_EditorOptions]], [[TS_71_Formatting]]
+
**Editor - [[TS_74_Editor]], [[TS_74_EditorCodeFolding]], [[TS_74_EditorOptions]], [[TS_74_Formatting]]
-
**Java - [[TS_71_JavaEditor]], [[TS_71_JavaNavigation]], [[TS_71_JavaCodeCompletion]],  [[TS_71_JavaHints]],[[TS_65_CompileOnSave]], [[TS_71_InspectAndRefactor]]
+
**Java - [[TS_74_JavaEditor]], [[TS_74_JavaNavigation]], [[TS_74_JavaCodeCompletion]],  [[TS_74_JavaHints]],[[TS_74_JavaProject]], [[TS_73_InspectAndRefactor]]
-
**Refactoring - [[TS_65_Refactoring_Sanity]], [[STS_68_Refactoring]], [[TS_60_Refactoring]] (most used), [[TS_60_Refactoring2]], [[TS_60_Refactoring3]], [[TS_65_CallHierarchy]]
+
**Refactoring - [[STS_68_Refactoring]], [[TS_74_Refactoring]] (most used), [[TS_74_Refactoring2]], [[TS_60_Refactoring3]], [[TS_74_Refactoring4]],[[TS_74_CallHierarchy]]
**Beans - [[TS_71_JavaBeans]]
**Beans - [[TS_71_JavaBeans]]
-
**JavaDoc - [[TS_71_JavaDoc]]
+
**JavaDoc - [[TS_73_JavaDoc]]
**SpellCheck - [[TS_70_SpellCheck]]
**SpellCheck - [[TS_70_SpellCheck]]
 +
**FindBug - [[TS_73_FindBugs]]
 +
 +
*JavaFX 2:
 +
** [[TS_74_JavaFX2]]
*Profiler:
*Profiler:
-
** [[TS_71_Profiler]], [[TS_71_Profiler_Sanity]](included in the full specification)
+
** [[TS_74_Profiler]], [[TS_74_Profiler_Sanity]]
*Java Web and EE:
*Java Web and EE:
-
** Web - [[TS_70_JavaEE_Sanity]], [[TS_70_WebProject]], [[TS_60_WebSamples]], [[TS_70_WebEnterpriseDebug]], [http://qa.netbeans.org/modules/webapps/promo-g/headlessdeployment/headlessdeployment.html Headless Deployment], [[TS_71_CDI]]
+
** Web - [[STS_74_JavaEE]], [[TS_72_WebProject]], [[TS_72_JavaEESamples]], [[TS_70_WebEnterpriseDebug]], [http://qa.netbeans.org/modules/webapps/promo-g/headlessdeployment/headlessdeployment.html Headless Deployment], [[TS_71_CDI]]
-
** EAR - [[TS_60_EARProject]]
+
** EAR - [[TS_73_EARProject]]
-
** EJB - [[TS_71_EJB]], [[TS_60_EJB_withEx_sources]], [http://qa.netbeans.org/modules/j2ee/promo-g/Ejb3.html EJB 3.0 Support TS], [[TS_68_EJB31_Validation]], [[TS_61_EjbJar_xml_editor]]
+
** EJB - [[TS_71_EJB]], [[TS_73_EJB_WithExistingSources]], [[TS_61_EjbJar_xml_editor]]
-
** Persistence - [[TS_61_PersistenceUnit]], [[TS_68_JavaEE6Persistence_Validation]]
+
** Persistence - [[TS_73_PersistenceUnit]], [[TS_73_Persistence]]
-
** Entity Classes - [[TS_61_JSFPages_from_Entity_Classes]], [[TS_71_Entity_Classes_From_Database]]
+
** GlassFish - [[TS_72_GlassFish]]
-
** GlassFish - [[TS_71_GlassFish]]
+
** Tomcat - [http://qa.netbeans.org/modules/webapps/promo-f/tomcat/tomcatint.html Tomcat integration TS]
** Tomcat - [http://qa.netbeans.org/modules/webapps/promo-f/tomcat/tomcatint.html Tomcat integration TS]
** JBoss - [[TS_61_JBoss]]
** JBoss - [[TS_61_JBoss]]
-
** WebLogic - [[TS_71_WebLogic]]
+
** WebLogic - [[TS_71_WebLogic]],
-
** JSF - [[TS_71_JSF_Support]]
+
** Oracle Cloud - [[TS_73_Cloud]]
 +
** JSF - [[TS_72_JSF_Support]]
** Struts - [[TS_71_StrutsSupport]]
** Struts - [[TS_71_StrutsSupport]]
** Spring - [[TS_71_SpringSupport]]
** Spring - [[TS_71_SpringSupport]]
-
** Hibernate - [[TS_65_HibernateSupport]]
+
** Hibernate - [[TS_71_HibernateSupport]]
-
** Web Services - [[WSTests]] (automated tests), [[TS_71_SaaSServices]], [[TS_60_WSDesigner]], [[TS_61_WebServicesEditorSupport]], [http://qa.netbeans.org/modules/j2ee/netbeans%206.1/WSClientJAXWS.html JAX-WS]
+
** Web Services - [[WSTests]] (automated tests), [[TS_73_RESTWebServices]], [[TS_71_SaaSServices]], [[TS_60_WSDesigner]], [[TS_61_WebServicesEditorSupport]], [http://qa.netbeans.org/modules/j2ee/netbeans%206.1/WSClientJAXWS.html JAX-WS]
** Obsolete - [[TS_61_WebSphere]], [http://qa.netbeans.org/modules/j2ee/promo-g/ApplicationClient.html App.Client TS], [http://qa.netbeans.org/modules/j2ee/netbeans%206.1/WSClientJAXRPC.html JAX-RPC]
** Obsolete - [[TS_61_WebSphere]], [http://qa.netbeans.org/modules/j2ee/promo-g/ApplicationClient.html App.Client TS], [http://qa.netbeans.org/modules/j2ee/netbeans%206.1/WSClientJAXRPC.html JAX-RPC]
Line 88: Line 100:
*DB:
*DB:
-
** [http://qa.netbeans.org/modules/webapps/promo-h/SQLEditor.html SQL Editor], [http://qa.netbeans.org/modules/webapps/promo-h/DBConnection.html Connection dialog], [http://qa.netbeans.org/modules/webapps/promo-h/DBIntegration.html Integration with MySQL and PostgreSQL], [http://qa.netbeans.org/modules/webapps/promo-h/DBSupport.html DB Support]
+
** [[TS_73_DB_SQL_Editor]], [http://qa.netbeans.org/modules/webapps/promo-h/DBConnection.html Connection dialog], [http://qa.netbeans.org/modules/webapps/promo-h/DBIntegration.html Integration with MySQL and PostgreSQL], [http://qa.netbeans.org/modules/webapps/promo-h/DBSupport.html DB Support], [[TS_70_DB_Sanity]]
-
[[TS_70_DB_Sanity]]
+
*PHP:
*PHP:
-
** [[TS_70_PHP_Sanity]], [[TS_69_PHP_Test_Specifications]]
+
** [[TS_73_PHP_Test_Specifications]],[[TS_72_PHP_Sanity]],[[TS_72_PHP]], [[TS_70_PHP_Sanity]]
-
 
+
*Web Client
 +
** [[TS_74_WebClient_Test_Specifications]], [[TS_73_WebClient_Test_Specifications]]
*Performance:
*Performance:
** [[TS_60_Performance]] ??? automated tests only
** [[TS_60_Performance]] ??? automated tests only
Line 105: Line 117:
*JavaME:
*JavaME:
-
** [[TS_61_MobilityFragmentation]], [[TS_61_MobilityEndToEnd]], [[TS_60_MobilityDebugging]], [[TS_61_MobilityProjectProperties]], [[TS_60_MobilityCreateNew]], [[TS_61_MobilityJMUnit]], [[TS_60_MobilityScreenDesigner]], [[TS_61_MobilityFlowDesigner]], [[TS_60_MobilityVisualProperties]], [[TS_61_MobilityGameDesigner]], [[TS_60_MobilitySVGComponents]], [[TS_65_MobilityCDC]], [[TS_61_MobilityOther]],  
+
** [[STS_73_J2ME]]
 +
** [[TS_61_MobilityFragmentation]], [[TS_61_MobilityEndToEnd]], [[TS_60_MobilityDebugging]], [[TS_61_MobilityProjectProperties]], [[TS_60_MobilityCreateNew]], [[TS_61_MobilityJMUnit]], [[TS_60_MobilityScreenDesigner]], [[TS_61_MobilityFlowDesigner]], [[TS_60_MobilityVisualProperties]], [[TS_73_MobilityGameDesigner]], [[TS_73_MobilitySVGComponents]], [[TS_61_MobilityOther]],  
*Ruby:
*Ruby:
Line 112: Line 125:
*Groovy:
*Groovy:
**[[GroovyGrailsTests]](automated tests)  
**[[GroovyGrailsTests]](automated tests)  
 +
**[[TS_73_Groovy]]
 +
**[[TS_73_GroovyGrails_Sanity]]
-
*JavaFX (deprecated):
+
*XML :
-
** [[TS_68_JavaFX_Sanity]], [[TS_68_JavaFX_Project]],  [[TS_68_JavaFX_Platforms]], [[TS_68_JavaFX_MobileEmulator]], [[TS_68_JavaFX_Samples]], [[TS_68_JavaFX_Debugger]]
+
** [[TS_73_XML]]
-
 
+
-
*JavaFX 2:
+
-
** [[TS_71_JavaFX2]]
+
*Obsolete:
*Obsolete:
-
** [[TS_70_XML]], [[TS_60_RESTSupport]], [http://qa.netbeans.org/modules/webapps/promo-h/TS_65_JavaScriptDebugger.html JS Debugger], [http://qa.netbeans.org/modules/webapps/promo-f/monitor/monitor.html HTTP monitor], [[TS_65_ThirdPartyLibraryManager]], [http://identity.netbeans.org/specs/spec/IdentityTestSpec.xml IdentityTestSpecification]
+
** [[TS_60_RESTSupport]], [http://qa.netbeans.org/modules/webapps/promo-h/TS_65_JavaScriptDebugger.html JS Debugger], [http://qa.netbeans.org/modules/webapps/promo-f/monitor/monitor.html HTTP monitor], [[TS_65_ThirdPartyLibraryManager]], [http://identity.netbeans.org/specs/spec/IdentityTestSpec.xml IdentityTestSpecification], [[TS_65_MobilityCDC]], [[TS_68_JavaFX_Sanity]], [[TS_68_JavaFX_Project]],  [[TS_68_JavaFX_Platforms]], [[TS_68_JavaFX_MobileEmulator]], [[TS_68_JavaFX_Samples]], [[TS_68_JavaFX_Debugger]], [[TS_72_Git]], [[TS_71_Subversion_Sanity]], [[TS_73_Git]], [[TS_72_SVN]], [[TS_72_HG]]
-
===New Test Specifications===
+
==New Test Specifications==
New version of Test Specification is written in JSPWiki using it's syntax with few enhancements. Look at [[TextFormattingRules| Text Formatting Rules]]. Pay special attention to [http://wiki.netbeans.org/wiki/view/TextFormattingRules#section-TextFormattingRules-NumberedLists Numbered list part] - you must add one or more spaces on the new line if you want to continue with numbered list.
New version of Test Specification is written in JSPWiki using it's syntax with few enhancements. Look at [[TextFormattingRules| Text Formatting Rules]]. Pay special attention to [http://wiki.netbeans.org/wiki/view/TextFormattingRules#section-TextFormattingRules-NumberedLists Numbered list part] - you must add one or more spaces on the new line if you want to continue with numbered list.
-
====How-to create a new Test Specification====
+
===How-to create a new Test Specification===
Easiest way to create such a new shiny Test Specification is:
Easiest way to create such a new shiny Test Specification is:
# Create a new wiki page and name it properly (name of test specification: '''"TS_nbversion_testspecname"''' - e.g. TS_60_ActionsWizard)
# Create a new wiki page and name it properly (name of test specification: '''"TS_nbversion_testspecname"''' - e.g. TS_60_ActionsWizard)
Line 131: Line 143:
# Edit your page
# Edit your page
-
====How-to create Test Specification using existing XML file(s)====
+
===How-to create Test Specification using existing XML file(s)===
If your Test Specification is now stored in XML file(s) and you use [http://qa.netbeans.org/tools/testspeceditor/launch.jnlp Test Specification Editor] or bash script to create HTML version of Test Specification, then please follow this how-to:
If your Test Specification is now stored in XML file(s) and you use [http://qa.netbeans.org/tools/testspeceditor/launch.jnlp Test Specification Editor] or bash script to create HTML version of Test Specification, then please follow this how-to:
* [[TestSpecificationsInfo| How to generate new Test Specification from existing XML]]
* [[TestSpecificationsInfo| How to generate new Test Specification from existing XML]]
Line 137: Line 149:
Hint: [http://qa.netbeans.org/tools/testspeceditor/launch.jnlp Test Specification Editor] now contains predefined XSL file to transform XML Test Specification to JSPWiki format too.
Hint: [http://qa.netbeans.org/tools/testspeceditor/launch.jnlp Test Specification Editor] now contains predefined XSL file to transform XML Test Specification to JSPWiki format too.
-
====Links====
+
===Links===
* [[TestSpecificationsTemplate| Test Specification Template]]
* [[TestSpecificationsTemplate| Test Specification Template]]
* [[TestSpecificationsInfo| How to generate new Test Specification from existing XML]]
* [[TestSpecificationsInfo| How to generate new Test Specification from existing XML]]

Current revision as of 13:05, 7 November 2013

NetBeans Test Specifications

Test specifications are documents containing description of test scenarios. These scenarios help QE with execution of manual tests.

List Of Test Specifications

STARTOF work in progress

see for platform history track start categorizing of some TS Category:TestSpecification:Core Category:TestSpecification:Obsolete ENDOF

New Test Specifications

New version of Test Specification is written in JSPWiki using it's syntax with few enhancements. Look at Text Formatting Rules. Pay special attention to Numbered list part - you must add one or more spaces on the new line if you want to continue with numbered list.

How-to create a new Test Specification

Easiest way to create such a new shiny Test Specification is:

  1. Create a new wiki page and name it properly (name of test specification: "TS_nbversion_testspecname" - e.g. TS_60_ActionsWizard)
  2. Copy & paste content of Test Specification Template into your newly created page
  3. Edit your page

How-to create Test Specification using existing XML file(s)

If your Test Specification is now stored in XML file(s) and you use Test Specification Editor or bash script to create HTML version of Test Specification, then please follow this how-to:

Hint: Test Specification Editor now contains predefined XSL file to transform XML Test Specification to JSPWiki format too.

Links

Not logged in. Log in, Register

By use of this website, you agree to the NetBeans Policies and Terms of Use. © 2012, Oracle Corporation and/or its affiliates. Sponsored by Oracle logo