NB68TestingProgress
NetBeans 6.8 Testing Progress
- See Tested Platforms & Runtimes in NetBeans 6.8 for details around Operating Systems and tested JDKs.
- See Detailed plan for other tasks we'll do in NetBeans 6.8 time-frame related to this release as well as other types of testing.
- Full test - for Primary Features and Quality Modules- run all Test Specifications on all platforms and default JDK(on specific platform) once a release, if time permits cover by "second supported JDK" / "JDK7"
- Acceptance test - for some Modules in Maintenance Mode - run all Test Specifications just on one platform and default JDK(on specific platform) once a release
- Sanity test - for some Modules in Maintenance Mode - run NB68SanityTestSpecifications or subset of all Test Specifications on one or more platforms and default JDK(on specific platform) once release
| Feature | Owner | Tests Specifications | Time to execute TSs | Automated Tests | Solaris | Mac OS | Ubuntu | Win XP | Win Vista | Win 7 | JDK7 | Notes | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Core | ||||||||||||||||||||||||
| Apisupport | TS_61_ProjectOperations, TS_60_ProjectsWizard, TS_65_Appisupport_Sanity | 5h | x | x | x | x | x | x | x | x | Not covered by NetBeans QE | |||||||||||||
| Ant | TS_61_Ant | 3h | x | Sanity test - all platforms | ||||||||||||||||||||
| Maven | JPo | Maven in J2SE, Maven web projects, TS_68_MavenEE6Sanity | 3h(one platform) | x | DONE | DONE | Sanity | Sanity +I18N/A11Y | DONE | DONE | Full test | |||||||||||||
| Embed. Browser | JPo | 8h (1h per OS/JDK version) | x | Full test | ||||||||||||||||||||
| Window System | TS_65_WindowSystem, TS_61_MainWindow, TS_61_StartPage , TS_65_Palette | 9h | Sanity test - all platforms | |||||||||||||||||||||
| UI | TS_60_Wizards, TS_60_Favorites | x | Sanity test - one platform | |||||||||||||||||||||
| Quick Search | TS_65_QuickSearch | x | Sanity test - one platform | |||||||||||||||||||||
| Projects | PD | TS_61_ProjectsActions, TS_61_ProjectsProperties, TS_61_ProjectsLibraries | 9h | x | PD Oct/09 | PD Oct/09 | U9.04, PD Oct/09 | PD Oct/09 | PD Oct/09 | PD Oct/09 | Full test | |||||||||||||
| Projects freeform | PD | TS_61_ProjectsWizardsAndFreeform | 1h | x | PD Oct/09 | PD Oct/09 | U9.04, PD Oct/09 | PD Nov/02 | PD Oct/09 | PD Oct/09 | Full test | |||||||||||||
| Projects javawebstart | PD | TS_65_J2SEWebstart | 7h ??TM | x | PD Oct/09 | PD Oct/09 | U9.04, PD Oct/09 | PD Oct/09 | PD Oct/09 | PD Oct/09 | Sanity test - one platform | |||||||||||||
| Property Sheet, Property Editors | TS_60_PropertySheet, TS_60_PropertyEditors | x | Acceptance test | |||||||||||||||||||||
| Options | TS_65_OptionsDialog | 20m | Sanity test - all platforms | |||||||||||||||||||||
| Output | TS_61_OutputWindow | 30m | Sanity test - all platforms | |||||||||||||||||||||
| Explorer | TS_61_FilesAndProjectsView | 1.5h | Sanity test - one platform | |||||||||||||||||||||
| Tasklist | TS_65_Tasklist | 0.5 | Sanity test - all platforms | |||||||||||||||||||||
| CLI | TS_65_CLI | 0.5 | Sanity test - all platforms | |||||||||||||||||||||
| Other | TS_60_Clusters, TS_60_Loaders | x | x | x | x | x | x | x | x | Not covered by NetBeans QE | ||||||||||||||
| Users Registration | TS_61_UserRegistration | 0.5 | x | x | x | x | x | check version | ||||||||||||||||
| Plugin Portal | TS_61_PluginPortal | x | x | x | x | x | x | x | x | Separate test round | ||||||||||||||
| Patches | TS_65_PatchesTesting | x | x | x | x | x | x | x | x | Separate test round | ||||||||||||||
| Satisfaction Survey | TS_61_SatisfactionSurvey | 0.5 | x | x | x | x | x | x | x | x | Not planned for 6.8 | |||||||||||||
| Collaboration | TS_61_Collaboration | - | x | x | x | x | x | x | x | x | Not planned for 6.8 | |||||||||||||
| Editor Technologies | ||||||||||||||||||||||||
| Editor editor,utilities,options | JPr | TS_68_Editor Sanity | 10h | 58 | JPr Oct/9 (jdk6_16) | JPr Nov/5 (jdk6_16) | JPr Nov/11 (jdk6_16) | JPr Oct/15 (jdk6_16) | PP Sep/23 (jdk6_16) | Full test | ||||||||||||||
| Java - java module | JPr | TS_70_Java Sanity | 7h | 391 | JPr Oct/9 (jdk6_16) | PP Oct/16 (jdk6_15) | PP Nov/10 (jdk6_16) | PP Oct/29 (jdk6_16) | PP Oct/15 (jdk6_16) | PP Sep/23 (jdk6_16) | Full test | |||||||||||||
| Java - compile on save | JPr | TS_65_CompileOnSave | 1h | PP Oct/09 (jdk6_16) | PP Oct/16 (jdk6_15) | PP Nov/10 (jdk6_16) | PP Oct/29 (jdk6_16) | PP Oct/15 (jdk6_16) | PP Sep/23 (jdk6_16) | Full test | ||||||||||||||
| Java - formatting | JPr | TS_65_Formatting | 2h | PP Oct/09 (jdk6_16) | PP Oct/16 (jdk6_15) | PP Nov/10 (jdk6_16) | PP Oct/29 (jdk6_16) | PP Oct/15 (jdk6_16) | PP Sep/23 (jdk6_16) | PP Oct/16 (jdk6_15) | Full test | |||||||||||||
| Java - java hints | JPr | TS_70_Hints | 1h | PP Oct/09 (jdk6_16) | PP Oct/16 (jdk6_15) | PP Nov/10 (jdk6_16) | PP Oct/29 (jdk6_16) | PP Oct/15 (jdk6_16) | PP Sep/23 (jdk6_16) | Full test | ||||||||||||||
| Refactoring | JPr | TS_60_Refactoring (most used), TS_60_Refactoring2, TS_60_Refactoring3, TS_65_CallHierarchy, Sanity | 12 | PP Oct/09 (jdk6_16) | JPr Nov/04 (jdk6_16) | JPr Nov/11 (jdk6_16) | PP Nov/13 (jdk6_16) | JPr Oct/14 (jdk6_16) | PP Sep/23 (jdk6_16) | Full test | ||||||||||||||
| Beans | JPr | TS_67_Beans | 2h | 0 | JPr Oct/12 (jdk6_16) | PP Oct/16 (jdk6_15) | PP Nov/10 (jdk6_16) | PP Oct/29 (jdk6_16) | JPr Oct/13 (jdk6_16) | JPr Sep/25(jdk6_16) | Sanity test - one platform | |||||||||||||
| Javadoc | JPr | TS_70_JavaDoc | 2h | 0 | JPr Oct/12 (jdk6_16) | PP Oct/16 (jdk6_15) | PP Nov/10 (jdk6_16) | PP Oct/29 (jdk6_16) | JPr Oct/13 (jdk6_16) | JPr Sep/25 (jdk6_16) | Sanity test - one platform | |||||||||||||
| Life Cycle Tools | ||||||||||||||||||||||||
| Debugger jpda,ant | VS | TS_67_Debugger_Sanity(Sanity), TS_67_JPDAdbg, Interface , Functionality, Debugging Views, Breakpoints, Miscellanous, TS_67_ANTdbg, TS_67_MultiThreadedDebugging | 16h(4h) | 16 (job) | VS Oct/15 (jdk 1.6u16) | VS Nov/11 (jdk 1.5u19) | VS Nov/13 (jdk 1.6u16) | VS Nov/10 (jdk 1.6u16) | VS Oct/19 (jdk 1.6u16) | VS Sep/29 (jdk 1.6u16) | Full test | |||||||||||||
| Form | PPr | TS_65_Form, TS_68_FormAndSupportSanity (Sanity) | 24h | 16 (job) | PP Oct/09 | PP Sep/23 | Full test one platform, Sanity - all other platforms | |||||||||||||||||
| Subversion | DK | TS_61_SVN | 5h | PP Nov/13 | PP Nov/20 | Full test | ||||||||||||||||||
| Mercurial | DK | TS_61_HG | 7h | PP Nov/11 (Sanity) | PP Nov/05 | Full test | ||||||||||||||||||
| Local History | DK | TS_61_LocalHistory | 15min | PP Nov/05 | Acceptance test | |||||||||||||||||||
| Editable Diff | DK | TS_61_Diff | 30min | PP Nov/11 | PP Nov/05 | Acceptance test | ||||||||||||||||||
| CVS | NB68CVSTesting | TS_61_CVS | 4h | - | x | Full test | ||||||||||||||||||
| ClearCase | TS_61_CC | 5h | - | x | x | x | x | x | x | x | planned for Update Center (one platform) | |||||||||||||
| Mobility | ||||||||||||||||||||||||
| Device Fragmentation | ACh | TS_61_MobilityFragmentation | 2 | - | x | x | ACh Oct/2 | x | x | x | Full test | |||||||||||||
| End to End | ACh | TS_61_MobilityEndToEnd | 1 | - | x | x | ACh Nov/3 | x | x | x | Full test | |||||||||||||
| Debugging in Java ME world | ACh | TS_60_MobilityDebugging | 0.5 | - | x | x | ACh Oct/2 | x | x | x | Full test | |||||||||||||
| Mobility Project Properties | ACh | TS_61_MobilityProjectProperties | 1 | - | x | x | ACh Oct/21 | x | x | x | Full test | |||||||||||||
| Create New - project, file, etc. | ACh | TS_60_MobilityCreateNew | 1 | - | x | x | ACh Oct/21 | x | x | x | Full test | |||||||||||||
| JMUnit Support | ACh | TS_61_MobilityJMUnit | 0.5 | - | x | x | ACh Nov/5 | x | x | x | Full test | |||||||||||||
| Screen Designer | ACh | TS_60_MobilityScreenDesigner | 1.5 | - | x | x | ACh Oct/20 | x | x | x | Full test | |||||||||||||
| Flow Designer | ACh | TS_61_MobilityFlowDesigner | 2 | - | x | x | ACh Oct/1 | x | x | x | Full test | |||||||||||||
| Properties in Visual Designer | ACh | TS_60_MobilityVisualProperties | 1.5 | - | x | x | ACh Nov/5 | x | x | x | Full test | |||||||||||||
| Game Designer | ACh | TS_61_MobilityGameDesigner | 1.5 | - | x | x | ACh Nov/9 | x | x | x | Full test | |||||||||||||
| SVG Components | ACh | TS_60_MobilitySVGComponents | 1 | - | x | x | ACh Nov/16 | x | x | x | Full test | |||||||||||||
| Mobility CDC | ACh | TS_65_MobilityCDC | 0.25 | - | x | x | ACh Nov/5 | x | x | x | Full test | |||||||||||||
| Other | ACh | TS_61_MobilityOther | 0.25 | - | x | x | ACh Nov/5 | x | x | x | Full test | |||||||||||||
| Support Modules | ||||||||||||||||||||||||
| Help System | TS_65_JavaHelp | 1.5h, 30m | PP Oct/07 | PP Oct/06 | Acceptance test | |||||||||||||||||||
| Utilities | TS_60_Utilities | 45min | PP Oct/07 | PP Oct/06 | Acceptance test | |||||||||||||||||||
| Properties | TS_61_Properties | 3h | PP Oct/07 | PP Oct/06 | Acceptance test | |||||||||||||||||||
| jUnit | TS_60_JUnit TS_68_JUnit (NEW) | 2h | PP Sep/30 | PP Sep/29 | Acceptance test | |||||||||||||||||||
| Internationalization | TS_61_Internationalization | 2,5h | PP Aug/06 | Acceptance test | ||||||||||||||||||||
| Java Web and EE | ||||||||||||||||||||||||
| EAR project | MS | TS_60_EARProject | MS Oct/29 | x | MS Oct/15 | x | Full test | |||||||||||||||||
| Web project | JS | TS_61_WebProject | 4h | 8 | Full test | |||||||||||||||||||
| EJB project (new, existing sources) | MS | TS_60_EJB_withEx_sources | 4h | MS Oct/29 | MS Oct/12 | x | Full test | |||||||||||||||||
| App. client project | Application Client | 8h | MS Oct/29 | MS Oct/5 | MS Oct/15 | Sanity test - all platforms | ||||||||||||||||||
| J2EE samples | MS | TS_60_WebSamples] | 4h | MS Oct/29 | MS Oct/5 | MS Oct/12 | x | Full test | ||||||||||||||||
| J2EE debugging | MS | TS_60_WebEnterpriseDebug | 8h | MS Oct/27 | Full test | |||||||||||||||||||
| EJB 2.1 support | MS | TS_61_EJB_Support | MS Oct/27 | MS Oct/6 | MS Oct/12 | Full test | ||||||||||||||||||
| EJB 3.0 support | MS | EJB 3.0 | 30 min | MS Oct/27 | MS Oct/6 | MS Oct/12 | Full test | |||||||||||||||||
| EJB 3.1 support | MS | TS_68_EJB31_Validation | 4h | MS Oct/27 | MS Aug/10 | x | Full test | |||||||||||||||||
| J2EE actions | MS | j2ee actions | 6h | MS Oct/26 | MS Aug/10 | MS Oct/12 | Full test | |||||||||||||||||
| Persistence | MS | TS_61_PersistenceUnit, TS_68_JavaEE6Persistence_Validation | MS Oct/26 | MS Aug/11 | MS Oct/11 | Full test | ||||||||||||||||||
| EJB config visual editor | TS_61_EjbJar_xml_editor | 2h | x | Acceptance test | ||||||||||||||||||||
| JSF from Entity classes | MM | TS_61_JSFPages_from_Entity_Classes | 1h | MM Oct/16 | MM Oct/16 | MM Oct/16 | MM Oct/16 | MM Oct/16 | MM Oct/16 | Full test | ||||||||||||||
| Entity classes from database | MS | TS_65_Entity_Classes_From_Database | MS Oct/26 | MS Aug/25 | MS Oct/10 | Full test | ||||||||||||||||||
| Tomcat integration | Tomcat | Sanity test - all platforms | ||||||||||||||||||||||
| JBoss integration | TS_61_JBoss | 3h | Sanity test - all platforms | |||||||||||||||||||||
| WebSphere integration | TS_61_WebSphere | 3h | Sanity test - all platforms | |||||||||||||||||||||
| WebLogic integration | TS_61_WebLogic | 3h | Sanity test - all platforms | |||||||||||||||||||||
| JSF support | MM | JSF Support, JSF Palette | 6h | MM Oct/16 | MM Oct/16 | MM Oct/16 | MM Oct/16 | MM Oct/16 | MM Oct/16 | Full test | ||||||||||||||
| Struts project | Struts User Scenario | 6h | Sanity test - all platforms | |||||||||||||||||||||
| Spring | TS_61_SpringSupport | Sanity test - all platforms | ||||||||||||||||||||||
| Hibernate | TS_65_HibernateSupport | Sanity test - all platforms | ||||||||||||||||||||||
| GlassFish support | - | TS_61_GlassFish | 3h | - | x | x | x | x | x | x | x | Tested by GF team | ||||||||||||
| Ruby | ||||||||||||||||||||||||
| Project | TM | TS_61_Ruby | 5 | Stable | TM 15/OCT (jdk6_12) | TM 27/OCT (jdk6_15) | TM 6/NOV (jdk6_14) | TM 16/OCT (jdk6_11) | x | Full test | ||||||||||||||
| Debugger | TM | TS_61_RubyDebugger | 3 | TM 15/OCT (jdk6_12) | TM 27/OCT (jdk6_15) | TM 16/OCT (jdk6_11) | x | Full test | ||||||||||||||||
| Web Services | ||||||||||||||||||||||||
| WS support in projects | MM | Automated tests | 6h | Full test - one platform, Sanity test - other platforms | ||||||||||||||||||||
| Partner Services | - | TS_61_SaaSServices | 16h | x | x | x | x | x | x | x | x | Not planned for NB 6.8 | ||||||||||||
| WS visual designer | - | TS_60_WSDesigner | 1h | x | x | x | x | x | x | x | x | Not planned for NB 6.8 | ||||||||||||
| WS editor support | - | TS_61_WebServicesEditorSupport | 2h | x | x | x | x | x | x | x | x | Not planned for NB 6.8 | ||||||||||||
| JAX-RPC client | - | JAX-RPC | 3h | x | x | x | x | x | x | x | x | Not planned for NB 6.8 | ||||||||||||
| JAX-WS client | MM | JAX-WS | 4h | 17 | MM Oct/16 | MM Oct/16 | MM Oct/16 | MM Oct/16 | MM Oct/16 | MM Oct/16 | Full test | |||||||||||||
| Identity | - | IdentityTestSpecification | 8h | 7 | x | x | x | x | x | x | x | Not planned for NB 6.8 | ||||||||||||
| Installer | ||||||||||||||||||||||||
| Installer(sanity) | MN | MilestoneSpec | 24 | 2009-11-07_14-23-54 | 2009-10-28_14-01-34 | 2009-11-07_14-23-54 | 2009-10-28_14-01-34 | 2009-11-07_14-23-54 | 2009-10-31_02-01-34 | Full test - NetBeans68InstallerTesting | ||||||||||||||
| Plugin Manager | MN | TS_70_PluginManager | 6 | 2009-10-28_14-01-34 | 2009-11-07_14-23-54 | 2009-10-28_14-01-34 | 2009-10-28_14-01-34 | 2009-10-15_14-01-27 | 2009-10-31_02-01-34 | Full test | ||||||||||||||
| CND | ||||||||||||||||||||||||
| Qt Support | AP | TS_67_CNDQtSupport | ? Alexander's decision | |||||||||||||||||||||
| Macro Support | AP | TS_67_CNDMacroSupport | ? Alexander's decision | |||||||||||||||||||||
| Discovery Improvements | AP | TS_67_CNDDiscoveryImprovements | ? Alexander's decision | |||||||||||||||||||||
| Refactoring | AP | TS_67_CNDrefactoring | ? Alexander's decision | |||||||||||||||||||||
| Easy Remote Setup | AP | TS_67_CNDeasyremote | ? Alexander's decision | |||||||||||||||||||||
| Observability Tool | AP | TS_67_CNDobservability | ? Alexander's decision | |||||||||||||||||||||
| XML | MN | TS_70_XML | 8h | 192 stable | + | + | 2009-11-09_11-56-24 | 2009-10-28_14-01-34 | 2009-10-15_14-01-27 | + | ? Who owns this ? / Tests are my. | |||||||||||||
| Databases | ||||||||||||||||||||||||
| SQL editor | MH | SQL Editor | 5h | MH Oct/12 | MH Nov/20 | MH Aug/17 | MH Nov/2 | MH Nov/6 | MH Nov/13 | Acceptance test | ||||||||||||||
| JDBC connection | MH | Connection dialog | 2h | MH Oct/15 | MH Nov/20 | MH Aug/18 | MH Nov/5 | MH Nov/6 | MH Nov/16 | Acceptance test | ||||||||||||||
| MySQL, PostgreSQL integration | MH | Integration with MySQL and PostgreSQL | 5h | MH Oct/16 | MH Aug/19 | MH Nov/2 | MH Nov/12 | MH Nov/16 | Acceptance test | |||||||||||||||
| Database support | MH | DB Support | 3h | Acceptance test | ||||||||||||||||||||
| Web Languages | ||||||||||||||||||||||||
| JSP editor | JS | TS_60_JSPeditor | 12h | 60 | ||||||||||||||||||||
| CSS editor | JS | TS_60_CSSeditor | 2h | 3 | ||||||||||||||||||||
| HTML editor | JS | TS_60_HTMLeditor | 5h | 15 | ||||||||||||||||||||
| TLD editor | JS | TS_60_TLDeditor | 1h | 1 | ||||||||||||||||||||
| JavaScript editor | MZ | TS_61_JavaScript | 20 min | |||||||||||||||||||||
| bash, sh editors | TS_60_Shell, TS_60_Bat, TS_60_Manifest | 10 | ||||||||||||||||||||||
| Profiler | MD | ProfilerTestSpecification | MD Sep | MDSep/15 | MDSep/15 | MD Nov/13 | MD Sep/23 | |||||||||||||||||
| PHP | FZ | Sanity, List of TS | 1h for sanity | 16 | FZ OCT/18 | FZ NOV/12 | FZ NOV/6 | FZ NOV/10 | FZ OCT/9 | FZ OCT/18 | ||||||||||||||
| Groovy | GroovyGrailsTests(automated tests) | 21 | ||||||||||||||||||||||
| REST | TS_60_RESTSupport | 37 | ||||||||||||||||||||||
| Ajax | ||||||||||||||||||||||||
| JavaScript debugger | JS Debugger | 8h | x | x | x | x | x | x | x | x | Beta UC - not covered at ll | |||||||||||||
| HTTP Monitor | HTTP monitor | - | x | x | x | x | x | x | x | x | Beta UC - not covered at ll | |||||||||||||
| JS library | TS_65_ThirdPartyLibraryManager | - | x | x | x | x | x | x | x | x | Stable UC - not covered | |||||||||||||
| Other | ||||||||||||||||||||||||
| Performance | OK | TS_60_Performance | 291, 320 | x | x | x | x | x | x | x | Covered just by automated tests | |||||||||||||
| Fitness Forever UI Spec | OK | FitnessForeverUISpec | Acceptance test | |||||||||||||||||||||
| Java FX | ||||||||||||||||||||||||
| Sanity | AS | TS_68_JavaFX_Sanity | 4h | ACh Oct/19 | ACh Oct/17 | ACh Oct/15 | LH Oct/20 | AS Sep/24 | Full test | |||||||||||||||
| Project | AS | TS_68_JavaFX_Project | 1h | ACh Oct/19 | ACh Oct/15 | LH Oct/20 | AS Sep/24 | Full test | ||||||||||||||||
| Platforms | AS | TS_68_JavaFX_Platforms | 1h | ACh Oct/15 | LH Oct/20 | AS Sep/24 | Full test | |||||||||||||||||
| MobileEmulator | AS | TS_68_JavaFX_MobileEmulator | 1h | ACh Oct/15 | LH Oct/20 | AS Sep/24 | Full test | |||||||||||||||||
| Samples | AS | TS_68_JavaFX_Samples | 1h | ACh Oct/15 | LH Oct/20 | ACh Sep/17 | Full test | |||||||||||||||||
| Project | AS | TS_68_JavaFX_Debugger | 1h | ACh Oct/19 | ACh Oct/16 | Full test | ||||||||||||||||||
| GlassFish Plugin | DN | Test Plan/Specs | 28h | ? | ||||||||||||||||||||
| CDev | ||||||||||||||||||||||||
| Ground | JU | TS_67_CDevGround | 1h | JUOct/19 | JUOct/1 | JUNov/10 | PDNov/13 | JUOct/9 | JUSept/23 | Full test | ||||||||||||||
| Bugtracking | JU | TS_67_CDevBugtracking | ?h | JUOct/19 | JUOct/1 | JUNov/12 | PDNov/13 | JUOct/9 | JUSept/23 | Full test | ||||||||||||||
| Chat | JU | TS_67_CDevChat | ?h | JUOct/19 | JUOct/1 | JUNov/13 | PDNov/13 | JUOct/9 | JUSept/23 | Full test | ||||||||||||||
| Kenai Projects | PD | TS_67_CDevProjects | 2h | 32 | JUOct/19 | JUOct/1 | JUNov/13 | PDNov/13 | JUOct/19 | JUSept/23 | Full test | |||||||||||||
| Continuous Integration | PD | TS_67_CDevContinuousIntegration | 2h | JUOct/19 | JUOct/1 | JUNov/10 | JUOct/9 | JUSept/23 | Full test | |||||||||||||||
