NB68TestingProgress
NetBeans 6.8 Testing Progress
- See Tested Platforms & Runtimes in NetBeans 6.8 for details around Operating Systems and tested JDKs.
- See Detailed plan for other tasks we'll do in NetBeans 6.8 time-frame related to this release as well as other types of testing.
- Full test - for Primary Features and Quality Modules- run all Test Specifications on all platforms and default JDK(on specific platform) once a release, if time permits cover by "second supported JDK" / "JDK7"
- Acceptance test - for some Modules in Maintenance Mode - run all Test Specifications just on one platform and default JDK(on specific platform) once a release
- Sanity test - for some Modules in Maintenance Mode - run NB68SanityTestSpecifications or subset of all Test Specifications on one or more platforms and default JDK(on specific platform) once release
Feature | Owner | Tests Specifications | Time to execute TSs | Automated Tests | Solaris | Mac OS | Ubuntu | Win XP | Win Vista | Win 7 | JDK7 | Notes | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Core | ||||||||||||||||||||||||
Apisupport | TS_61_ProjectOperations, TS_60_ProjectsWizard, TS_65_Appisupport_Sanity | 5h | x | x | x | x | x | x | x | x | Not covered by NetBeans QE | |||||||||||||
Ant | TS_61_Ant | 3h | x | Sanity test - all platforms | ||||||||||||||||||||
Maven | JPo | Maven in J2SE, Maven web projects, TS_68_MavenEE6Sanity | 3h(one platform) | x | DONE | DONE | Sanity | Sanity +I18N/A11Y | DONE | DONE | Full test | |||||||||||||
Embed. Browser | JPo | 8h (1h per OS/JDK version) | x | Full test | ||||||||||||||||||||
Window System | TS_65_WindowSystem, TS_61_MainWindow, TS_61_StartPage , TS_65_Palette | 9h | Sanity test - all platforms | |||||||||||||||||||||
UI | TS_60_Wizards, TS_60_Favorites | x | Sanity test - one platform | |||||||||||||||||||||
Quick Search | TS_65_QuickSearch | x | Sanity test - one platform | |||||||||||||||||||||
Projects | PD | TS_61_ProjectsActions, TS_61_ProjectsProperties, TS_61_ProjectsLibraries | 9h | x | PD Oct/09 | PD Oct/09 | U9.04, PD Oct/09 U9.10, PD Dec/09, Sanity | PD Oct/09 | PD Oct/09 | PD Oct/09 | Full test | |||||||||||||
Projects freeform | PD | TS_61_ProjectsWizardsAndFreeform | 1h | x | PD Oct/09 | PD Oct/09 | U9.04, PD Oct/09 | PD Nov/02 | PD Oct/09 | PD Oct/09 | Full test | |||||||||||||
Projects javawebstart | PD | TS_65_J2SEWebstart | 7h ??TM | x | PD Oct/09 | PD Oct/09 | U9.04, PD Oct/09 U9.10, PD Dec/09, Sanity | PD Oct/09 | PD Oct/09 | PD Oct/09 | Sanity test - one platform | |||||||||||||
Property Sheet, Property Editors | TS_60_PropertySheet, TS_60_PropertyEditors | x | Acceptance test | |||||||||||||||||||||
Options | TS_65_OptionsDialog | 20m | Sanity test - all platforms | |||||||||||||||||||||
Output | TS_61_OutputWindow | 30m | Sanity test - all platforms | |||||||||||||||||||||
Explorer | TS_61_FilesAndProjectsView | 1.5h | Sanity test - one platform | |||||||||||||||||||||
Tasklist | TS_65_Tasklist | 0.5 | Sanity test - all platforms | |||||||||||||||||||||
CLI | TS_65_CLI | 0.5 | Sanity test - all platforms | |||||||||||||||||||||
Other | TS_60_Clusters, TS_60_Loaders | x | x | x | x | x | x | x | x | Not covered by NetBeans QE | ||||||||||||||
Users Registration | TS_61_UserRegistration | 0.5 | x | x | x | x | x | check version | ||||||||||||||||
Plugin Portal | TS_61_PluginPortal | x | x | x | x | x | x | x | x | Separate test round | ||||||||||||||
Patches | TS_65_PatchesTesting | x | x | x | x | x | x | x | x | Separate test round | ||||||||||||||
Satisfaction Survey | TS_61_SatisfactionSurvey | 0.5 | x | x | x | x | x | x | x | x | Not planned for 6.8 | |||||||||||||
Collaboration | TS_61_Collaboration | - | x | x | x | x | x | x | x | x | Not planned for 6.8 | |||||||||||||
Editor Technologies | ||||||||||||||||||||||||
Editor editor,utilities,options | JPr | TS_68_Editor Sanity | 10h | 58 | JPr Oct/9 (jdk6_16) | JPr Nov/5 (jdk6_16) | JPr Nov/11 (jdk6_16) | JPr Nov/16 (jdk6_16) | JPr Oct/15 (jdk6_16) | PP Sep/23 (jdk6_16) | Full test | |||||||||||||
Java - java module | JPr | TS_70_Java Sanity | 7h | 391 | JPr Oct/9 (jdk6_16) | PP Oct/16 (jdk6_15) | PP Nov/10 (jdk6_16) | PP Oct/29 (jdk6_16) | PP Oct/15 (jdk6_16) | PP Sep/23 (jdk6_16) | Full test | |||||||||||||
Java - compile on save | JPr | TS_65_CompileOnSave | 1h | PP Oct/09 (jdk6_16) | PP Oct/16 (jdk6_15) | PP Nov/10 (jdk6_16) | PP Oct/29 (jdk6_16) | PP Oct/15 (jdk6_16) | PP Sep/23 (jdk6_16) | Full test | ||||||||||||||
Java - formatting | JPr | TS_65_Formatting | 2h | PP Oct/09 (jdk6_16) | PP Oct/16 (jdk6_15) | PP Nov/10 (jdk6_16) | PP Oct/29 (jdk6_16) | PP Oct/15 (jdk6_16) | PP Sep/23 (jdk6_16) | PP Oct/16 (jdk6_15) | Full test | |||||||||||||
Java - java hints | JPr | TS_70_Hints | 1h | PP Oct/09 (jdk6_16) | PP Oct/16 (jdk6_15) | PP Nov/10 (jdk6_16) | PP Oct/29 (jdk6_16) | PP Oct/15 (jdk6_16) | PP Sep/23 (jdk6_16) | Full test | ||||||||||||||
Refactoring | JPr | TS_60_Refactoring (most used), TS_60_Refactoring2, TS_60_Refactoring3, TS_65_CallHierarchy, Sanity | 12 | PP Oct/09 (jdk6_16) | JPr Nov/04 (jdk6_16) | JPr Nov/11 (jdk6_16) | PP Nov/13 (jdk6_16) | JPr Oct/14 (jdk6_16) | PP Sep/23 (jdk6_16) | Full test | ||||||||||||||
Beans | JPr | TS_67_Beans | 2h | 0 | JPr Oct/12 (jdk6_16) | PP Oct/16 (jdk6_15) | PP Nov/10 (jdk6_16) | PP Oct/29 (jdk6_16) | JPr Oct/13 (jdk6_16) | JPr Sep/25(jdk6_16) | Sanity test - one platform | |||||||||||||
Javadoc | JPr | TS_70_JavaDoc | 2h | 0 | JPr Oct/12 (jdk6_16) | PP Oct/16 (jdk6_15) | PP Nov/10 (jdk6_16) | PP Oct/29 (jdk6_16) | JPr Oct/13 (jdk6_16) | JPr Sep/25 (jdk6_16) | Sanity test - one platform | |||||||||||||
Life Cycle Tools | ||||||||||||||||||||||||
Debugger jpda,ant | VS | TS_68_Debugger_Sanity(Sanity), TS_67_JPDAdbg, Interface , Functionality, Debugging Views, Breakpoints, Miscellanous, TS_67_ANTdbg, TS_67_MultiThreadedDebugging | 16h(4h) | 16 (job) | VS Oct/15 (jdk 1.6u16) | VS Nov/11 (jdk 1.5u19) | VS Nov/13 (jdk 1.6u16) | VS Nov/10 (jdk 1.6u16) | VS Oct/19 (jdk 1.6u16) | VS Sep/29 (jdk 1.6u16) | Full test | |||||||||||||
Form | PPr | TS_65_Form, TS_68_FormAndSupportSanity (Sanity) | 24h | 16 (job) | PP Oct/09 | PP Sep/23 | Full test one platform, Sanity - all other platforms | |||||||||||||||||
Subversion | DK | TS_61_SVN | 5h | TM 13/NOV | PP Nov/13 | PP Nov/20 | Full test | |||||||||||||||||
Mercurial | DK | TS_61_HG | 7h | TM 20/NOV | PP Nov/11 (Sanity) | PP Nov/05 | Full test | |||||||||||||||||
Local History | DK | TS_61_LocalHistory | 15min | PP Nov/05 | Acceptance test | |||||||||||||||||||
Editable Diff | DK | TS_61_Diff | 30min | PP Nov/11 | PP Nov/05 | Acceptance test | ||||||||||||||||||
CVS | NB68CVSTesting | TS_61_CVS | 4h | - | TM 16/NOV | x | Full test | |||||||||||||||||
ClearCase | TS_61_CC | 5h | - | x | x | x | x | x | x | x | planned for Update Center (one platform) | |||||||||||||
Mobility | ||||||||||||||||||||||||
Device Fragmentation | ACh | TS_61_MobilityFragmentation | 2 | - | x | x | ACh Oct/2 | x | x | x | Full test | |||||||||||||
End to End | ACh | TS_61_MobilityEndToEnd | 1 | - | x | x | ACh Nov/3 | x | x | x | Full test | |||||||||||||
Debugging in Java ME world | ACh | TS_60_MobilityDebugging | 0.5 | - | x | x | ACh Oct/2 | x | x | x | Full test | |||||||||||||
Mobility Project Properties | ACh | TS_61_MobilityProjectProperties | 1 | - | x | x | ACh Oct/21 | x | x | x | Full test | |||||||||||||
Create New - project, file, etc. | ACh | TS_60_MobilityCreateNew | 1 | - | x | x | ACh Oct/21 | x | x | x | Full test | |||||||||||||
JMUnit Support | ACh | TS_61_MobilityJMUnit | 0.5 | - | x | x | ACh Nov/5 | x | x | x | Full test | |||||||||||||
Screen Designer | ACh | TS_60_MobilityScreenDesigner | 1.5 | - | x | x | ACh Oct/20 | x | x | x | Full test | |||||||||||||
Flow Designer | ACh | TS_61_MobilityFlowDesigner | 2 | - | x | x | ACh Oct/1 | x | x | x | Full test | |||||||||||||
Properties in Visual Designer | ACh | TS_60_MobilityVisualProperties | 1.5 | - | x | x | ACh Nov/5 | x | x | x | Full test | |||||||||||||
Game Designer | ACh | TS_61_MobilityGameDesigner | 1.5 | - | x | x | ACh Nov/9 | x | x | x | Full test | |||||||||||||
SVG Components | ACh | TS_60_MobilitySVGComponents | 1 | - | x | x | ACh Nov/16 | x | x | x | Full test | |||||||||||||
Mobility CDC | ACh | TS_65_MobilityCDC | 0.25 | - | x | x | ACh Nov/5 | x | x | x | Full test | |||||||||||||
Other | ACh | TS_61_MobilityOther | 0.25 | - | x | x | ACh Nov/5 | x | x | x | Full test | |||||||||||||
Support Modules | ||||||||||||||||||||||||
Help System | TS_65_JavaHelp | 1.5h, 30m | PP Oct/07 | PP Oct/06 | Acceptance test | |||||||||||||||||||
Utilities | TS_60_Utilities | 45min | PP Oct/07 | PP Oct/06 | Acceptance test | |||||||||||||||||||
Properties | TS_61_Properties | 3h | PP Oct/07 | PP Oct/06 | Acceptance test | |||||||||||||||||||
jUnit | TS_60_JUnit TS_68_JUnit (NEW) | 2h | PP Sep/30 | PP Sep/29 | Acceptance test | |||||||||||||||||||
Internationalization | TS_61_Internationalization | 2,5h | PP Aug/06 | Acceptance test | ||||||||||||||||||||
Java Web and EE | ||||||||||||||||||||||||
EAR project | MS | TS_60_EARProject | MS Oct/29 | x | MS Oct/15 | x | Full test | |||||||||||||||||
Web project | JS | TS_61_WebProject | 4h | 8 | Full test | |||||||||||||||||||
EJB project (new, existing sources) | MS | TS_60_EJB_withEx_sources | 4h | MS Oct/29 | MS Oct/12 | x | Full test | |||||||||||||||||
App. client project | Application Client | 8h | MS Oct/29 | MS Oct/5 | MS Oct/15 | Sanity test - all platforms | ||||||||||||||||||
J2EE samples | MS | TS_60_WebSamples] | 4h | MS Oct/29 | MS Oct/5 | MS Oct/12 | x | Full test | ||||||||||||||||
J2EE debugging | MS | TS_60_WebEnterpriseDebug | 8h | MS Oct/27 | Full test | |||||||||||||||||||
EJB 2.1 support | MS | TS_61_EJB_Support | MS Oct/27 | MS Oct/6 | MS Oct/12 | Full test | ||||||||||||||||||
EJB 3.0 support | MS | EJB 3.0 | 30 min | MS Oct/27 | MS Oct/6 | MS Oct/12 | Full test | |||||||||||||||||
EJB 3.1 support | MS | TS_68_EJB31_Validation | 4h | MS Oct/27 | MS Aug/10 | x | Full test | |||||||||||||||||
J2EE actions | MS | j2ee actions | 6h | MS Oct/26 | MS Aug/10 | MS Oct/12 | Full test | |||||||||||||||||
Persistence | MS | TS_61_PersistenceUnit, TS_68_JavaEE6Persistence_Validation | MS Oct/26 | MS Aug/11 | MS Oct/11 | Full test | ||||||||||||||||||
EJB config visual editor | TS_61_EjbJar_xml_editor | 2h | x | Acceptance test | ||||||||||||||||||||
JSF from Entity classes | MM | TS_61_JSFPages_from_Entity_Classes | 1h | MM Oct/16 | MM Oct/16 | MM Oct/16 | MM Oct/16 | MM Oct/16 | MM Oct/16 | Full test | ||||||||||||||
Entity classes from database | MS | TS_65_Entity_Classes_From_Database | MS Oct/26 | MS Aug/25 | MS Oct/10 | Full test | ||||||||||||||||||
Tomcat integration | Tomcat | Sanity test - all platforms | ||||||||||||||||||||||
JBoss integration | TS_61_JBoss | 3h | Sanity test - all platforms | |||||||||||||||||||||
WebSphere integration | TS_61_WebSphere | 3h | Sanity test - all platforms | |||||||||||||||||||||
WebLogic integration | TS_61_WebLogic | 3h | Sanity test - all platforms | |||||||||||||||||||||
JSF support | MM | JSF Support, JSF Palette | 6h | MM Oct/16 | MM Oct/16 | MM Oct/16 | MM Oct/16 | MM Oct/16 | MM Oct/16 | Full test | ||||||||||||||
Struts project | Struts User Scenario | 6h | Sanity test - all platforms | |||||||||||||||||||||
Spring | TS_61_SpringSupport | Sanity test - all platforms | ||||||||||||||||||||||
Hibernate | TS_65_HibernateSupport | Sanity test - all platforms | ||||||||||||||||||||||
GlassFish support | - | TS_61_GlassFish | 3h | - | x | x | x | x | x | x | x | Tested by GF team | ||||||||||||
Ruby | ||||||||||||||||||||||||
Project | TM | TS_61_Ruby | 5 | Stable | TM 15/OCT (jdk6_12) | TM 27/OCT (jdk6_15) | TM 6/NOV (jdk6_14) | TM 16/OCT (jdk6_11) | x | Full test | ||||||||||||||
Debugger | TM | TS_61_RubyDebugger | 3 | TM 15/OCT (jdk6_12) | TM 27/OCT (jdk6_15) | TM 16/OCT (jdk6_11) | x | Full test | ||||||||||||||||
Web Services | ||||||||||||||||||||||||
WS support in projects | MM | Automated tests | 6h | x | sanity | x | DONE | sanity | DONE | x | x | Full test - one platform, Sanity test - other platforms | ||||||||||||
Partner Services | - | TS_61_SaaSServices | 16h | x | x | x | DONE | sanity | DONE | x | x | Not planned for NB 6.8 | ||||||||||||
WS visual designer | - | TS_60_WSDesigner | 1h | x | x | x | DONE | sanity | DONE | x | x | Not planned for NB 6.8 | ||||||||||||
WS editor support | - | TS_61_WebServicesEditorSupport | 2h | x | sanity | x | DONE | sanity | DONE | x | x | Not planned for NB 6.8 | ||||||||||||
JAX-RPC client | - | JAX-RPC | 3h | x | x | x | x | x | x | x | x | Not planned for NB 6.8 | ||||||||||||
JAX-WS client | MM | JAX-WS | 4h | 17 | sanity | MM Oct/16 | DONE | sanity | DONE | x | x | Full test | ||||||||||||
Identity | - | IdentityTestSpecification | 8h | 7 | x | x | x | x | x | x | x | Not planned for NB 6.8 | ||||||||||||
Installer | ||||||||||||||||||||||||
Installer(sanity) | MN | MilestoneSpec | 24 | 2009-11-07_14-23-54 | 2009-10-28_14-01-34 | 2009-11-07_14-23-54 | 2009-10-28_14-01-34 | 2009-11-07_14-23-54 | 2009-10-31_02-01-34 | Full test - NetBeans68InstallerTesting | ||||||||||||||
Plugin Manager | MN | TS_70_PluginManager | 6 | 2009-10-28_14-01-34 | 2009-11-07_14-23-54 | 2009-10-28_14-01-34 | 2009-10-28_14-01-34 | 2009-10-15_14-01-27 | 2009-10-31_02-01-34 | Full test | ||||||||||||||
CND | ||||||||||||||||||||||||
Qt Support | AP | TS_67_CNDQtSupport | ? Alexander's decision | |||||||||||||||||||||
Macro Support | AP | TS_67_CNDMacroSupport | ? Alexander's decision | |||||||||||||||||||||
Discovery Improvements | AP | TS_67_CNDDiscoveryImprovements | ? Alexander's decision | |||||||||||||||||||||
Refactoring | AP | TS_67_CNDrefactoring | ? Alexander's decision | |||||||||||||||||||||
Easy Remote Setup | AP | TS_67_CNDeasyremote | ? Alexander's decision | |||||||||||||||||||||
Observability Tool | AP | TS_67_CNDobservability | ? Alexander's decision | |||||||||||||||||||||
XML | MN | TS_70_XML | 8h | 192 stable | + | + | 2009-11-09_11-56-24 | 2009-10-28_14-01-34 | 2009-10-15_14-01-27 | + | ? Who owns this ? / Tests are my. | |||||||||||||
Databases | ||||||||||||||||||||||||
SQL editor | MH | SQL Editor | 5h | MH Oct/12 | MH Nov/20 | MH Aug/17 | MH Nov/2 | MH Nov/6 | MH Nov/13 | Acceptance test | ||||||||||||||
JDBC connection | MH | Connection dialog | 2h | MH Oct/15 | MH Nov/20 | MH Aug/18 | MH Nov/5 | MH Nov/6 | MH Nov/16 | Acceptance test | ||||||||||||||
MySQL, PostgreSQL integration | MH | Integration with MySQL and PostgreSQL | 5h | MH Oct/16 | MH Nov/23 | MH Aug/19 | MH Nov/2 | MH Nov/12 | MH Nov/16 | Acceptance test | ||||||||||||||
Database support | MH | DB Support | 3h | Acceptance test | ||||||||||||||||||||
Web Languages | ||||||||||||||||||||||||
JSP editor | JS | TS_60_JSPeditor | 12h | 60 | ||||||||||||||||||||
CSS editor | JS | TS_60_CSSeditor | 2h | 3 | ||||||||||||||||||||
HTML editor | JS | TS_60_HTMLeditor | 5h | 15 | ||||||||||||||||||||
TLD editor | JS | TS_60_TLDeditor | 1h | 1 | ||||||||||||||||||||
JavaScript editor | MZ | TS_61_JavaScript | 20 min | |||||||||||||||||||||
bash, sh editors | TS_60_Shell, TS_60_Bat, TS_60_Manifest | 10 | ||||||||||||||||||||||
Profiler | MD | ProfilerTestSpecification | MD Sep | MDSep/15 | MDSep/15 | MD Nov/13 | MD Sep/23 | |||||||||||||||||
PHP | FZ | Sanity, List of TS | 1h for sanity | 16 | FZ OCT/18 | FZ NOV/12 | FZ NOV/6 | FZ NOV/10 | FZ OCT/9 | FZ OCT/18 | ||||||||||||||
Groovy | GroovyGrailsTests(automated tests) | 21 | ||||||||||||||||||||||
REST | TS_60_RESTSupport | 37 | ||||||||||||||||||||||
Ajax | ||||||||||||||||||||||||
JavaScript debugger | JS Debugger | 8h | x | x | x | x | x | x | x | x | Beta UC - not covered at ll | |||||||||||||
HTTP Monitor | HTTP monitor | - | x | x | x | x | x | x | x | x | Beta UC - not covered at ll | |||||||||||||
JS library | TS_65_ThirdPartyLibraryManager | - | x | x | x | x | x | x | x | x | Stable UC - not covered | |||||||||||||
Other | ||||||||||||||||||||||||
Performance | OK | TS_60_Performance | 291, 320 | x | x | x | x | x | x | x | Covered just by automated tests | |||||||||||||
Fitness Forever UI Spec | OK | FitnessForeverUISpec | Acceptance test | |||||||||||||||||||||
Java FX | ||||||||||||||||||||||||
Sanity | AS | TS_68_JavaFX_Sanity | 4h | ACh Oct/19 | ACh Oct/17 | ACh Oct/15 | LH Oct/20 | AS Sep/24 | Full test | |||||||||||||||
Project | AS | TS_68_JavaFX_Project | 1h | ACh Oct/19 | ACh Oct/15 | LH Oct/20 | AS Sep/24 | Full test | ||||||||||||||||
Platforms | AS | TS_68_JavaFX_Platforms | 1h | ACh Oct/15 | LH Oct/20 | AS Sep/24 | Full test | |||||||||||||||||
MobileEmulator | AS | TS_68_JavaFX_MobileEmulator | 1h | ACh Oct/15 | LH Oct/20 | AS Sep/24 | Full test | |||||||||||||||||
Samples | AS | TS_68_JavaFX_Samples | 1h | ACh Oct/15 | LH Oct/20 | ACh Sep/17 | Full test | |||||||||||||||||
Project | AS | TS_68_JavaFX_Debugger | 1h | ACh Oct/19 | ACh Oct/16 | Full test | ||||||||||||||||||
GlassFish Plugin | DN | Test Plan/Specs | 28h | ? | ||||||||||||||||||||
CDev | ||||||||||||||||||||||||
Ground | JU | TS_67_CDevGround | 1h | JUOct/19 | JUOct/1 | JUNov/10 | PDNov/13 | JUOct/9 | JUSept/23 | Full test | ||||||||||||||
Bugtracking | JU | TS_67_CDevBugtracking | ?h | JUOct/19 | JUOct/1 | JUNov/12 | PDNov/13 | JUOct/9 | JUSept/23 | Full test | ||||||||||||||
Chat | JU | TS_67_CDevChat | ?h | JUOct/19 | JUOct/1 | JUNov/13 | PDNov/13 | JUOct/9 | JUSept/23 | Full test | ||||||||||||||
Kenai Projects | PD | TS_67_CDevProjects | 2h | 32 | JUOct/19 | JUOct/1 | JUNov/13 | PDNov/13 | JUOct/19 | JUSept/23 | Full test | |||||||||||||
Continuous Integration | PD | TS_67_CDevContinuousIntegration | 2h | JUOct/19 | JUOct/1 | JUNov/10 | JUOct/9 | JUSept/23 | Full test |