!!!DRAFT DRAFT DRAFT DRAFT DRAFT DRAFT DRAFT DRAFT!!!

NetBeans IDE 6.0 Localization Test Plan (pt_BR, ja, zh)

1. Test Plan Identifier

1.1 Title

NetBeans IDE 6.0 Localization Test Plan

1.2 Revision History

2. Introduction

The NetBeans IDE is a free, open-source Integrated Development Environment for software developers. The IDE runs on many platforms including Windows, Linux, Solaris, and the MacOS. It is easy to install and use straight out of the box. The NetBeans IDE provides developers with all the tools they need to create professional cross-platform desktop, enterprise, web and mobile applications. http://www.netbeans.org/products/ide/

Supports for pt_BR (Brazilian Portuguese), ja (Japanese), and zh (Simplified Chinese) locales will be included in ML (Multi Lingual) installer. Other locale (language) supports will also be available.

Reference

• NetBeans IDE
  http://www.netbeans.org/
• NetBeans 6.0 Localization Plan
  http://wiki.netbeans.org/wiki/view/NB6L10nPlan
• NetBeans 6.0 Supported Platforms
  http://wiki.netbeans.org/wiki/view/NB6TestedPlatformsAndRuntimes
• NetBeans 6.0 Installable Components
  http://wiki.netbeans.org/wiki/view/NB6InstallableComponents
• Test Specifications for NetBeans 6.0
  http://wiki.netbeans.org/wiki/view/TestSpecifications60
• NetBeans 6.0 UML Module Test Specifications
  http://uml.netbeans.org/qa/test-specs-nb60.html
• NetBeans Installer
  http://nbi.netbeans.org/
• NetBeans 6.0 Update Centers
  http://wiki.netbeans.org/wiki/view/NB6UpdateCenters
• Documentation Plan for NetBeans 6.0 SOA Pack
  http://wiki.netbeans.org/wiki/view/SOADocPlan
• Ruby Test Specification for NetBeans 6.0
  http://wiki.netbeans.org/wiki/view/TS_60_Ruby]
• Tutorials
  
  • IDE/Profiler: http://wiki.netbeans.org/wiki/view/NB6CoreAndWebDocsTable
  • Mobility: http://wiki.netbeans.org/wiki/view/DraftTutorials
  • SOA: http://wiki.netbeans.org/wiki/view/SOATutsDocPlan
  • UML: http://wiki.netbeans.org/wiki/view/UMLDocPlan#section-UMLDocPlan-Tutorials
  • Ruby: http://wiki.netbeans.org/wiki/view/Ruby60DocPlan#section-Ruby60DocPlan-Tutorials
  • Web and JavaEE: http://wiki.netbeans.org/wiki/view/NB6CoreAndWebDocsTable
  • CND
  • NetBeans IDE 6.0 Beta Documentation: http://www.netbeans.org/kb/60/

3. Test items

3.1 NetBeans IDE 6.0

The followings are the product features that should be covered in the localization testing.

• IDE/Profiler
  • Apisupport
  • DB
  • Debugger
  • Editor
  • Java
  • Form
  • J2EE
  • Web Services
  • Platform
  • VCS
  • Other
    • Data Sources
    • Enterprise Resources
    • Internationalization
    • Properties
    • Task List
    • Utilities
    • UI Gestures
    • Utilities
    • JUnit
    • Sh Scripts
    • Diff files
    • Manifest files
    • Bat files
    • Eclipse Project Importer
    • Editable Diff
• Mobility
  • Device Fragmentation
  • End to End - JSR172, Mobile2Web, Samples
  • Debugging in Java ME world
  • Mobility Project Properties
  • Create New - project, file, etc.
  • JMUnit Support
  • Screen Designer
  • Flow Designer
  • Properties in Visual Designer
  • Game Designer
  • SVG Components
• SOA
  • Design Time
    • BPEL Designer
    • XSLT Editor
    • CASA Editor
    • Cross-Project XML References
  • Runtime
    • JBI Components provided with Application Server
• UML
  • Customizable Code Generation
  • Domain Modeling Code Generation
  • Source Code Synchronization
  • UML options dialog
• Ruby
  • Project support
  • Editing Support
  • Ruby on Rails
• Web and Java EE
  • Web Service Consumption
  • EJB Consumption
  • Query Editor
  • CachedRowSet DataProvider
  • JSF Palette
  • JSF Support
• CND
  • C/C++ project support
  • C/C++ project templates
  • makefile wizard
  • class viewer
  • editor,
  • C/C++ language model editor features
  • Debugging
• Installer
  • Java IDE
  • Web and Java EE
  • Mobility
  • C/C++
  • UML
  • SOA
  • Ruby
  • Sun Java System Application Server
  • Apache Tomcat
• Update Center
  • NetBeans (All plugins that are either part of the full NetBeans distro or additional features.)
  • NetBeans Beta (Beta quality plugins certified by NetBeans)
  • 3rd Party Features (Free versions of commercial plugins certified by NetBeans)
  • Plugin Portal (All plugins available on Plugin Portal)
• Bundles
  • Bundle with Java SE
  • Bundle with Application Server/GlassFish
  • Bundle with others

3.2 Platform

• Solaris 10 SPARC/x86/x64
• Solaris Nevada SPARC/x86/x64
• Ubuntu 7.x x86
• Red Hat Enterprise Linux 4 x86
• Windows XP Professional SP2 x86
• Windows Vista Business x86
• Mac OS 10.4.x PPC
• Mac OS 10.4.x Intel

3.3 Locale

• pt_BR (Brazilian Portuguese)
• ja (Japanese)
• zh (Simplified Chinese)

This test plan is intended for these locales. Other locales would have different requirements, so they are out of scope of this documents.

3.4 Application Server

• AS 9.1 PE (GlassFish v2)
• Tomcat 6.0

3.5 Database

• JavaDB 10

3.6 Web Browser

• Firefox 2.0
• IE 6.0
• IE 7.0
• Safari

3.7 VCS

• CVS 1.12
• Subversion 1.4

4. Features to be tested

• Localized User Interface (label and message)
• Localized OnlineHelp
• all IDE features (through with base test cases)

5. Features not to tested

• Performance
• Accessibility
• 3rd party Application

6. Approach

6.1 Test Management

Test status will be tracked through NetBeans IDE 6.0 localization Test Status

6.2 Test Types

The followings are possible testings for NetBeans IDE 6.0. Different product/components might have different test requirement.

6.2.1 Install Test

To ascertain localized product can be installed (customized-installed) and uninstalled on supported platforms and locales.

6.2.2 Base Test Cases Test

Execute test cases in Test Specifications for NetBeans 6.0, NetBeans 6.0 UML Module Test Specifications. Review as much message as possible in live environment. A set of test cases with priority order must be defined per component. When applicable, locale specific characters should be tried. Approximate test case numbers are available at NB6L10nTestPlanBTCL.

6.2.3 Tutorial Based Test

Run through tutorials. To confirm that features are working fine in target locale and on target platform with target software. A set of test cases with priority order must be defined per component. When applicable, locale specific characters should be tried.

6.2.4 Regression Test

To ascertain localized products function well, and no new problems are introduced after software modification, e.g bug fixing etc.

6.2.5 Sanity Test

A basic test to quickly check the most crucial functionalities of the localized product work on supported platforms and locales.

Install, start IDE, create, build and run small application, open the help and randomly selects some chapters, uninstall netbeans.

6.2.6 Download Test

To ascertain the localized bits can be successfully downloaded via supported browsers on supported platforms and locales. The downloaded bits are desired ones. The download pages are properly localized and displayed.

6.2.7 Media Test

Burn DVD with the image file to test the products are desired ones; and they can be installed on supported platforms and locales.

6.3 QA Phase

The testing will be divided into three phases (or more if necessary). Each test phase has predefined start date and end date.

QA Phase 1:

When the QA Phase 1 starts, translation is not complete. Partial translation is available (80% or so).

• sanity test for all supported platforms/locales
• base test cases
  • do as much test cases as possible
  • results should be recorded regularly
  • when test period expires, all status must be recorded
  • execute on a convenient platform(s) per locale

QA Phase 2:

When the QA Phase 2, translation is almost complete. This test phase should be completed by RC1.

• install test
• tutorials based test
  • do as much test cases as possible
  • results should be recorded regularly
  • when test period expires, all status must be recorded
  • one test case will be execute on a few selected platform/locale combinations
  • the combinations will be defined in 6.4 Test Matrix

QA Phase Final:

This test phase must be completed by FCS GO/NoGO.

• sanity test
• execute on all platform/locale

ad-hoc test:

• download test -- when available, download test will be done.
• media test (if applicable)
• regression test -- when bugs are fixed, regression test shall be done.

6.4 Test Matrix

6.4.1 QA Phase 1 (Base Test Cases)

6.4.2 QA Phase 2 - Download Test and Install Test

6.4.3 QA Phase 2 - Tutorial Based Test

6.4.4 QA Phase Final

• Fail
• Pass
• Cannot Test

6.5 Bug Management

Any bugs (localization, internationalization, and base) should be managed by issuezilla.

New L10N bugs should be filed to translatedfiles component, with CC to jf4jbugs (@netbeans.org).

New I18N bugs should be filed to appropriate components, with Summary started with "I18N - ", Keywords I18N, CC to jf4jbugs (@netbeans.org).

Reference:

• http://translatedfiles.netbeans.org/docs/qa/reportbug.html
• http://www.netbeans.org/community/issues.html

7. Quality Criteria

7.1 Entrance Criteria for FCS(RC) build testing

• All translatable components have been translated and reviewed.
• All l10n packages build environment has been created and tested.
• All l10n packages can be build.

7.2 Pass Criteria for FCS(RC) build testing

• All P1/P2 bugs have been fixed. Waived P2 bugs has been discussed and approved.
• All P3 bugs have been evaluated.
• All docs packages have been made and includes final translated pdf books.

8. Test Deliverables

• Localization test plan (this document)
• Lists of selected base test cases for each components
• Lists of selected tutorials for each components
• Bug Reports
• Testing closure report

9. Testing tasks

• platform installation
• determine a set of base test cases with priority order
• determine a set of tutorials with priority order
• performing each test cases

10. Environmental Needs

10.1 Hardware

• SPARC machines
• x86/x64 PC machines
• PPC/Intel Mac machines

10.2 Operating System

• Solaris 10 SPARC
• Solaris 10 x86/x64
• Solaris Nevada SPARC
• Solaris Nevada x86/x64
• Ubuntu 7.x x86
• Windows XP Professional SP2 x86
• Windows Vista Business x86
• Mac OS 10.4.x PPC
• Mac OS 10.4.x Intel

10.3 Software

Java SE

• Java SE 6.0 Update 1 (or higher)
• Java SE 5.0 Update 11 (or higher)

Application Server

• AS 9.1 PE (GlassFish v2)
• Tomcat 6.0

Database

• JavaDB 10

Web Browser

• Firefox 2.0 (Solaris, Ubuntu, Windows XP)
• IE 6.0 (Windows XP)
• IE 7.0 (Windows Vista)
• Safari (Mac OS X)

11. Staffing and training needs

Plan

12. Schedule

Reference:

• http://wiki.netbeans.org/wiki/view/NB6Schedule

13. Risks and contingencies

• l10nkit availability

• Translation schecule
• people resource