NetBeans IDE 6.5 Localization Test Plan (pt_BR, zh_CN, ja_JP)

1. Test Plan Identifier

1.1 Title

NetBeans IDE 6.5 Localization Test Plan

1.2 Revision History

2. Introduction

NetBeans 6.5 is an update release.

Supports for pt_BR (Brazilian Portuguese), zh_CN (Simplified Chinese), and ja_JP (Japanese) locales will be included in ML (Multi Lingual) installer. Other locale (language) supports will also be available.

Reference

• NetBeans IDE
  http://www.netbeans.org/
• NetBeans 6.5 Planning
  http://wiki.netbeans.org/NetBeans65
• NetBeans 6.5 Milestones Calendar
  http://wiki.netbeans.org/NB65Milestones
• NB 6.5 Quality Criteria
  http://wiki.netbeans.org/NB65QualityCriteria
• NetBeans 6.5 Development Plan
  http://wiki.netbeans.org/NB65EngineeringPlan
• NetBeans Distributions http://wiki.netbeans.org/NB65EngineeringPlan#section-NB65EngineeringPlan-NetBeansDistributions
• Preliminary Feature Planing Documents
  http://wiki.netbeans.org/NB65ProjectPages
• NetBeans 6.5 Supported Platforms
  http://wiki.netbeans.org/NB65TestedPlatformAndRuntimes
• Test Specifications for NetBeans 6.5
  http://wiki.netbeans.org/TestSpecifications65
• NetBeans 6.5 UML Module Test Specifications http://uml.netbeans.org/qa/test-specs-nb65.html
• NetBeans 6.5 Localization Project Plan
  http://wiki.netbeans.org/NB65L10nProjPlan
• NetBeans 6.5 Localization Link Summary
  http://wiki.netbeans.org/NB65Localization
• NetBeans 6.5 Localization Scope
  http://wiki.netbeans.org/NB65L10nScope
• Translated Files Project home
  http://translatedfiles.netbeans.org
• Translated Files wiki home
  http://wiki.netbeans.org/wiki/view/TranslatedFiles
• NetBeans 6.5 Localization Schedule
  http://wiki.netbeans.org/NB65L10nSchedule
• Team Roles and Communications
  http://wiki.netbeans.org/NbL10nCommunications

• Tutorials
  
  • NetBeans IDE Documentation
    http://www.netbeans.org/kb/
  • PHP Learning Trail
    http://www.netbeans.org/kb/trails/php.html

3. Test items

3.1 NetBeans IDE 6.5

The followings are the product features that should be covered in the localization testing.

• IDE
  • Java SE
  • Web & Java EE
  • Mobility
  • Ruby
  • C/C++
  • PHP
  • SOA
  • Groovy, Support for Groovy/Grails

• Installer

• Update Center
  • UML
  • Stable Update Center
  • Buleprints (if ready)

• Bundles
  • JDK6 Update 7 with NetBeans IDE Java SE bundle
  • Java EE 5 Tools Bundle
  • MySQL GlassFish Bundle

3.2 Platform and Runtimes

Reference: NetBeans 6.5 Supported Platforms

3.2.1 Java SE

• 6.0
• 5.0

Following Java SE will not be covered in the localization testing.

• 7.0
• JDK 6U10
• Open JDK

3.2.2 Operating Systems

• OpenSolaris 2008.05
• Solaris 10 SPARC
• Ubuntu 8.04
• Red Hat Enterprise Linux 5
• Windows XP Professional SP3
• Windows Vista Business
• Mac OS X 10.5 Intel

3.2.3 Default L&F on each OS are:

• Vista - Aero
• Linux, Solaris - GTK (set in JDK and IDE). GTK requires at least Java SE 6.0 Upd 1
• Mac - Aqua

3.2.4 Servers and tested Java EE versions for particular servers

• Glassfish v2(J2EE 1.4 + Java EE 5)
• Glassfish v3

Following application servers will not be covered in the localization testing.

• AS 8.2 PE (J2EE 1.4 + persistence in ejb, web projects, JAX-WS)
• JBoss 4.2
• JBoss 5 Beta
• Tomcat 5.5, JBoss 5.0 (J2EE 1.4)
• Tomcat 6.0 (Java EE5 + persistence in web, JAX-WS)
• WebLogic 10 (J2EE 1.4, JavaEE5)
• WebSphere 6.1

3.2.5 Databases

• JavaDB(supplied with IDE)
• MySQL 6.x

Following databases will not be covered in the localization testing.

• Postgres SQL 8.x
• MS SQL Server 2005
• Oracle 9
• Oracle 10

3.2.6 VCS

• Mercurial 1.0
• Subversion 1.4.6
• CVS 1.12

Following VCS programs will not be covered in the localization testing.

• CVS 1.11
• Rational ClearCase V7.0

3.2.7 Emulator Platforms of Mobility Pack

Supported SDKs:

• Sun Java Wireless Toolkit 2.5.2 for CLDC - Windows and Linux version - BUNDLED
• Sun Java Toolkit 1.0 for CDC
• Java ME SDK 3.0 (CLDC/CDC)

Following emulators will not be covered in the localization testing.

• Sony Ericsson UIQ 3.0 + M600 Extension Package / P990 Extension Package
• RICOH SDK 1.14
• NSICOM CreMe VM
• Nokia Series 80 Platform SDK's for Symbian OS for Personal Profile
• ??? Acadia (Java FX Mobile)
• ??? Support for phoneME (CLDC) and phoneME Advanced (CDC) - nice to have

3.2.8 Other 3rd party SW

Following software will not be covered in the localization testing.

• Apache Ant 1.7.0 or later (any final version released before we go into high resistance mode)

3.2.9 Web Browsers

Firefox 3.0 Firefox 2.0 IE 7 IE 6 Safari latest

3.3 Locale

• pt_BR (Brazilian Portuguese)
• zh_CN (Simplified Chinese)
• ja_JP (Japanese)

This test plan is intended for these locales. Other locales would have different requirements, so they are out of scope of this documents.

4. Features to be tested

• Localized User Interface (e.g. label, menu, and message)
• Localized Online Help
• IDE features behavior in target locale

5. Features not to tested

• Performance
• Accessibility
• 3rd party Application

6. Approach

6.1 Test Management

Test cases, matrix, and status will be maintained on the Wiki page.

• NetBeans 6.5 l10n Test Cases

Most test cases are assumed just to point at existing tutorials and/or base test cases with additional simple instruction. If required, step-by-step procedures can be described.

Each component lead is responsible to lead the effort of selecting which tutorial and/or base test cases will be used for the testing.

Execute test cases, and save results on the Wiki pages.

• pt_BR Test Result
• zh_CN Test Result
• ja_JP Test Result

6.2 Test Types

The followings are possible testings for NetBeans IDE 6.5. Different product/components might have different test requirement.

6.2.1 Install Test

To ascertain localized product can be installed (customized-installed) and uninstalled on supported platforms and locales.

6.2.2 Base Test Cases Test

Execute test cases in Test Specifications for NetBeans 6.5,

6.2.3 Tutorial Test

Run through tutorials. To confirm that features are working fine in target locale and on target platform with target software. A set of test cases with priority order must be defined per component. Where applicable, locale specific characters should be tried.

6.2.4 Regression Test

To ascertain localized products function well, and no new problems are introduced after software modification, e.g bug fixing etc.

6.2.5 Sanity Test

A basic test to quickly check the most crucial functionalities of the localized product work on supported platforms and locales.

Install, start IDE, create, build and run small application, open the help and randomly selects some chapters, uninstall netbeans.

6.2.6 Download Test

To ascertain the localized bits can be successfully downloaded via supported browsers on supported platforms and locales. The downloaded bits are desired ones. The download pages are properly localized and displayed.

6.3 QA Phase

The testing will be divided into three phases (or more if necessary). Each test phase has predefined start date and end date.

QA Phase 0:

This phase is to create test cases. This phase is expected to overlap QA Phase 1. This means that QA Phase 1 can start before QA Phase 0 completes.

QA Phase 1:

When the QA Phase 1 starts, translation may not complete. This test phase should be completed by ML RC.

• execute test cases for Base Test Cases Test and Tutorial Test
• Sanity Test for all supported platforms/locales
• when bugs are fixed, Regression Test shall be done

• results should be recorded regularly
• when test period expires, all status must be recorded
• one test case will be executed on a few select platform/locale combinations
• the combinations will be defined in 6.4 Test Matrix

QA Phase 2:

This test phase must be completed by FCS GO/NoGO.

• Sanity Test for all supported platforms/locales
• Download Test for all supported platforms/locales
• when bugs are fixed, Regression Test shall be done

6.4 Test Matrix

6.4.1 QA Phase 1

6.4.2 QA Phase 2

All languages check on platforms defined in section 3.2.2.

6.5 Bug Management

6.5.1 Bug Report

Any bugs (localization, internationalization, and base) should be managed through issuezilla.

New L10N bugs should be filed to translatedfiles component, with CC to jf4jbugs (@netbeans.org).

New I18N bugs should be filed to appropriate components, with Summary started with "I18N - ", Keywords I18N, CC to jf4jbugs (@netbeans.org).

6.5.2 Bug Track Dashboard

6.5.3 Reference:

• http://translatedfiles.netbeans.org/docs/qa/reportbug.html
• http://www.netbeans.org/community/issues.html

7. Quality Criteria

7.1 Entrance Criteria for FCS(RC) build testing

• All translatable components have been translated and reviewed.
• All l10n packages build environment has been created and tested.
• All l10n packages can be built.

7.2 Pass Criteria for FCS (RC) build testing

• All P1/P2 bugs have been fixed. Waived P2 bugs has been discussed and approved.
• All P3 bugs have been evaluated.
• All docs packages have been made and include final translated pdf books.

8. Test Deliverables

• Localization test plan (this document)
• Lists of test cases for each component (refer to section 6.1)
• Bug Reports
• Testing closure report

9. Testing tasks

• platform installation
• test case creation in Wiki page
• test case execution

10. Environmental Needs

10.1 Hardware

• SPARC machines
• x86/x64 PC machines
• Intel Mac machines

10.2 Operating System

• OpenSolaris 2008.05 x86/x64
• Solaris 10 SPARC
• Ubuntu 8.04 x86
• Red Hat Enterprise Linux 5 x86
• Windows XP Professional SP3 x86
• Windows Vista Business x86
• Mac OS 10.5 Intel

10.3 Software

Java SE

• Java SE 6.0
• Java SE 5.0

Application Server

• GlassFish v2
• GlassFish v3

Database

• JavaDB
• MySQL 6.x

Web Browser

• Firefox 2.0 (Solaris, Ubuntu, Windows XP)
• Firefox 3.0 (Solaris, Ubuntu, Windows XP)
• IE 6.0 (Windows XP)
• IE 7.0 (Windows Vista)
• Safari (Mac OS X)

11. Staffing and training needs

Plan

12. Schedule

Reference:

• http://wiki.netbeans.org/NB65L10nSchedule

13. Risks and contingencies

• l10nkit availability
• Translation schecule
• people resource