NB68A11YandI18Ntesting

NetBeans 6.8 Accessibility and Internationalization Testing plan

Quality engineers will explicitly write issues filed during testing to this table :

Area QE Owner(s) A11Y I18N
Maven Jaroslav Pospisil Issue 173864 DONE
PHP Filip Zamboj Issue 173784, sum: 32 Issue 173868
Ruby Tomas Musil Issue 173610 Issue 174072
Debugger Vojta Sigler No test No test
C-dev Jara Uhrik Issue 173764 Issue 173847
Editor/Java/Refactoring Jirka Prox / Peter Pis done Issue 173871
Projects Petr Dvorak Issue 174384
Form, Support Modules Pavel Pribyl Done Done
DB Martin Havle No test
Subversion / Mercurial Daniel Krezelok Issue 175406
Java EE Martin Schovanek
Michal Mocnak
No test No test
JavaScript Martin Zmrhal No test
Web, JSP, HTML, CSS Jindrich Sedek No test
XML, Installer/AU Michael Nazarov Issue 173842
Mobility Andrei Chistiakov No test No test
JavaFX Andrei Chistiakov Issue 173594 Issue 174130
CnD Alexander Pepin Issue 174560 No test
Profiler Matus Dekanek No test No test
Server Plugins Davis Nguyen No test
Summary: [All issues http://www.netbeans.org/issues/buglist.cgi?Submit+query=Submit+query&issueidtype=include&issue_id=173861 173862 173864 163867 163911 173602 173603 173604 173605 173606 173613 173614 173615 173617 173618 173619 173620 173621 173622 173623 173624 173625 173626 173628 173767 173768 173770 173771 173772 173773 173779 173780 173781 173783 173784 173588 173592 173598 173586 173590 173600 173607 173608 173610 173762 173747 173764 174371 174380 174381 174384 175404 175405 175406 173842 173582 173591 173594 174221 174537 174538 174539 174540 174542 174543 174551 174556 174560

], P2 issues, P3 issues, [[Http://www.netbeans.org/issues/buglist.cgiSubmit+query=Submit+queryissueidtype=includeissue_id=163867163911173586173590173594173600173602173604173605173607173608173610173614173615173618173619173621173622173623173625173626173628173768173770173772173773173779173780173781173783173784173861174371| P4 issues]] |

Accessibility

According to the NB68PlanQE the NetBeans Quality Engineering will provide testing of accessibility during Sep 22-25 (finally we will do it mainly in Oct 2-5 because we were busy with Beta testing). We agreed that testing will be provided only for areas that changed UI a lot or hasn't been tested yet.

A11Y-testing tool

There is A11Y-tester (org-netbeans-modules-a11y.nbm) available which will be used for testing accessibility. Do following steps to run a11y-tester version 2.5.1 in NetBeans:

  • Go to Settings tab of Plugin Manager (main menu Tools|Plugins)
  • Push Add button and type http://a11y.netbeans.org/nbms/updates.xml to URL field
  • Install Accessibility plugin which appears in Available Plugins tab
  • After the restart push wheelchair icon in toolbar

Detailed instructions can be found at http://a11y.netbeans.org

How to evaluate A11Y-tester output

It is not enough to execute A11Y-tester and file issues according to its output. While testing A11Y by A11Y-tester module there is human evaluation needed. The tool returns 2 types of results for each accessibility category of conflicts:

  • 1/String "-none" in the output means that there is no conflict in appropriate category of conflicts.
  • 2/The output of the tool tells us where could be potentially A11Y-issue but those suspicions need to be checked and the conclusion decision should be made whether it is issue or not according to common sense.

Testing process

We will use distributed process of testing NetBeans accessibility. It means that everybody from NetBeans Quality Engineering should execute A11Y testing in his/her responsible area (according to changes made in UI).

  • For all new features/UI there should be executed "first round" of a11y-testing right after the feature is integrated. This testing is executed in the same range as "regular round".
  • The "regular round" is usually executed at the same time for all team members according to the testing schedules. Quality engineer executes tests for all dialogs and UI components from the area of responsibility and evaluates the output. Issues are reported to issuezilla and the issue priority is set according to the bug priority guidelines document. Add keyword "A11Y" into the keyword field of reported issue. We used to have issue summary prefix 'A11Y' but please don't use this convention and sign the a11y-issues just with the 'A11Y' keyword. The output from A11Y-tester is usually added to the issue description.
  • Provide testing with the latest 6.8 Beta build or daily build.

Assessment

The 508 form will be submitted in Oct 26 at http://section508tool.sfbay/ and will contain link to this document.

Contact person

If you have questions related to accessibility feel free to contact Jaromir.Uhrik@Sun.Com


Internationalization

Please see these pages before starting i18n testing

Presentation about i18n - File:I18nnb68beta NB68A11YandI18Ntesting.odp i18n

Web about i18n testing - http://wiki.netbeans.org/I18NShortly


basic information

  • during testing focus on a new functionality of your area + basic area behavior
  • testing language is Japanese, so do not forget to change language before log in to Ubuntu or openSolaris. On Win XP Japanese locale is set up by default. You can also switch to Korean or Taiwanese. In Korean brackets are instead of multibytes.
  • if filling a bug, put - jf4jbug, mvanek to cc
  • provided NB 6.8 beta is installed from a zip file, not using installer so you might have to install glassfish, tomcat or other stuff needed for your area.
  • use scp to copy images instead of http. Http is not suitable for tranfers files bigger than 4gb
  • all images are available at beetle.czech.sun.com in - /space/data/transfer/vdi/i18n
  • if you still have images from previous i18n testing, remove these images first
  • File:Unpseudo-keys NB68A11YandI18Ntesting.txt list not being localized labels. If you are not sure label should be localized or not, check the label in this file first


Contact person

If you are not sure about i18n bug, please send email to michal.vanek@sun.com.

OS images

Images with NB6.8 beta builds are available for OS - Win XP, Ubuntu and openSolaris.

  • JDK16 is installed on all images
  • netbeans are configured to use jdk1.6.0_16

Win XP

  • no login required
  • image location: beetle.czech.sun.com - /space/data/transfer/vdi/i18n/winXP1i18n.vdi.tar.gz
  • NB 6.8 Beta location: C:\Program Files\NetBeans 6.8 Beta
  • jdk location: C:\Program Files\Java\jdk1.6.0_16

openSolaris

  • image location: beetle.czech.sun.com - /space/data/transfer/vdi/i18n/openSolarisi18n.vdi.tar.gz
  • credentials: i18n/i18n
  • NB 6.8 Beta location: /export/home/i18n/netbeans-6.8beta
  • jdk location: /export/home/i18n/i18n/jdk/jdk1.6.0_16

Ubuntu

  • image location: beetle.czech.sun.com - /space/data/transfer/vdi/i18n/ubuntui18n.vdi.tar.gz
  • credentials: i18n/i18ni18n
  • NB 6.8 Beta location: /home/i18n/netbeans-6.8beta
  • jdk location: /home/i18n/i18n/jdk1.6.0_16


Not logged in. Log in, Register

By use of this website, you agree to the NetBeans Policies and Terms of Use. © 2012, Oracle Corporation and/or its affiliates. Sponsored by Oracle logo