NB69A11YandI18Ntesting

(Difference between revisions)
(NetBeans 6.9 Accessibility and Internationalization Testing plan)
(Results Table)
 
(47 intermediate revisions not shown)
Line 1: Line 1:
__NOTOC__
__NOTOC__
==NetBeans 6.9 Accessibility and Internationalization Testing plan==
==NetBeans 6.9 Accessibility and Internationalization Testing plan==
 +
__TOC__
 +
===Results Table===
Quality engineers will '''explicitly''' write issues filed during testing to this table :
Quality engineers will '''explicitly''' write issues filed during testing to this table :
Line 10: Line 12:
!  I18N
!  I18N
|-  
|-  
-
|  Maven/ Web Services Client/ Partner Services
+
|  Maven
|  Jaroslav Pospisil
|  Jaroslav Pospisil
-
|
+
|   <i>DONE</i><br><b>&nbsp;P3: </b>[http://netbeans.org/bugzilla/show_bug.cgi?id=184972 184972]
-
|   
+
|  <i>NOT TESTED</i>
 +
|-
 +
Web Services Client / Partner Services
 +
|  Jaroslav Pospisil
 +
|  <i>NOT TESTED</i>
 +
|  <i>NOT TESTED</i>
|-  
|-  
|  PHP
|  PHP
|  Filip Zamboj
|  Filip Zamboj
-
|
+
|   <i>DONE</i><br><b>&nbsp;P2: </b>[http://netbeans.org/bugzilla/show_bug.cgi?id=184650 184650], [http://netbeans.org/bugzilla/show_bug.cgi?id=184654 184654], [http://netbeans.org/bugzilla/show_bug.cgi?id=184659 184659], [http://netbeans.org/bugzilla/show_bug.cgi?id=184729 184729]<br>
-
|   
+
<b>&nbsp;P3: [http://netbeans.org/bugzilla/show_bug.cgi?id=184621 184621], [http://netbeans.org/bugzilla/show_bug.cgi?id=184630 184630], [http://netbeans.org/bugzilla/show_bug.cgi?id=184636 184636], [http://netbeans.org/bugzilla/show_bug.cgi?id=184644 184644], [http://netbeans.org/bugzilla/show_bug.cgi?id=184647 184647], [http://netbeans.org/bugzilla/show_bug.cgi?id=184656 184656], [http://netbeans.org/bugzilla/show_bug.cgi?id=184661 184661], [http://netbeans.org/bugzilla/show_bug.cgi?id=184663 184663], [http://netbeans.org/bugzilla/show_bug.cgi?id=184736 184736], [http://netbeans.org/bugzilla/show_bug.cgi?id=184737 184737], [http://netbeans.org/bugzilla/show_bug.cgi?id=184739 184739], [http://netbeans.org/bugzilla/show_bug.cgi?id=184741 184741], [http://netbeans.org/bugzilla/show_bug.cgi?id=184742 184742], [http://netbeans.org/bugzilla/show_bug.cgi?id=184745 184745], [http://netbeans.org/bugzilla/show_bug.cgi?id=184747 184747], [http://netbeans.org/bugzilla/show_bug.cgi?id=184751 184751], [http://netbeans.org/bugzilla/show_bug.cgi?id=184754 184754], [http://netbeans.org/bugzilla/show_bug.cgi?id=184755 184755], [http://netbeans.org/bugzilla/show_bug.cgi?id=184757 184757], [http://netbeans.org/bugzilla/show_bug.cgi?id=184760 184760], [http://netbeans.org/bugzilla/show_bug.cgi?id=184806 184806], [http://netbeans.org/bugzilla/show_bug.cgi?id=184807 184807], [http://netbeans.org/bugzilla/show_bug.cgi?id=184809 184809], [http://netbeans.org/bugzilla/show_bug.cgi?id=184813 184813], [http://netbeans.org/bugzilla/show_bug.cgi?id=184815 184815], [http://netbeans.org/bugzilla/show_bug.cgi?id=184817 184817], [http://netbeans.org/bugzilla/show_bug.cgi?id=184823 184823], [http://netbeans.org/bugzilla/show_bug.cgi?id=184825 184825]</b><br>
 +
<b>&nbsp;P4: [http://netbeans.org/bugzilla/show_bug.cgi?id=184619 184619], [http://netbeans.org/bugzilla/show_bug.cgi?id=184631 184631], [http://netbeans.org/bugzilla/show_bug.cgi?id=184634 184634], [http://netbeans.org/bugzilla/show_bug.cgi?id=184635 184635], [http://netbeans.org/bugzilla/show_bug.cgi?id=184638 184638], [http://netbeans.org/bugzilla/show_bug.cgi?id=184639 184639], [http://netbeans.org/bugzilla/show_bug.cgi?id=184640 184640], [http://netbeans.org/bugzilla/show_bug.cgi?id=184641 184641], [http://netbeans.org/bugzilla/show_bug.cgi?id=184642 184642], [http://netbeans.org/bugzilla/show_bug.cgi?id=184645 184645], [http://netbeans.org/bugzilla/show_bug.cgi?id=184646 184646], [http://netbeans.org/bugzilla/show_bug.cgi?id=184651 184651], [http://netbeans.org/bugzilla/show_bug.cgi?id=184652 184652], [http://netbeans.org/bugzilla/show_bug.cgi?id=184655 184655], [http://netbeans.org/bugzilla/show_bug.cgi?id=184657 184657], [http://netbeans.org/bugzilla/show_bug.cgi?id=184660 184660], [http://netbeans.org/bugzilla/show_bug.cgi?id=184662 184662], [http://netbeans.org/bugzilla/show_bug.cgi?id=184664 184664], [http://netbeans.org/bugzilla/show_bug.cgi?id=184668 184668], [http://netbeans.org/bugzilla/show_bug.cgi?id=184730 184730], [http://netbeans.org/bugzilla/show_bug.cgi?id=184732 184732], [http://netbeans.org/bugzilla/show_bug.cgi?id=184738 184738], [http://netbeans.org/bugzilla/show_bug.cgi?id=184740 184740], [http://netbeans.org/bugzilla/show_bug.cgi?id=184748 184748], [http://netbeans.org/bugzilla/show_bug.cgi?id=184749 184749], [http://netbeans.org/bugzilla/show_bug.cgi?id=184753 184753], [http://netbeans.org/bugzilla/show_bug.cgi?id=184756 184756], [http://netbeans.org/bugzilla/show_bug.cgi?id=184759 184759], [http://netbeans.org/bugzilla/show_bug.cgi?id=184805 184805], [http://netbeans.org/bugzilla/show_bug.cgi?id=184808 184808], [http://netbeans.org/bugzilla/show_bug.cgi?id=184810 184810], [http://netbeans.org/bugzilla/show_bug.cgi?id=184811 184811], [http://netbeans.org/bugzilla/show_bug.cgi?id=184812 184812], [http://netbeans.org/bugzilla/show_bug.cgi?id=184814 184814], [http://netbeans.org/bugzilla/show_bug.cgi?id=184816 184816], [http://netbeans.org/bugzilla/show_bug.cgi?id=184818 184818], [http://netbeans.org/bugzilla/show_bug.cgi?id=184819 184819], [http://netbeans.org/bugzilla/show_bug.cgi?id=184820 184820], [http://netbeans.org/bugzilla/show_bug.cgi?id=184821 184821], [http://netbeans.org/bugzilla/show_bug.cgi?id=184822 184822], [http://netbeans.org/bugzilla/show_bug.cgi?id=184824 184824]</b>
 +
<i>NOT TESTED</i>
|-  
|-  
|  Debugger  
|  Debugger  
|  Marian Mirilovic  
|  Marian Mirilovic  
-
|  NOT TESTED
+
<i>NOT TESTED</i>
-
|  NOT TESTED
+
<i>NOT TESTED</i>
|-  
|-  
|  C-dev  
|  C-dev  
|  Jara Uhrik
|  Jara Uhrik
-
|  <b>P2: </b>[http://netbeans.org/bugzilla/show_bug.cgi?id=184532 184532], [http://netbeans.org/bugzilla/show_bug.cgi?id=184549 184549], [http://netbeans.org/bugzilla/show_bug.cgi?id=184556 184556]
+
<i>DONE</i><br><b>&nbsp;P2: </b>[http://netbeans.org/bugzilla/show_bug.cgi?id=184532 184532], [http://netbeans.org/bugzilla/show_bug.cgi?id=184549 184549], [http://netbeans.org/bugzilla/show_bug.cgi?id=184556 184556]
-
<b>P3: </b>[http://netbeans.org/bugzilla/show_bug.cgi?id=184542 184542], [http://netbeans.org/bugzilla/show_bug.cgi?id=182544 182544], [http://netbeans.org/bugzilla/show_bug.cgi?id=182547 182547]
+
<b>&nbsp;P3: </b>[http://netbeans.org/bugzilla/show_bug.cgi?id=184542 184542], [http://netbeans.org/bugzilla/show_bug.cgi?id=184544 184544], [http://netbeans.org/bugzilla/show_bug.cgi?id=184547 184547]
-
|  NOT TESTED
+
<i>NOT TESTED</i>
|-  
|-  
|  Editor/ Java/ Refactoring
|  Editor/ Java/ Refactoring
|  Peter Pis
|  Peter Pis
-
|   
+
<i>DONE</i>
-
|
+
<b>&nbsp;P3: </b>[http://netbeans.org/bugzilla/show_bug.cgi?id=184623 184623], [http://netbeans.org/bugzilla/show_bug.cgi?id=184624 184624], [http://netbeans.org/bugzilla/show_bug.cgi?id=184625 184625], [http://netbeans.org/bugzilla/show_bug.cgi?id=184626 184626], [http://netbeans.org/bugzilla/show_bug.cgi?id=184627 184627]
 +
| sanity test - linewrap
|-  
|-  
|  OSGi
|  OSGi
|  Tomas Musil
|  Tomas Musil
-
|   
+
<i>DONE</i>
-
|   
+
<b>&nbsp;P2: </b>[http://netbeans.org/bugzilla/show_bug.cgi?id=184837 184837]<br>
 +
<b>&nbsp;P3: </b>[http://netbeans.org/bugzilla/show_bug.cgi?id=184839 184839],
 +
[http://netbeans.org/bugzilla/show_bug.cgi?id=184842 184842]<br>
 +
<b>&nbsp;P4: </b>[http://netbeans.org/bugzilla/show_bug.cgi?id=184833 184833],
 +
[http://netbeans.org/bugzilla/show_bug.cgi?id=184834 184834]
 +
<i>NOT TESTED</i>
|-  
|-  
|  DB
|  DB
|  Michael Nazarov
|  Michael Nazarov
-
|   
+
<i>DONE</i>
-
|   
+
<b>&nbsp;P2:</b> [http://netbeans.org/bugzilla/show_bug.cgi?id=185170 185170]
 +
<i>NOT TESTED</i>
|-  
|-  
|  Java EE
|  Java EE
|  Martin Schovanek/Michal Mocnak
|  Martin Schovanek/Michal Mocnak
-
|   
+
<i>NOT TESTED</i>
-
|   
+
<i>NOT TESTED</i>
|-  
|-  
|  JavaScript
|  JavaScript
|  Petr Blaha
|  Petr Blaha
-
|   
+
<i>NOT TESTED</i>
-
|
+
|   <i>NOT TESTED</i>
|-  
|-  
|  Web, JSP, HTML, CSS
|  Web, JSP, HTML, CSS
|  Jindra Sedek
|  Jindra Sedek
-
|   
+
<i>DONE</i>
-
|   
+
<b>&nbsp;P2: </b>[http://netbeans.org/bugzilla/show_bug.cgi?id=184715 184715]
 +
<i>NOT TESTED</i>
|-  
|-  
|  XML, Installler/AU
|  XML, Installler/AU
|  Michael Nazarov
|  Michael Nazarov
-
|   
+
<i>DONE</i>
-
|   
+
<i>NOT TESTED</i>
|-  
|-  
|  Mobility
|  Mobility
|  Andrei Chistiakov
|  Andrei Chistiakov
-
|   NOT TESTED
+
| <i>NOT TESTED</i>
-
|  NOT TESTED
+
<i>NOT TESTED</i>
|-  
|-  
|  Java FX
|  Java FX
|  Alexandr Scherbatiy/Lukas Hasik
|  Alexandr Scherbatiy/Lukas Hasik
-
|   
+
<i>DONE</i> 
-
|   
+
<b>&nbsp;P2:&nbsp;</b>[http://netbeans.org/bugzilla/show_bug.cgi?id=184863 184863], [http://netbeans.org/bugzilla/show_bug.cgi?id=184865 184865], [http://netbeans.org/bugzilla/show_bug.cgi?id=184850 184850], [http://netbeans.org/bugzilla/show_bug.cgi?id=184855 184855], [http://netbeans.org/bugzilla/show_bug.cgi?id=184856 184856], [http://netbeans.org/bugzilla/show_bug.cgi?id=184860 184860], [http://netbeans.org/bugzilla/show_bug.cgi?id=184861 184861]<br> <b>&nbsp;P3: </b>[http://netbeans.org/bugzilla/show_bug.cgi?id=184721 184721], [http://netbeans.org/bugzilla/show_bug.cgi?id=184722 184722], [http://netbeans.org/bugzilla/show_bug.cgi?id=184723 184723],
 +
[http://netbeans.org/bugzilla/show_bug.cgi?id=184724 184724], 
 +
[http://netbeans.org/bugzilla/show_bug.cgi?id=184725 184725],[http://netbeans.org/bugzilla/show_bug.cgi?id=184848 184848], [http://netbeans.org/bugzilla/show_bug.cgi?id=184849 184849], [http://netbeans.org/bugzilla/show_bug.cgi?id=184867 184867], [http://netbeans.org/bugzilla/show_bug.cgi?id=184875 184875], [http://netbeans.org/bugzilla/show_bug.cgi?id=184876 184876]<br> <b>&nbsp;P4: </b>[http://netbeans.org/bugzilla/show_bug.cgi?id=184847 184847], [http://netbeans.org/bugzilla/show_bug.cgi?id=184869 184869], [http://netbeans.org/bugzilla/show_bug.cgi?id=184870 184870]
 +
<i>NOT TESTED</i>
|-  
|-  
|  CnD
|  CnD
|  Alexander Pepin
|  Alexander Pepin
-
|   
+
<i>NOT TESTED</i>
-
|
+
|   <i>NOT TESTED</i>
|-  
|-  
|  C/V, Platform
|  C/V, Platform
|  Ivan Sidorkin
|  Ivan Sidorkin
-
|   
+
<i>NOT TESTED</i>
-
+
<i>NOT TESTED</i>
-
|-
+
-
|  Server Plugins
+
-
Davis Nguyen
+
-
+
-
|   
+
|-  
|-  
| '''Summary:'''
| '''Summary:'''
|   
|   
-
|  [http://www.netbeans.org/issues/buglist.cgi?Submit+query=Submit+query&issueidtype=include&issue_id= All Issues], [http://www.netbeans.org/issues/buglist.cgiSubmit+query=Submit+queryissueidtype=includeissue_id= P2 issues], [http://www.netbeans.org/issues/buglist.cgiSubmit+query=Submit+queryissueidtype=includeissue_id= P3 issues], [http://www.netbeans.org/issues/buglist.cgiSubmit+query=Submit+queryissueidtype=includeissue_id= P4 issues]  
+
|  [http://netbeans.org/bugzilla/buglist.cgi?bug_id=184650,184654,184659,184729,184532,184549,184556,184837,185170,184715,184863,184865,184850,184855,184856,184860,184861,184972,184621,184630,184636,184644,184647,184656,184661,184663,184736,184737,184739,184741,184742,184745,184747,184751,184754,184755,184757,184760,184806,184807,184809,184813,184815,184817,184823,184825,184542,184544,184547,184623,184624,184625,184626,184627,184839,184842,184721,184722,184723,184724,184725,184848,184849,184867,184875,184876,184619,184631,184634,184635,184638,184639,184640,184641,184642,184645,184646,184651,184652,184655,184657,184660,184662,184664,184668,184730,184732,184738,184740,184748,184749,184753,184756,184759,184805,184808,184810,184811,184812,184814,184816,184818,184819,184820,184821,184822,184824,184833,184834,184847,184869,184870 All Issues(112)], [http://netbeans.org/bugzilla/buglist.cgi?bug_id=184650,184654,184659,184729,184532,184549,184556,184837,185170,184715,184863,184865,184850,184855,184856,184860,184861 P2 issues(17)], [http://netbeans.org/bugzilla/buglist.cgi?bug_id=184972,184621,184630,184636,184644,184647,184656,184661,184663,184736,184737,184739,184741,184742,184745,184747,184751,184754,184755,184757,184760,184806,184807,184809,184813,184815,184817,184823,184825,184542,184544,184547,184623,184624,184625,184626,184627,184839,184842,184721,184722,184723,184724,184725,184848,184849,184867,184875,184876 P3 issues(49)], [http://netbeans.org/bugzilla/buglist.cgi?bug_id=184619,184631,184634,184635,184638,184639,184640,184641,184642,184645,184646,184651,184652,184655,184657,184660,184662,184664,184668,184730,184732,184738,184740,184748,184749,184753,184756,184759,184805,184808,184810,184811,184812,184814,184816,184818,184819,184820,184821,184822,184824,184833,184834,184847,184869,184870 P4 issues(46)]  
|
|
|}
|}
===Accessibility===
===Accessibility===
-
According to the [http://wiki.netbeans.org/NetBeans_69_Quality_Plan  NB 69 Quality Plan] the NetBeans Quality Engineering will provide testing of accessibility during '''Apr 19-21'''. We agreed that testing will be provided only for areas that changed UI a lot or hasn't been tested yet. If your area is not tested then please write "NOT TESTED" to the table.  
+
According to the [http://wiki.netbeans.org/NetBeans_69_Quality_Plan  NB 69 Quality Plan] the NetBeans Quality Engineering will provide testing of accessibility during '''Apr 19-21'''. We agreed that testing will be provided only for areas that changed UI a lot or hasn't been tested yet. If your area is not tested then please write "NOT TESTED" to the table. If you are done with testing please write "DONE" to the proper cell.
====A11Y-testing tool====
====A11Y-testing tool====
Line 123: Line 138:
====Contact person====
====Contact person====
If you have questions related to accessibility feel free to contact Jaromir.Uhrik@Sun.Com
If you have questions related to accessibility feel free to contact Jaromir.Uhrik@Sun.Com
 +
 +
====Completed Dates====
 +
Testing has been performed in April 19-29, 2010.
 +
 +
508 assessment submitted in April 29, 2010.

Current revision as of 10:55, 3 May 2010

NetBeans 6.9 Accessibility and Internationalization Testing plan

Contents


Results Table

Quality engineers will explicitly write issues filed during testing to this table :

Area QE Owner(s) A11Y I18N
Maven Jaroslav Pospisil DONE
 P3: 184972
NOT TESTED
Web Services Client / Partner Services Jaroslav Pospisil NOT TESTED NOT TESTED
PHP Filip Zamboj DONE
 P2: 184650, 184654, 184659, 184729

 P3: 184621, 184630, 184636, 184644, 184647, 184656, 184661, 184663, 184736, 184737, 184739, 184741, 184742, 184745, 184747, 184751, 184754, 184755, 184757, 184760, 184806, 184807, 184809, 184813, 184815, 184817, 184823, 184825
 P4: 184619, 184631, 184634, 184635, 184638, 184639, 184640, 184641, 184642, 184645, 184646, 184651, 184652, 184655, 184657, 184660, 184662, 184664, 184668, 184730, 184732, 184738, 184740, 184748, 184749, 184753, 184756, 184759, 184805, 184808, 184810, 184811, 184812, 184814, 184816, 184818, 184819, 184820, 184821, 184822, 184824

NOT TESTED
Debugger Marian Mirilovic NOT TESTED NOT TESTED
C-dev Jara Uhrik DONE
 P2: 184532, 184549, 184556

 P3: 184542, 184544, 184547

NOT TESTED
Editor/ Java/ Refactoring Peter Pis DONE

 P3: 184623, 184624, 184625, 184626, 184627

sanity test - linewrap
OSGi Tomas Musil DONE

 P2: 184837
 P3: 184839, 184842
 P4: 184833, 184834

NOT TESTED
DB Michael Nazarov DONE

 P2: 185170

NOT TESTED
Java EE Martin Schovanek/Michal Mocnak NOT TESTED NOT TESTED
JavaScript Petr Blaha NOT TESTED NOT TESTED
Web, JSP, HTML, CSS Jindra Sedek DONE

 P2: 184715

NOT TESTED
XML, Installler/AU Michael Nazarov DONE NOT TESTED
Mobility Andrei Chistiakov NOT TESTED NOT TESTED
Java FX Alexandr Scherbatiy/Lukas Hasik DONE

 P2: 184863, 184865, 184850, 184855, 184856, 184860, 184861
 P3: 184721, 184722, 184723, 184724, 184725,184848, 184849, 184867, 184875, 184876
 P4: 184847, 184869, 184870

NOT TESTED
CnD Alexander Pepin NOT TESTED NOT TESTED
C/V, Platform Ivan Sidorkin NOT TESTED NOT TESTED
Summary: All Issues(112), P2 issues(17), P3 issues(49), P4 issues(46)

Accessibility

According to the NB 69 Quality Plan the NetBeans Quality Engineering will provide testing of accessibility during Apr 19-21. We agreed that testing will be provided only for areas that changed UI a lot or hasn't been tested yet. If your area is not tested then please write "NOT TESTED" to the table. If you are done with testing please write "DONE" to the proper cell.

A11Y-testing tool

To install the tester tool please follow the page at http://wiki.netbeans.org/A11YShortly

How to evaluate A11Y-tester output

It is not enough to execute A11Y-tester and file issues according to its output. While testing A11Y by A11Y-tester module there is human evaluation needed. The tool returns 2 types of results for each accessibility category of conflicts:

  • 1/String "-none" in the output means that there is no conflict in appropriate category of conflicts.
  • 2/The output of the tool tells us where could be potentially A11Y-issue but those suspicions need to be checked and the conclusion decision should be made whether it is issue or not according to common sense.

Testing process

We will use distributed process of testing NetBeans accessibility. It means that everybody from NetBeans Quality Engineering should execute A11Y testing in his/her responsible area (according to changes made in UI).

  • For all new features/UI there should be executed "first round" of a11y-testing right after the feature is integrated. This testing is executed in the same range as "regular round".
  • The "regular round" is usually executed at the same time for all team members according to the testing schedules. Quality engineer executes tests for all dialogs and UI components from the area of responsibility and evaluates the output. Issues are reported to issuezilla and the issue priority is set according to the Bug priority guidelines document. Add keyword "A11Y" into the keyword field of reported issue. We used to have issue summary prefix 'A11Y' but please don't use this convention and sign the a11y-issues just with the 'A11Y' keyword. The output from A11Y-tester is usually added to the issue description.
  • Provide testing with the latest 6.9 Beta build or daily build.

Assessment

The 508 form will be submitted by May 3 at http://section508tool.sfbay/ and will contain link to this document.

Contact person

If you have questions related to accessibility feel free to contact Jaromir.Uhrik@Sun.Com

Completed Dates

Testing has been performed in April 19-29, 2010.

508 assessment submitted in April 29, 2010.

Not logged in. Log in, Register

By use of this website, you agree to the NetBeans Policies and Terms of Use. © 2012, Oracle Corporation and/or its affiliates. Sponsored by Oracle logo