NB67QualityCriteria
NB 6.7 Quality Criteria
Contents |
Divided modules to "Under Development" and "In Maintenance Mode"
Milestone 1 (Dec-15)
- All P1 must be fixed
- P2 < 211
- Number of unevaluated P2,P3 bugs lower than 20% of all opened bugs P2,P3
- P3 < 3968
- Complete reassessments of P3 bugs must be completed
- Deprecated API's dependencies must be removed
| Team | P2 | P3 |
|---|---|---|
| Core | 25 | 589 |
| Editor | 25 | 606 |
| LCT | 9 | 287 |
| C-Dev | - | - |
| Mobility | 4 | 84 |
| JavaEE | 21 | 395 |
| Ruby | 6 | 194 |
| Web Serv | 5 | 110 |
| VisualWeb | 5 | 138 |
| Installer | 5 | 20 |
| SOA | 21 | 239 |
| XML | 4 | 80 |
| CND | 26 | 274 |
| DB | 5 | 131 |
| Web Lang | 5 | 223 |
| Profiler | 2 | 57 |
| PHP | 10 | 110 |
| Groovy | 3 | 89 |
| REST | 8 | 26 |
| AJAX | 3 | 45 |
| Other | 1 | 96 |
| Python | 10 | 80 |
| Support Modules | 4 | 80 |
| Total | 207 | 3953 |
Milestone 2 (Feb-16)
- All P1 must be fixed
- P2 < 173
- Number of unevaluated (P2,P3,P4) bugs lower than 20% of all opened bugs
- P3 < 3763
- Status check for opened bugs
| Team | P2 | P3 |
|---|---|---|
| Core | 15 | 520 |
| Editor | 15 | 615 |
| LCT | 8 | 290 |
| C-Dev | 20 | TBD |
| Mobility | 5 | 75 |
| JavaEE | 10 | 370 |
| Ruby | 5 | 190 |
| Web Serv | 3 | 100 |
| VisualWeb | 5 | 138 |
| Installer | 2 | 20 |
| SOA | 15 | 240 |
| XML | 4 | 75 |
| CND | 15 | 270 |
| DB | 5 | 130 |
| Web Lang | 5 | 185 |
| Profiler | 4 | 55 |
| PHP | 8 | 100 |
| Groovy | 5 | 80 |
| REST | 5 | 25 |
| AJAX | 5 | 40 |
| Other | 2 | 95 |
| Python | 5 | 80 |
| Support Modules | 3 | 70 |
| Total | 169 | 3763 |
Milestone 3 (Mar-20)
- All P1 must be fixed
- Number of unevaluated bugs lower than 20% of all opened bugs
- Status check for opened bugs
| Team | P2 |
|---|---|
| Core | 10 |
| Editor | 10 |
| LCT | 5 |
| C-Dev | 15 |
| Mobility | 3 |
| Support Modules | 2 |
| JavaEE | 5 |
| Ruby | 3 |
| Web Serv | 2 |
| Installer | 2 |
| XML | 4 |
| CND | 10 |
| DB | 3 |
| Web Lang | 3 |
| Profiler | 2 |
| PHP | 5 |
| Groovy | 3 |
| REST | 3 |
| AJAX | 3 |
| Other | 2 |
| Total | 115 |
Beta (Apr-20)
- All P1 must be fixed
- All P2 must be evaluated
- Number of unevaluated (P3,P4) bugs lower than 10% of all opened bugs
| Team | P2 | P3 |
|---|---|---|
| Core | 5 | 400 |
| Editor | 5 | 530 |
| LCT | 3 | 160 |
| C-Dev | 7 | 60 |
| Mobility | 2 | 80 |
| Support Modules | 2 | 70 |
| JavaEE | 3 | - |
| Ruby | 2 | - |
| Web Serv | 2 | - |
| Installer | 2 | 25 |
| XML | 2 | - |
| CND | 5 | 200 |
| DB | 2 | - |
| Web Lang | 2 | - |
| Profiler | 2 | 50 |
| PHP | 3 | - |
| Groovy | 2 | - |
| REST | 2 | - |
| AJAX | 2 | - |
| Other | 1 | 80 |
| Total | 56 | 1655 |
Code Freeze (Entry, May-25) - FCS QC
- All P1 bugs must be fixed (not waived)
- All P2 bugs must be fixed or waived
- All P2 bugs reported after cut-off date must be evaluated for showstopper status
- All bugs must be evaluated before submitting for waive request
- All P3 must be evaluated
- All P4 must be evaluated
| Team | P3 |
|---|---|
| Core | 300 |
| Editor | 440 |
| LCT | 140 |
| C-Dev | 50 |
| Mobility | 70 |
| Support Modules | 60 |
| JavaEE | - |
| Ruby | - |
| Web Serv | - |
| Installer | 20 |
| XML | - |
| CND | 160 |
| DB | - |
| Web Lang | - |
| Profiler | 40 |
| PHP | - |
| Groovy | - |
| REST | - |
| AJAX | - |
| Other | 70 |
| Total | 1350 |
If used - instead of number - all modules for particular team are "In Maintenance Mode".
NB 6.7 Performance Quality Criteria
- UI responsiveness: 90% of UI responsiveness tests pass (compared to 85% for 6.5)
- Startup: no regression against 6.5
- Memory consumption: max 10% increase

