PerformanceComparativeDashboard
DRAFT
Current measurements are performed for build 20090630 Dev vs (FCS NB6.7, Eclipse Galileo)
All measurements are manual. Numbers are average of 3 measurements.
Configuration: as listed in Recommended Hardware Configurations for Netbeans
OS: Windows XP SP3
Hardware: Processor: 2.6 GHz Intel Pentium IV or equivalent / Memory: 1 GB
JDK: 1.6.0_13
Projects: Limewire for j2se tests (from sourceforge). PerformanceTestFolderWebApp web project from nb repository for deployment
Base profile for NB: Java SE bundle, full profile for NB: All bundle (JavaSE+Java Web&EE+Ruby+Mobility+PHP+C+SOA)
Base profile for Eclipse: Eclipse IDE for Java Developers, full profile for Eclipse: Eclipse IDE for Java EE Developers+Web Tools, Mobile Tools for the Java Platform, C/C++ Development Tools, Dynamic Languages Toolkit, Tracing and Profiling Tools
1. Startup:
Start: triggering nb icon (or exe file) - stop: nb main window appears.
With opened project - 1 java file is opened in editor.
Base:
| Testcase | NB 6.8 | NB 6.7 | NB6.5 | Eclipse Galileo | . | NB6.1 | NB6.0 |
|---|---|---|---|---|---|---|---|
| Startup cold w/o project | 20s | 19s | 20s | 21s | . | 22s | 22s |
| Startup cold with project | 23s | 23s | 26s | 28s | . | 26s | 36s |
Full:
| Testcase | NB 6.8 | NB 6.7 | NB6.5 | Eclipse Galileo | . | NB6.1 | NB6.0 |
|---|---|---|---|---|---|---|---|
| Startup cold w/o project | 22s | 22s | 26s | 24s | . | 28s | 33s |
| Startup cold with project | 26s | 26s | 33s | 33s | . | 32s | 54s |
2. Edit:
| Testcase | NB 6.8 | NB 6.7 | NB6.5 | Eclipse Galileo | . | NB6.1 | NB6.0 |
|---|---|---|---|---|---|---|---|
| Refactoring: Move class | 4s | 8s | 92s | 2s | . | 52s | 99s |
| Refactoring: Find Usages | 8s | 42s | 12s | 12s | . | 16s | 20s |
3. Build:
| Testcase | NB 6.8 | NB 6.7 | NB6.5 | Eclipse Galileo | . | NB6.1 | NB6.0 |
|---|---|---|---|---|---|---|---|
| Build project 1st time | 47s | 46s | 45s | 50s | . | 47s | 48s |
| Rebuild project | 41s | 40s | 42s | 36s | . | 41s | 42s |
4. Memory consumption:
Memory reported by TaskManager
'After create, edit, build' - newly created JavaSE Application
Base profile
| Testcase | NB 6.8 | NB 6.7 | NB6.5 | Eclipse Galileo | . | NB6.1 | NB6.0 |
|---|---|---|---|---|---|---|---|
| After startup & warmup | 99Mb | 98Mb | 88Mb | 94Mb | . | 92Mb | 118Mb |
| After create, edit, build | 125Mb | 123Mb | 122Mb | 154Mb | . | 120Mb | 147Mb |
Full profile
| Testcase | NB 6.8 | NB 6.7 | NB6.5 | Eclipse Galileo | . | NB6.1 | NB6.0 |
|---|---|---|---|---|---|---|---|
| After startup & warmup | 108Mb | 110Mb | 90Mb | 108Mb | . | 98Mb | 140 Mb |
| After create, edit, build | 136Mb | 132Mb | 135Mb | 171Mb | . | 127Mb | 172Mb |
