This is the list of metrics that the v2018.04 grades are made of along with their weight.
This grade version was used for all trials between April 2018 and December 2019.
Changes in v2018.04 compared to previous version: Replace Sysbench v0.4 by Sysbench v1.0
|
Category Metric Name |
Weight | Test | Metric Description |
|---|---|---|---|
| Web Performance | |||
| Mean Response Time | 1 | Web | |
| P99 Response Time | 1 | Web | |
| Raw CPU Power | |||
| Ops per hour | 1 | Endurance | The amount of work the server can perform over a long period of time |
| Multi Threaded Ops per second | 1 | Sysbench | The maximum amount of multi threaded work the server can perform over a short period of time |
| Performance Stability | |||
| Response Time Standard Deviation | 1 | Web | |
| P99 over Mean Response Time Ratio | 1 | Web | |
| Ops/hour Coefficient of Variation | 1 | Endurance | The variation of the server performance over a long period of time over the amount of work it performs |
| Disk IO Performance | |||
| Database Response Time | 2 | Web | |
| Sequential Disk IO Read Speed 4k blocks | 1 | Sysbench | The storage sequential read speed over a short period of time |
| Random Disk IO Read Latency | 1 | Sysbench | The average latency of a random read from disk |
| Random Disk IO Read Speed 4k blocks (no validate opt) | 1 | Sysbench | The storage random read speed over a short period of time |
| Random Disk IO Write Speed 4k blocks | 1 | Sysbench | The storage random write speed over a short period of time |
| Network Performance | |||
| Response Time US West | 1 | Remote | |
| Response Time Europe West | 1 | Remote | |
| Response Time Japan | 1 | Remote | |
| Network Download Speed | 2 | Transfers | The maximum bandwidth the server was able to use for downloads |
| Network Upload Speed | 2 | Transfers | The maximum bandwidth the server was able to use for uploads |