This is the list of metrics that the v2019.12 grades are made of along with their weight.
This grade version was used for all trials between December 2019 and November 2021.
Changes in v2019.12 compared to previous version: Introduce Web Runs tests
|
Category Metric Name |
Weight | Test | Metric Description |
|---|---|---|---|
| Web Performance | |||
| Web Max Request Rate | 1 | Web Runs | The maximum rate of HTTP requests the instance was able to serve without returning timeouts or errors |
| Web Average Latency | 1 | Web Runs | The average response time of HTTP requests |
| Web P99 Latency | 1 | Web Runs | The 99th percentile response time of HTTP requests |
| Raw CPU Power | |||
| Ops per hour | 1 | Endurance | The amount of work the server can perform over a long period of time |
| Multi Threaded Ops per second | 1 | Sysbench | The maximum amount of multi threaded work the server can perform over a short period of time |
| Memory Read Transfer Speed | 1 | Sysbench | The memory read speed of 1K blocks over a short period of time |
| Performance Stability | |||
| P99 minus Mean Response Time | 1 | Web Runs | The difference between the 99th percentile and average latency of HTTP requests |
| Ops/hour Coefficient of Variation | 1 | Endurance | The variation of the server performance over a long period of time over the amount of work it performs |
| Latencies Standard Deviation | 1 | Web Runs | The standard deviation of response times for all rates of requests |
| Disk IO Performance | |||
| Sequential Disk IO Read Speed 4k blocks | 1 | Sysbench | The storage sequential read speed over a short period of time |
| Sequential Disk IO Write Speed 4k blocks | 1 | Sysbench | The storage sequential write speed over a short period of time |
| Random Disk IO Read Speed 4k blocks (no validate opt) | 1 | Sysbench | The storage random read speed over a short period of time |
| Random Disk IO Write Speed 4k blocks | 1 | Sysbench | The storage random write speed over a short period of time |
| Network Performance | |||
| Network Download Speed | 1 | Transfers | The maximum bandwidth the server was able to use for downloads |
| Network Upload Speed | 1 | Transfers | The maximum bandwidth the server was able to use for uploads |
| Monthly Included Network Transfers | 1 | Transfers | The volume of network transfers included in the VPS plan per month |