This is the list of metrics that the v2021.11 grades are made of along with their weight.
This grade version was used for all trials between November 2021 and May 2022.
Changes in v2021.11 compared to previous version: Use 128k block size for Sysbench sequential fileio tests
|
Category Metric Name |
Weight | Test | Metric Description |
|---|---|---|---|
| Web Performance | |||
| Web Max Request Rate | 1 | Web Runs | The maximum rate of HTTP requests the instance was able to serve without returning timeouts or errors |
| Web Average Latency | 1 | Web Runs | The average response time of HTTP requests |
| Web P99 Latency | 1 | Web Runs | The 99th percentile response time of HTTP requests |
| Raw CPU Power | |||
| Ops per hour | 1 | Endurance | The amount of work the server can perform over a long period of time |
| Multi Threaded Ops per second | 1 | Sysbench | The maximum amount of multi threaded work the server can perform over a short period of time |
| Memory Read Transfer Speed | 1 | Sysbench | The memory read speed of 1K blocks over a short period of time |
| Performance Stability | |||
| P99 minus Mean Response Time | 1 | Web Runs | The difference between the 99th percentile and average latency of HTTP requests |
| Ops/hour Coefficient of Variation | 1 | Endurance | The variation of the server performance over a long period of time over the amount of work it performs |
| Latencies Standard Deviation | 1 | Web Runs | The standard deviation of response times for all rates of requests |
| Disk IO Performance | |||
| Sequential Disk IO Read Speed 128k blocks (no validate opt) | 1 | Sysbench | The storage sequential read speed over a short period of time |
| Sequential Disk IO Write Speed 128k blocks | 1 | Sysbench | The storage random write speed over a short period of time |
| Random Disk IO Read Speed 4k blocks (no validate opt) | 1 | Sysbench | The storage random read speed over a short period of time |
| Random Disk IO Write Speed 4k blocks | 1 | Sysbench | The storage random write speed over a short period of time |
| Network Performance | |||
| Network Download Speed | 1 | Transfers | The maximum bandwidth the server was able to use for downloads |
| Network Upload Speed | 1 | Transfers | The maximum bandwidth the server was able to use for uploads |
| Monthly Included Network Transfers | 1 | Transfers | The volume of network transfers included in the VPS plan per month |