k8s storage performance

Longhorn Single Replica with Data Locality

Longhorn Single OVH 2C4G

Random Read/Write IOPS: 3439/3066. BW: 184MiB/s / 136MiB/s
Average Latency (usec) Read/Write: 1600.96/1699.54
Sequential Read/Write: 334MiB/s / 177MiB/s
Mixed Random Read/Write IOPS: 2308/766

Longhorn Single GCP e2-standard-2 2C8G

Random Read/Write IOPS: 140/256. BW: 16.4MiB/s / 26.2MiB/s
Average Latency (usec) Read/Write: 29.27/14.72
Sequential Read/Write: 105MiB/s / 84.3MiB/s
Mixed Random Read/Write IOPS: 124/41

Longhorn Single DigitalOcean 4c8G

Random Read/Write IOPS: 6423/2087. BW: 249MiB/s / 93.8MiB/s
Average Latency (usec) Read/Write: 1102.75/1838.85
Sequential Read/Write: 425MiB/s / 232MiB/s
Mixed Random Read/Write IOPS: 3408/1127

Ceph EC2+1 on Longhorn Single with Locality

Random Read/Write IOPS: 454/292. BW: 10.3MiB/s / 10.5MiB/s
Average Latency (usec) Read/Write: 29.75/61.55
Sequential Read/Write: 11.3MiB/s / 12.6MiB/s
Mixed Random Read/Write IOPS: 51/17
Random Read/Write IOPS: 194/179. BW: 9962KiB/s / 10.5MiB/s
Average Latency (usec) Read/Write: 31.24/65.63
Sequential Read/Write: 9.98MiB/s / 12.1MiB/s
Mixed Random Read/Write IOPS: 40/12

Digital Ocean k8s

Ceph EC2+1 on Longhorn Single with Locality

Random Read/Write IOPS: 419/228. BW: 51.1MiB/s / 32.3MiB/s
Average Latency (usec) Read/Write: 18.34/84.29
Sequential Read/Write: 157MiB/s / 94.8MiB/s
Mixed Random Read/Write IOPS: 389/131