/run/media/nvme1n1/test-pcie-1: (g=0): rw=read, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=libaio, iodepth=4 fio-3.17-dirty Starting 1 process /run/media/nvme1n1/test-pcie-1: (groupid=0, jobs=1): err= 0: pid=1384: Mon Mar 13 16:09:44 2023 read: IOPS=382, BW=1528MiB/s (1603MB/s)(89.6GiB/60010msec) slat (usec): min=67, max=2207, avg=86.61, stdev=33.12 clat (usec): min=7181, max=44285, avg=10379.10, stdev=1179.60 lat (usec): min=7267, max=46494, avg=10466.05, stdev=1186.68 clat percentiles (usec): | 1.00th=[ 9896], 5.00th=[10028], 10.00th=[10028], 20.00th=[10028], | 30.00th=[10028], 40.00th=[10028], 50.00th=[10159], 60.00th=[10159], | 70.00th=[10159], 80.00th=[10159], 90.00th=[10159], 95.00th=[13435], | 99.00th=[15664], 99.50th=[16057], 99.90th=[16581], 99.95th=[17171], | 99.99th=[40109] bw ( MiB/s): min= 1168, max= 1576, per=99.99%, avg=1528.25, stdev=95.43, samples=120 iops : min= 292, max= 394, avg=382.06, stdev=23.86, samples=120 lat (msec) : 10=3.48%, 20=96.50%, 50=0.02% cpu : usr=0.17%, sys=3.28%, ctx=22933, majf=0, minf=543 IO depths : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=22929,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=4 Run status group 0 (all jobs): READ: bw=1528MiB/s (1603MB/s), 1528MiB/s-1528MiB/s (1603MB/s-1603MB/s), io=89.6GiB (96.2GB), run=60010-60010msec Disk stats (read/write): nvme1n1: ios=366040/0, merge=0/0, ticks=3352351/0, in_queue=3352351, util=99.87%