User Tools

Site Tools


storage:ceph

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
storage:ceph [2024/11/28 12:06] Jan Formanstorage:ceph [2025/01/21 14:54] (current) Jan Forman
Line 263: Line 263:
   * 10 OSDs and osd pool default size = 4, we'd recommend approximately   * 10 OSDs and osd pool default size = 4, we'd recommend approximately
   * (100 * 10) / 4 = 250.   * (100 * 10) / 4 = 250.
 +
 +
 +====== FIO 3xNodes ======
 +<code>
 +ceph_test: (groupid=0, jobs=16): err= 0: pid=1884829: Tue Jan 21 14:52:38 2025
 +  read: IOPS=16.5k, BW=2066MiB/s (2166MB/s)(1211GiB/600014msec)
 +    slat (usec): min=5, max=9989, avg=15.24, stdev= 9.73
 +    clat (usec): min=2, max=833395, avg=3854.45, stdev=6681.18
 +     lat (usec): min=225, max=833407, avg=3869.91, stdev=6681.22
 +    clat percentiles (usec):
 +      1.00th=[  553],  5.00th=[  611], 10.00th=[  676], 20.00th=[  799],
 +     | 30.00th=[  922], 40.00th=[ 1090], 50.00th=[ 1434], 60.00th=[ 1991],
 +     | 70.00th=[ 2933], 80.00th=[ 4686], 90.00th=[ 9765], 95.00th=[16712],
 +     | 99.00th=[31589], 99.50th=[39584], 99.90th=[57410], 99.95th=[63701],
 +     | 99.99th=[79168]
 +   bw (  MiB/s): min=  125, max= 3034, per=100.00%, avg=2069.56, stdev=18.99, samples=19162
 +   iops        : min= 1005, max=24278, avg=16556.49, stdev=151.89, samples=19162
 +  lat (usec)   : 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 250=0.01%
 +  lat (usec)   : 500=0.19%, 750=15.82%, 1000=19.21%
 +  lat (msec)   : 2=24.95%, 4=16.83%, 10=13.27%, 20=6.21%, 50=3.30%
 +  lat (msec)   : 100=0.21%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
 +  cpu          : usr=0.53%, sys=1.66%, ctx=9602473, majf=0, minf=2249
 +  IO depths    : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
 +     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
 +     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
 +     issued rwts: total=9917559,0,0,0 short=0,0,0,0 dropped=0,0,0,0
 +     latency   : target=0, window=0, percentile=100.00%, depth=4
 +
 +Run status group 0 (all jobs):
 +   READ: bw=2066MiB/s (2166MB/s), 2066MiB/s-2066MiB/s (2166MB/s-2166MB/s), io=1211GiB (1300GB), run=600014-600014msec
 +
 +Disk stats (read/write):
 +    dm-0: ios=9918511/2691, merge=0/0, ticks=38120430/45168, in_queue=38165598, util=100.00%, aggrios=9918511/2638, aggrmerge=0/140, aggrticks=38166176/39876, aggrin_queue=38206052, aggrutil=73.52%
 +  vda: ios=9918511/2638, merge=0/140, ticks=38166176/39876, in_queue=38206052, util=73.52%
 +</code>
 +
 +
storage/ceph.txt · Last modified: 2025/01/21 14:54 by Jan Forman