Acutally, good question - is RBD caching at all - possible with Windows guestes, if it ussing latest VirtIO drivers ? Linux caching (write caching, writeback) is working fine with newer virt-io drivers...
Thanks On 18 March 2015 at 10:39, Alexandre DERUMIER <aderum...@odiso.com> wrote: > Hi, > > I don't known how rbd read-ahead is working, > > but with qemu virtio-scsi, you can have read merge request (for sequential > reads), so it's doing bigger ops to ceph cluster and improve throughput. > virtio-blk merge request will be supported in coming qemu 2.3. > > > (I'm not sure of virtio-win drivers support of theses features) > > > ----- Mail original ----- > De: "Stephen Taylor" <stephen.tay...@storagecraft.com> > À: "ceph-users" <ceph-us...@ceph.com> > Envoyé: Mardi 17 Mars 2015 21:22:59 > Objet: Re: [ceph-users] RBD read-ahead not working in 0.87.1 > > > > Never mind. After digging through the history on Github it looks like the > docs are wrong. The code for the RBD read-ahead feature appears in 0.88, > not 0.86, which explains why I can’t get it to work in 0.87.1. > > > > Steve > > > > > From: Stephen Taylor > Sent: Tuesday, March 17, 2015 11:32 AM > To: 'ceph-us...@ceph.com' > Subject: RBD read-ahead not working in 0.87.1 > > > > > Hello, fellow Ceph users, > > > > I’m trying to utilize RBD read-ahead settings with 0.87.1 (documented as > new in 0.86) to convince the Windows boot loader to boot a Windows RBD in a > reasonable amount of time using QEMU on Ubuntu 14.04.2. Below is the output > of “ceph -w” during the Windows VM boot process. During the boot loader > phase it’s almost a perfect correspondence of kB/s rd and op/s, which I > interpret as the boot loader doing LOTS of non-cached, 1kB reads. This is > what the [client] section of my ceph.conf looks like: > > > > [client] > > rbd_cache = true > > rbd_cache_size = 268435456 > > rbd_cache_max_dirty = 201326592 > > rbd_cache_target_dirty = 134217728 > > rbd_readahead_trigger_requests = 1 > > rbd_readahead_max_bytes = 524288 > > rbd_readahead_disable_after_bytes = 0 > > rbd_cache_writethrough_until_flush = true > > admin_socket = /var/run/ceph/$cluster-$type.$id.$pid.$cctid.asok > > > > Some of those values are not what I would use in production. This is just > a test environment to try to prove that the RBD read-ahead caching works as > I expect. > > > > Another interesting note is that “sudo ceph daemon /var/run/ceph/<admin > socket> config show | grep rbd_readahead” yields nothing. The “config show” > lists all of the config settings with the values I expect, but the > rbd_readahead_* settings are absent. I have tried all kinds of different > values in my ceph.conf file with the same result. > > > > The reason I’m convinced that read-ahead caching is my problem here is > that I can mount my RBD via rbd-fuse and use the same QEMU command with the > -drive parameter changed to use the rbd-fuse mount as a raw file instead of > direct librbd, and the same Windows VM boots in a fraction of the time with > much lower op/s numbers in the Ceph status output. I assume this is due to > the Linux page cache helping me out with the rbd-fuse mount. > > > > Are the RBD read-ahead settings simply not working? That’s what it looks > like, but I figure I must be doing something wrong. Thanks for any help. > > > > Steve Taylor > > > > 2015-03-17 09:50:19.209721 mon.0 [INF] pgmap v20871: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 3 B/s rd, > 0 op/s > > 2015-03-17 09:50:24.199327 mon.0 [INF] pgmap v20872: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 7 B/s rd, > 0 op/s > > 2015-03-17 10:02:03.471846 mon.0 [INF] pgmap v20873: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1 B/s rd, > 0 op/s > > 2015-03-17 10:02:05.739547 mon.0 [INF] pgmap v20874: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 754 B/s > rd, 0 op/s > > 2015-03-17 10:02:08.008245 mon.0 [INF] pgmap v20875: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 144 kB/s > rd, 156 op/s > > 2015-03-17 10:02:09.286862 mon.0 [INF] pgmap v20876: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 130 kB/s > rd, 147 op/s > > 2015-03-17 10:02:10.543695 mon.0 [INF] pgmap v20877: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 614 kB/s > rd, 614 op/s > > 2015-03-17 10:02:11.832906 mon.0 [INF] pgmap v20878: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 828 kB/s > rd, 828 op/s > > 2015-03-17 10:02:12.998471 mon.0 [INF] pgmap v20879: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 387 kB/s > rd, 387 op/s > > 2015-03-17 10:02:14.378462 mon.0 [INF] pgmap v20880: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 76889 B/s > rd, 75 op/s > > 2015-03-17 10:02:15.656530 mon.0 [INF] pgmap v20881: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 73924 B/s > rd, 72 op/s > > 2015-03-17 10:02:16.935335 mon.0 [INF] pgmap v20882: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 788 kB/s > rd, 788 op/s > > 2015-03-17 10:02:18.213478 mon.0 [INF] pgmap v20883: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 815 kB/s > rd, 815 op/s > > 2015-03-17 10:02:19.391355 mon.0 [INF] pgmap v20884: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 179 kB/s > rd, 2038 B/s wr, 183 op/s > > 2015-03-17 10:02:20.470287 mon.0 [INF] pgmap v20885: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 880 kB/s > rd, 2162 B/s wr, 884 op/s > > 2015-03-17 10:02:24.481794 mon.0 [INF] pgmap v20886: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 861 kB/s > rd, 861 op/s > > 2015-03-17 10:02:29.482878 mon.0 [INF] pgmap v20887: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 565 kB/s > rd, 565 op/s > > 2015-03-17 10:02:30.660130 mon.0 [INF] pgmap v20888: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 456 kB/s > rd, 456 op/s > > 2015-03-17 10:02:34.606273 mon.0 [INF] pgmap v20889: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 75287 B/s > rd, 73 op/s > > 2015-03-17 10:02:35.783596 mon.0 [INF] pgmap v20890: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 498 kB/s > rd, 498 op/s > > 2015-03-17 10:02:37.153032 mon.0 [INF] pgmap v20891: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1045 kB/s > rd, 1045 op/s > > 2015-03-17 10:02:39.964924 mon.0 [INF] pgmap v20892: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 608 kB/s > rd, 608 op/s > > 2015-03-17 10:02:41.254458 mon.0 [INF] pgmap v20893: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 627 kB/s > rd, 627 op/s > > 2015-03-17 10:02:43.610167 mon.0 [INF] pgmap v20894: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail > > 2015-03-17 10:02:45.899723 mon.0 [INF] pgmap v20895: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 527 kB/s > rd, 527 op/s > > 2015-03-17 10:02:48.622893 mon.0 [INF] pgmap v20896: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 860 kB/s > rd, 860 op/s > > 2015-03-17 10:02:50.911971 mon.0 [INF] pgmap v20897: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 401 kB/s > rd, 401 op/s > > 2015-03-17 10:02:53.635378 mon.0 [INF] pgmap v20898: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 586 kB/s > rd, 586 op/s > > 2015-03-17 10:02:58.646913 mon.0 [INF] pgmap v20899: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 690 kB/s > rd, 690 op/s > > 2015-03-17 10:03:03.692158 mon.0 [INF] pgmap v20900: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 363 kB/s > rd, 363 op/s > > 2015-03-17 10:03:04.981368 mon.0 [INF] pgmap v20901: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 470 kB/s > rd, 470 op/s > > 2015-03-17 10:03:06.159172 mon.0 [INF] pgmap v20902: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 919 kB/s > rd, 919 op/s > > 2015-03-17 10:03:08.561356 mon.0 [INF] pgmap v20903: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 237 kB/s > rd, 237 op/s > > 2015-03-17 10:03:09.738691 mon.0 [INF] pgmap v20904: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 414 kB/s > rd, 416 op/s > > 2015-03-17 10:03:11.129509 mon.0 [INF] pgmap v20905: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 556 kB/s > rd, 559 op/s > > 2015-03-17 10:03:12.295674 mon.0 [INF] pgmap v20906: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 225 kB/s > rd, 225 op/s > > 2015-03-17 10:03:14.665069 mon.0 [INF] pgmap v20907: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 790 kB/s > rd, 790 op/s > > 2015-03-17 10:03:19.276405 mon.0 [INF] pgmap v20908: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 552 kB/s > rd, 552 op/s > > 2015-03-17 10:03:20.555160 mon.0 [INF] pgmap v20909: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 474 kB/s > rd, 474 op/s > > 2015-03-17 10:03:24.511301 mon.0 [INF] pgmap v20910: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 796 kB/s > rd, 796 op/s > > 2015-03-17 10:03:29.511593 mon.0 [INF] pgmap v20911: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 570 kB/s > rd, 570 op/s > > 2015-03-17 10:03:32.990465 mon.0 [INF] pgmap v20912: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 331 kB/s > rd, 331 op/s > > 2015-03-17 10:03:35.246022 mon.0 [INF] pgmap v20913: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 295 kB/s > rd, 295 op/s > > 2015-03-17 10:03:37.513926 mon.0 [INF] pgmap v20914: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 522 kB/s > rd, 522 op/s > > 2015-03-17 10:03:38.793046 mon.0 [INF] pgmap v20915: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 557 kB/s > rd, 557 op/s > > 2015-03-17 10:03:40.060172 mon.0 [INF] pgmap v20916: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 522 kB/s > rd, 522 op/s > > 2015-03-17 10:03:41.237340 mon.0 [INF] pgmap v20917: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 281 kB/s > rd, 281 op/s > > 2015-03-17 10:03:42.616491 mon.0 [INF] pgmap v20918: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 345 kB/s > rd, 345 op/s > > 2015-03-17 10:03:43.783635 mon.0 [INF] pgmap v20919: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 705 kB/s > rd, 705 op/s > > 2015-03-17 10:03:45.061879 mon.0 [INF] pgmap v20920: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1055 kB/s > rd, 1055 op/s > > 2015-03-17 10:03:46.441007 mon.0 [INF] pgmap v20921: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 564 kB/s > rd, 564 op/s > > 2015-03-17 10:03:48.709881 mon.0 [INF] pgmap v20922: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 138 kB/s > rd, 138 op/s > > 2015-03-17 10:03:49.999259 mon.0 [INF] pgmap v20923: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 323 kB/s > rd, 323 op/s > > 2015-03-17 10:03:51.176572 mon.0 [INF] pgmap v20924: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 948 kB/s > rd, 948 op/s > > 2015-03-17 10:03:53.534008 mon.0 [INF] pgmap v20925: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 542 kB/s > rd, 542 op/s > > 2015-03-17 10:03:54.812720 mon.0 [INF] pgmap v20926: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 538 kB/s > rd, 538 op/s > > 2015-03-17 10:03:55.989587 mon.0 [INF] pgmap v20927: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 720 kB/s > rd, 720 op/s > > 2015-03-17 10:03:58.395073 mon.0 [INF] pgmap v20928: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 104 kB/s > rd, 104 op/s > > 2015-03-17 10:03:59.685214 mon.0 [INF] pgmap v20929: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 461 kB/s > rd, 461 op/s > > 2015-03-17 10:04:00.851117 mon.0 [INF] pgmap v20930: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1250 kB/s > rd, 1250 op/s > > 2015-03-17 10:04:02.129721 mon.0 [INF] pgmap v20931: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 604 kB/s > rd, 604 op/s > > 2015-03-17 10:04:03.509471 mon.0 [INF] pgmap v20932: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 148 kB/s > rd, 148 op/s > > 2015-03-17 10:04:04.687831 mon.0 [INF] pgmap v20933: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 385 kB/s > rd, 385 op/s > > 2015-03-17 10:04:05.933237 mon.0 [INF] pgmap v20934: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 821 kB/s > rd, 821 op/s > > 2015-03-17 10:04:08.356863 mon.0 [INF] pgmap v20935: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 476 kB/s > rd, 476 op/s > > 2015-03-17 10:04:09.545628 mon.0 [INF] pgmap v20936: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 505 kB/s > rd, 505 op/s > > 2015-03-17 10:04:10.846714 mon.0 [INF] pgmap v20937: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1115 kB/s > rd, 1115 op/s > > 2015-03-17 10:04:14.481198 mon.0 [INF] pgmap v20938: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 300 kB/s > rd, 300 op/s > > 2015-03-17 10:04:15.770863 mon.0 [INF] pgmap v20939: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 588 kB/s > rd, 588 op/s > > 2015-03-17 10:04:18.038033 mon.0 [INF] pgmap v20940: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 771 kB/s > rd, 771 op/s > > 2015-03-17 10:04:19.316903 mon.0 [INF] pgmap v20941: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 130 kB/s > rd, 130 op/s > > 2015-03-17 10:04:20.504842 mon.0 [INF] pgmap v20942: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 121 kB/s > rd, 121 op/s > > 2015-03-17 10:04:21.572500 mon.0 [INF] pgmap v20943: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 282 kB/s > rd, 282 op/s > > 2015-03-17 10:04:22.851725 mon.0 [INF] pgmap v20944: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1353 kB/s > rd, 1353 op/s > > 2015-03-17 10:04:24.129912 mon.0 [INF] pgmap v20945: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1076 kB/s > rd, 1076 op/s > > 2015-03-17 10:04:27.746575 mon.0 [INF] pgmap v20946: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 419 kB/s > rd, 419 op/s > > 2015-03-17 10:04:28.923887 mon.0 [INF] pgmap v20947: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 437 kB/s > rd, 437 op/s > > 2015-03-17 10:04:30.325483 mon.0 [INF] pgmap v20948: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 621 kB/s > rd, 621 op/s > > 2015-03-17 10:04:31.502744 mon.0 [INF] pgmap v20949: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 602 kB/s > rd, 602 op/s > > 2015-03-17 10:04:33.871064 mon.0 [INF] pgmap v20950: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 109 kB/s > rd, 109 op/s > > 2015-03-17 10:04:35.048870 mon.0 [INF] pgmap v20951: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 232 kB/s > rd, 232 op/s > > 2015-03-17 10:04:36.227572 mon.0 [INF] pgmap v20952: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 765 kB/s > rd, 765 op/s > > 2015-03-17 10:04:37.684245 mon.0 [INF] pgmap v20953: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 720 kB/s > rd, 657 op/s > > 2015-03-17 10:04:38.875313 mon.0 [INF] pgmap v20954: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1675 kB/s > rd, 435 op/s > > 2015-03-17 10:04:39.965845 mon.0 [INF] pgmap v20955: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 5030 kB/s > rd, 841 B/s wr, 515 op/s > > 2015-03-17 10:04:41.097895 mon.0 [INF] pgmap v20956: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 4957 kB/s > rd, 20668 B/s wr, 431 op/s > > 2015-03-17 10:04:42.376409 mon.0 [INF] pgmap v20957: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1404 kB/s > rd, 19482 B/s wr, 202 op/s > > 2015-03-17 10:04:43.655129 mon.0 [INF] pgmap v20958: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 634 kB/s > rd, 58 op/s > > 2015-03-17 10:04:44.832699 mon.0 [INF] pgmap v20959: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 6239 kB/s > rd, 581 op/s > > 2015-03-17 10:04:46.112387 mon.0 [INF] pgmap v20960: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 7541 kB/s > rd, 9782 B/s wr, 646 op/s > > 2015-03-17 10:04:47.492910 mon.0 [INF] pgmap v20961: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 3605 kB/s > rd, 9442 B/s wr, 184 op/s > > 2015-03-17 10:04:48.773262 mon.0 [INF] pgmap v20962: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 8985 kB/s > rd, 3147 B/s wr, 209 op/s > > 2015-03-17 10:04:50.053820 mon.0 [INF] pgmap v20963: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 9706 kB/s > rd, 6407 B/s wr, 234 op/s > > 2015-03-17 10:04:51.271915 mon.0 [INF] pgmap v20964: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 11525 kB/s > rd, 27710 B/s wr, 345 op/s > > 2015-03-17 10:04:52.364283 mon.0 [INF] pgmap v20965: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 10135 kB/s > rd, 27162 B/s wr, 323 op/s > > 2015-03-17 10:04:53.498020 mon.0 [INF] pgmap v20966: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 2659 kB/s > rd, 7085 B/s wr, 234 op/s > > 2015-03-17 10:04:54.788609 mon.0 [INF] pgmap v20967: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 5288 kB/s > rd, 23027 B/s wr, 399 op/s > > 2015-03-17 10:04:56.069884 mon.0 [INF] pgmap v20968: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 7420 kB/s > rd, 63889 B/s wr, 514 op/s > > 2015-03-17 10:04:57.343814 mon.0 [INF] pgmap v20969: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 5959 kB/s > rd, 50637 B/s wr, 396 op/s > > 2015-03-17 10:04:58.530908 mon.0 [INF] pgmap v20970: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 3849 kB/s > rd, 36271 B/s wr, 220 op/s > > 2015-03-17 10:04:59.678533 mon.0 [INF] pgmap v20971: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 9873 kB/s > rd, 81353 B/s wr, 496 op/s > > 2015-03-17 10:05:00.784316 mon.0 [INF] pgmap v20972: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 14101 kB/s > rd, 110 kB/s wr, 715 op/s > > 2015-03-17 10:05:01.912176 mon.0 [INF] pgmap v20973: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 7575 kB/s > rd, 62578 B/s wr, 401 op/s > > 2015-03-17 10:05:03.193227 mon.0 [INF] pgmap v20974: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 4121 kB/s > rd, 454 kB/s wr, 225 op/s > > 2015-03-17 10:05:04.497318 mon.0 [INF] pgmap v20975: 8192 pgs: 8192 > active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 5943 kB/s > rd, 848 kB/s wr, 403 op/s > > 2015-03-17 10:05:05.832782 mon.0 [INF] pgmap v20976: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 8673 kB/s > rd, 1365 kB/s wr, 596 op/s > > 2015-03-17 10:05:07.152474 mon.0 [INF] pgmap v20977: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 6227 kB/s > rd, 1745 kB/s wr, 419 op/s > > 2015-03-17 10:05:08.441195 mon.0 [INF] pgmap v20978: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 1591 kB/s > rd, 791 kB/s wr, 136 op/s > > 2015-03-17 10:05:09.721208 mon.0 [INF] pgmap v20979: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2478 kB/s > rd, 3919 B/s wr, 193 op/s > > 2015-03-17 10:05:10.997558 mon.0 [INF] pgmap v20980: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 3922 kB/s > rd, 50239 B/s wr, 257 op/s > > 2015-03-17 10:05:12.275103 mon.0 [INF] pgmap v20981: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2262 kB/s > rd, 46455 B/s wr, 142 op/s > > 2015-03-17 10:05:13.453351 mon.0 [INF] pgmap v20982: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 1515 kB/s > rd, 3260 B/s wr, 93 op/s > > 2015-03-17 10:05:14.557189 mon.0 [INF] pgmap v20983: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 3568 kB/s > rd, 99024 B/s wr, 223 op/s > > 2015-03-17 10:05:15.692062 mon.0 [INF] pgmap v20984: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 5324 kB/s > rd, 140 kB/s wr, 339 op/s > > 2015-03-17 10:05:16.968958 mon.0 [INF] pgmap v20985: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 3938 kB/s > rd, 59936 B/s wr, 254 op/s > > 2015-03-17 10:05:18.245603 mon.0 [INF] pgmap v20986: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2164 kB/s > rd, 18338 B/s wr, 134 op/s > > 2015-03-17 10:05:19.526337 mon.0 [INF] pgmap v20987: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 5368 kB/s > rd, 3203 B/s wr, 244 op/s > > 2015-03-17 10:05:20.804013 mon.0 [INF] pgmap v20988: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 10160 kB/s > rd, 1601 B/s wr, 455 op/s > > 2015-03-17 10:05:22.082049 mon.0 [INF] pgmap v20989: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 7102 kB/s > rd, 1601 B/s wr, 324 op/s > > 2015-03-17 10:05:23.270817 mon.0 [INF] pgmap v20990: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 3618 kB/s > rd, 164 op/s > > 2015-03-17 10:05:24.428232 mon.0 [INF] pgmap v20991: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 7165 kB/s > rd, 1720 B/s wr, 315 op/s > > 2015-03-17 10:05:25.520324 mon.0 [INF] pgmap v20992: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 9056 kB/s > rd, 37377 B/s wr, 400 op/s > > 2015-03-17 10:05:26.651862 mon.0 [INF] pgmap v20993: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 7138 kB/s > rd, 35763 B/s wr, 325 op/s > > 2015-03-17 10:05:27.930974 mon.0 [INF] pgmap v20994: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 3809 kB/s > rd, 9343 B/s wr, 192 op/s > > 2015-03-17 10:05:29.289967 mon.0 [INF] pgmap v20995: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2451 kB/s > rd, 47276 B/s wr, 159 op/s > > 2015-03-17 10:05:30.489020 mon.0 [INF] pgmap v20996: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 4055 kB/s > rd, 53135 B/s wr, 329 op/s > > 2015-03-17 10:05:31.589897 mon.0 [INF] pgmap v20997: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 4079 kB/s > rd, 35653 B/s wr, 328 op/s > > 2015-03-17 10:05:32.879243 mon.0 [INF] pgmap v20998: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2268 kB/s > rd, 21360 B/s wr, 168 op/s > > 2015-03-17 10:05:34.170379 mon.0 [INF] pgmap v20999: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2949 kB/s > rd, 1652 B/s wr, 202 op/s > > 2015-03-17 10:05:35.440131 mon.0 [INF] pgmap v21000: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 5426 kB/s > rd, 6271 B/s wr, 359 op/s > > 2015-03-17 10:05:36.715360 mon.0 [INF] pgmap v21001: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 5713 kB/s > rd, 10055 B/s wr, 371 op/s > > 2015-03-17 10:05:37.991711 mon.0 [INF] pgmap v21002: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 3294 kB/s > rd, 3619 B/s wr, 166 op/s > > 2015-03-17 10:05:39.179736 mon.0 [INF] pgmap v21003: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2880 kB/s > rd, 27590 B/s wr, 119 op/s > > 2015-03-17 10:05:40.271971 mon.0 [INF] pgmap v21004: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 3595 kB/s > rd, 77124 B/s wr, 191 op/s > > 2015-03-17 10:05:41.406527 mon.0 [INF] pgmap v21005: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2750 kB/s > rd, 57515 B/s wr, 168 op/s > > 2015-03-17 10:05:42.582659 mon.0 [INF] pgmap v21006: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 1893 kB/s > rd, 22107 B/s wr, 106 op/s > > 2015-03-17 10:05:43.728560 mon.0 [INF] pgmap v21007: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2213 kB/s > rd, 65435 B/s wr, 132 op/s > > 2015-03-17 10:05:44.819652 mon.0 [INF] pgmap v21008: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 1899 kB/s > rd, 136 kB/s wr, 132 op/s > > 2015-03-17 10:05:45.965061 mon.0 [INF] pgmap v21009: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 921 kB/s > rd, 145 kB/s wr, 86 op/s > > 2015-03-17 10:05:47.264299 mon.0 [INF] pgmap v21010: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 288 kB/s > rd, 65213 B/s wr, 40 op/s > > 2015-03-17 10:05:48.452603 mon.0 [INF] pgmap v21011: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 176 kB/s > rd, 9210 B/s wr, 16 op/s > > 2015-03-17 10:05:49.555159 mon.0 [INF] pgmap v21012: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 179 kB/s > rd, 38383 B/s wr, 31 op/s > > 2015-03-17 10:05:50.677028 mon.0 [INF] pgmap v21013: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 67965 B/s > wr, 29 op/s > > 2015-03-17 10:05:53.699362 mon.0 [INF] pgmap v21014: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 17292 B/s > wr, 6 op/s > > 2015-03-17 10:05:54.989031 mon.0 [INF] pgmap v21015: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 1466 B/s > wr, 0 op/s > > 2015-03-17 10:05:56.166680 mon.0 [INF] pgmap v21016: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 42048 B/s > wr, 17 op/s > > 2015-03-17 10:05:57.590742 mon.0 [INF] pgmap v21017: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 39704 B/s > wr, 16 op/s > > 2015-03-17 10:05:58.779233 mon.0 [INF] pgmap v21018: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 1574 B/s > rd, 77146 B/s wr, 6 op/s > > 2015-03-17 10:05:59.891952 mon.0 [INF] pgmap v21019: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 13585 B/s > rd, 117 kB/s wr, 9 op/s > > 2015-03-17 10:06:01.026348 mon.0 [INF] pgmap v21020: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 12460 B/s > rd, 122 kB/s wr, 14 op/s > > 2015-03-17 10:06:02.338654 mon.0 [INF] pgmap v21021: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 85076 B/s > wr, 11 op/s > > 2015-03-17 10:06:03.639856 mon.0 [INF] pgmap v21022: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 8219 B/s > wr, 4 op/s > > 2015-03-17 10:06:04.941046 mon.0 [INF] pgmap v21023: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 25074 B/s > rd, 45838 B/s wr, 11 op/s > > 2015-03-17 10:06:06.263902 mon.0 [INF] pgmap v21024: 8192 pgs: 8192 > active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 25192 B/s > rd, 75971 B/s wr, 14 op/s > > > > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > -- Andrija Panić
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
