Re: [ceph-users] Storing VM Images on CEPH with RBD-QEMU driver

2013-12-20 Thread Dan van der Ster
On Fri, Dec 20, 2013 at 6:19 PM, James Pearce wrote: > > "fio --size=100m --ioengine=libaio --invalidate=1 --direct=1 --numjobs=10 > --rw=read --name=fiojob --blocksize_range=4K-512k --iodepth=16" > > Since size=100m so reads would be entirely cached --invalidate=1 drops the cache, no? Our result

Re: [ceph-users] Storing VM Images on CEPH with RBD-QEMU driver

2013-12-20 Thread James Pearce
"fio --size=100m --ioengine=libaio --invalidate=1 --direct=1 --numjobs=10 --rw=read --name=fiojob --blocksize_range=4K-512k --iodepth=16" Since size=100m so reads would be entirely cached and, if hypervisor is write-back, potentially many writes would never make it to the cluster as well?

Re: [ceph-users] Storing VM Images on CEPH with RBD-QEMU driver

2013-12-20 Thread Christian Balzer
Hello Dan, On Fri, 20 Dec 2013 14:01:04 +0100 Dan van der Ster wrote: > On Fri, Dec 20, 2013 at 9:44 AM, Christian Balzer wrote: > > > > Hello, > > > > On Fri, 20 Dec 2013 09:20:48 +0100 Dan van der Ster wrote: > > > >> Hi, > >> Our fio tests against qemu-kvm on RBD look quite promising, detail

Re: [ceph-users] Storing VM Images on CEPH with RBD-QEMU driver

2013-12-20 Thread Dan van der Ster
On Fri, Dec 20, 2013 at 9:44 AM, Christian Balzer wrote: > > Hello, > > On Fri, 20 Dec 2013 09:20:48 +0100 Dan van der Ster wrote: > >> Hi, >> Our fio tests against qemu-kvm on RBD look quite promising, details here: >> >> https://docs.google.com/spreadsheet/ccc?key=0AoB4ekP8AM3RdGlDaHhoSV81MDhUS2

Re: [ceph-users] Storing VM Images on CEPH with RBD-QEMU driver

2013-12-20 Thread Peder Jansson
- Original Message - From: "Wido den Hollander" To: ceph-users@lists.ceph.com Sent: Friday, December 20, 2013 8:04:09 AM Subject: Re: [ceph-users] Storing VM Images on CEPH with RBD-QEMU driver Hi, > Hi, > > I'm testing CEPH with the RBD/QEMU driver throug

Re: [ceph-users] Storing VM Images on CEPH with RBD-QEMU driver

2013-12-20 Thread Christian Balzer
Hello, On Fri, 20 Dec 2013 09:20:48 +0100 Dan van der Ster wrote: > Hi, > Our fio tests against qemu-kvm on RBD look quite promising, details here: > > https://docs.google.com/spreadsheet/ccc?key=0AoB4ekP8AM3RdGlDaHhoSV81MDhUS25EUVZxdmN6WHc&usp=drive_web#gid=0 > That data is very interesting a

Re: [ceph-users] Storing VM Images on CEPH with RBD-QEMU driver

2013-12-20 Thread Dan van der Ster
Hi, Our fio tests against qemu-kvm on RBD look quite promising, details here: https://docs.google.com/spreadsheet/ccc?key=0AoB4ekP8AM3RdGlDaHhoSV81MDhUS25EUVZxdmN6WHc&usp=drive_web#gid=0 tl;dr: rbd with caching enabled is (1) at least 2x faster than the local instance storage, and (2) reaches the

Re: [ceph-users] Storing VM Images on CEPH with RBD-QEMU driver

2013-12-19 Thread Wido den Hollander
On 12/19/2013 04:00 PM, Peder Jansson wrote: Hi, I'm testing CEPH with the RBD/QEMU driver through libvirt to store my VM images on. Installation and configuration all went very well with the ceph-deploy tool. I have set up authx authentication in libvirt and that works like a charm too. Howeve

[ceph-users] Storing VM Images on CEPH with RBD-QEMU driver

2013-12-19 Thread Peder Jansson
Hi, I'm testing CEPH with the RBD/QEMU driver through libvirt to store my VM images on. Installation and configuration all went very well with the ceph-deploy tool. I have set up authx authentication in libvirt and that works like a charm too. However, when coming to performance I have big iss