Re: [Gluster-users] QEMU-GlusterFS native integration demo video
Ok, thanks for clarifying Bharata. Looking forward to see the next version results. Regards, Fernando -Original Message- From: Bharata B Rao [mailto:bharata@gmail.com] Sent: 03 September 2012 10:19 To: Fernando Frediani (Qube) Cc: gluster-users@gluster.org Subject: Re: [Gluster-users] QEMU-GlusterFS native integration demo video On Mon, Sep 3, 2012 at 2:42 PM, Fernando Frediani (Qube) wrote: > Hi Bharata, > > I am interested to see the performance for read and writes separately. > Aggregated will probably be much influenced by the read performance. Sorry if it was not explicit from those URLs, but the numbers you see are separate for reads and writes. Aggregated means that the result is aggregated from 4 write or read requests that run simultaneously as part of either write or read test. > > Interesting the last figures, seems quiet a significant performance gain > using the QEMU-GlusterFS. Right. > > See if you can get the results for read and writes separately. I am working on next version of the patches that will work with the latest libgfapi. I will try to re-generate these numbers for the latest version. Regards, Bharata. ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] QEMU-GlusterFS native integration demo video
On Mon, Sep 3, 2012 at 2:42 PM, Fernando Frediani (Qube) wrote: > Hi Bharata, > > I am interested to see the performance for read and writes separately. > Aggregated will probably be much influenced by the read performance. Sorry if it was not explicit from those URLs, but the numbers you see are separate for reads and writes. Aggregated means that the result is aggregated from 4 write or read requests that run simultaneously as part of either write or read test. > > Interesting the last figures, seems quiet a significant performance gain > using the QEMU-GlusterFS. Right. > > See if you can get the results for read and writes separately. I am working on next version of the patches that will work with the latest libgfapi. I will try to re-generate these numbers for the latest version. Regards, Bharata. ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] QEMU-GlusterFS native integration demo video
Hi Bharata, I am interested to see the performance for read and writes separately. Aggregated will probably be much influenced by the read performance. Interesting the last figures, seems quiet a significant performance gain using the QEMU-GlusterFS. See if you can get the results for read and writes separately. Best regards, Fernando -Original Message- From: Bharata B Rao [mailto:bharata@gmail.com] Sent: 03 September 2012 10:01 To: Fernando Frediani (Qube) Cc: gluster-users@gluster.org Subject: Re: [Gluster-users] QEMU-GlusterFS native integration demo video On Mon, Sep 3, 2012 at 2:14 PM, Fernando Frediani (Qube) wrote: > Hi Bharata > Thanks for this, very useful. > > Would you be able to specify tests with mainly reads and writes. As far as I > know there is a big hit and poor performance on writes in normal fuse mounts. Ok, here are the aggregated bandwidth numbers from a quick FIO (4 seq writes using libaio) write test: Base: 189667KB/s QEMU-GlusterFS native: 150635KB/s QEMU-GlusterFS FUSE: 43028KB/s So as you can see, native is much better than FUSE, but still doesn't match the base numbers. When I say base, it means that the guest is run directly from glusterfs brick (w/o gluster FUSE mount or using QEMU-GlusterFS native driver). > Are you using IOmeter or bonnie ? FIO at the moment. Plan to include more benchmark numbers in future. Any help here would be appreciated :) > > Seems the results with fuse and the native qemu-glusterfs are pretty similar, > am I right ? No, QEMU-GlusterFS native numbers are way better than FUSE. Let me quote the numbers from the URL I gave earlier: Base: 63076KB/s QEMU-GlusterFS native: 53609KB/s QEMU-GlusterFS FUSE: 29392KB/s Regards, Bharata. ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] QEMU-GlusterFS native integration demo video
On Mon, Sep 3, 2012 at 2:14 PM, Fernando Frediani (Qube) wrote: > Hi Bharata > Thanks for this, very useful. > > Would you be able to specify tests with mainly reads and writes. As far as I > know there is a big hit and poor performance on writes in normal fuse mounts. Ok, here are the aggregated bandwidth numbers from a quick FIO (4 seq writes using libaio) write test: Base: 189667KB/s QEMU-GlusterFS native: 150635KB/s QEMU-GlusterFS FUSE: 43028KB/s So as you can see, native is much better than FUSE, but still doesn't match the base numbers. When I say base, it means that the guest is run directly from glusterfs brick (w/o gluster FUSE mount or using QEMU-GlusterFS native driver). > Are you using IOmeter or bonnie ? FIO at the moment. Plan to include more benchmark numbers in future. Any help here would be appreciated :) > > Seems the results with fuse and the native qemu-glusterfs are pretty similar, > am I right ? No, QEMU-GlusterFS native numbers are way better than FUSE. Let me quote the numbers from the URL I gave earlier: Base: 63076KB/s QEMU-GlusterFS native: 53609KB/s QEMU-GlusterFS FUSE: 29392KB/s Regards, Bharata. ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] QEMU-GlusterFS native integration demo video
Hi Bharata Thanks for this, very useful. Would you be able to specify tests with mainly reads and writes. As far as I know there is a big hit and poor performance on writes in normal fuse mounts. Are you using IOmeter or bonnie ? Seems the results with fuse and the native qemu-glusterfs are pretty similar, am I right ? Regards, Fernando -Original Message- From: Bharata B Rao [mailto:bharata@gmail.com] Sent: 03 September 2012 06:54 To: Fernando Frediani (Qube) Cc: gluster-users@gluster.org Subject: Re: [Gluster-users] QEMU-GlusterFS native integration demo video On Tue, Aug 28, 2012 at 3:04 PM, Fernando Frediani (Qube) wrote: > Thanks for sharing it with us Bharata. > > I saw you have two nodes. Have you done any performance tests and if so how > they compare with creating normal .qcow2 or .raw files on the filesystem, > specially for the writes ? Fernando, In the video I was using a single node system (local brick). However I have tested QEMU-GlusterFS with 2 node scenario too. I have some performance numbers that compare the QEMU-GlusterFS native integration with QEMU-GlusterFS FUSE mount. Were you looking for anything different ? I don't have numbers for qcow2 or for create, but have numbers for reads for raw files. FIO numbers for read can be found here: http://lists.nongnu.org/archive/html/qemu-devel/2012-07/msg02718.html http://lists.gnu.org/archive/html/gluster-devel/2012-08/msg00063.html I am planning to publish more numbers for other scenarios (qcow2 and writes etc) in future. Regards, Bharata. ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] QEMU-GlusterFS native integration demo video
On Wed, Aug 29, 2012 at 3:56 AM, Bryan Whitehead wrote: > I'd just like to also state this is fantastic. I hope the performance > will match. Bryan, Feel free to try out the patches and let us know if you find any discrepancies in performance numbers. Regards, Bharata. ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] QEMU-GlusterFS native integration demo video
On Sat, Sep 1, 2012 at 4:42 AM, Nux! wrote: > Nicely done! > I wonder if this feature will be ever backported to EL6 KVM. > Also, if anyone knows, would there be any performance benefit from using > this method instead of using the raw file in a mounted glusterfs dir? There is a good performance improvement in using this method instead of using raw VM image file from gluster FUSE mount. Refer to the FIO performance numbers from these mailing thread discussions: http://lists.nongnu.org/archive/html/qemu-devel/2012-07/msg02718.html http://lists.gnu.org/archive/html/gluster-devel/2012-08/msg00063.html Regards, Bharata. ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] QEMU-GlusterFS native integration demo video
On Tue, Aug 28, 2012 at 3:04 PM, Fernando Frediani (Qube) wrote: > Thanks for sharing it with us Bharata. > > I saw you have two nodes. Have you done any performance tests and if so how > they compare with creating normal .qcow2 or .raw files on the filesystem, > specially for the writes ? Fernando, In the video I was using a single node system (local brick). However I have tested QEMU-GlusterFS with 2 node scenario too. I have some performance numbers that compare the QEMU-GlusterFS native integration with QEMU-GlusterFS FUSE mount. Were you looking for anything different ? I don't have numbers for qcow2 or for create, but have numbers for reads for raw files. FIO numbers for read can be found here: http://lists.nongnu.org/archive/html/qemu-devel/2012-07/msg02718.html http://lists.gnu.org/archive/html/gluster-devel/2012-08/msg00063.html I am planning to publish more numbers for other scenarios (qcow2 and writes etc) in future. Regards, Bharata. ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] QEMU-GlusterFS native integration demo video
On 28.08.2012 05:13, Bharata B Rao wrote: Hi, If you are interested and/or curious to know how QEMU can be used to create and boot VM's from GlusterFS volume, take a look at the demo video I have created at: www.youtube.com/watch?v=JG3kF_djclg Regards, Bharata. Nicely done! I wonder if this feature will be ever backported to EL6 KVM. Also, if anyone knows, would there be any performance benefit from using this method instead of using the raw file in a mounted glusterfs dir? -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] QEMU-GlusterFS native integration demo video
I'd just like to also state this is fantastic. I hope the performance will match. On Tue, Aug 28, 2012 at 2:34 AM, Fernando Frediani (Qube) wrote: > Thanks for sharing it with us Bharata. > > I saw you have two nodes. Have you done any performance tests and if so how > they compare with creating normal .qcow2 or .raw files on the filesystem, > specially for the writes ? > > Thanks > > Fernando > > -Original Message- > From: gluster-users-boun...@gluster.org > [mailto:gluster-users-boun...@gluster.org] On Behalf Of Bharata B Rao > Sent: 28 August 2012 05:14 > To: gluster-users@gluster.org; gluster-de...@nongnu.org > Subject: [Gluster-users] QEMU-GlusterFS native integration demo video > > Hi, > > If you are interested and/or curious to know how QEMU can be used to create > and boot VM's from GlusterFS volume, take a look at the demo video I have > created at: > > www.youtube.com/watch?v=JG3kF_djclg > > Regards, > Bharata. > -- > http://bharata.sulekha.com/blog/posts.htm, http://raobharata.wordpress.com/ > ___ > Gluster-users mailing list > Gluster-users@gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > ___ > Gluster-users mailing list > Gluster-users@gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] QEMU-GlusterFS native integration demo video
Thanks for sharing it with us Bharata. I saw you have two nodes. Have you done any performance tests and if so how they compare with creating normal .qcow2 or .raw files on the filesystem, specially for the writes ? Thanks Fernando -Original Message- From: gluster-users-boun...@gluster.org [mailto:gluster-users-boun...@gluster.org] On Behalf Of Bharata B Rao Sent: 28 August 2012 05:14 To: gluster-users@gluster.org; gluster-de...@nongnu.org Subject: [Gluster-users] QEMU-GlusterFS native integration demo video Hi, If you are interested and/or curious to know how QEMU can be used to create and boot VM's from GlusterFS volume, take a look at the demo video I have created at: www.youtube.com/watch?v=JG3kF_djclg Regards, Bharata. -- http://bharata.sulekha.com/blog/posts.htm, http://raobharata.wordpress.com/ ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
