Re: [Gluster-users] ZFS with SSD ZIL vs XFS
Hi, Have you thought about using an SSD as a GlusterFS hot tiers? Regards, Bartosz On 10.10.2017 19:59, Gandalf Corvotempesta wrote: 2017-10-10 18:27 GMT+02:00 Jeff Darcy : Probably not. If there is, it would probably favor XFS. The developers at Red Hat use XFS almost exclusively. We at Facebook have a mix, but XFS is (I think) the most common. Whatever the developers use tends to become "the way local filesystems work" and code is written based on that profile, so even without intention that tends to get a bit of a boost. To the extent that ZFS makes different tradeoffs - e.g. using lots more memory, very different disk access patterns - it's probably going to have a bit more of an "impedance mismatch" with the choices Gluster itself has made. Ok, so XFS is the way to go :) ___ Gluster-users mailing list Gluster-users@gluster.org http://lists.gluster.org/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://lists.gluster.org/mailman/listinfo/gluster-users
Re: [Gluster-users] ZFS with SSD ZIL vs XFS
Last time I've read about tiering in gluster, there wasn't any performance gain with VM workload and more over doesn't speed up writes... Il 10 ott 2017 9:27 PM, "Bartosz Zięba" ha scritto: > Hi, > > Have you thought about using an SSD as a GlusterFS hot tiers? > > Regards, > Bartosz > > > On 10.10.2017 19:59, Gandalf Corvotempesta wrote: > >> 2017-10-10 18:27 GMT+02:00 Jeff Darcy : >> >>> Probably not. If there is, it would probably favor XFS. The developers >>> at Red Hat use XFS almost exclusively. We at Facebook have a mix, but >>> XFS is (I think) the most common. Whatever the developers use tends to >>> become "the way local filesystems work" and code is written based on >>> that profile, so even without intention that tends to get a bit of a >>> boost. To the extent that ZFS makes different tradeoffs - e.g. using >>> lots more memory, very different disk access patterns - it's probably >>> going to have a bit more of an "impedance mismatch" with the choices >>> Gluster itself has made. >>> >> Ok, so XFS is the way to go :) >> ___ >> Gluster-users mailing list >> Gluster-users@gluster.org >> http://lists.gluster.org/mailman/listinfo/gluster-users >> > > > ___ Gluster-users mailing list Gluster-users@gluster.org http://lists.gluster.org/mailman/listinfo/gluster-users
Re: [Gluster-users] ZFS with SSD ZIL vs XFS
Any performance report to share? Il 10 ott 2017 8:25 PM, "Dmitri Chebotarov" <4dim...@gmail.com> ha scritto: > > I've had good results with using SSD as LVM cache for gluster bricks ( > http://man7.org/linux/man-pages/man7/lvmcache.7.html). I still use XFS on > bricks. > > > > On Tue, Oct 10, 2017 at 12:27 PM, Jeff Darcy wrote: > >> On Tue, Oct 10, 2017, at 11:19 AM, Gandalf Corvotempesta wrote: >> > Anyone made some performance comparison between XFS and ZFS with ZIL >> > on SSD, in gluster environment ? >> > >> > I've tried to compare both on another SDS (LizardFS) and I haven't >> > seen any tangible performance improvement. >> > >> > Is gluster different ? >> >> Probably not. If there is, it would probably favor XFS. The developers >> at Red Hat use XFS almost exclusively. We at Facebook have a mix, but >> XFS is (I think) the most common. Whatever the developers use tends to >> become "the way local filesystems work" and code is written based on >> that profile, so even without intention that tends to get a bit of a >> boost. To the extent that ZFS makes different tradeoffs - e.g. using >> lots more memory, very different disk access patterns - it's probably >> going to have a bit more of an "impedance mismatch" with the choices >> Gluster itself has made. >> >> If you're interested in ways to benefit from a disk+SSD combo under XFS, >> it is possible to configure XFS with a separate journal device but I >> believe there were some bugs encountered when doing that. Richard >> Wareing's upcoming Dev Summit talk on Hybrid XFS might cover those, in >> addition to his own work on using an SSD in even more interesting ways. >> ___ >> Gluster-users mailing list >> Gluster-users@gluster.org >> http://lists.gluster.org/mailman/listinfo/gluster-users >> > > > ___ > Gluster-users mailing list > Gluster-users@gluster.org > http://lists.gluster.org/mailman/listinfo/gluster-users > ___ Gluster-users mailing list Gluster-users@gluster.org http://lists.gluster.org/mailman/listinfo/gluster-users
Re: [Gluster-users] ZFS with SSD ZIL vs XFS
2017-10-10 18:27 GMT+02:00 Jeff Darcy : > Probably not. If there is, it would probably favor XFS. The developers > at Red Hat use XFS almost exclusively. We at Facebook have a mix, but > XFS is (I think) the most common. Whatever the developers use tends to > become "the way local filesystems work" and code is written based on > that profile, so even without intention that tends to get a bit of a > boost. To the extent that ZFS makes different tradeoffs - e.g. using > lots more memory, very different disk access patterns - it's probably > going to have a bit more of an "impedance mismatch" with the choices > Gluster itself has made. Ok, so XFS is the way to go :) ___ Gluster-users mailing list Gluster-users@gluster.org http://lists.gluster.org/mailman/listinfo/gluster-users
Re: [Gluster-users] ZFS with SSD ZIL vs XFS
I've had good results with using SSD as LVM cache for gluster bricks ( http://man7.org/linux/man-pages/man7/lvmcache.7.html). I still use XFS on bricks. On Tue, Oct 10, 2017 at 12:27 PM, Jeff Darcy wrote: > On Tue, Oct 10, 2017, at 11:19 AM, Gandalf Corvotempesta wrote: > > Anyone made some performance comparison between XFS and ZFS with ZIL > > on SSD, in gluster environment ? > > > > I've tried to compare both on another SDS (LizardFS) and I haven't > > seen any tangible performance improvement. > > > > Is gluster different ? > > Probably not. If there is, it would probably favor XFS. The developers > at Red Hat use XFS almost exclusively. We at Facebook have a mix, but > XFS is (I think) the most common. Whatever the developers use tends to > become "the way local filesystems work" and code is written based on > that profile, so even without intention that tends to get a bit of a > boost. To the extent that ZFS makes different tradeoffs - e.g. using > lots more memory, very different disk access patterns - it's probably > going to have a bit more of an "impedance mismatch" with the choices > Gluster itself has made. > > If you're interested in ways to benefit from a disk+SSD combo under XFS, > it is possible to configure XFS with a separate journal device but I > believe there were some bugs encountered when doing that. Richard > Wareing's upcoming Dev Summit talk on Hybrid XFS might cover those, in > addition to his own work on using an SSD in even more interesting ways. > ___ > Gluster-users mailing list > Gluster-users@gluster.org > http://lists.gluster.org/mailman/listinfo/gluster-users > ___ Gluster-users mailing list Gluster-users@gluster.org http://lists.gluster.org/mailman/listinfo/gluster-users
Re: [Gluster-users] ZFS with SSD ZIL vs XFS
On Tue, Oct 10, 2017, at 11:19 AM, Gandalf Corvotempesta wrote: > Anyone made some performance comparison between XFS and ZFS with ZIL > on SSD, in gluster environment ? > > I've tried to compare both on another SDS (LizardFS) and I haven't > seen any tangible performance improvement. > > Is gluster different ? Probably not. If there is, it would probably favor XFS. The developers at Red Hat use XFS almost exclusively. We at Facebook have a mix, but XFS is (I think) the most common. Whatever the developers use tends to become "the way local filesystems work" and code is written based on that profile, so even without intention that tends to get a bit of a boost. To the extent that ZFS makes different tradeoffs - e.g. using lots more memory, very different disk access patterns - it's probably going to have a bit more of an "impedance mismatch" with the choices Gluster itself has made. If you're interested in ways to benefit from a disk+SSD combo under XFS, it is possible to configure XFS with a separate journal device but I believe there were some bugs encountered when doing that. Richard Wareing's upcoming Dev Summit talk on Hybrid XFS might cover those, in addition to his own work on using an SSD in even more interesting ways. ___ Gluster-users mailing list Gluster-users@gluster.org http://lists.gluster.org/mailman/listinfo/gluster-users
[Gluster-users] ZFS with SSD ZIL vs XFS
Anyone made some performance comparison between XFS and ZFS with ZIL on SSD, in gluster environment ? I've tried to compare both on another SDS (LizardFS) and I haven't seen any tangible performance improvement. Is gluster different ? ___ Gluster-users mailing list Gluster-users@gluster.org http://lists.gluster.org/mailman/listinfo/gluster-users
