Re: [Openstack] [Swift] Swift on RHEL
On 12/10/2013 06:24 PM, Kotwani, Mukul wrote: 2.6.18, not sure about the IO schedulers. The default scheduler could be different. Is the expected performance between the schedulers supposed to be that dramatically different? I expect redhat didn't backport CFS to 2.6.18 -- that's the process scheduler, not i/o. Whether it'd make a difference depends on your job mix, of course. But in general if it were centos/sl you could try installing kernel-ml from elrepo and then running your comparison. If it's rhel: talk to redhat (and they'll probably advise you to upgrade to 6.5 if not 7). -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] [Swift] Swift on RHEL
On Wed, Dec 11, 2013 at 12:53 AM, Kotwani, Mukul mukul.g.kotw...@hp.com wrote: Hey John, Ubuntu is 13.04 and Redhat is 5.8. So its 2x vs 3x kernel ? ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] [Swift] Swift on RHEL
Hey John, Ubuntu is 13.04 and Redhat is 5.8. Mukul -Original Message- From: John Smith [mailto:lbalba...@gmail.com] Sent: Tuesday, December 10, 2013 3:49 PM To: Kotwani, Mukul Cc: Pete Zaitcev; OpenStack Mailing List Subject: Re: [Openstack] [Swift] Swift on RHEL Hi, What verslons of RHEL and Ubuntu are you comparing ? Regards, John Smith On Wed, Dec 11, 2013 at 12:23 AM, Kotwani, Mukul mukul.g.kotw...@hp.com wrote: A new piece of data.. We used the disable_fallocate configurable on Ubuntu, and the numbers do reduce, but they are nowhere near the numbers for Redhat (5.8). As an example, for a specific test: PUT for Ubuntu, default parameters: ~140 ops/sec PUT for Ubuntu, disable_fallocate=true: ~100 ops/sec PUT for Redhat 5.8, default parameters: ~15 ops/sec Has anyone seen this? We are not able to find anything that can explain this kind of discrepancy. FYI, this is the same hardware(we are switching between Ubuntu and RH, to keep things the same) and software(Swift and xfs, same versions for both), same ring configuration, same test scripts. It seems like Ubuntu is far ahead, and we don't have any root cause ATM. PUTs are written though to the disk and not cached, so I am not sure what to attribute this to. Has anyone run Swift on RH and done comparisons with Ubuntu? Any help/pointers would be great! Thanks, Mukul -Original Message- From: Kotwani, Mukul Sent: Thursday, December 05, 2013 6:44 PM To: Pete Zaitcev Cc: OpenStack Mailing List Subject: Re: [Openstack] [Swift] Swift on RHEL Thanks Pete! We were using Grizzly, which is over a release old, with Folsom Keystone for RHEL. So not recent at all. Is there something that would be missing in RHEL5.x which would cause performance issues? I saw some references to fallocate, but not much beyond that. Is this something you would expect to see? Which was the first RHEL release was Swift supported on officially? I tried to find a support matrix or supportable platforms but could not find anything.. Mukul -Original Message- From: Pete Zaitcev [mailto:zait...@redhat.com] Sent: Thursday, December 05, 2013 4:36 PM To: Kotwani, Mukul Cc: OpenStack Mailing List Subject: Re: [Openstack] [Swift] Swift on RHEL On Thu, 5 Dec 2013 21:19:49 + Kotwani, Mukul mukul.g.kotw...@hp.com wrote: Has anyone used and/or deployed RHEL (5.8) with Swift? I was also looking for a Supported platforms for Swift, and I could not find it. I don't think an RDO for RHEL 5.x ever existed. First packages were built a year after RHEL 6 GA shipped. The oldest build in Koji is openstack-swift-1.0.2-5.fc15 (a community build by Silas), and the oldest RHOS build is openstack-swift-1.4.8-2.el6 from 2012. Frankly I'm surprised you managed to get it running at all. (Which Swift release is that, BTW? We even require PBR nowadays.) I dimly remember bothering with XFS for RHEL 5, but it was so long ago that I cannot even remember if I got that cluster to do anything useful. -- Pete ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] [Swift] Swift on RHEL
Hi, What verslons of RHEL and Ubuntu are you comparing ? Regards, John Smith On Wed, Dec 11, 2013 at 12:23 AM, Kotwani, Mukul mukul.g.kotw...@hp.com wrote: A new piece of data.. We used the disable_fallocate configurable on Ubuntu, and the numbers do reduce, but they are nowhere near the numbers for Redhat (5.8). As an example, for a specific test: PUT for Ubuntu, default parameters: ~140 ops/sec PUT for Ubuntu, disable_fallocate=true: ~100 ops/sec PUT for Redhat 5.8, default parameters: ~15 ops/sec Has anyone seen this? We are not able to find anything that can explain this kind of discrepancy. FYI, this is the same hardware(we are switching between Ubuntu and RH, to keep things the same) and software(Swift and xfs, same versions for both), same ring configuration, same test scripts. It seems like Ubuntu is far ahead, and we don't have any root cause ATM. PUTs are written though to the disk and not cached, so I am not sure what to attribute this to. Has anyone run Swift on RH and done comparisons with Ubuntu? Any help/pointers would be great! Thanks, Mukul -Original Message- From: Kotwani, Mukul Sent: Thursday, December 05, 2013 6:44 PM To: Pete Zaitcev Cc: OpenStack Mailing List Subject: Re: [Openstack] [Swift] Swift on RHEL Thanks Pete! We were using Grizzly, which is over a release old, with Folsom Keystone for RHEL. So not recent at all. Is there something that would be missing in RHEL5.x which would cause performance issues? I saw some references to fallocate, but not much beyond that. Is this something you would expect to see? Which was the first RHEL release was Swift supported on officially? I tried to find a support matrix or supportable platforms but could not find anything.. Mukul -Original Message- From: Pete Zaitcev [mailto:zait...@redhat.com] Sent: Thursday, December 05, 2013 4:36 PM To: Kotwani, Mukul Cc: OpenStack Mailing List Subject: Re: [Openstack] [Swift] Swift on RHEL On Thu, 5 Dec 2013 21:19:49 + Kotwani, Mukul mukul.g.kotw...@hp.com wrote: Has anyone used and/or deployed RHEL (5.8) with Swift? I was also looking for a Supported platforms for Swift, and I could not find it. I don't think an RDO for RHEL 5.x ever existed. First packages were built a year after RHEL 6 GA shipped. The oldest build in Koji is openstack-swift-1.0.2-5.fc15 (a community build by Silas), and the oldest RHOS build is openstack-swift-1.4.8-2.el6 from 2012. Frankly I'm surprised you managed to get it running at all. (Which Swift release is that, BTW? We even require PBR nowadays.) I dimly remember bothering with XFS for RHEL 5, but it was so long ago that I cannot even remember if I got that cluster to do anything useful. -- Pete ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] [Swift] Swift on RHEL
My first guess is that the Redhat kernel in 5.8 may not have as many xfs improvements and may require that the inode size set to 1024 instead of the default. That would be the first thing I would try. -- Chuck On Tue, Dec 10, 2013 at 5:57 PM, John Smith lbalba...@gmail.com wrote: On Wed, Dec 11, 2013 at 12:53 AM, Kotwani, Mukul mukul.g.kotw...@hp.com wrote: Hey John, Ubuntu is 13.04 and Redhat is 5.8. So its 2x vs 3x kernel ? ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] [Swift] Swift on RHEL
On 12/10/2013 03:23 PM, Kotwani, Mukul wrote: A new piece of data.. We used the disable_fallocate configurable on Ubuntu, and the numbers do reduce, but they are nowhere near the numbers for Redhat (5.8). As an example, for a specific test: PUT for Ubuntu, default parameters: ~140 ops/sec PUT for Ubuntu, disable_fallocate=true: ~100 ops/sec PUT for Redhat 5.8, default parameters: ~15 ops/sec Has anyone seen this? We are not able to find anything that can explain this kind of discrepancy. FYI, this is the same hardware(we are switching between Ubuntu and RH, to keep things the same) and software(Swift and xfs, same versions for both), same ring configuration, same test scripts. It seems like Ubuntu is far ahead, and we don't have any root cause ATM. PUTs are written though to the disk and not cached, so I am not sure what to attribute this to. Are RH 5.8 (2.6.32 with assorted backports) and what you later say is Ubuntu 13.04 (3.8 kernel?) using the same I/O scheduler in their drivers? rick jones Has anyone run Swift on RH and done comparisons with Ubuntu? Any help/pointers would be great! Thanks, Mukul -Original Message- From: Kotwani, Mukul Sent: Thursday, December 05, 2013 6:44 PM To: Pete Zaitcev Cc: OpenStack Mailing List Subject: Re: [Openstack] [Swift] Swift on RHEL Thanks Pete! We were using Grizzly, which is over a release old, with Folsom Keystone for RHEL. So not recent at all. Is there something that would be missing in RHEL5.x which would cause performance issues? I saw some references to fallocate, but not much beyond that. Is this something you would expect to see? Which was the first RHEL release was Swift supported on officially? I tried to find a support matrix or supportable platforms but could not find anything.. Mukul -Original Message- From: Pete Zaitcev [mailto:zait...@redhat.com] Sent: Thursday, December 05, 2013 4:36 PM To: Kotwani, Mukul Cc: OpenStack Mailing List Subject: Re: [Openstack] [Swift] Swift on RHEL On Thu, 5 Dec 2013 21:19:49 + Kotwani, Mukul mukul.g.kotw...@hp.com wrote: Has anyone used and/or deployed RHEL (5.8) with Swift? I was also looking for a Supported platforms for Swift, and I could not find it. I don't think an RDO for RHEL 5.x ever existed. First packages were built a year after RHEL 6 GA shipped. The oldest build in Koji is openstack-swift-1.0.2-5.fc15 (a community build by Silas), and the oldest RHOS build is openstack-swift-1.4.8-2.el6 from 2012. Frankly I'm surprised you managed to get it running at all. (Which Swift release is that, BTW? We even require PBR nowadays.) I dimly remember bothering with XFS for RHEL 5, but it was so long ago that I cannot even remember if I got that cluster to do anything useful. -- Pete ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] [Swift] Swift on RHEL
2.6.18, not sure about the IO schedulers. The default scheduler could be different. Is the expected performance between the schedulers supposed to be that dramatically different? Mukul -Original Message- From: Jones, Richard (Mr. Netperf) Sent: Tuesday, December 10, 2013 4:17 PM To: Kotwani, Mukul; Pete Zaitcev Cc: OpenStack Mailing List Subject: Re: [Openstack] [Swift] Swift on RHEL On 12/10/2013 04:12 PM, Rick Jones wrote: On 12/10/2013 03:23 PM, Kotwani, Mukul wrote: A new piece of data.. We used the disable_fallocate configurable on Ubuntu, and the numbers do reduce, but they are nowhere near the numbers for Redhat (5.8). As an example, for a specific test: PUT for Ubuntu, default parameters: ~140 ops/sec PUT for Ubuntu, disable_fallocate=true: ~100 ops/sec PUT for Redhat 5.8, default parameters: ~15 ops/sec Has anyone seen this? We are not able to find anything that can explain this kind of discrepancy. FYI, this is the same hardware(we are switching between Ubuntu and RH, to keep things the same) and software(Swift and xfs, same versions for both), same ring configuration, same test scripts. It seems like Ubuntu is far ahead, and we don't have any root cause ATM. PUTs are written though to the disk and not cached, so I am not sure what to attribute this to. Are RH 5.8 (2.6.32 with assorted backports) Or is that 2.6.18 and backports? I may have been thinking of RHEL6. rick jones and what you later say is Ubuntu 13.04 (3.8 kernel?) using the same I/O scheduler in their drivers? rick jones Has anyone run Swift on RH and done comparisons with Ubuntu? Any help/pointers would be great! Thanks, Mukul -Original Message- From: Kotwani, Mukul Sent: Thursday, December 05, 2013 6:44 PM To: Pete Zaitcev Cc: OpenStack Mailing List Subject: Re: [Openstack] [Swift] Swift on RHEL Thanks Pete! We were using Grizzly, which is over a release old, with Folsom Keystone for RHEL. So not recent at all. Is there something that would be missing in RHEL5.x which would cause performance issues? I saw some references to fallocate, but not much beyond that. Is this something you would expect to see? Which was the first RHEL release was Swift supported on officially? I tried to find a support matrix or supportable platforms but could not find anything.. Mukul -Original Message- From: Pete Zaitcev [mailto:zait...@redhat.com] Sent: Thursday, December 05, 2013 4:36 PM To: Kotwani, Mukul Cc: OpenStack Mailing List Subject: Re: [Openstack] [Swift] Swift on RHEL On Thu, 5 Dec 2013 21:19:49 + Kotwani, Mukul mukul.g.kotw...@hp.com wrote: Has anyone used and/or deployed RHEL (5.8) with Swift? I was also looking for a Supported platforms for Swift, and I could not find it. I don't think an RDO for RHEL 5.x ever existed. First packages were built a year after RHEL 6 GA shipped. The oldest build in Koji is openstack-swift-1.0.2-5.fc15 (a community build by Silas), and the oldest RHOS build is openstack-swift-1.4.8-2.el6 from 2012. Frankly I'm surprised you managed to get it running at all. (Which Swift release is that, BTW? We even require PBR nowadays.) I dimly remember bothering with XFS for RHEL 5, but it was so long ago that I cannot even remember if I got that cluster to do anything useful. -- Pete ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
[Openstack] [Swift] Swift on RHEL
Folks, Has anyone used and/or deployed RHEL (5.8) with Swift? We are running some experiments with Swift installed on both platforms, same hardware, and we are seeing some pretty different performance profiles. Ubuntu is doing much better than RHEL. Has anyone else seen the performance difference? I was also looking for a Supported platforms for Swift, and I could not find it. Any pointers to that will be great. Thanks in advance! Mukul ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] [Swift] Swift on RHEL
On Thu, Dec 5, 2013 at 10:19 PM, Kotwani, Mukul mukul.g.kotw...@hp.com wrote: Has anyone used and/or deployed RHEL (5.8) with Swift? We are running some experiments with Swift installed on both platforms, same hardware, and we are seeing some pretty different performance profiles. Ubuntu is doing much better than RHEL. Hi, Just curious: what Ubuntu version are you comparing to RHEL 5.8 ? Regards, John Smith. ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] [Swift] Swift on RHEL
On Thu, 5 Dec 2013 21:19:49 + Kotwani, Mukul mukul.g.kotw...@hp.com wrote: Has anyone used and/or deployed RHEL (5.8) with Swift? I was also looking for a Supported platforms for Swift, and I could not find it. I don't think an RDO for RHEL 5.x ever existed. First packages were built a year after RHEL 6 GA shipped. The oldest build in Koji is openstack-swift-1.0.2-5.fc15 (a community build by Silas), and the oldest RHOS build is openstack-swift-1.4.8-2.el6 from 2012. Frankly I'm surprised you managed to get it running at all. (Which Swift release is that, BTW? We even require PBR nowadays.) I dimly remember bothering with XFS for RHEL 5, but it was so long ago that I cannot even remember if I got that cluster to do anything useful. -- Pete ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
