Re: [ceph-users] Poor CentOS 7.5 client performance
Ilya, Your recommendation worked beautifully. Thank you! Is this something that is expected behavior or is this something that should be filed as a bug. I ask because I have just enough experience with ceph at this point to be very dangerous and not enough history to know if this was expected from past behavior. I did the dd testing after noticing poor read/write from a set of machines that use ceph to back their home directories. Mac Please excuse any typos. Autocorrect is evil! > On May 17, 2018, at 16:57, Ilya Dryomov wrote: > > Ilya ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Poor CentOS 7.5 client performance
Dan, You are correct, that is some important information. I am using the kernel client. Mounts from fstab. Mac Please excuse any typos. Autocorrect is evil! > On May 17, 2018, at 08:30, Dan van der Ster wrote: > > Hi, > > It still isn't clear if you're using the fuse or kernel client. > > Do you `mount -t ceph` or something else? > > -- Dan > > > On Wed, May 16, 2018 at 8:28 PM Donald "Mac" McCarthy > wrote: > >> CephFS. 8 core atom C2758, 16 GB ram, 256GB ssd, 2.5 GB NIC (supermicro > microblade node). > >> Read test: >> dd if=/ceph/1GB.test of=/dev/null bs=1M > >> Write >> dd if=/dev/zero of=/ceph/out.test bs=1M count=1024 > > >> The tests are identical on both kernels - the results... well that is a > different story. > >> CEPH servers are on release 12.2.4 > >> Client updated to 12.2.5 - in both kernels, ceph client is 12.2.5 > >> Please excuse any typos. Autocorrect is evil! > >>> On May 16, 2018, at 14:18, Jason Dillaman wrote: >>> >>> What is your client (librbd, krbd, CephFS, ceph-client, ...) and how >>> are you testing performance? >>> >>> On Wed, May 16, 2018 at 11:14 AM, Donald "Mac" McCarthy >>> wrote: >>>> Recently upgraded a CEPH client to CentOS 7.5. Upon doing so read and > write performance became intolerably slow. ~2.5 MB/s. When booted back to > a CentOS 7.4 kernel, performance went back to a normal 200 MB/s read and > write. I have not seen any mention of this issue in all of the normal > places including here. For now the solution is clear - don’t use the 7.5 > update. Has anyone else experienced this issue? >>>> >>>> Please excuse any typos. Autocorrect is evil! >>>> ___ >>>> ceph-users mailing list >>>> ceph-users@lists.ceph.com >>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>> >>> >>> >>> -- >>> Jason >> ___ >> ceph-users mailing list >> ceph-users@lists.ceph.com >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Poor CentOS 7.5 client performance
CephFS. 8 core atom C2758, 16 GB ram, 256GB ssd, 2.5 GB NIC (supermicro microblade node). Read test: dd if=/ceph/1GB.test of=/dev/null bs=1M Write dd if=/dev/zero of=/ceph/out.test bs=1M count=1024 The tests are identical on both kernels - the results... well that is a different story. CEPH servers are on release 12.2.4 Client updated to 12.2.5 - in both kernels, ceph client is 12.2.5 Please excuse any typos. Autocorrect is evil! > On May 16, 2018, at 14:18, Jason Dillaman wrote: > > What is your client (librbd, krbd, CephFS, ceph-client, ...) and how > are you testing performance? > > On Wed, May 16, 2018 at 11:14 AM, Donald "Mac" McCarthy > wrote: >> Recently upgraded a CEPH client to CentOS 7.5. Upon doing so read and write >> performance became intolerably slow. ~2.5 MB/s. When booted back to a >> CentOS 7.4 kernel, performance went back to a normal 200 MB/s read and >> write. I have not seen any mention of this issue in all of the normal places >> including here. For now the solution is clear - don’t use the 7.5 update. >> Has anyone else experienced this issue? >> >> Please excuse any typos. Autocorrect is evil! >> ___ >> ceph-users mailing list >> ceph-users@lists.ceph.com >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > > -- > Jason ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Poor CentOS 7.5 client performance
Recently upgraded a CEPH client to CentOS 7.5. Upon doing so read and write performance became intolerably slow. ~2.5 MB/s. When booted back to a CentOS 7.4 kernel, performance went back to a normal 200 MB/s read and write. I have not seen any mention of this issue in all of the normal places including here. For now the solution is clear - don’t use the 7.5 update. Has anyone else experienced this issue? Please excuse any typos. Autocorrect is evil! ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
