Re: [ceph-users] Omap warning in 12.2.6
Thanks for the heads up. I upgraded the cluster to 12.2.7 and the message went away. No CRC errors luckily. -Brent From: Brady Deetz [mailto:bde...@gmail.com] Sent: Thursday, July 19, 2018 3:26 PM To: Brent Kennedy Cc: ceph-users Subject: Re: [ceph-users] Omap warning in 12.2.6 12.2.6 has a regression. See "v12.2.7 Luminous released" and all of the related disaster posts. Also in the release nodes for .7 is a bug disclosure for 12.2.5 that affects rgw users pretty badly during upgrade. You might take a look there. On Thu, Jul 19, 2018 at 2:13 PM Brent Kennedy mailto:bkenn...@cfl.rr.com> > wrote: I just upgraded our cluster to 12.2.6 and now I see this warning about 1 large omap object. I looked and it seems this warning was just added in 12.2.6. I found a few discussions on what is was but not much information on addressing it properly. Our cluster uses rgw exclusively with just a few buckets in the .rgw.buckets pool. Our largest bucket has millions of objects in it. Any thoughts or links on this? Regards, -Brent Existing Clusters: Test: Luminous 12.2.6 with 3 osd servers, 1 mon/man, 1 gateway ( all virtual ) US Production: Firefly with 4 osd servers, 3 mons, 3 gateways behind haproxy LB UK Production: Luminous 12.2.6 with 8 osd servers, 3 mons/man, 3 gateways behind haproxy LB ___ ceph-users mailing list ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Omap warning in 12.2.6
Search the cluster log for 'Large omap object found' for more details. On Fri, Jul 20, 2018 at 5:13 AM, Brent Kennedy wrote: > I just upgraded our cluster to 12.2.6 and now I see this warning about 1 > large omap object. I looked and it seems this warning was just added in > 12.2.6. I found a few discussions on what is was but not much information > on addressing it properly. Our cluster uses rgw exclusively with just a few > buckets in the .rgw.buckets pool. Our largest bucket has millions of > objects in it. > > > > Any thoughts or links on this? > > > > > > Regards, > > -Brent > > > > Existing Clusters: > > Test: Luminous 12.2.6 with 3 osd servers, 1 mon/man, 1 gateway ( all virtual > ) > > US Production: Firefly with 4 osd servers, 3 mons, 3 gateways behind haproxy > LB > > UK Production: Luminous 12.2.6 with 8 osd servers, 3 mons/man, 3 gateways > behind haproxy LB > > > > > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > -- Cheers, Brad ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Omap warning in 12.2.6
12.2.6 has a regression. See "v12.2.7 Luminous released" and all of the related disaster posts. Also in the release nodes for .7 is a bug disclosure for 12.2.5 that affects rgw users pretty badly during upgrade. You might take a look there. On Thu, Jul 19, 2018 at 2:13 PM Brent Kennedy wrote: > I just upgraded our cluster to 12.2.6 and now I see this warning about 1 > large omap object. I looked and it seems this warning was just added in > 12.2.6. I found a few discussions on what is was but not much information > on addressing it properly. Our cluster uses rgw exclusively with just a > few buckets in the .rgw.buckets pool. Our largest bucket has millions of > objects in it. > > > > Any thoughts or links on this? > > > > > > Regards, > > -Brent > > > > Existing Clusters: > > Test: Luminous 12.2.6 with 3 osd servers, 1 mon/man, 1 gateway ( all > virtual ) > > US Production: Firefly with 4 osd servers, 3 mons, 3 gateways behind > haproxy LB > > UK Production: Luminous 12.2.6 with 8 osd servers, 3 mons/man, 3 gateways > behind haproxy LB > > > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Omap warning in 12.2.6
I just upgraded our cluster to 12.2.6 and now I see this warning about 1 large omap object. I looked and it seems this warning was just added in 12.2.6. I found a few discussions on what is was but not much information on addressing it properly. Our cluster uses rgw exclusively with just a few buckets in the .rgw.buckets pool. Our largest bucket has millions of objects in it. Any thoughts or links on this? Regards, -Brent Existing Clusters: Test: Luminous 12.2.6 with 3 osd servers, 1 mon/man, 1 gateway ( all virtual ) US Production: Firefly with 4 osd servers, 3 mons, 3 gateways behind haproxy LB UK Production: Luminous 12.2.6 with 8 osd servers, 3 mons/man, 3 gateways behind haproxy LB ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
