Re: [ceph-users] Still have orphaned rgw shadow files, ceph 0.94.3

FYI, over the past week I have deleted over 50 TB of data from my cluster of these objects. Almost all were from buckets that no longer exist, and the fix tool did not find them. Fortunately i don't need the data from these old buckets so deleting all objects by prefix worked great. Anyone

Re: [ceph-users] Still have orphaned rgw shadow files, ceph 0.94.3

No input, eh? (or maybe TL,DR for everyone) Short version: Presuming the bucket index shows blank/empty, which it does and is fine, would me manually deleting the rados objects with the prefix matching the former bucket's ID cause any problems? thanks, -Ben On Fri, Aug 28, 2015 at 4:22 PM, Ben

Re: [ceph-users] Still have orphaned rgw shadow files, ceph 0.94.3

As long as you're 100% sure that the prefix is only being used for the specific bucket that was previously removed, then it is safe to remove these objects. But please do double check and make sure that there's no other bucket that matches this prefix somehow. Yehuda On Mon, Aug 31, 2015 at 2:42

Re: [ceph-users] Still have orphaned rgw shadow files, ceph 0.94.3

Ok. I'm not too familiar with the inner workings of RGW, but i would assume that for a bucket with these parameters: "id": "default.8873277.32", "marker": "default.8873277.32", Tha it would be the only bucket using the files that start with "default.8873277.32"

Re: [ceph-users] Still have orphaned rgw shadow files, ceph 0.94.3

Make sure you use the underscore also, e.g., "default.8873277.32_". Otherwise you could potentially erase objects you did't intend to, like ones who start with "default.8873277.320" and such. On Mon, Aug 31, 2015 at 3:20 PM, Ben Hines wrote: > Ok. I'm not too familiar with the

Re: [ceph-users] Still have orphaned rgw shadow files, ceph 0.94.3

Good call, thanks! Is there any risk of also deleting parts of the bucket index? I'm not sure what the objects for the index itself look like, or if they are in the .rgw.buckets pool. On Mon, Aug 31, 2015 at 3:23 PM, Yehuda Sadeh-Weinraub wrote: > Make sure you use the

Re: [ceph-users] Still have orphaned rgw shadow files, ceph 0.94.3

The bucket index objects are most likely in the .rgw.buckets.index pool. Yehuda On Mon, Aug 31, 2015 at 3:27 PM, Ben Hines wrote: > Good call, thanks! > > Is there any risk of also deleting parts of the bucket index? I'm not > sure what the objects for the index itself look

[ceph-users] Still have orphaned rgw shadow files, ceph 0.94.3

Ceph 0.93-94.2-94.3 I noticed my pool used data amount is about twice the bucket used data count. This bucket was emptied long ago. It has zero objects: globalcache01, { bucket: globalcache01, pool: .rgw.buckets, index_pool: .rgw.buckets.index, id: