Re: [ceph-users] rgw leaking data, orphan search loop

On Tue, Feb 28, 2017 at 5:44 AM, George Mihaiescu wrote: > Hi Yehuda, > > I've ran the "radosgw-admin orphans find" command again, but captured its > output this time. > > There are both "shadow" files and "multipart" files detected as leaked. > > leaked: >

Re: [ceph-users] rgw leaking data, orphan search loop

Hi Yehuda, I've ran the "radosgw-admin orphans find" command again, but captured its output this time. There are both "shadow" files and "multipart" files detected as leaked. leaked: default.34461213.1__multipart_data/d2a14aeb-a384-51b1-8704-fe76a9a6f5f5.-j0vqDrC0wr44bii2ytrtpcrlnspSyE.44

Re: [ceph-users] rgw leaking data, orphan search loop

oid is object id. The orphan find command generates a list of objects that needs to be removed at the end of the run (if finishes successfully). If you didn't catch that, you should be able to still run the same scan (using the same scan id) and retrieve that info again. Yehuda On Fri, Feb 24,

Re: [ceph-users] rgw leaking data, orphan search loop

Hi Yehuda, Thank you for the quick reply. What is the you're referring to that I should backup and then delete? I extracted the files from the ".log" pool where the "orphan find" tool stored the results, but they are zero bytes files. -rw-r--r-- 1 root root 0 Feb 24 12:45

Re: [ceph-users] rgw leaking data, orphan search loop

Hi, we wanted to have more confidence in the orphans search tool before providing a functionality that actually remove the objects. One thing that you can do is create a new pool, copy these objects to the new pool (as a backup, rados -p --target-pool= cp ), and remove these objects (rados -p

Re: [ceph-users] rgw leaking data, orphan search loop

Hi, I updated http://tracker.ceph.com/issues/18331 with my own issue, and I am hoping Orit or Yehuda could give their opinion on what to do next. What was the purpose of the "orphan find" tool and how to actually clean up these files? Thank you, George On Fri, Jan 13, 2017 at 2:22 PM, Wido den

Re: [ceph-users] rgw leaking data, orphan search loop

> Op 24 december 2016 om 13:47 schreef Wido den Hollander : > > > > > Op 23 december 2016 om 16:05 schreef Wido den Hollander : > > > > > > > > > Op 22 december 2016 om 19:00 schreef Orit Wasserman : > > > > > > > > > HI Maruis, > > > >

Re: [ceph-users] rgw leaking data, orphan search loop

On Sat, Dec 24, 2016 at 2:47 PM, Wido den Hollander wrote: > > > Op 23 december 2016 om 16:05 schreef Wido den Hollander : > > > > > > > > > Op 22 december 2016 om 19:00 schreef Orit Wasserman < > owass...@redhat.com>: > > > > > > > > > HI Maruis, > > > > > > On

Re: [ceph-users] rgw leaking data, orphan search loop

> Op 23 december 2016 om 16:05 schreef Wido den Hollander : > > > > > Op 22 december 2016 om 19:00 schreef Orit Wasserman : > > > > > > HI Maruis, > > > > On Thu, Dec 22, 2016 at 12:00 PM, Marius Vaitiekunas > > wrote: > > >

Re: [ceph-users] rgw leaking data, orphan search loop

> Op 22 december 2016 om 19:00 schreef Orit Wasserman : > > > HI Maruis, > > On Thu, Dec 22, 2016 at 12:00 PM, Marius Vaitiekunas > wrote: > > On Thu, Dec 22, 2016 at 11:58 AM, Marius Vaitiekunas > > wrote: > >> >

Re: [ceph-users] rgw leaking data, orphan search loop

HI Maruis, On Thu, Dec 22, 2016 at 12:00 PM, Marius Vaitiekunas wrote: > On Thu, Dec 22, 2016 at 11:58 AM, Marius Vaitiekunas > wrote: >> >> Hi, >> >> 1) I've written before into mailing list, but one more time. We have big >> issues

Re: [ceph-users] rgw leaking data, orphan search loop

On Thu, Dec 22, 2016 at 11:58 AM, Marius Vaitiekunas < mariusvaitieku...@gmail.com> wrote: > Hi, > > 1) I've written before into mailing list, but one more time. We have big > issues recently with rgw on jewel. because of leaked data - the rate is > about 50GB/hour. > > We've hitted these bugs: >

[ceph-users] rgw leaking data, orphan search loop

Hi, 1) I've written before into mailing list, but one more time. We have big issues recently with rgw on jewel. because of leaked data - the rate is about 50GB/hour. We've hitted these bugs: rgw: fix put_acls for objects starting and ending with underscore ( issue#17625