Re: snap_trimming + backfilling is inefficient with many purged_snaps

2014-09-21 Thread Florian Haas
On Sat, Sep 20, 2014 at 9:08 PM, Alphe Salas asa...@kepler.cl wrote: Real field testings and proof workout are better than any unit testing ... I would follow Dan s notice of resolution because it based on real problem and not fony style test ground. That statement is almost an insult to the

Re: snap_trimming + backfilling is inefficient with many purged_snaps

2014-09-21 Thread Dan van der Ster
Hi Florian, September 21 2014 3:33 PM, Florian Haas flor...@hastexo.com wrote: That said, I'm not sure that wip-9487-dumpling is the final fix to the issue. On the system where I am seeing the issue, even with the fix deployed, osd's still not only go crazy snap trimming (which by itself

Re: snap_trimming + backfilling is inefficient with many purged_snaps

2014-09-21 Thread Florian Haas
On Sun, Sep 21, 2014 at 4:26 PM, Dan van der Ster daniel.vanders...@cern.ch wrote: Hi Florian, September 21 2014 3:33 PM, Florian Haas flor...@hastexo.com wrote: That said, I'm not sure that wip-9487-dumpling is the final fix to the issue. On the system where I am seeing the issue, even with

Re: issue 8747 / 9011

2014-09-21 Thread Sage Weil
On Fri, 19 Sep 2014, Dmitry Smirnov wrote: Hi Sage, On Fri, 19 Sep 2014 16:43:31 Sage Weil wrote: Are you still seeing this crash? osd/ReplicatedPG.cc: 5297: FAILED assert(soid scrubber.start || soid = scrubber.end) Thanks for following-up on this, Sage. Yes, I've seen this

Re: snap_trimming + backfilling is inefficient with many purged_snaps

2014-09-21 Thread Sage Weil
On Sun, 21 Sep 2014, Florian Haas wrote: So yes, I think your patch absolutely still has merit, as would any means of reducing the number of snapshots an OSD will trim in one go. As it is, the situation looks really really bad, specifically considering that RBD and RADOS are meant to be super

Re: issue 8747 / 9011

2014-09-21 Thread Dmitry Smirnov
On Sun, 21 Sep 2014 12:28:23 Sage Weil wrote: Is there any possibility of enabling logging on your osds (debug ms = 1, debug osd = 20) so that we can capture this? I'll put it on my TODO list but I won't be able to do it anytime soon... Meanwhile is there any chance for #8752 to get some

Re: issue 8747 / 9011

2014-09-21 Thread Sage Weil
On Mon, 22 Sep 2014, Dmitry Smirnov wrote: On Sun, 21 Sep 2014 12:28:23 Sage Weil wrote: Is there any possibility of enabling logging on your osds (debug ms = 1, debug osd = 20) so that we can capture this? I'll put it on my TODO list but I won't be able to do it anytime soon...