mon memory leak

2013-03-13 Thread Stefan Priebe - Profihost AG
Hi, are there any known ceph-mon memory leaks in bobtail? Today i've seen a ceph-mon process consuming 50GB Memory. Stefan -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More majordomo info at

[PATCH V2] ceph: use i_release_count to indicate dir's completeness

2013-03-13 Thread Yan, Zheng
From: Yan, Zheng zheng.z@intel.com Current ceph code tracks directory's completeness in two places. ceph_readdir() checks i_release_count to decide if it can set the I_COMPLETE flag in i_ceph_flags. All other places check the I_COMPLETE flag. This indirection introduces locking complexity.

Re: OSD memory leaks?

2013-03-13 Thread Dave Spano
Lol. I'm totally fine with that. My glance images pool isn't used too often. I'm going to give that a try today and see what happens. I'm still crossing my fingers, but since I added log max recent=1 to ceph.conf, I've been okay despite the improper pg_num, and a lot of scrubbing/deep

Re: mon memory leak

2013-03-13 Thread Travis Rhoden
Hi Stefan, I have seen a mon grow quite high on Bobtail. Joao had some theories as for why, and I was able to provide him with a memory dump of the running process. No word yet on whether it revealed anything, but I know it is on his stack. Background here:

Re: mon memory leak

2013-03-13 Thread Joao Eduardo Luis
On 03/13/2013 01:42 PM, Travis Rhoden wrote: Hi Stefan, I have seen a mon grow quite high on Bobtail. Joao had some theories as for why, and I was able to provide him with a memory dump of the running process. No word yet on whether it revealed anything, but I know it is on his stack.

Re: mon memory leak

2013-03-13 Thread Stefan Priebe - Profihost AG
Hi Joao, Am 13.03.2013 14:58, schrieb Joao Eduardo Luis: I'm expecting to be able to find the time Real Soon Now to put a doc together with ways, for anyone willing, to provide us further insight on what's happening. The monitor is supposed to be able to dump a heap profile (using

Re: mon memory leak

2013-03-13 Thread Joao Eduardo Luis
On 03/13/2013 02:06 PM, Stefan Priebe - Profihost AG wrote: Hi Joao, Am 13.03.2013 14:58, schrieb Joao Eduardo Luis: I'm expecting to be able to find the time Real Soon Now to put a doc together with ways, for anyone willing, to provide us further insight on what's happening. The monitor is

Re: [PATCH V2] ceph: use i_release_count to indicate dir's completeness

2013-03-13 Thread Greg Farnum
Looks good, thanks. :) We'll also be testing the first patch in this series. -Greg On Wednesday, March 13, 2013 at 4:44 AM, Yan, Zheng wrote: From: Yan, Zheng zheng.z@intel.com (mailto:zheng.z@intel.com) Current ceph code tracks directory's completeness in two places.

Re: How to set the number of pgs when using mkcephfs?

2013-03-13 Thread Bryan K. Wright
Hi again, Sorry, I finally figured it out based on comments here: http://en.usenet.digipedia.org/thread/11905/7191/ num_pgs = num_osds osd_pg_bits. Ah. OK, so I can now adjust the number of placement groups by fiddling with osd pg bits in ceph.conf.

Re: OSD memory leaks?

2013-03-13 Thread Sébastien Han
Dave, Just to be sure, did the log max recent=1 _completely_ stod the memory leak or did it slow it down? Thanks! -- Regards, Sébastien Han. On Wed, Mar 13, 2013 at 2:12 PM, Dave Spano dsp...@optogenics.com wrote: Lol. I'm totally fine with that. My glance images pool isn't used too

Re: OSD memory leaks?

2013-03-13 Thread Dave Spano
Sebastien, I'm not totally sure yet, but everything is still working. Sage and Greg, I copied my glance image pool per the posting I mentioned previously, and everything works when I use the ceph tools. I can export rbds from the new pool and delete them as well. I noticed that the copied

Re: OSD memory leaks?

2013-03-13 Thread Greg Farnum
It sounds like maybe you didn't rename the new pool to use the old pool's name? Glance is looking for a specific pool to store its data in; I believe it's configurable but you'll need to do one or the other. -Greg On Wednesday, March 13, 2013 at 3:38 PM, Dave Spano wrote: Sebastien, I'm

Re: OSD memory leaks?

2013-03-13 Thread Dave Spano
I renamed the old one from images to images-old, and the new one from images-new to images. Dave Spano Optogenics Systems Administrator - Original Message - From: Greg Farnum lt;g...@inktank.comgt; To: Dave Spano lt;dsp...@optogenics.comgt; Cc: Sébastien Han

Re: OSD memory leaks?

2013-03-13 Thread Josh Durgin
On 03/13/2013 05:05 PM, Dave Spano wrote: I renamed the old one from images to images-old, and the new one from images-new to images. This reminds me of a problem you might hit with this: RBD clones track the parent image pool by id, so they'll continue working after the pool is renamed. If

Inktank Office Hours

2013-03-13 Thread Ross David Turk
Hi! As the Ceph community grows, it's important that help is available to new users. Up to this point, Inktank engineers have been monitoring the channel and mailing list as time permits. That made sense when there wasn't much foot traffic, but we have a lot now! We'd like to introduce