Re: snapshot of rbd

2011-06-15 Thread Yehuda Sadeh Weinraub
On Tue, Jun 14, 2011 at 6:55 PM, Simon Tian wrote: > > Hmm, is vm need to be shutdown too when setting a snapshot, because of > the IO state > ( like file description. etc ) in the vm memory. Setting the snapshot is a runtime operation. Either you load it originally with that snapshot, or you res

Re: linux client stalls under heavy write load

2011-06-15 Thread Sage Weil
On Wed, 15 Jun 2011, Jim Schutt wrote: > Sage Weil wrote: > > On Wed, 15 Jun 2011, Jim Schutt wrote: > > > Here's everything the log has to say about address 0x5f5f900 after that > > > first message comes in: > > > > > > osd.32.log:2886557:2011-06-15 11:11:22.606598 7f0125d7b940 -- > > > 172.17.40

Re: linux client stalls under heavy write load

2011-06-15 Thread Jim Schutt
Sage Weil wrote: On Wed, 15 Jun 2011, Jim Schutt wrote: Here's everything the log has to say about address 0x5f5f900 after that first message comes in: osd.32.log:2886557:2011-06-15 11:11:22.606598 7f0125d7b940 -- 172.17.40.30:6800/7317 >> 172.17.40.48:0/710998528 pipe(0x205b000 sd=101 pgs=197

Re: linux client stalls under heavy write load

2011-06-15 Thread Sage Weil
On Wed, 15 Jun 2011, Jim Schutt wrote: > Here's everything the log has to say about address 0x5f5f900 after that > first message comes in: > > osd.32.log:2886557:2011-06-15 11:11:22.606598 7f0125d7b940 -- > 172.17.40.30:6800/7317 >> 172.17.40.48:0/710998528 pipe(0x205b000 sd=101 > pgs=197 cs=1 l=1

linux client stalls under heavy write load

2011-06-15 Thread Jim Schutt
Hi, I've been having trouble with Linux client stalls under heavy write load. I think I've got the signature isolated. The following logs were collected using the current stable branch (commit f9e9490d77d), patched with a little extra debugging output. This was with 64 clients against 48 OSDs,

Re: syslog problems

2011-06-15 Thread Sam Lang
On 06/15/2011 02:23 PM, Wido den Hollander wrote: Hi, On Wed, 2011-06-15 at 10:05 -0500, Sam Lang wrote: On 06/15/2011 09:50 AM, Wido den Hollander wrote: Hi, On Wed, 2011-06-15 at 09:26 -0500, Sam Lang wrote: In my ceph setup, I had logs being written to the default location (/var/log/ceph/

Re: syslog problems

2011-06-15 Thread Wido den Hollander
Hi, On Wed, 2011-06-15 at 10:05 -0500, Sam Lang wrote: > On 06/15/2011 09:50 AM, Wido den Hollander wrote: > > Hi, > > > > On Wed, 2011-06-15 at 09:26 -0500, Sam Lang wrote: > >> In my ceph setup, I had logs being written to the default location > >> (/var/log/ceph/) and eventually would get monit

Re: Don't understand why space usage keeps growing

2011-06-15 Thread Gregory Farnum
On Jun 14, 2011, at 11:25 AM, Wilfrid Allembrand wrote: > Hi Greg, > > Thank you for your answer. Yes, I'm sure that nothing else is writing > on the mount point but you are right for the bench, I also used this > rados bench : rados bench 30 write -p data in order to test the write > speed. >

Re: syslog problems

2011-06-15 Thread Sam Lang
On 06/15/2011 09:50 AM, Wido den Hollander wrote: Hi, On Wed, 2011-06-15 at 09:26 -0500, Sam Lang wrote: In my ceph setup, I had logs being written to the default location (/var/log/ceph/) and eventually would get monitor or osd crashes because the disk would fill up with logs. So I started wr

Re: syslog problems

2011-06-15 Thread Wido den Hollander
Hi, On Wed, 2011-06-15 at 09:26 -0500, Sam Lang wrote: > In my ceph setup, I had logs being written to the default location > (/var/log/ceph/) and eventually would get monitor or osd crashes because > the disk would fill up with logs. So I started writing the logs to > syslog, and now the loca

syslog problems

2011-06-15 Thread Sam Lang
In my ceph setup, I had logs being written to the default location (/var/log/ceph/) and eventually would get monitor or osd crashes because the disk would fill up with logs. So I started writing the logs to syslog, and now the local disk doesn't fill up, but I still get similar errors to tho