Re: OSD blocked for more than 120 seconds

2011-10-17 Thread Christian Brunner
2011/10/15 Martin Mailand mar...@tuxadero.com: Hi Christian, I have a very similar experience, I also used josef's tree and btrfs snaps = 0, the next problem I had than was excessive fragmentation, so I  used this patch http://marc.info/?l=linux-btrfsm=131495014823121w=2, and changed the

Re: OSD blocked for more than 120 seconds

2011-10-17 Thread Martin Mailand
Am 17.10.2011 11:40, schrieb Christian Brunner: 2011/10/15 Martin Mailandmar...@tuxadero.com: Hi Christian, I have a very similar experience, I also used josef's tree and btrfs snaps = 0, the next problem I had than was excessive fragmentation, so I used this patch

Re: OSD blocked for more than 120 seconds

2011-10-17 Thread Tomasz Paszkowski
Hi, It seems that ext4 and btrfs are not to be considered as stable for now. Does anyone could confirm that ext3 is the best choice for this moment ? On 17 October 2011 13:49, Martin Mailand mar...@tuxadero.com wrote: Am 17.10.2011 11:40, schrieb Christian Brunner: 2011/10/15 Martin

Re: OSD blocked for more than 120 seconds

2011-10-17 Thread Martin Mailand
Am 17.10.2011 14:05, schrieb Tomasz Paszkowski: Hi, It seems that ext4 and btrfs are not to be considered as stable for now. Does anyone could confirm that ext3 is the best choice for this moment ? Hi, I did a quick test with ext3, and it did not look very good. After a few minutes one of the

Re: OSD blocked for more than 120 seconds

2011-10-17 Thread Martin Mailand
Am 17.10.2011 11:40, schrieb Christian Brunner: Our bugreport with RedHat didn't make any progress for a long time, but last week RedHat made two sugestions: - If you configure ceph with 'filestore flusher = false', do you see any different behavior? - If you mount with -o noauto_da_alloc does

Re: OSD blocked for more than 120 seconds

2011-10-17 Thread Sage Weil
On Mon, 17 Oct 2011, Martin Mailand wrote: Am 17.10.2011 11:40, schrieb Christian Brunner: Our bugreport with RedHat didn't make any progress for a long time, but last week RedHat made two sugestions: - If you configure ceph with 'filestore flusher = false', do you see any different

how to run ceph on top of other local file system

2011-10-17 Thread sheng qiu
Hi all, i am new here. i want to use ceph to build a DFS. while i see, ceph can only use ext3/4 and btreefs to manage the osd. how can i modify it to support other local file system? Thanks, Sheng -- Sheng Qiu Texas A M University Room 302 Wisenbaker email: herbert1984...@gmail.com College

Re: how to run ceph on top of other local file system

2011-10-17 Thread Tommi Virtanen
On Mon, Oct 17, 2011 at 10:10, sheng qiu herbert1984...@gmail.com wrote: Hi all, i am new here. i want to use ceph to build a DFS. while i see, ceph can only use ext3/4 and btreefs to manage the osd. how can i modify it to support other local file system? Ceph works with any POSIX-compliant

Re: how to run ceph on top of other local file system

2011-10-17 Thread sheng qiu
hi Tommi, if my local file system does not support extended attributes, can i use it? for example, i have mounted my local file system on /mnt/data/osd.0, when i configure this directory as the osd.0 in the ceph.conf, it shows error like cannot write osd object into the directory. how can i fix

Re: how to run ceph on top of other local file system

2011-10-17 Thread Gregory Farnum
On Mon, Oct 17, 2011 at 10:20 AM, sheng qiu herbert1984...@gmail.com wrote: if my local file system does not support extended attributes, can i use it? Unfortunately not. Ceph requires xattr support; it uses xattrs for internal bookkeeping as well as for its own xattr support. Most filesystems

Re: OSD blocked for more than 120 seconds

2011-10-17 Thread Martin Mailand
Hi Sage, the hang was on a btrfs, I do not have a fix for that. The 'filestore flusher = false' does fix the ext4 problems, which where reported from Christian, but this option has quite an impact of the osd performance. The '-o noauto_da_alloc' option did not solve the fsck problem. Best

Re: OSD blocked for more than 120 seconds

2011-10-17 Thread Christian Brunner
2011/10/17 Martin Mailand mar...@tuxadero.com: Hi Sage, the hang was on a btrfs, I do not have a fix for that. The 'filestore flusher = false' does fix the ext4 problems, which where reported from Christian, but this option has quite an impact of the osd performance. The '-o