Re: [PATCH V2] mds: fix CDir::_commit_partial() bug

2012-11-24 Thread Yan, Zheng
Hi, Sage I found this fix is still not enough because we don't know if a dentry has been successfully deleted from the directory fragment after MDS restart. There are several options to fix this, which one do you like? 1. Make OSD ignore the TMAP_RM commands if it can't the find items. 2. Add

Re: tiering of storage pools in ceph in general

2012-11-24 Thread Gregory Farnum
On Thursday, November 22, 2012 at 4:33 AM, Jimmy Tang wrote: Hi All, Is it possible at this point in time to setup some form of tiering of storage pools in ceph by modifying the crush map? For example I want to have my most recently used data on a small set of nodes that have SSD's and

Re: Very bad behavior when

2012-11-24 Thread Gregory Farnum
On Thursday, November 22, 2012 at 5:26 AM, Sylvain Munaut wrote: Hi, I know that ceph has time synced servers has a requirements, but I think a sane failure mode like a message in the logs instead of incontrollably growing memory usage would be a good idea. I had the NTP process die on me

Re: [Discussion] Enhancement for CRUSH rules

2012-11-24 Thread Gregory Farnum
On Thursday, November 22, 2012 at 7:38 PM, Chen, Xiaoxi wrote: Hi list, I am thinking about the possibility to add some primitive in CRUSH to meet the following user stories: A. Same host, Same rack To balance between availability and performance ,one may like such a rule: 3 Replicas,

Re: RBD fio Performance concerns

2012-11-24 Thread Gregory Farnum
On Friday, November 23, 2012 at 5:36 AM, Chen, Xiaoxi wrote: Hi Han, I have a cluster with 8 nodes(each node with 1 SSD as journal and 3 7200 rpm sata disk as data disk), each OSD consist of 1 sata disk together with one 30G partition from the SSD.So in total I have 24 OSDs. My test method

Re: Very bad behavior when

2012-11-24 Thread Sylvain Munaut
Hi, In addition to Sam's question about version, are you using cephx? I'm running 0.48.2 on Ubuntu Precise and cephx auth is enabled. Cheers, Sylvain -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More

Re: syncfs via syscall doesn not work

2012-11-24 Thread Sage Weil
On Sat, 24 Nov 2012, Stefan Priebe - Profihost AG wrote: At the machine compiling? Yes! Hmm, I just tested on my wonky wheezy machine (glibc 2.13, 3.2) and system(SYS_syncfs, ..) works for me. But the #define is in libc6-dev: vapre:src 08:57 AM $ grep -r SYS_syncfs /usr/include

Re: [PATCH v2] make mkcephfs and init-ceph osd filesystem handling more flexible

2012-11-24 Thread Sage Weil
Thanks, Danny! sage On Fri, 23 Nov 2012, Danny Al-Gaaf wrote: Remove btrfs specific keys and replace them by more generic keys to be able to replace btrfs with e.g. xfs or ext4 easily. Add new key to define the osd fs type: 'osd mkfs type', which can get defined in the [osd] section for

Re: [PATCH V2] mds: fix CDir::_commit_partial() bug

2012-11-24 Thread Yan, Zheng
On 11/25/2012 12:21 AM, Sage Weil wrote: On Sat, 24 Nov 2012, Yan, Zheng wrote: Hi, Sage I found this fix is still not enough because we don't know if a dentry has been successfully deleted from the directory fragment after MDS restart. There are several options to fix this, which one do

Re: [PATCH V2] mds: fix CDir::_commit_partial() bug

2012-11-24 Thread Sage Weil
On Sun, 25 Nov 2012, Yan, Zheng wrote: On 11/25/2012 12:21 AM, Sage Weil wrote: On Sat, 24 Nov 2012, Yan, Zheng wrote: Hi, Sage I found this fix is still not enough because we don't know if a dentry has been successfully deleted from the directory fragment after MDS restart. There

Re: [PATCH V2] mds: fix CDir::_commit_partial() bug

2012-11-24 Thread Yan, Zheng
On 11/25/2012 01:51 AM, Sage Weil wrote: On Sun, 25 Nov 2012, Yan, Zheng wrote: On 11/25/2012 12:21 AM, Sage Weil wrote: On Sat, 24 Nov 2012, Yan, Zheng wrote: Hi, Sage I found this fix is still not enough because we don't know if a dentry has been successfully deleted from the directory