[sheepdog] [PATCH v2 2/2] Revert "tests/functional: update test scripts for VID GC feature"

2015-03-15 Thread Hitoshi Mitake
This reverts commit 5d005d41862647f6c7cdb7977f2611e61abc104b. Signed-off-by: Hitoshi Mitake --- tests/functional/016.out | 12 ++-- tests/functional/044.out | 12 ++-- tests/functional/046.out | 6 +++--- tests/functional/086.out | 6 +++--- tests/functional/092.out | 6 +++---

[sheepdog] [PATCH v2 1/2] sheep, dog: make recycling VID selectable

2015-03-15 Thread Hitoshi Mitake
This patch adds a new option -R to "dog cluster format". If user specifies the option during cluster format, the cluster will enable recycling VID (disabled in default). Signed-off-by: Hitoshi Mitake --- dog/cluster.c| 9 - include/internal_proto.h | 1 + sheep/ops.c

Re: [sheepdog] [PATCH v2 0/5] garbage collect needless VIDs and inode objects

2015-03-15 Thread Hitoshi Mitake
At Mon, 16 Mar 2015 14:48:47 +0800, Liu Yuan wrote: > > On Mon, Mar 16, 2015 at 03:39:17PM +0900, Hitoshi Mitake wrote: > > At Mon, 16 Mar 2015 14:31:44 +0800, > > Liu Yuan wrote: > > > > > > On Mon, Mar 16, 2015 at 02:08:25PM +0800, Liu Yuan wrote: > > > > On Mon, Mar 16, 2015 at 02:36:57PM +090

Re: [sheepdog] [PATCH 1/2] sheep : add new strage type "tree"

2015-03-15 Thread Saeki Masaki
On 2015/03/16 11:06, Liu Yuan wrote: On Thu, Mar 12, 2015 at 01:50:26PM +0900, Saeki Masaki wrote: Current sheepdog stores whole objects in single directory like "/var/lib/sheepdog/obj" This mechanism is difficult to handle massive files when increasing cluster volume. In particular, inode ob

Re: [sheepdog] [PATCH v2 0/5] garbage collect needless VIDs and inode objects

2015-03-15 Thread Liu Yuan
On Mon, Mar 16, 2015 at 03:39:17PM +0900, Hitoshi Mitake wrote: > At Mon, 16 Mar 2015 14:31:44 +0800, > Liu Yuan wrote: > > > > On Mon, Mar 16, 2015 at 02:08:25PM +0800, Liu Yuan wrote: > > > On Mon, Mar 16, 2015 at 02:36:57PM +0900, Hitoshi Mitake wrote: > > > > At Mon, 16 Mar 2015 10:21:50 +0800

Re: [sheepdog] [PATCH 1/2] sheep, dog: make recycling VID selectable

2015-03-15 Thread Liu Yuan
On Mon, Mar 16, 2015 at 03:24:31PM +0900, Hitoshi Mitake wrote: > This patch adds a new option -R to "dog cluster format". If user > specifies the option during cluster format, the cluster will enable > recycling VID (disabled in default). > > Signed-off-by: Hitoshi Mitake > --- > dog/cluster.c

Re: [sheepdog] [PATCH v2 0/5] garbage collect needless VIDs and inode objects

2015-03-15 Thread Hitoshi Mitake
At Mon, 16 Mar 2015 14:31:44 +0800, Liu Yuan wrote: > > On Mon, Mar 16, 2015 at 02:08:25PM +0800, Liu Yuan wrote: > > On Mon, Mar 16, 2015 at 02:36:57PM +0900, Hitoshi Mitake wrote: > > > At Mon, 16 Mar 2015 10:21:50 +0800, > > > Liu Yuan wrote: > > > > > > > > On Thu, Mar 12, 2015 at 08:14:33PM

[sheepdog] [PATCH 2/2] Revert "tests/functional: update test scripts for VID GC feature"

2015-03-15 Thread Hitoshi Mitake
This reverts commit 5d005d41862647f6c7cdb7977f2611e61abc104b. Signed-off-by: Hitoshi Mitake --- tests/functional/016.out | 12 ++-- tests/functional/044.out | 12 ++-- tests/functional/046.out | 6 +++--- tests/functional/086.out | 6 +++--- tests/functional/092.out | 6 +++---

Re: [sheepdog] [PATCH v2 0/5] garbage collect needless VIDs and inode objects

2015-03-15 Thread Liu Yuan
On Mon, Mar 16, 2015 at 02:08:25PM +0800, Liu Yuan wrote: > On Mon, Mar 16, 2015 at 02:36:57PM +0900, Hitoshi Mitake wrote: > > At Mon, 16 Mar 2015 10:21:50 +0800, > > Liu Yuan wrote: > > > > > > On Thu, Mar 12, 2015 at 08:14:33PM +0900, Hitoshi Mitake wrote: > > > > At Thu, 12 Mar 2015 14:41:56 +

Re: [sheepdog] [PATCH v2 0/5] garbage collect needless VIDs and inode objects

2015-03-15 Thread Hitoshi Mitake
At Mon, 16 Mar 2015 14:08:25 +0800, Liu Yuan wrote: > > On Mon, Mar 16, 2015 at 02:36:57PM +0900, Hitoshi Mitake wrote: > > At Mon, 16 Mar 2015 10:21:50 +0800, > > Liu Yuan wrote: > > > > > > On Thu, Mar 12, 2015 at 08:14:33PM +0900, Hitoshi Mitake wrote: > > > > At Thu, 12 Mar 2015 14:41:56 +080

Re: [sheepdog] [PATCH] sheep: Remove the duplicated code line

2015-03-15 Thread Hitoshi Mitake
At Fri, 13 Mar 2015 11:49:08 -0700, Roy Yang wrote: > > Remove the duplicated code line in lib/net.c > > Signed-off-by: Roy Yang > --- > lib/net.c |1 - > 1 files changed, 0 insertions(+), 1 deletions(-) Applied, thanks. Hitoshi > > diff --git a/lib/net.c b/lib/net.c > index 5b34a1c..6e8

[sheepdog] [PATCH 1/2] sheep, dog: make recycling VID selectable

2015-03-15 Thread Hitoshi Mitake
This patch adds a new option -R to "dog cluster format". If user specifies the option during cluster format, the cluster will enable recycling VID (disabled in default). Signed-off-by: Hitoshi Mitake --- dog/cluster.c| 9 - include/internal_proto.h | 1 + sheep/ops.c

Re: [sheepdog] [PATCH v2 0/5] garbage collect needless VIDs and inode objects

2015-03-15 Thread Liu Yuan
On Mon, Mar 16, 2015 at 02:36:57PM +0900, Hitoshi Mitake wrote: > At Mon, 16 Mar 2015 10:21:50 +0800, > Liu Yuan wrote: > > > > On Thu, Mar 12, 2015 at 08:14:33PM +0900, Hitoshi Mitake wrote: > > > At Thu, 12 Mar 2015 14:41:56 +0800, > > > Liu Yuan wrote: > > > > > > > > On Tue, Jan 13, 2015 at 1

Re: [sheepdog] [PATCH v2 0/5] garbage collect needless VIDs and inode objects

2015-03-15 Thread Hitoshi Mitake
At Mon, 16 Mar 2015 10:21:50 +0800, Liu Yuan wrote: > > On Thu, Mar 12, 2015 at 08:14:33PM +0900, Hitoshi Mitake wrote: > > At Thu, 12 Mar 2015 14:41:56 +0800, > > Liu Yuan wrote: > > > > > > On Tue, Jan 13, 2015 at 10:37:40AM +0900, Hitoshi Mitake wrote: > > > > Current sheepdog never recycles V

Re: [sheepdog] rlimit nofile

2015-03-15 Thread Liu Yuan
On Thu, Mar 12, 2015 at 03:17:35PM +0300, Vasiliy Tolstov wrote: > Why sheepdog complains about maximum open files limit is too small and > not increase it via > http://man7.org/linux/man-pages/man2/getrlimit.2.html ? Thanks, we should give it a try, could you post a patch for it and verify it can

Re: [sheepdog] [PATCH v2 0/5] garbage collect needless VIDs and inode objects

2015-03-15 Thread Liu Yuan
On Thu, Mar 12, 2015 at 08:14:33PM +0900, Hitoshi Mitake wrote: > At Thu, 12 Mar 2015 14:41:56 +0800, > Liu Yuan wrote: > > > > On Tue, Jan 13, 2015 at 10:37:40AM +0900, Hitoshi Mitake wrote: > > > Current sheepdog never recycles VIDs. But it will cause problems > > > e.g. VID space exhaustion, to

Re: [sheepdog] [PATCH 1/2] sheep : add new strage type "tree"

2015-03-15 Thread Liu Yuan
On Thu, Mar 12, 2015 at 01:50:26PM +0900, Saeki Masaki wrote: > Current sheepdog stores whole objects in single directory like > "/var/lib/sheepdog/obj" > This mechanism is difficult to handle massive files when increasing cluster > volume. > > In particular, inode object having special informat

[sheepdog] network partition

2015-03-15 Thread Xu Yifeng
suppose there are 5 nodes A,B,C,D,E, and their networks to zookeeper is OK, but the network among 5 nodes are broken, and now node E is down, and D wants to pull objects from A,B,C and failed, the current code simply ignore errors and broadcast that the recovering procedure is done, some replic