[sheepdog] [PATCH v2 3/3] sheep/http: add lock to protect container and object

2013-12-10 Thread Robin Dong
From: Robin Dong san...@taobao.com Add locks to protect containers and objects when users create/delete containers or create/delete objects in the same time. Signed-off-by: Robin Dong san...@taobao.com --- sheep/http/kv.c| 242 -

[sheepdog] [PATCH v2 2/3] sheep/http: add support for big object which is larger than SD_DATA_OBJ_SIZE

2013-12-10 Thread Robin Dong
From: Robin Dong san...@taobao.com Using hyper volume and extent structure of onode to store large number of objects size of which exceed SD_DATA_OBJ_SIZE. Signed-off-by: Robin Dong san...@taobao.com --- sheep/http/kv.c| 427 +++--

[sheepdog] [PATCH v2 1/3] sheep/http: store accounts and containers into hyper volume for object-storage

2013-12-10 Thread Robin Dong
From: Robin Dong san...@taobao.com Using hyper volume (size up to 16PB) to store large number of accounts and containers. Signed-off-by: Robin Dong san...@taobao.com --- sheep/http/http.c | 5 + sheep/http/http.h | 1 + sheep/http/kv.c| 627

Re: [sheepdog] [PATCH] dog: vdi checking for lost inode objects

2013-12-10 Thread Hitoshi Mitake
At Wed, 20 Nov 2013 22:04:28 +0800, Liu Yuan wrote: On Wed, Nov 20, 2013 at 10:54:02PM +0900, Hitoshi Mitake wrote: Current dog vdi check cannot work well in a case of inode object lost. This patch lets the subcommand handle the case correctly. Signed-off-by: Hitoshi Mitake

[sheepdog] [PATCH stable-0.7 2/3] md: remove unnecessary sd_err

2013-12-10 Thread Hitoshi Mitake
From: Liu Yuan namei.u...@gmail.com Signed-off-by: Liu Yuan namei.u...@gmail.com Signed-off-by: MORITA Kazutaka morita.kazut...@lab.ntt.co.jp Conflicts: sheep/md.c Conflict was resolved by Hitoshi Mitake. Signed-off-by: Hitoshi Mitake mitake.hito...@lab.ntt.co.jp --- sheep/md.c | 1 -

[sheepdog] [PATCH stable-0.7 0/3] update for trivial changing

2013-12-10 Thread Hitoshi Mitake
This update only contains trivial changes. 1. remove dead code in logger 2. remove a needless log message in md 3. resolve a build error of sheepfs on Ubuntu 13.01 Basically, users don't have to care about it. It is a preparation for coming big update. This patchset contains manual modification

[sheepdog] [PATCH stable-0.7 1/3] logger: remove unnecessary lock for log rotation

2013-12-10 Thread Hitoshi Mitake
From: MORITA Kazutaka morita.kazut...@lab.ntt.co.jp The logger process runs with one thread, so no need for pthread_mutex_lock. Signed-off-by: MORITA Kazutaka morita.kazut...@lab.ntt.co.jp Signed-off-by: Liu Yuan namei.u...@gmail.com --- lib/logger.c | 4 1 file changed, 4 deletions(-)

[sheepdog] [PATCH stable-0.7 3/3] sheepfs: add -lpthread to the linker option

2013-12-10 Thread Hitoshi Mitake
Because libsheepdog wraps pthread reader writer lock, the flag is required for building sheepfs too. Signed-off-by: Hitoshi Mitake mitake.hito...@lab.ntt.co.jp Signed-off-by: MORITA Kazutaka morita.kazut...@lab.ntt.co.jp --- sheepfs/Makefile.am | 2 +- 1 file changed, 1 insertion(+), 1

Re: [sheepdog] [PATCH] sheep: add an option for selecting the output directory of sheep.log

2013-12-10 Thread Hitoshi Mitake
At Tue, 10 Dec 2013 12:36:06 +0800, Liu Yuan wrote: On Mon, Dec 09, 2013 at 08:49:45PM +0900, Teruaki Ishizaki wrote: Previously sheep.log was saved in the Sheepdog store directory, and used size of Sheepdog store directory included log file size. So, administrator couldn't do capacity

Re: [sheepdog] [PATCH] sheep: add an option for selecting the output directory of sheep.log

2013-12-10 Thread Ryusuke Konishi
On Wed, 11 Dec 2013 10:22:05 +0900, Hitoshi Mitake wrote: At Tue, 10 Dec 2013 12:36:06 +0800, Liu Yuan wrote: On Mon, Dec 09, 2013 at 08:49:45PM +0900, Teruaki Ishizaki wrote: Previously sheep.log was saved in the Sheepdog store directory, and used size of Sheepdog store directory

Re: [sheepdog] [PATCH] sheep: add an option for selecting the output directory of sheep.log

2013-12-10 Thread Liu Yuan
On Wed, Dec 11, 2013 at 10:31:54AM +0900, Ryusuke Konishi wrote: On Wed, 11 Dec 2013 10:22:05 +0900, Hitoshi Mitake wrote: At Tue, 10 Dec 2013 12:36:06 +0800, Liu Yuan wrote: On Mon, Dec 09, 2013 at 08:49:45PM +0900, Teruaki Ishizaki wrote: Previously sheep.log was saved in the

[sheepdog] CFP: sheepdog bugtracker on Launchpad

2013-12-10 Thread Hitoshi Mitake
Hi sheepdog users and developers, We have a bugtracker on Launchpad: https://bugs.launchpad.net/sheepdog-project I'd like you to submit bugs and problems if they seem to be long living ones. Because mailing lists are not a suitable place for this purpose. Searching existing bugs from the

Re: [sheepdog] [PATCH 1/2] sheep: introduce strict mode for write

2013-12-10 Thread Robin Dong
Why not adding the check in gateway_forward_request() ? I think we should check the copy number before send forward the request out. 2013/12/10 Liu Yuan namei.u...@gmail.com We make sure we write the exact number of copies to honor the promise of the redundancy for strict mode. This means

Re: [sheepdog] [PATCH 1/2] sheep: introduce strict mode for write

2013-12-10 Thread Liu Yuan
On Wed, Dec 11, 2013 at 10:59:27AM +0800, Robin Dong wrote: Why not adding the check in gateway_forward_request() ? I think we should check the copy number before send forward the request out. I think it is better to check the request as early as possible, no? This is pointless to run the

Re: [sheepdog] [PATCH 1/2] sheep: introduce strict mode for write

2013-12-10 Thread Robin Dong
2013/12/11 Liu Yuan namei.u...@gmail.com On Wed, Dec 11, 2013 at 10:59:27AM +0800, Robin Dong wrote: Why not adding the check in gateway_forward_request() ? I think we should check the copy number before send forward the request out. I think it is better to check the request as early as

Re: [sheepdog] [PATCH 2/2] tests/func: add 080 to test strict mode

2013-12-10 Thread Robin Dong
Reviewed-by: Robin Dong san...@taobao.com 2013/12/10 Liu Yuan namei.u...@gmail.com Signed-off-by: Liu Yuan namei.u...@gmail.com --- tests/functional/080 | 37 + tests/functional/080.out | 14 ++ tests/functional/group |1 + 3

Re: [sheepdog] [PATCH] sheep: add an option for selecting the output directory of sheep.log

2013-12-10 Thread Teruaki Ishizaki
2013/12/11 Liu Yuan namei.u...@gmail.com: On Wed, Dec 11, 2013 at 10:31:54AM +0900, Ryusuke Konishi wrote: On Wed, 11 Dec 2013 10:22:05 +0900, Hitoshi Mitake wrote: At Tue, 10 Dec 2013 12:36:06 +0800, Liu Yuan wrote: On Mon, Dec 09, 2013 at 08:49:45PM +0900, Teruaki Ishizaki wrote:

Re: [sheepdog] [PATCH v2 1/3] sheep/http: store accounts and containers into hyper volume for object-storage

2013-12-10 Thread Liu Yuan
On Tue, Dec 10, 2013 at 06:41:04PM +0800, Robin Dong wrote: From: Robin Dong san...@taobao.com Using hyper volume (size up to 16PB) to store large number of accounts and containers. I can't apply this set on master. Could you please rebase it? And also please write a diff what you update

[sheepdog] [PATCH v2] sheep: add an option for selecting the output directory of sheep.log

2013-12-10 Thread Teruaki Ishizaki
Previously sheep.log was saved in the Sheepdog store directory, and used size of Sheepdog store directory included log file size. So, administrator couldn't do capacity planning simply. This patch adds an option for setting the output directory of sheep.log. Usage: $ sheep -L

[sheepdog] [PATCH] sheep: merge options related to sheep.log

2013-12-10 Thread Teruaki Ishizaki
Previously, sheep had many log options, -l, -F , -d and -L. This patch merge options to the option '-l'. Usage: $ sheep -l dir=log_directory,level=log_level_num,format=log_format Example: $ sheep -l dir=/logdir,level=7,format=server Signed-off-by: Teruaki Ishizaki

Re: [sheepdog] [PATCH v2] sheep: add an option for selecting the output directory of sheep.log

2013-12-10 Thread Liu Yuan
On Wed, Dec 11, 2013 at 04:25:45PM +0900, Teruaki Ishizaki wrote: Previously sheep.log was saved in the Sheepdog store directory, and used size of Sheepdog store directory included log file size. So, administrator couldn't do capacity planning simply. This patch adds an option for setting

Re: [sheepdog] [PATCH] sheep: merge options related to sheep.log

2013-12-10 Thread Liu Yuan
On Wed, Dec 11, 2013 at 04:30:15PM +0900, Teruaki Ishizaki wrote: Previously, sheep had many log options, -l, -F , -d and -L. This patch merge options to the option '-l'. Usage: $ sheep -l dir=log_directory,level=log_level_num,format=log_format Example: $ sheep -l

Re: [sheepdog] [PATCH stable-0.7 0/3] update for trivial changing

2013-12-10 Thread Liu Yuan
On Tue, Dec 10, 2013 at 11:29:03PM +0900, Hitoshi Mitake wrote: This update only contains trivial changes. 1. remove dead code in logger 2. remove a needless log message in md 3. resolve a build error of sheepfs on Ubuntu 13.01 Basically, users don't have to care about it. It is a