Re: still recovery issues with cuttlefish

2013-08-14 Thread Stefan Priebe - Profihost AG
the same problem still occours. Will need to check when i've time to gather logs again. Am 14.08.2013 01:11, schrieb Samuel Just: I'm not sure, but your logs did show that you had 16 recovery ops in flight, so it's worth a try. If it doesn't help, you should collect the same set of logs I'll

Re: [PATCH v4] Ceph-fuse: Fallocate and punch hole support

2013-08-14 Thread Li Wang
Ok, regarding the very 'FIRST' object, what does 'FIRST' refer to? Suppose the object size is 4MB, we open an empty file, write at [6MB, 7MB], then an object named something like 0001 generated. Is it the first object? Then next time, if we write at [0MB, 1MB], then the object named

Re: [ceph-users] Help needed porting Ceph to RSockets

2013-08-14 Thread Andreas Bluemle
Hi, maybe some information about the environment I am working in: - CentOS 6.4 with custom kernel 3.8.13 - librdmacm / librspreload from git, tag 1.0.17 - application started with librspreload in LD_PRELOAD environment Currently, I have increased the value of the spin time by setting the

Re: teuthology and code coverage

2013-08-14 Thread Josh Durgin
On 08/13/2013 10:01 AM, Loic Dachary wrote: Hi, When running teuthology from a laptop with the configuration below and ./virtualenv/bin/teuthology --archive=/tmp/teuthology try.yaml it then fails on ./virtualenv/bin/teuthology-coverage -v --html-output /tmp/html -o /tmp/lcov

Re: [PATCH v4] Ceph-fuse: Fallocate and punch hole support

2013-08-14 Thread Yan, Zheng
On Wed, Aug 14, 2013 at 3:06 PM, Li Wang liw...@ubuntukylin.com wrote: Ok, regarding the very 'FIRST' object, what does 'FIRST' refer to? Suppose the object size is 4MB, we open an empty file, write at [6MB, 7MB], then an object named something like 0001 generated. Is it the first object? Then

RE: v0.67 Dumpling released

2013-08-14 Thread Dietmar Maurer
Another three months have gone by, and the next stable release of Ceph is ready: Dumpling! Thank you to everyone who has contributed to this release! Seem there is a new dependency in the ceph-common debian package: python-ceph Is that really required (previous release does not depend on

Re: teuthology and code coverage

2013-08-14 Thread Loic Dachary
On 14/08/2013 09:38, Josh Durgin wrote: On 08/13/2013 10:01 AM, Loic Dachary wrote: Hi, When running teuthology from a laptop with the configuration below and ./virtualenv/bin/teuthology --archive=/tmp/teuthology try.yaml it then fails on ./virtualenv/bin/teuthology-coverage -v

Re: v0.67 Dumpling released

2013-08-14 Thread James Page
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 On 14/08/13 08:37, Dietmar Maurer wrote: Another three months have gone by, and the next stable release of Ceph is ready: Dumpling! Thank you to everyone who has contributed to this release! Seem there is a new dependency in the ceph-common

Re: [Xen-devel] Xen blktap driver for Ceph RBD : Anybody wants to test ? :p

2013-08-14 Thread Frederik Thuysbaert
On 13-08-13 17:39, Sylvain Munaut wrote: It's actually strange that it changes anything at all. Can you try adding a ERROR(HERE\n); in that error path processing and check syslog to see if it's triggered at all ? A traceback would be great if you can get a core file. And possibly compile

review request : ReplicatedPG::AccessMode::wake removal

2013-08-14 Thread Loic Dachary
Hi Sam, IIRC, a few weeks ago you told me that https://github.com/ceph/ceph/blob/962b64a83037ff79855c5261325de0cd1541f582/src/osd/ReplicatedPG.cc#L4626 if (mode.wake) { requeue_ops(mode.waiting); for (listCond*::iterator p = mode.waiting_cond.begin(); p != mode.waiting_cond.end();

How to collect coverage with teuthology ?

2013-08-14 Thread Loic Dachary
Hi, Although http://gitbuilder.sepia.ceph.com/gitbuilder-ceph-deb-precise-amd64-gcov/log.cgi?log=26707923b23cb55583a7d6b46ef6deb9591fd165 claims to build packages with coverage ( -gcov in the name ), I can't figure out where it is nor how it is supposed to be used. A hint would be much

RGW blueprint for plugin architecture

2013-08-14 Thread Roald van Loon
Hi all, For those interested; http://wiki.ceph.com/01Planning/02Blueprints/Emperor/rgw:_plugin_architecture I know a plugin architecture is a sensitive subject for a lot of people (it is for me at least), but I think it might be worthwhile discussing it. Please comment/flame away :-) Roald

Re: [ceph-users] Help needed porting Ceph to RSockets

2013-08-14 Thread Atchley, Scott
On Aug 14, 2013, at 3:21 AM, Andreas Bluemle andreas.blue...@itxperts.de wrote: Hi, maybe some information about the environment I am working in: - CentOS 6.4 with custom kernel 3.8.13 - librdmacm / librspreload from git, tag 1.0.17 - application started with librspreload in LD_PRELOAD

Re: [Xen-devel] Xen blktap driver for Ceph RBD : Anybody wants to test ? :p

2013-08-14 Thread Sylvain Munaut
Hi, I just tested with tap2:aio and that worked (had an old image of the VM on lvm still so just tested with that). Switching back to rbd and it crashes every time, just as postgres is starting in the vm. Booting into single user mode, waiting 30 seconds, then letting the boot continue it

RE: [Xen-devel] Xen blktap driver for Ceph RBD : Anybody wants to test ? :p

2013-08-14 Thread James Harper
Hi, I just tested with tap2:aio and that worked (had an old image of the VM on lvm still so just tested with that). Switching back to rbd and it crashes every time, just as postgres is starting in the vm. Booting into single user mode, waiting 30 seconds, then letting the boot continue

Re: [Xen-devel] Xen blktap driver for Ceph RBD : Anybody wants to test ? :p

2013-08-14 Thread Sylvain Munaut
Hi Frederik, A traceback would be great if you can get a core file. And possibly compile tapdisk with debug symbols. I'm not quite sure what u mean, can u give some more information on how I do this? I compiled tapdisk with ./configure CFLAGS=-g, but I'm not sure this is what u meant. Yes,

Re: [PATCH v4] Ceph-fuse: Fallocate and punch hole support

2013-08-14 Thread Sage Weil
On Wed, 14 Aug 2013, Li Wang wrote: Ok, regarding the very 'FIRST' object, what does 'FIRST' refer to? Suppose the object size is 4MB, we open an empty file, write at [6MB, 7MB], then an object named something like 0001 generated. Is it the first object? Then next time, if we write at [0MB,

RE: v0.67 Dumpling released

2013-08-14 Thread Sage Weil
On Wed, 14 Aug 2013, Dietmar Maurer wrote: Another three months have gone by, and the next stable release of Ceph is ready: Dumpling! Thank you to everyone who has contributed to this release! Seem there is a new dependency in the ceph-common debian package: python-ceph Is that really

Re: How to collect coverage with teuthology ?

2013-08-14 Thread Sage Weil
On Wed, 14 Aug 2013, Loic Dachary wrote: Hi, Although http://gitbuilder.sepia.ceph.com/gitbuilder-ceph-deb-precise-amd64-gcov/log.cgi?log=26707923b23cb55583a7d6b46ef6deb9591fd165 claims to build packages with coverage ( -gcov in the name ), I can't figure out where it is nor how it is

RE: [ceph-users] Help needed porting Ceph to RSockets

2013-08-14 Thread Hefty, Sean
The first question I would have is: why is the rpoll() split into these two pieces? There must have been some reason to do a busy loop on some local state information rather than just call the real poll() directly. As Scott mentioned in his email, this is done for performance reasons. The

Re: RGW blueprint for plugin architecture

2013-08-14 Thread Yehuda Sadeh
On Wed, Aug 14, 2013 at 5:57 AM, Roald van Loon roaldvanl...@gmail.com wrote: Hi all, For those interested; http://wiki.ceph.com/01Planning/02Blueprints/Emperor/rgw:_plugin_architecture I know a plugin architecture is a sensitive subject for a lot of people (it is for me at least), but I

Re: review request : ReplicatedPG::AccessMode::wake removal

2013-08-14 Thread Loic Dachary
I removed the code in a minimal way instead of removing the data member itself, as you suggested. https://github.com/dachary/ceph/commit/2f73eea0b8d7d4633d5887ba725d258ce81f8ac0 On 14/08/2013 12:17, Loic Dachary wrote: Hi Sam, IIRC, a few weeks ago you told me that

Re: RGW blueprint for plugin architecture

2013-08-14 Thread Roald van Loon
I most definitely agree, that's why I think a lightweight and extensible solution would be best. No big interface description but just a simple loader function with parameters depending on the type of 'plugin'. If we need another type of plugin, we can add that later on (of course, we have to be

Re: github pull requests, comments and rebase

2013-08-14 Thread Gregory Farnum
On Thu, Aug 8, 2013 at 1:46 PM, Sage Weil s...@inktank.com wrote: On Thu, 8 Aug 2013, Loic Dachary wrote: Hi Sage, During the discussions about continuous integration at the CDS this week ( http://youtu.be/cGosx5zD4FM?t=1h16m05s ) you mentionned that github was able to keep track of the

Re: RGW blueprint for plugin architecture

2013-08-14 Thread Yehuda Sadeh
On Wed, Aug 14, 2013 at 11:24 AM, Roald van Loon roaldvanl...@gmail.com wrote: I most definitely agree, that's why I think a lightweight and extensible solution would be best. No big interface description but just a simple loader function with parameters depending on the type of 'plugin'. If

Re: cephfs set_layout - EINVAL - solved

2013-08-14 Thread Gregory Farnum
On Fri, Aug 9, 2013 at 2:03 AM, Kasper Dieter dieter.kas...@ts.fujitsu.com wrote: OK, I found this nice page: http://ceph.com/docs/next/dev/file-striping/ which explains --stripe_unit --stripe_count --object_size But still I'm not sure about (1) what is the equivalent command on cephfs to

Re: cephfs set_layout - tuning

2013-08-14 Thread Kasper Dieter
On Wed, Aug 14, 2013 at 10:17:24PM +0200, Gregory Farnum wrote: On Fri, Aug 9, 2013 at 2:03 AM, Kasper Dieter dieter.kas...@ts.fujitsu.com wrote: OK, I found this nice page: http://ceph.com/docs/next/dev/file-striping/ which explains --stripe_unit --stripe_count --object_size But still

Re: cephfs set_layout - tuning

2013-08-14 Thread Gregory Farnum
On Wed, Aug 14, 2013 at 1:38 PM, Kasper Dieter dieter.kas...@ts.fujitsu.com wrote: On Wed, Aug 14, 2013 at 10:17:24PM +0200, Gregory Farnum wrote: On Fri, Aug 9, 2013 at 2:03 AM, Kasper Dieter dieter.kas...@ts.fujitsu.com wrote: OK, I found this nice page:

Re: radosgw S3 api

2013-08-14 Thread Lorieri
for the records: radosgw-admin key create --gen-secret --subuser=myuser:swift --key-type=swift git clone https://github.com/openstack/python-swiftclient.git cd python-swiftclient python setup.py install swift -v -A http://mycluster/auth/v1.0 -U myuser:swift --key='x' post mybucket -r .r:*

[PATCH v4] Ceph: Punch hole support for kernel client

2013-08-14 Thread Li Wang
This patch implements fallocate and punch hole support for Ceph kernel client. Signed-off-by: Li Wang liw...@ubuntukylin.com Signed-off-by: Yunchuan Wen yunchuan...@ubuntukylin.com --- Passed the fsx test from xfstests. Truncate rather than delete the first object. Thanks go to Sage and Zheng

[PATCH v5] Ceph: Punch hole support for kernel client

2013-08-14 Thread Li Wang
This patch implements fallocate and punch hole support for Ceph kernel client. Signed-off-by: Li Wang liw...@ubuntukylin.com Signed-off-by: Yunchuan Wen yunchuan...@ubuntukylin.com --- Against v3: Passed the fsx test from xfstests. Truncate rather than delete the first object. Thanks go to Sage

[PATCH v5] Ceph-fuse: Fallocate and punch hole support

2013-08-14 Thread Li Wang
This patch implements fallocate and punch hole support for Ceph fuse client. Signed-off-by: Yunchuan Wen yunchuan...@ubuntukylin.com Signed-off-by: Li Wang liw...@ubuntukylin.com --- Enable libcephfs to not delete the first object by passing in a flag. --- src/client/Client.cc | 93

Re: [PATCH v5] Ceph-fuse: Fallocate and punch hole support

2013-08-14 Thread Sage Weil
On Thu, 15 Aug 2013, Li Wang wrote: This patch implements fallocate and punch hole support for Ceph fuse client. Signed-off-by: Yunchuan Wen yunchuan...@ubuntukylin.com Signed-off-by: Li Wang liw...@ubuntukylin.com This is failing to build on several platforms.. take a look at

[patch 1/2] libceph: fix error handling in handle_reply()

2013-08-14 Thread Dan Carpenter
We've tried to fix the error paths in this function before, but there is still a hidden goto in the ceph_decode_need() macro which goes to the wrong place. We need to release the req and unlock a mutex before returning. Signed-off-by: Dan Carpenter dan.carpen...@oracle.com diff --git

[patch 2/2] libceph: potential NULL dereference in ceph_osdc_handle_map()

2013-08-14 Thread Dan Carpenter
There are two places where we read nr_maps if both of them are set to zero then we would hit a NULL dereference here. Signed-off-by: Dan Carpenter dan.carpen...@oracle.com --- I think this is a real bug, but please review my fix for it because I'm not very familiar with this code. diff --git