Re: Ceph Ansible Repo

2014-03-03 Thread Sebastien Han
Ian, Yes I’ve seen it, however it only installs Ceph. Cheers. Sébastien Han Cloud Engineer "Always give 100%. Unless you're giving blood.” Phone: +33 (0)1 49 70 99 72 Mail: sebastien@enovance.com Address : 11 bis, rue Roquépine - 75008 Paris Web : www.enovance.com - Twitter : @en

Erasure Code user guide

2014-03-03 Thread Loic Dachary
Hi John, I'd like to draft a user guide for erasure coded pools, oriented toward system administrators. Where do you advise me to insert this ? Should I get inspiration from an example ? Thanks in advance for any pointers or advice :-) -- Loïc Dachary, Artisan Logiciel Libre signature.asc

Re: [RFC] add rocksdb support

2014-03-03 Thread Mark Nelson
On 03/02/2014 08:07 PM, Shu, Xinxin wrote: Hi all, This patch added rocksdb support for ceph, enabled rocksdb for omap directory. Rocksdb source code can be get from link. To use use rocksdb, C++11 standard should be enabled, gcc version >= 4.7 is required to get C++11 support. Rocksdb can

Re: Erasure Code user guide

2014-03-03 Thread Wido den Hollander
On 03/03/2014 02:20 PM, Loic Dachary wrote: Hi John, I'd like to draft a user guide for erasure coded pools, oriented toward system administrators. Where do you advise me to insert this ? Should I get inspiration from an example ? the docs dir isn't good for that? If not, might be that the

Re: Ceph Ansible Repo

2014-03-03 Thread Travis Rhoden
I had been working on something similar to Seb's. Alfredo's (which I had looked at before) seems to be a wrapper around ceph-deploy. Useful, but not as fully featured. It also hasn't been updated in 7 months. I would certainly like to see a more fully-featured set of Ansible playbooks in Ceph's

[PATCH] rbd: fix error paths in rbd_img_request_fill()

2014-03-03 Thread Ilya Dryomov
Doing rbd_obj_request_put() in rbd_img_request_fill() error paths is not only insufficient, but also triggers an rbd_assert() in rbd_obj_request_destroy(): Assertion failure in rbd_obj_request_destroy() at line 1867: rbd_assert(obj_request->img_request == NULL); rbd_img_obj_request_add() adds obj

Re: Erasure Code user guide

2014-03-03 Thread Loic Dachary
On 03/03/2014 15:47, Wido den Hollander wrote: > On 03/03/2014 02:20 PM, Loic Dachary wrote: >> Hi John, >> >> I'd like to draft a user guide for erasure coded pools, oriented toward >> system administrators. Where do you advise me to insert this ? Should I get >> inspiration from an example ?

ceph branch status

2014-03-03 Thread ceph branch robot
-- All Branches -- Alfredo Deza 2013-09-27 10:33:52 -0400 wip-5900 2014-01-21 16:29:22 -0500 wip-6465 Dan Mick 2013-07-16 23:00:06 -0700 wip-5634 2014-02-12 23:29:28 -0800 wip-no-version 2014-02-18 13:07:32 -0800 wip-7463 2014-02-27 17:2

Re: Erasure Code user guide

2014-03-03 Thread Wido den Hollander
On 03/03/2014 04:35 PM, Loic Dachary wrote: On 03/03/2014 15:47, Wido den Hollander wrote: On 03/03/2014 02:20 PM, Loic Dachary wrote: Hi John, I'd like to draft a user guide for erasure coded pools, oriented toward system administrators. Where do you advise me to insert this ? Should I get

Re: [PATCH 0/3] Ceph fscache: Fix kernel panic due to a race

2014-03-03 Thread Milosz Tanski
Hey guys, I'm terribly sorry but apparently this got stuck in my draft mailbox for 3 months. Since we've been running this on both our test / prod clusters I would say this is sufficiently tested. I've looked at the code and tested this for a week now on test cluster and it looks good. It does fix

Re: Ceph Ansible Repo

2014-03-03 Thread Ian Colle
Gents, Enjoy. Ready for PR’s. https://github.com/ceph/ceph-ansible Ian R. Colle Director of Engineering Inktank Delivering the Future of Storage http://www.linkedin.com/in/ircolle http://www.twitter.com/ircolle Cell: +1.303.601.7713 Email: i...@inktank.com On 3/3/14, 8:30 AM, "Travis Rhoden"

Re: Ceph Ansible Repo

2014-03-03 Thread Sebastien Han
Thanks a lot Ian, here we go https://github.com/ceph/ceph-ansible/pull/1 :) Sébastien Han Cloud Engineer "Always give 100%. Unless you're giving blood.” Phone: +33 (0)1 49 70 99 72 Mail: sebastien@enovance.com Address : 11 bis, rue Roquépine - 75008 Paris Web : www.enovance.com -

Re: [GSOC] Google Storage API Project

2014-03-03 Thread Vipul Nayyar
Hello, I'm Vipul, a Computer Engg. student studying in New Delhi. I've been a past GSOC student under RTEMS last year, along with experience in working on distributed storage systems, especially Redhat's Gluster. So, basically I have some successful experience in contributing to Open Source and

Re: [GSOC] Google Storage API Project

2014-03-03 Thread Ian Colle
Vipul, Great to hear from you! You can start here: http://www.ceph.com/docs/master/. For the S3 API specifically http://www.ceph.com/docs/master/radosgw/s3/ Background architecture docs might be of interest - http://www.ceph.com/docs/master/architecture/ Have you looked in https://github.com/c

Re: Erasure Code user guide

2014-03-03 Thread Loic Dachary
Hi John, Thanks for the guidance, I'll do as you suggest. Cheers On 03/03/2014 21:14, John Wilkins wrote: > Sorry Loic. I didn't see this earlier. > > I recommend putting it here: http://ceph.com/docs/master/rados/operations/ > > We already have a guide for pools here: > http://ceph.com/doc

Re: [PATCH] rbd: fix error paths in rbd_img_request_fill()

2014-03-03 Thread Alex Elder
On 03/03/2014 09:38 AM, Ilya Dryomov wrote: Doing rbd_obj_request_put() in rbd_img_request_fill() error paths is not only insufficient, but also triggers an rbd_assert() in rbd_obj_request_destroy(): Assertion failure in rbd_obj_request_destroy() at line 1867: rbd_assert(obj_request->img_request

ceph-osd seg-fault with small writes

2014-03-03 Thread Noah Watkins
Running rados bench with the default 4MB object size works fine, but when I shrink the write size to 4K (i.e. running `rados -p data -b 4096 bench 30 write`), ceph-osd will segfault almost immediately. Here is the segfault, and a link to the full debug uploaded using ceph-post-file. ceph-post-fil

New Defects reported by Coverity Scan for ceph (fwd)

2014-03-03 Thread Sage Weil
--- Begin Message --- Hi, Please find the latest report on new defect(s) introduced to ceph found with Coverity Scan. Defect(s) Reported-by: Coverity Scan Showing 15 of 15 defect(s) ** CID 1188299: Data race condition (MISSING_LOCK) /mds/MDSUtility.cc: 142 in MDSUtility::handle_mds_map(MM

Re: New Defects reported by Coverity Scan for ceph (fwd)

2014-03-03 Thread John Spray
On Mon, Mar 3, 2014 at 10:23 PM, Sage Weil wrote: > ** CID 1188299: Data race condition (MISSING_LOCK) > /mds/MDSUtility.cc: 142 in MDSUtility::handle_mds_map(MMDSMap *)() Is there a trick to getting coverity to realise that the lock is held, but by the calling function? Does it recognise asse

Re: Erasure Code user guide

2014-03-03 Thread Loic Dachary
I should have checked the tracker. Thanks Neil :-) http://tracker.ceph.com/issues/7548#note-1 On 03/03/2014 23:32, Neil Levine wrote: > Loic, feel free to grab http://tracker.ceph.com/issues/7548 > > The wiki is probably better for "opinionated" guides (preferred > architectures, tuning tweaks

Re: ceph-brag ready

2014-03-03 Thread Sage Weil
Hi Sebastien, Good seeing you last week in Frankfurt! I meant to follow up earlier (or hack on this a bit myself) but haven't had time. After taking a look, my wish list here would be: - simplify the 'bytes' info to just be bytes. - maybe prefix these all with 'num_' - for crush_types, make

Re: New Defects reported by Coverity Scan for ceph (fwd)

2014-03-03 Thread Li Wang
Then it seems that Coverity is only able to perform intra-procedure check, is there any inter-procedure check option to turn on? On 2014/3/4 6:53, John Spray wrote: On Mon, Mar 3, 2014 at 10:23 PM, Sage Weil wrote: ** CID 1188299: Data race condition (MISSING_LOCK) /mds/MDSUtility.cc: 142 i

Re: [RFC] add rocksdb support

2014-03-03 Thread Alexandre DERUMIER
>>Performance Test >>Attached file is the performance comparison of rocksdb and leveldb on four >>nodes with 40 osds, using 'rados bench' as the test tool. The performance >>results is quite promising. Thanks for your work, indeed performance seem to be promising ! >>Any comments or suggestio