Re: durability model

2014-05-26 Thread Kyle Bader
> Something that is not yet clear for me is how do we study the overlapping of > different layers of reliability using the modelling tool. Is the idea to use > erasure coding on top of another reliable layer like a RAID-based storage? If > I understand correctly the current tool models disks, RA

Re: [Share]Performance tunning on Ceph FileStore with SSD backend

2014-05-26 Thread Stefan Priebe - Profihost AG
Am 27.05.2014 08:37, schrieb Haomai Wang: > I'm not full sure the correctness of changes although it seemed ok to > me. And I apply these changes to product env and no problems. Do you have a branch in your yuyuyu github account for this? > On Tue, May 27, 2014 at 2:05 PM, Stefan Priebe - Profiho

Re: [Share]Performance tunning on Ceph FileStore with SSD backend

2014-05-26 Thread Haomai Wang
I'm not full sure the correctness of changes although it seemed ok to me. And I apply these changes to product env and no problems. On Tue, May 27, 2014 at 2:05 PM, Stefan Priebe - Profihost AG wrote: > Am 27.05.2014 06:42, schrieb Haomai Wang: >> On Tue, May 27, 2014 at 4:29 AM, Stefan Priebe w

Re: [Share]Performance tunning on Ceph FileStore with SSD backend

2014-05-26 Thread Stefan Priebe - Profihost AG
Am 27.05.2014 06:42, schrieb Haomai Wang: > On Tue, May 27, 2014 at 4:29 AM, Stefan Priebe wrote: >> Hi Haomai, >> >> regarding the FDCache problems you're seeing. Isn't this branch interesting >> for you? Have you ever tested it? >> >> http://lists.ceph.com/pipermail/ceph-commit-ceph.com/2014-Jan

Re: [Share]Performance tunning on Ceph FileStore with SSD backend

2014-05-26 Thread Haomai Wang
On Tue, May 27, 2014 at 4:29 AM, Stefan Priebe wrote: > Hi Haomai, > > regarding the FDCache problems you're seeing. Isn't this branch interesting > for you? Have you ever tested it? > > http://lists.ceph.com/pipermail/ceph-commit-ceph.com/2014-January/007399.html > I don't test performance impro

Re: [Share]Performance tunning on Ceph FileStore with SSD backend

2014-05-26 Thread Haomai Wang
On Tue, May 27, 2014 at 4:29 AM, Stefan Priebe wrote: > Hi Haomai, > > regarding the FDCache problems you're seeing. Isn't this branch interesting > for you? Have you ever tested it? > > http://lists.ceph.com/pipermail/ceph-commit-ceph.com/2014-January/007399.html > Yes, I noticed it. But my main

RE: Slow request on cache tiering

2014-05-26 Thread Wang, Zhiqiang
Thanks Mark! I agree with you that the slow request is caused by that the cache is full and needs to do flush. In my testing, a base pool with SSD journals also performs good than that of a base pool with a cache tier. For the heartbeat failure issue, I'll try your workaround to see. -Origin

Re: Feedback: default FS pools and newfs behavior

2014-05-26 Thread Sebastien Han
Hi John, Thanks for you work! Sébastien Han Cloud Engineer "Always give 100%. Unless you're giving blood.” Phone: +33 (0)1 49 70 99 72 Mail: sebastien@enovance.com Address : 11 bis, rue Roquépine - 75008 Paris Web : www.enovance.com - Twitter : @enovance On 21 May 2014, at 17:32

Re: [Share]Performance tunning on Ceph FileStore with SSD backend

2014-05-26 Thread Stefan Priebe
Hi Haomai, regarding the FDCache problems you're seeing. Isn't this branch interesting for you? Have you ever tested it? http://lists.ceph.com/pipermail/ceph-commit-ceph.com/2014-January/007399.html Greets, Stefan Am 09.04.2014 12:05, schrieb Haomai Wang: Hi all, I would like to share some

ceph branch status

2014-05-26 Thread ceph branch robot
-- All Branches -- Alfredo Deza 2013-09-27 10:33:52 -0400 wip-5900 2014-05-22 17:04:28 -0400 wip-8292 Dan Mick 2013-07-16 23:00:06 -0700 wip-5634 2014-03-24 21:06:21 -0700 wip-sockaddr 2014-03-28 18:45:51 -0700 wip-fix-testcrypto Gary Lowell

Re: [Performance] Improvement on DB Performance

2014-05-26 Thread Haomai Wang
On Wed, May 21, 2014 at 11:23 PM, Sage Weil wrote: > On Wed, 21 May 2014, Haomai Wang wrote: >> I pushed the commit to fix this >> problem(https://github.com/ceph/ceph/pull/1848). >> >> With test program(Each sync request is issued with ten write request), >> a significant improvement is noticed.

Re: Slow request on cache tiering

2014-05-26 Thread Mark Nelson
On 05/26/2014 07:05 AM, Wang, Zhiqiang wrote: Hi all, Hi Zhigiang! The problem you describe below is something we've seen internally at Inktank as well. I've got a couple of comments / suggestions. I'm experiencing a problem when running ceph with cache tiering. Can someone help to take

Re: erasure code & reliability model

2014-05-26 Thread Loic Dachary
Hi koleosfuskus, I've added a link to the page in https://wiki.ceph.com/Development for future reference. Cheers On 26/05/2014 13:02, Koleos Fuskus wrote: > Hello Guang, > > Here is the wiki: > https://wiki.ceph.com/Development/Add_erasure_coding_to_the_durability_modeling > > Koleos > > >

Slow request on cache tiering

2014-05-26 Thread Wang, Zhiqiang
Hi all, I'm experiencing a problem when running ceph with cache tiering. Can someone help to take a look? Any comments are appreciated, thx! ===Configuration=== I have 2 pools, one is 'rbd', the other is 'cache'. Pool 'cache' is the cache tier of pool 'rbd'. The 'rbd' pool has 16 HDD OSDs. And

Re: erasure code & reliability model

2014-05-26 Thread Guang Yang
Thanks Koleos! Guang On May 26, 2014, at 7:02 PM, Koleos Fuskus wrote: > Hello Guang, > > Here is the wiki: > https://wiki.ceph.com/Development/Add_erasure_coding_to_the_durability_modeling > > Koleos > > > > On Monday, May 26, 2014 10:05 AM, Guang Yang wrote: > Hello Loic and Koleos, > D

Re: Questions of KeyValueStore (leveldb) backend

2014-05-26 Thread Haomai Wang
On Mon, May 26, 2014 at 5:23 PM, Wido den Hollander wrote: > On 05/26/2014 06:55 AM, Haomai Wang wrote: >> >> On Mon, May 26, 2014 at 9:46 AM, Guang Yang wrote: >>> >>> Hello Haomai, >>> We are evaluating the key-value store backend which comes along with >>> Firefly release (thanks for implement

Re: Questions of KeyValueStore (leveldb) backend

2014-05-26 Thread Wido den Hollander
On 05/26/2014 06:55 AM, Haomai Wang wrote: On Mon, May 26, 2014 at 9:46 AM, Guang Yang wrote: Hello Haomai, We are evaluating the key-value store backend which comes along with Firefly release (thanks for implementing it in Ceph), it is very promising for a couple of our use cases, after goin

Repair-Optimal MDS Array Codes over GF(2)

2014-05-26 Thread Loic Dachary
Hi Cyril, I browsed your article on "Repair-Optimal MDS Array Codes over GF(2)" http://arxiv.org/pdf/1302.4129.pdf and it looks like something useful in the context of Ceph. Are you aware of a Free Software implementation I could look at ? Cheers -- Loïc Dachary, Artisan Logiciel Libre s

Re: erasure code & reliability model

2014-05-26 Thread Guang Yang
Hello Loic and Koleos, Do we have any wiki page documenting the progress and report of this effort? We are very interested in such as well. Thanks, Guang On May 8, 2014, at 1:19 AM, Loic Dachary wrote: > > Hi, > > On 07/05/2014 18:43, Koleos Fuskus wrote:> Hi Loic, >> >> What do you mean by