RE: [RFC] add rocksdb support

2014-07-02 Thread Sushma Gurram
My question is that whether your > estimate branch has DBObjectMap header cache, if enable header cache, is the > "header_lock" still be a awful point? Same as KeyValueStore, I will try to > see too. > > >> >> Thanks, >> Sushma >> >> -Origin

Re: [RFC] add rocksdb support

2014-07-02 Thread Haomai Wang
--- > From: Haomai Wang [mailto:haomaiw...@gmail.com] > Sent: Tuesday, July 01, 2014 2:10 PM > To: Sushma Gurram > Cc: Shu, Xinxin; Mark Nelson; Sage Weil; Zhang, Jian; > ceph-devel@vger.kernel.org > Subject: Re: [RFC] add rocksdb support > > Hi Sushma, > > Thank

Re: [RFC] add rocksdb support

2014-07-02 Thread Haomai Wang
s DBObjectMap header cache, if enable header cache, is the > "header_lock" still be a awful point? Same as KeyValueStore, I will try to > see too. > > >> >> Thanks, >> Sushma >> >> -Original Message- >> From: Haomai Wang [mailto:haomaiw

RE: [RFC] add rocksdb support

2014-07-02 Thread Shu, Xinxin
ginal Message- > From: Haomai Wang [mailto:haomaiw...@gmail.com] > Sent: Friday, June 27, 2014 1:08 AM > To: Sushma Gurram > Cc: Shu, Xinxin; Mark Nelson; Sage Weil; Zhang, Jian; > ceph-devel@vger.kernel.org > Subject: Re: [RFC] add rocksdb support > > As I mention

RE: [RFC] add rocksdb support

2014-07-01 Thread Sushma Gurram
ssage- From: Haomai Wang [mailto:haomaiw...@gmail.com] Sent: Tuesday, July 01, 2014 10:03 AM To: Sushma Gurram Cc: Somnath Roy; Shu, Xinxin; Mark Nelson; Sage Weil; Zhang, Jian; ceph-devel@vger.kernel.org Subject: Re: [RFC] add rocksdb support On Tue, Jul 1, 2014 at 11:15 PM, Sushma Gurram

Re: [RFC] add rocksdb support

2014-07-01 Thread Haomai Wang
m: Haomai Wang [mailto:haomaiw...@gmail.com] > Sent: Tuesday, July 01, 2014 1:06 AM > To: Somnath Roy > Cc: Sushma Gurram; Shu, Xinxin; Mark Nelson; Sage Weil; Zhang, Jian; > ceph-devel@vger.kernel.org > Subject: Re: [RFC] add rocksdb support > > Hi, > > I don'

RE: [RFC] add rocksdb support

2014-07-01 Thread Sage Weil
gt; > -Original Message- > From: ceph-devel-ow...@vger.kernel.org > [mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Haomai Wang > Sent: Monday, June 30, 2014 11:10 PM > To: Sushma Gurram > Cc: Shu, Xinxin; Mark Nelson; Sage Weil; Zhang, Jian; > ceph-devel@vger

RE: [RFC] add rocksdb support

2014-07-01 Thread Sushma Gurram
ks, Sushma -Original Message- From: Haomai Wang [mailto:haomaiw...@gmail.com] Sent: Tuesday, July 01, 2014 1:06 AM To: Somnath Roy Cc: Sushma Gurram; Shu, Xinxin; Mark Nelson; Sage Weil; Zhang, Jian; ceph-devel@vger.kernel.org Subject: Re: [RFC] add rocksdb support Hi, I don't know why OSD cap

Re: [RFC] add rocksdb support

2014-07-01 Thread Haomai Wang
h-devel-ow...@vger.kernel.org] On Behalf Of Haomai Wang > Sent: Monday, June 30, 2014 11:10 PM > To: Sushma Gurram > Cc: Shu, Xinxin; Mark Nelson; Sage Weil; Zhang, Jian; > ceph-devel@vger.kernel.org > Subject: Re: [RFC] add rocksdb support > > Hi Sushma, > > Thanks for y

RE: [RFC] add rocksdb support

2014-07-01 Thread Somnath Roy
l Message- From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Haomai Wang Sent: Monday, June 30, 2014 11:10 PM To: Sushma Gurram Cc: Shu, Xinxin; Mark Nelson; Sage Weil; Zhang, Jian; ceph-devel@vger.kernel.org Subject: Re: [RFC] add rocksdb support

Re: [RFC] add rocksdb support

2014-06-30 Thread Haomai Wang
t; From: Haomai Wang [mailto:haomaiw...@gmail.com] > Sent: Friday, June 27, 2014 1:08 AM > To: Sushma Gurram > Cc: Shu, Xinxin; Mark Nelson; Sage Weil; Zhang, Jian; > ceph-devel@vger.kernel.org > Subject: Re: [RFC] add rocksdb support > > As I mentioned days ago: > > There ex

RE: [RFC] add rocksdb support

2014-06-30 Thread Sushma Gurram
this lock? Thanks, Sushma -Original Message- From: Haomai Wang [mailto:haomaiw...@gmail.com] Sent: Friday, June 27, 2014 1:08 AM To: Sushma Gurram Cc: Shu, Xinxin; Mark Nelson; Sage Weil; Zhang, Jian; ceph-devel@vger.kernel.org Subject: Re: [RFC] add rocksdb support As I mentioned days ago:

RE: [RFC] add rocksdb support

2014-06-27 Thread Sushma Gurram
lto:aderum...@odiso.com] Sent: Thursday, June 26, 2014 8:34 PM To: Sushma Gurram Cc: Jian Zhang; ceph-devel@vger.kernel.org; Xinxin Shu; Mark Nelson; Sage Weil Subject: Re: [RFC] add rocksdb support Hi Sushma, what is the hardware disk for osd ? ssd ? where is the journal for xfs osd ? on the

Re: [RFC] add rocksdb support

2014-06-27 Thread Haomai Wang
M > To: 'Shu, Xinxin'; 'Mark Nelson'; 'Sage Weil' > Cc: 'Zhang, Jian'; ceph-devel@vger.kernel.org > Subject: RE: [RFC] add rocksdb support > > > Hi Xinxin, > > Thanks for providing the results of the performance tests. > > I use

Re: [RFC] add rocksdb support

2014-06-26 Thread Alexandre DERUMIER
h-devel@vger.kernel.org Envoyé: Vendredi 27 Juin 2014 02:44:17 Objet: RE: [RFC] add rocksdb support Delivery failure due to table format. Resending as plain text. _ From: Sushma Gurram Sent: Thursday, June 26, 2014 5:35 PM To: 'Shu, X

RE: [RFC] add rocksdb support

2014-06-26 Thread Sushma Gurram
anks, Sushma -Original Message- From: Shu, Xinxin [mailto:xinxin@intel.com] Sent: Sunday, June 22, 2014 6:18 PM To: Sushma Gurram; 'Mark Nelson'; 'Sage Weil' Cc: 'ceph-devel@vger.kernel.org'; Zhang, Jian Subject: RE: [RFC] add rocksdb support Hi all, We enabled roc

Re: [RFC] add rocksdb support

2014-06-23 Thread Dan van der Ster
github.com/ceph/rocksdb/pull/2 has not been merged , so if > you use 'git submodule update --init' to get rocksdb submodule , It did not > support autoconf/automake . > > -Original Message- > From: ceph-devel-ow...@vger.kernel.org > [mailto:ceph-devel-ow...@vger.kernel.org]

RE: [RFC] add rocksdb support

2014-06-22 Thread Shu, Xinxin
0.495 668.360 0.383 680.673 0.376 -Original Message- From: Shu, Xinxin Sent: Saturday, June 14, 2014 11:50 AM To: Sushma Gurram; Mark Nelson; Sage Weil Cc: ceph-devel@vger.kernel.org; Zhang, Jian Subject: RE: [RFC] add rocksdb support Currently ceph will

RE: [RFC] add rocksdb support

2014-06-13 Thread Shu, Xinxin
- From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Sushma Gurram Sent: Saturday, June 14, 2014 2:52 AM To: Shu, Xinxin; Mark Nelson; Sage Weil Cc: ceph-devel@vger.kernel.org; Zhang, Jian Subject: RE: [RFC] add rocksdb support Hi Xinxin, I tried to c

Re: [RFC] add rocksdb support

2014-06-13 Thread David Zafman
Original Message- > From: ceph-devel-ow...@vger.kernel.org > [mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Shu, Xinxin > Sent: Monday, June 09, 2014 10:00 PM > To: Mark Nelson; Sage Weil > Cc: ceph-devel@vger.kernel.org; Zhang, Jian > Subject: RE: [RFC] add ro

RE: [RFC] add rocksdb support

2014-06-13 Thread Sushma Gurram
bject: RE: [RFC] add rocksdb support Hi mark I have finished development of support of rocksdb submodule, a pull request for support of autoconf/automake for rocksdb has been created , you can find https://github.com/ceph/rocksdb/pull/2 , if this patch is ok , I will create a pull reques

RE: [RFC] add rocksdb support

2014-06-09 Thread Shu, Xinxin
@vger.kernel.org; Zhang, Jian Subject: Re: [RFC] add rocksdb support Hi Xinxin, On 05/28/2014 05:05 AM, Shu, Xinxin wrote: > Hi sage , > I will add two configure options to --with-librocksdb-static and > --with-librocksdb , with --with-librocksdb-static option , ceph will compile > the c

Re: [RFC] add rocksdb support

2014-06-09 Thread Mark Nelson
From: Mark Nelson [mailto:mark.nel...@inktank.com] Sent: Wednesday, May 21, 2014 9:06 PM To: Shu, Xinxin; Sage Weil Cc: ceph-devel@vger.kernel.org; Zhang, Jian Subject: Re: [RFC] add rocksdb support On 05/21/2014 07:54 AM, Shu, Xinxin wrote: Hi, sage I will add rocksdb submodule into the makefile , cu

RE: [RFC] add rocksdb support

2014-06-03 Thread Sage Weil
1, 2014 9:06 PM > To: Shu, Xinxin; Sage Weil > Cc: ceph-devel@vger.kernel.org; Zhang, Jian > Subject: Re: [RFC] add rocksdb support > > On 05/21/2014 07:54 AM, Shu, Xinxin wrote: > > Hi, sage > > > > I will add rocksdb submodule into the makefile , currently we want

RE: [RFC] add rocksdb support

2014-05-28 Thread Shu, Xinxin
--- From: Mark Nelson [mailto:mark.nel...@inktank.com] Sent: Wednesday, May 21, 2014 9:06 PM To: Shu, Xinxin; Sage Weil Cc: ceph-devel@vger.kernel.org; Zhang, Jian Subject: Re: [RFC] add rocksdb support On 05/21/2014 07:54 AM, Shu, Xinxin wrote: > Hi, sage > > I will add rocksdb submodule

Re: [RFC] add rocksdb support

2014-05-21 Thread Mark Nelson
AM To: Shu, Xinxin Cc: ceph-devel@vger.kernel.org Subject: Re: [RFC] add rocksdb support Hi Xinxin, I've pushed an updated wip-rocksdb to github/liewegas/ceph.git that includes the latest set of patches with the groundwork and your rocksdb patch. There is also a commit that adds rocksdb as

RE: [RFC] add rocksdb support

2014-05-21 Thread Shu, Xinxin
, 2014 9:19 AM To: Shu, Xinxin Cc: ceph-devel@vger.kernel.org Subject: Re: [RFC] add rocksdb support Hi Xinxin, I've pushed an updated wip-rocksdb to github/liewegas/ceph.git that includes the latest set of patches with the groundwork and your rocksdb patch. There is also a commit that

Re: [RFC] add rocksdb support

2014-05-20 Thread Sage Weil
Hi Xinxin, I've pushed an updated wip-rocksdb to github/liewegas/ceph.git that includes the latest set of patches with the groundwork and your rocksdb patch. There is also a commit that adds rocksdb as a git submodule. I'm thinking that, since there aren't any distro packages for rocksdb at t

RE: [RFC] add rocksdb support

2014-03-06 Thread Shu, Xinxin
ceph-devel@vger.kernel.org Subject: RE: [RFC] add rocksdb support To me this numbers look within error bars identical and isn't that expected? The main benefit of Rocksdb vs. Leveldb you can see when you create large tables going to 1 billion entries. How many keys did you create per OS

RE: [RFC] add rocksdb support

2014-03-05 Thread Andreas Joachim Peters
dreas. From: ceph-devel-ow...@vger.kernel.org [ceph-devel-ow...@vger.kernel.org] on behalf of Haomai Wang [haomaiw...@gmail.com] Sent: 05 March 2014 09:31 To: Alexandre DERUMIER Cc: Xinxin Shu; ceph-devel@vger.kernel.org Subject: Re: [RFC] add rocksdb support I think the reason wh

Re: [RFC] add rocksdb support

2014-03-05 Thread Haomai Wang
> De: "Xinxin Shu" > À: "Alexandre DERUMIER" > Cc: ceph-devel@vger.kernel.org > Envoyé: Mardi 4 Mars 2014 09:41:05 > Objet: RE: [RFC] add rocksdb support > > Hi Alexandre, below is random io test results, almost the same iops. > > Rocksdb results &g

RE: [RFC] add rocksdb support

2014-03-05 Thread Shu, Xinxin
with 7.2k disks, replications 2x. -Original Message- From: Alexandre DERUMIER [mailto:aderum...@odiso.com] Sent: Wednesday, March 05, 2014 4:23 PM To: Shu, Xinxin Cc: ceph-devel@vger.kernel.org Subject: Re: [RFC] add rocksdb support >>Hi Alexandre, below is random io test r

Re: [RFC] add rocksdb support

2014-03-05 Thread Alexandre DERUMIER
ot;Alexandre DERUMIER" Cc: ceph-devel@vger.kernel.org Envoyé: Mardi 4 Mars 2014 09:41:05 Objet: RE: [RFC] add rocksdb support Hi Alexandre, below is random io test results, almost the same iops. Rocksdb results ebs_test: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=rbd, iodepth

RE: [RFC] add rocksdb support

2014-03-04 Thread Shu, Xinxin
rch 04, 2014 12:49 PM To: Shu, Xinxin Cc: ceph-devel@vger.kernel.org Subject: Re: [RFC] add rocksdb support >>Performance Test >>Attached file is the performance comparison of rocksdb and leveldb on four >>nodes with 40 osds, using 'rados bench' as the test tool. The per

Re: [RFC] add rocksdb support

2014-03-03 Thread Alexandre DERUMIER
gt;> -ioengine=rbd -bs=4k -size=19G -numjobs=1 -runtime=100 >> -group_reporting -name=ebs_test -pool=openstack -rbdname=image >> -clientname=fio -invalidate=0 - Mail original - De: "Xinxin Shu" À: ceph-devel@vger.kernel.org Envoyé: Lundi 3 Mars 2014 03:07:18

Re: [RFC] add rocksdb support

2014-03-03 Thread Mark Nelson
On 03/02/2014 08:07 PM, Shu, Xinxin wrote: Hi all, This patch added rocksdb support for ceph, enabled rocksdb for omap directory. Rocksdb source code can be get from link. To use use rocksdb, C++11 standard should be enabled, gcc version >= 4.7 is required to get C++11 support. Rocksdb can

[RFC] add rocksdb support

2014-03-02 Thread Shu, Xinxin
Hi all, This patch added rocksdb support for ceph, enabled rocksdb for omap directory. Rocksdb source code can be get from link. To use use rocksdb, C++11 standard should be enabled, gcc version >= 4.7 is required to get C++11 support. Rocksdb can be installed with instructions described i