RE: [NewStore]About PGLog Workload With RocksDB

2015-09-14 Thread Sage Weil
can provide help to you." Also, apparently hbase is working on doing something similar. If anyone is interested in hacking on this, let me know! sage > > > -xiaoxi > -Original Message- > From: ceph-devel-ow...@vger.kernel.org > [mailto:ceph-devel-ow...@vger.kernel

RE: [NewStore]About PGLog Workload With RocksDB

2015-09-09 Thread Dałek , Piotr
> -Original Message- > From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel- > ow...@vger.kernel.org] On Behalf Of Haomai Wang > Sent: Tuesday, September 08, 2015 3:58 PM > To: Sage Weil > Hi Sage, > > I notice your post in rocksdb page about make rocksdb aware of short alive >

Re: [NewStore]About PGLog Workload With RocksDB

2015-09-08 Thread Sage Weil
> On Tue, Sep 8, 2015 at 9:58 PM, Haomai Wang wrote: > > Hi Sage, > > > > I notice your post in rocksdb page about make rocksdb aware of short > > alive key/value pairs. > > > > I think it would be great if one keyvalue db impl could support > > different key types with

Re: [NewStore]About PGLog Workload With RocksDB

2015-09-08 Thread Mark Nelson
On 09/08/2015 02:19 PM, Sage Weil wrote: On Tue, Sep 8, 2015 at 9:58 PM, Haomai Wang wrote: Hi Sage, I notice your post in rocksdb page about make rocksdb aware of short alive key/value pairs. I think it would be great if one keyvalue db impl could support different

Re: [NewStore]About PGLog Workload With RocksDB

2015-09-08 Thread Sage Weil
On Tue, 8 Sep 2015, Mark Nelson wrote: > On 09/08/2015 02:19 PM, Sage Weil wrote: > > > On Tue, Sep 8, 2015 at 9:58 PM, Haomai Wang wrote: > > > > Hi Sage, > > > > > > > > I notice your post in rocksdb page about make rocksdb aware of short > > > > alive key/value pairs. >

Re: [NewStore]About PGLog Workload With RocksDB

2015-09-08 Thread Haomai Wang
On Tue, Sep 8, 2015 at 10:12 PM, Gregory Farnum wrote: > On Tue, Sep 8, 2015 at 3:06 PM, Haomai Wang wrote: >> Hit "Send" by accident for previous mail. :-( >> >> some points about pglog: >> 1. short-alive but frequency(HIGH) > > Is this really true? The

Re: [NewStore]About PGLog Workload With RocksDB

2015-09-08 Thread Haomai Wang
Hit "Send" by accident for previous mail. :-( some points about pglog: 1. short-alive but frequency(HIGH) 2. small and related to the number of pgs 3. typical seq read/write scene 4. doesn't need rich structure like LSM or B-tree to support apis, has obvious different to user-side/other omap

Re: [NewStore]About PGLog Workload With RocksDB

2015-09-08 Thread Gregory Farnum
On Tue, Sep 8, 2015 at 3:06 PM, Haomai Wang wrote: > Hit "Send" by accident for previous mail. :-( > > some points about pglog: > 1. short-alive but frequency(HIGH) Is this really true? The default length of the log is 1000 entries, and most OSDs have ~100 PGs, so on a hard

Re: [NewStore]About PGLog Workload With RocksDB

2015-09-08 Thread Gregory Farnum
On Tue, Sep 8, 2015 at 3:12 PM, Gregory Farnum wrote: > On Tue, Sep 8, 2015 at 3:06 PM, Haomai Wang wrote: >> Hit "Send" by accident for previous mail. :-( >> >> some points about pglog: >> 1. short-alive but frequency(HIGH) > > Is this really true? The