RE: [NewStore]About PGLog Workload With RocksDB

2015-09-14 Thread Sage Weil
On Mon, 14 Sep 2015, Chen, Xiaoxi wrote: > >What I'd like to do is make it so that we take N + M logs, and we > >flush/dedup the N log segments into SST's... but skip any keys present > >in the M log buffers that follow. > >That way we have M logs' worth of time to hide overwrites and >

Re: reducing package size / compression time

2015-09-14 Thread Sage Weil
On Mon, 14 Sep 2015, Loic Dachary wrote: > Thanks for the link. Was that effective ? It appeared to cut out ~17 minutes from the build time, and increased the debuginfo package size by 30%. Seems like a good trade to me! s > > On 14/09/2015 03:40, Sage Weil wrote: > > On Mon, 14 Sep 2015,

Re: [PATCH 00/39] drop null test before destroy functions

2015-09-14 Thread SF Markus Elfring
> Recent commits to kernel/git/torvalds/linux.git have made the following > functions able to tolerate NULL arguments: > > kmem_cache_destroy (commit 3942d29918522) > mempool_destroy (commit 4e3ca3e033d1) > dma_pool_destroy (commit 44d7175da6ea) How do you think about to extend an other SmPL

[PATCH] libceph: advertise support for keepalive2

2015-09-14 Thread Ilya Dryomov
We are the client, but advertise keepalive2 anyway - for consistency, if nothing else. In the future the server might want to know whether its clients support keepalive2. Signed-off-by: Ilya Dryomov --- include/linux/ceph/ceph_features.h | 1 + 1 file changed, 1

[PATCH] libceph: don't access invalid memory in keepalive2 path

2015-09-14 Thread Ilya Dryomov
This struct ceph_timespec ceph_ts; ... con_out_kvec_add(con, sizeof(ceph_ts), _ts); wraps ceph_ts into a kvec and adds it to con->out_kvec array, yet ceph_ts becomes invalid on return from prepare_write_keepalive(). As a result, we send out bogus keepalive2 stamps. Fix this by

ceph branch status

2015-09-14 Thread ceph branch robot
-- All Branches -- Adam C. Emerson 2015-09-04 16:44:21 -0400 wip-cxx11concurrency 2015-09-11 15:03:23 -0400 wip-cxx11time Adam Crume 2014-12-01 20:45:58 -0800 wip-doc-rbd-replay Alfredo Deza

radosgw socket dir

2015-09-14 Thread Sage Weil
radosgw now runs as ceph:ceph under systemd. /run/ceph-rgw is 755 owned as the web user. I think this will break anybody using apache and fastcgi. That's not the default, but I don't think that combo makes any sense anyway. Should we... - make /run/ceph-rgw ceph:ceph 0755, make the

Re: [HPDD-discuss] [PATCH] nfsd: add a new EXPORT_OP_NOWCC flag to struct export_operations

2015-09-14 Thread bfie...@fieldses.org
On Sat, Sep 12, 2015 at 06:24:54AM -0400, Jeff Layton wrote: > On Sat, 12 Sep 2015 04:41:33 + > "Dilger, Andreas" wrote: > > > On 2015/09/11, 4:20 AM, "HPDD-discuss on behalf of Jeff Layton" > >

Re: radosgw socket dir

2015-09-14 Thread Wido den Hollander
On 14-09-15 17:05, Sage Weil wrote: > radosgw now runs as ceph:ceph under systemd. /run/ceph-rgw is 755 owned > as the web user. I think this will break anybody using apache and > fastcgi. That's not the default, but I don't think that combo > makes any sense anyway. > > Should we... > >

RE: loadable objectstore

2015-09-14 Thread Allen Samuels
Yes, I'm referring to the C++ vtable. Allen Samuels Software Architect, Emerging Storage Solutions 2880 Junction Avenue, Milpitas, CA 95134 T: +1 408 801 7030| M: +1 408 780 6416 allen.samu...@sandisk.com -Original Message- From: James (Fei) Liu-SSI [mailto:james@ssi.samsung.com]

RE: loadable objectstore

2015-09-14 Thread James (Fei) Liu-SSI
Hi Allen, I am not exactly sure what the vtable is. Is the vtable same as vtable from C++ object concept? IMHP, the procedure linkage table was used to redirect position-independent function calls to absolute location of function based on the ELF format spec[1]. The performance hit for

Re: A new rados api set_client_priority

2015-09-14 Thread Gregory Farnum
On Thu, Sep 10, 2015 at 2:43 AM, 瞿天善 wrote: > Hi, > I'm working on the topic > > , first step I add a new rados api set_client_priority, then I will do > more test to get the idea of how to

Re: [rgw] Multi-tenancy support in radosgw

2015-09-14 Thread Yehuda Sadeh-Weinraub
On Fri, Sep 11, 2015 at 3:24 PM, Radoslaw Zarzynski wrote: > Hello, > > It's a well-known trait of radosgw that an user cannot create new > bucket with a given name if the name is already occupied by other > user's bucket (request to do that will be rejected with 409

Re: 答复: 答复: 2 replications,flapping can not stop for a very long time

2015-09-14 Thread Gregory Farnum
The OSD is supposed to stay down if any of the networks are missing. Ceph is a CP system in CAP parlance; there's no such thing as a CA system. ;) What version of Ceph are you testing right now? -Greg On Mon, Sep 14, 2015 at 1:02 AM, zhao.ming...@h3c.com wrote: > Thanks

RE: About Fio backend with ObjectStore API

2015-09-14 Thread James (Fei) Liu-SSI
Hi Casey, I also make the fio_objectstore to support kevvaluestore. Attachment is the patch for supporting keyvaluestore(LevelDB). More parameters should be added if we want to support RocksDB with more parameters. It would be great if you can put fio-objectstore into upstream as suggested

Re: rbd lock list command failure

2015-09-14 Thread Josh Durgin
On 09/09/2015 09:26 AM, Huamin Chen wrote: Hi Running "rbd lock list" inside a Docker container yields mixed results. Sometimes I can get the right results but most times I just get errors. A good run is like this: [root@host server]# docker run --privileged --net=host -v /dev:/dev -v

RE: shec tests failure on i386

2015-09-14 Thread Miyamae, Takeshi
Hi Loic, Thank you for testing shec on i386 and telling us about the issue. We will try to reproduce the issue on our own virtual machines for now. Best regards, Takeshi Miyamae -Original Message- From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-ow...@vger.kernel.org] On

Re: [rgw] Multi-tenancy support in radosgw

2015-09-14 Thread Pete Zaitcev
On Sat, 12 Sep 2015 00:24:27 +0200 Radoslaw Zarzynski wrote: > Each already existing user would obtain empty bucket namespace > by default. It will be possible to create user with his own, unique > namespace. [...] > 2. We will always need ID of namespace in order to

答复: 答复: 答复: 2 replications,flapping can not stop for a very long time

2015-09-14 Thread zhao.ming...@h3c.com
The OSD is supposed to stay down if any of the networks are missing. osd1 osd2 osd3,if cut off osd2's cluster-network,then all of the osd( osd1/osd2/osd3) will all stay down? Ceph is a CP system in CAP parlance; there's no such thing as a CA system. ;) What version of Ceph are

Re: osd: new pool flags: noscrub, nodeep-scrub

2015-09-14 Thread Mykola Golub
On Fri, Sep 11, 2015 at 04:24:23PM +0300, Mykola Golub wrote: > On Fri, Sep 11, 2015 at 05:59:56AM -0700, Sage Weil wrote: > > > I wonder if, in addition, we should also allow scrub and deep-scrub > > intervals to be set on a per-pool basis? > > ceph osd pool set [deep-]scrub_interval N ? > >

RE: 答复: 2 replications,flapping can not stop for a very long time

2015-09-14 Thread Chen, Xiaoxi
This is kind of unsolvable problem, in CAP , we choose Consistency and Availability, thus we had to lose Partition tolerance. There are three networks here , mon<-> osd, osd<-public->osd, osd<- cluster-> osd. If some of the networks are reachable but some are not, likely the flipping will

RE: Backfill

2015-09-14 Thread GuangYang
Thanks Sage. That makes sense. Just would like to confirm my understanding: Let's say the map for the PG changes from [1, 2, 3] to [1, 2, 4] and 4 is the backfill target (4 may or may not have the info for the PG, which should not matter as long as it is not eligible for log based recovery),

shec tests failure on i386

2015-09-14 Thread Loic Dachary
Hi Takeshi, http://tracker.ceph.com/issues/12936 shows that shec tests fail on i386. Before I investigate further, I'd like to know if you had a chance to run more tests ? There are not many users of i386 these days, of course ;-) But this is a good test to verify there are no architecture

RE: Backfill

2015-09-14 Thread Sage Weil
On Mon, 14 Sep 2015, GuangYang wrote: > Thanks Sage. That makes sense. Just would like to confirm my understanding: > > Let's say the map for the PG changes from [1, 2, 3] to [1, 2, 4] and 4 is the > backfill target (4 may or may not have the info for the PG, which should not > matter as long

Re: reducing package size / compression time

2015-09-14 Thread Loic Dachary
Thanks for the link. Was that effective ? On 14/09/2015 03:40, Sage Weil wrote: > On Mon, 14 Sep 2015, Loic Dachary wrote: >> Hi Sage, >> >> You did something to reduce the size (hence the compression time) of the >> debug packages using >>

答复: 答复: 2 replications,flapping can not stop for a very long time

2015-09-14 Thread zhao.ming...@h3c.com
Thanks for your explaination~ you mean the origin design leads to this result?In that network situation,flapping must appear and can not terminate except that someone(such as manager) force marking osd out,isn't it? I also want to ask about whether ceph community has a plan to solve this

reducing the size of Ceph debug packages

2015-09-14 Thread Loic Dachary
Hi James, https://fedoraproject.org/wiki/Features/DwarfCompressor is packaged for Ubuntu (http://packages.ubuntu.com/trusty/dwz) and could be used to reduce the size of the Ceph debug packages. This is how it's done for RPM :

Re: [PATCH 33/39] rbd: drop null test before destroy functions

2015-09-14 Thread Ilya Dryomov
On Sun, Sep 13, 2015 at 3:15 PM, Julia Lawall wrote: > Remove unneeded NULL test. > > The semantic patch that makes this change is as follows: > (http://coccinelle.lip6.fr/) > > // > @@ expression x; @@ > -if (x != NULL) { >