[doc] Adding/Removing OSD is not thorough

2014-10-10 Thread deanraccoon
Dear list, When I tried to add OSD manually, following the http://ceph.com/docs/v0.78/rados/operations/add-or-rm-osds/. It said: ssh {new-osd-host} ceph-osd -i {osd-num} --mkfs --mkkey But It won't create the empty sysvinit file as ceph-deploy does in centos. If we do not have sysvinit file

ceph-devel irc channel archive

2014-10-10 Thread Loic Dachary
Hi, Are there publicly accessible archives of the ceph-devel IRC channel ? It would be most convenient to search for past conversations. Cheers -- Loïc Dachary, Artisan Logiciel Libre signature.asc Description: OpenPGP digital signature

Re: [PATCH 1/1 linux-next] ceph: fix bool assignments

2014-10-10 Thread Ilya Dryomov
On Fri, Oct 10, 2014 at 1:16 AM, Fabian Frederick wrote: > Fix some coccinelle warnings: > fs/ceph/caps.c:2400:6-10: WARNING: Assignment of bool to 0/1 > fs/ceph/caps.c:2401:6-15: WARNING: Assignment of bool to 0/1 > fs/ceph/caps.c:2402:6-17: WARNING: Assignment of bool to 0/1 > fs/ceph/caps.c:240

Re: [PATCH 1/1 linux-next] ceph: fix bool assignments

2014-10-10 Thread Ilya Dryomov
On Fri, Oct 10, 2014 at 4:41 AM, Dan Mick wrote: > > > On 10/09/2014 02:16 PM, Fabian Frederick wrote: >> Fix some coccinelle warnings: >> fs/ceph/caps.c:2400:6-10: WARNING: Assignment of bool to 0/1 > > >> - bool wake = 0; >> + bool wake = false; > > FWIW, that message is backwards: it sh

Re: [PATCH 1/1 linux-next] ceph: fix bool assignments

2014-10-10 Thread Fabian Frederick
> On 10 October 2014 at 10:24 Ilya Dryomov wrote: > > > On Fri, Oct 10, 2014 at 4:41 AM, Dan Mick wrote: > > > > > > On 10/09/2014 02:16 PM, Fabian Frederick wrote: > >> Fix some coccinelle warnings: > >> fs/ceph/caps.c:2400:6-10: WARNING: Assignment of bool to 0/1 > > > > > >> -     bool wake

Re: ceph-devel irc channel archive

2014-10-10 Thread Wido den Hollander
On 10/10/2014 09:58 AM, Loic Dachary wrote: > Hi, > > Are there publicly accessible archives of the ceph-devel IRC channel ? It > would be most convenient to search for past conversations. > Yes there is: http://irclogs.ceph.widodh.nl/ But while typing this message I see that my bot has died a

Re: ceph-devel irc channel archive

2014-10-10 Thread Loic Dachary
On 10/10/2014 10:53, Wido den Hollander wrote: > On 10/10/2014 09:58 AM, Loic Dachary wrote: >> Hi, >> >> Are there publicly accessible archives of the ceph-devel IRC channel ? It >> would be most convenient to search for past conversations. >> > > Yes there is: http://irclogs.ceph.widodh.nl/ >

Re: ceph-devel irc channel archive

2014-10-10 Thread Wido den Hollander
On 10/10/2014 10:56 AM, Loic Dachary wrote: > > > On 10/10/2014 10:53, Wido den Hollander wrote: >> On 10/10/2014 09:58 AM, Loic Dachary wrote: >>> Hi, >>> >>> Are there publicly accessible archives of the ceph-devel IRC channel ? It >>> would be most convenient to search for past conversations.

Re: v0.86 released (Giant release candidate)

2014-10-10 Thread Florian Haas
Hi Sage, On Tue, Oct 7, 2014 at 9:20 PM, Sage Weil wrote: > This is a release candidate for Giant, which will hopefully be out in > another week or two (s v0.86). We did a feature freeze about a month ago > and since then have been doing only stabilization and bug fixing (and a > handful on low-

arm7 gitbuilder ?

2014-10-10 Thread Loic Dachary
Hi Sandon, Would it be possible to resurect / create an arm7 gitbuilder for whatever distribution is more convenient ? Janne made a great contribution to erasure code optimization on NEON ( https://bitbucket.org/jannau/gf-complete/branch/neon ) and it would make it easier to have a gitbuilder

Re: ARM NEON optimisations for gf-complete/jerasure/ceph-erasure

2014-10-10 Thread Janne Grunau
Hi Kevin, On 2014-09-16 11:25:12 -0700, Kevin Greenan wrote: > > I feel that separating the arch-specific implementations out and have a > default 'generic' implementation would be a huge improvement. Note that > gf-complete was in active development for some time before including the > SIMD cod

Re: arm7 gitbuilder ?

2014-10-10 Thread Sage Weil
On Fri, 10 Oct 2014, Loic Dachary wrote: > Hi Sandon, > > Would it be possible to resurect / create an arm7 gitbuilder for > whatever distribution is more convenient ? Janne made a great > contribution to erasure code optimization on NEON ( > https://bitbucket.org/jannau/gf-complete/branch/neon

Request for comments

2014-10-10 Thread Barclay Jameson
When reading code for libcephfs.cc (giant branch) it wasn't apparent to me for the lines 95 and lines 101 what the return values was expected from the function calls init and mount other than 0. It was only after tracing a bit of code did I see that error code such as: -ENOENT and -EEXIST could be

Re: why index (collectionIndex) need a lock?

2014-10-10 Thread Gregory Farnum
[ Please keep stuff on the list; we don't do private emails and you'll get faster responses. ] I don't know for this particular case, but I think it's just an invariant for all FileStore operations. There's a lot of random stuff that can go into the omap; it's user-accessible. -Greg Software Engin

Re: Request for comments

2014-10-10 Thread John Spray
We do have a lot of functions that bubble up standard error numbers -- in general callers of these functions have to accommodate the possibility of any error code (including errors they don't understand). I notice that ::mount is a bit unusual in additionally having some explicit 'magic' return co

Re: arm7 gitbuilder ?

2014-10-10 Thread Loic Dachary
On 10/10/2014 17:11, Sage Weil wrote: > On Fri, 10 Oct 2014, Loic Dachary wrote: >> Hi Sandon, >> >> Would it be possible to resurect / create an arm7 gitbuilder for >> whatever distribution is more convenient ? Janne made a great >> contribution to erasure code optimization on NEON ( >> https

Re: arm7 gitbuilder ?

2014-10-10 Thread Sage Weil
On Fri, 10 Oct 2014, Loic Dachary wrote: > On 10/10/2014 17:11, Sage Weil wrote: > > On Fri, 10 Oct 2014, Loic Dachary wrote: > >> Hi Sandon, > >> > >> Would it be possible to resurect / create an arm7 gitbuilder for > >> whatever distribution is more convenient ? Janne made a great > >> contribu

Re: arm7 gitbuilder ?

2014-10-10 Thread Noah Watkins
On Fri, Oct 10, 2014 at 10:14 AM, Sage Weil wrote: > On Fri, 10 Oct 2014, Loic Dachary wrote: >> On 10/10/2014 17:11, Sage Weil wrote: >> > On Fri, 10 Oct 2014, Loic Dachary wrote: >> >> Hi Sandon, >> >> >> >> Would it be possible to resurect / create an arm7 gitbuilder for >> >> whatever distribu

[PATCH 1/3] libceph: ceph-msgr workqueue needs a resque worker

2014-10-10 Thread Ilya Dryomov
Commit f363e45fd118 ("net/ceph: make ceph_msgr_wq non-reentrant") effectively removed WQ_MEM_RECLAIM flag from ceph_msgr_wq. This is wrong - libceph is very much a memory reclaim path, so restore it. Cc: sta...@vger.kernel.org # needs backporting for < 3.12 Signed-off-by: Ilya Dryomov Tested-by:

[PATCH 2/3] rbd: rbd workqueues need a resque worker

2014-10-10 Thread Ilya Dryomov
Need to use WQ_MEM_RECLAIM for our workqueues to prevent I/O lockups under memory pressure - we sit on the memory reclaim path. Cc: sta...@vger.kernel.org # 3.17, needs backporting for 3.16 Signed-off-by: Ilya Dryomov Tested-by: Micha Krause --- drivers/block/rbd.c |3 ++- 1 file changed, 2

[PATCH 0/3] libceph, rbd: don't lockup under memory pressure

2014-10-10 Thread Ilya Dryomov
Hello, These are fixes for the problem that Micha was running into and helped debug. It appeared to be a stupid bug in messenger and to a lesser extent in rbd - workqueues in memory reclaim paths really do need to have WQ_MEM_RECLAIM set. Thanks, Ilya Ilya Dryomov (3): libce

[PATCH 3/3] rbd: use a single workqueue for all devices

2014-10-10 Thread Ilya Dryomov
Using one queue per device doesn't make much sense given that our workfn processes "devices" and not "requests". Switch to a single workqueue for all devices. Signed-off-by: Ilya Dryomov --- drivers/block/rbd.c | 33 ++--- 1 file changed, 18 insertions(+), 15 delet

Re: arm7 gitbuilder ?

2014-10-10 Thread Loic Dachary
Hi Noah, My focus is to create centos7 and ubuntu-14.04 packages at this point. And somehow find a way to convince teuthology to use them instead of what http://ceph.com/gitbuilder.cgi creates, but that's a separate issue. What kind of output would you like to get from these arm7 machines ? Ch

ISA plugin tests

2014-10-10 Thread Loic Dachary
Hi Andreas, Not every mail is about problems ;-) I'm happy to report that the ISA plugin you wrote passes the rados suite http://pulpito.ceph.com/loic-2014-10-10_08:45:20-rados:thrash-erasure-code-isa-master-testing-basic-vps/ The rhel failures should be ignored, they are unrelated. And the onl

Re: arm7 gitbuilder ?

2014-10-10 Thread Sage Weil
On Fri, 10 Oct 2014, Loic Dachary wrote: > Hi Noah, > > My focus is to create centos7 and ubuntu-14.04 packages at this point. > And somehow find a way to convince teuthology to use them instead of > what http://ceph.com/gitbuilder.cgi creates, but that's a separate > issue. > > What kind of o

Re: arm7 gitbuilder ?

2014-10-10 Thread Loic Dachary
On 10/10/2014 22:30, Sage Weil wrote: > On Fri, 10 Oct 2014, Loic Dachary wrote: >> Hi Noah, >> >> My focus is to create centos7 and ubuntu-14.04 packages at this point. >> And somehow find a way to convince teuthology to use them instead of >> what http://ceph.com/gitbuilder.cgi creates, but t

Re: arm7 gitbuilder ?

2014-10-10 Thread Noah Watkins
On Fri, Oct 10, 2014 at 12:16 PM, Loic Dachary wrote: > Hi Noah, > > My focus is to create centos7 and ubuntu-14.04 packages at this point. I think a newish Ubuntu should work just fine for us. Are the builds using a cross compile? If so it'd be great if there was one build for ARMv8. -- To unsub

Micro Ceph summit during the OpenStack summit

2014-10-10 Thread Loic Dachary
Hi Ceph, TL;DR: please register at http://pad.ceph.com/p/kilo if you're attending the OpenStack summit November 3 - 7 in Paris will be the OpenStack summit in Paris https://www.openstack.org/summit/openstack-paris-summit-2014/, an opportunity to meet with Ceph developers and users. We will hav

Re: arm7 gitbuilder ?

2014-10-10 Thread Loic Dachary
On 10/10/2014 23:48, Noah Watkins wrote: > On Fri, Oct 10, 2014 at 12:16 PM, Loic Dachary wrote: >> Hi Noah, >> >> My focus is to create centos7 and ubuntu-14.04 packages at this point. > > I think a newish Ubuntu should work just fine for us. Are the builds > using a cross compile? If so it'd

Re: arm7 gitbuilder ?

2014-10-10 Thread Noah Watkins
On Fri, Oct 10, 2014 at 2:54 PM, Loic Dachary wrote: > I would be surprised if it could easily be setup for cross compilation. > Although it would be nice to have an ARMv8 I don't need it right now. Do you ? Potentially. I'll poke around a bit and see. Maybe we can run 32-bit builds on ARMv8. I'

Firefly v0.80.6 issues 9696 and 9732

2014-10-10 Thread Samuel Just
We've gotten some reports of a couple of issues on v0.80.6: 1) #9696: mixed clusters (or upgrading clusters) with v0.80.6 and pre-firefly osds/mons can hit an assert in PG::choose_acting during backfill. The fix appears to be to remove the assert (wip-9696[-firefly]). 2) #9731: there is a bug in

Re: arm7 gitbuilder ?

2014-10-10 Thread Loic Dachary
On 11/10/2014 00:17, Noah Watkins wrote: > On Fri, Oct 10, 2014 at 2:54 PM, Loic Dachary wrote: >> I would be surprised if it could easily be setup for cross compilation. >> Although it would be nice to have an ARMv8 I don't need it right now. Do you >> ? > > Potentially. I'll poke around a b

Re: arm7 gitbuilder ?

2014-10-10 Thread Noah Watkins
On Fri, Oct 10, 2014 at 3:21 PM, Loic Dachary wrote: > > You are lucky to have access to ARMv8 boxes :-) Would you be willing to run a > few tests on my behalf ? That might be a challenge since we (our reserach group) don't own them--we just have remote access for a specific project. But it does

CephFS priorities (survey!)

2014-10-10 Thread Sage Weil
Hi everyone, In order to help us prioritize our efforts around CephFS, we'd very much appreciate it if anybody interested complete the below survey: https://www.surveymonkey.com/s/VWYVSZ8 It's a single rank-order list of things we could be working on. Any input you provide will be mos

RE: 10/7/2014 Weekly Ceph Performance Meeting: kernel boot params

2014-10-10 Thread Duan, Jiangang
Thanks. let's try do this test on our setup. BTW, what workload you use here? -jiangang -Original Message- From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Somnath Roy Sent: Wednesday, October 08, 2014 5:51 PM To: Duan, Jiangang; Andreas Bluem

RE: 10/7/2014 Weekly Ceph Performance Meeting: kernel boot params

2014-10-10 Thread Somnath Roy
As I mentioned, total workload is ~19 TB...Each RBD is ~230 GB and io_size = 64K.. -Original Message- From: Duan, Jiangang [mailto:jiangang.d...@intel.com] Sent: Friday, October 10, 2014 4:39 PM To: Somnath Roy; Andreas Bluemle; ceph-devel@vger.kernel.org Subject: RE: 10/7/2014 Weekly Ce

hammer blueprints

2014-10-10 Thread Sage Weil
Here's my list of possible blueprints for hammer. And who might write them up. This is just a brain dump of what I'm thinking about; please add, remove, object, suggest, etc.! Some of these blueprints already exist, but I suspect they are in need up a refresh to make them reflect the current