[ceph-users] Remove HDD under OSD + rados request = not found

2013-09-06 Thread Mihály Árva-Tóth
Hello, I have a server with hot swappable SATA disks. When I remove HDD from a working server, OSD does not noice missing of HDD. ceph healt status write HEALTH_OK and all of OSD "in" and "up". When I run a swift client on another server to get an object which one of chunk is available on removed

[ceph-users] CephFS test-case

2013-09-06 Thread Nigel Williams
I appreciate CephFS is not a high priority, but this is a user-experience test-case that can be a source of stability bugs for Ceph developers to investigate (and hopefully resolve): CephFS test-case 1. Create two clusters, each 3 nodes with 4 OSDs each 2. I used Ubuntu 13.04 followed by update/

[ceph-users] librados vs libcephfs performance for database broker

2013-09-06 Thread Serge Slipchenko
Hi, I am setting up a cluster that is using Hypertable as one of the key components. This had required some fixes of CephBroker, which I hope would be integrated to the main Hypertable branch soon. However, it seems to me that CephBroker doesn't need full fledged filesystem support. I wonder

Re: [ceph-users] newbie question: rebooting the whole cluster, powerfailure

2013-09-06 Thread Bernhard Glomm
> > > > And a second question regarding ceph-deploy: > > > > How do I specify a second NIC/address to be used as the intercluster > > > > communication? > > > You will not be able to do something like this with ceph-deploy. This > > > sounds like a very specific (or a bit more advanced) > > > co

Re: [ceph-users] Using radosgw with s3cmd: Bucket failure

2013-09-06 Thread Georg Höllrigl
Just in case someone stumbles across the same problem: The option name in ceph.conf is rgw_dns_name - not as described "rgw dns name" at http://ceph.com/docs/next/radosgw/config-ref/ !? And the hostname needs to be set to your DNS name withouth any wildcard. Georg On 06.09.2013 08:51, Georg

Re: [ceph-users] newbie question: rebooting the whole cluster, powerfailure

2013-09-06 Thread Bernhard Glomm
thnx Jens > > I have my testcluster consisting two OSDs that also host MONs plus > > one to five MONs. > Are you saying that you have a total of 7 mons? yepp > > down the at last, not the other MON though (since - surprise - they > > are in this test szenario just virtual instances residing o

Re: [ceph-users] newbie question: rebooting the whole cluster, powerfailure

2013-09-06 Thread Nigel Williams
On 06/09/2013, at 7:49 PM, "Bernhard Glomm" wrote: > Can I introduce the cluster network later on, after the cluster is deployed > and started working? > (by editing ceph.conf, push it to the cluster members and restart the > daemons?) Thanks Bernhard for asking this question, I have the same q

Re: [ceph-users] newbie question: rebooting the whole cluster, powerfailure

2013-09-06 Thread Jens Kristian Søgaard
Hi, In order to reach a quorum after reboot, you need to have more than half of yours mons running. with 7 MONs I have to have at least 5 MONS running? No. 4 is more than half of 7, so 4 would be a majority and thus would be able to form a quorum. 4 would be more than the half b

Re: [ceph-users] trouble with ceph-deploy

2013-09-06 Thread Pavel Timoschenkov
>>>Try >>>ceph-disk -v activate /dev/sdaa1 ceph-disk -v activate /dev/sdaa1 /dev/sdaa1: ambivalent result (probably more filesystems on the device, use wipefs(8) to see more details) >>>as there is probably a partition there. And/or tell us what >>>/proc/partitions contains, cat /proc/partit

Re: [ceph-users] newbie question: rebooting the whole cluster, powerfailure

2013-09-06 Thread Bernhard Glomm
Thnx a lot for making this clear! I thought 4 out of seven wouldn't be good because it's not an odd number... but I guess after I would have brought up the cluster with 4 MONs I could have removed one of the MONs to reach that (well, or add one) thnx again Bernhard Am 06.09.2013 13:26:37, schri

Re: [ceph-users] quick-ceph-deploy

2013-09-06 Thread Alfredo Deza
On Thu, Sep 5, 2013 at 8:25 PM, sriram wrote: > I am trying to deploy ceph reading the instructions from this link. > > http://ceph.com/docs/master/start/quick-ceph-deploy/ > > I get the error below. Can someone let me know if this is something related > to what I am doing wrong or the script? > >

Re: [ceph-users] newbie question: rebooting the whole cluster, powerfailure

2013-09-06 Thread Jens Kristian Søgaard
Hi Bernhard, I thought 4 out of seven wouldn't be good because it's not an odd number... but I guess after I would have brought up the cluster with 4 MONs I could have removed one of the MONs to reach that (well, or add one) Think of it like this: You created 7 mons in ceph. This is like havi

Re: [ceph-users] Using radosgw with s3cmd: Bucket failure

2013-09-06 Thread Yehuda Sadeh
On Fri, Sep 6, 2013 at 3:00 AM, Georg Höllrigl wrote: > Just in case someone stumbles across the same problem: > > The option name in ceph.conf is rgw_dns_name - not as described "rgw dns > name" at http://ceph.com/docs/next/radosgw/config-ref/ !? Both should work. > > And the hostname needs to

Re: [ceph-users] quick-ceph-deploy

2013-09-06 Thread sriram
I am running it on the same machine. "[abc@abc-ld ~]$ ceph-deploy install abc-ld" On Fri, Sep 6, 2013 at 5:42 AM, Alfredo Deza wrote: > On Thu, Sep 5, 2013 at 8:25 PM, sriram wrote: > > I am trying to deploy ceph reading the instructions from this link. > > > > http://ceph.com/docs/master/star

Re: [ceph-users] CORS not working

2013-09-06 Thread Paweł Stefański
Sorry for delay, static3 bucket was created on 0.56 afair, I've tested the same operation with fresh bucket created now on dumpling, and the problem still occurs. regards! -- pawel On 04.09.2013 20:15, Yehuda Sadeh wrote: Is static3 a bucket that you created before the upgrade? Can you test

Re: [ceph-users] CephFS test-case

2013-09-06 Thread Sage Weil
On Fri, 6 Sep 2013, Nigel Williams wrote: > I appreciate CephFS is not a high priority, but this is a > user-experience test-case that can be a source of stability bugs for > Ceph developers to investigate (and hopefully resolve): > > CephFS test-case > > 1. Create two clusters, each 3 nodes with

[ceph-users] ceph-deploy depends on sudo

2013-09-06 Thread Gilles Mocellin
Perhaps it's worth a bug report, or some changes in ceph-deploy : I've just deployed some test clusters with ceph-deploy on Debian Wheezy. I had errors with ceph-deploy, when the destination node does not have sudo installed. Even if a run it as root, and so connect to the node as root. Either

Re: [ceph-users] quick-ceph-deploy

2013-09-06 Thread Alfredo Deza
On Fri, Sep 6, 2013 at 11:05 AM, sriram wrote: > sudo su -c 'rpm --import > "https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc";' > error: https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc: key > 1 import failed. > Can you actually get to that URL and see the GPG key

Re: [ceph-users] newbie question: rebooting the whole cluster, powerfailure

2013-09-06 Thread Gilles Mocellin
Le 06/09/2013 12:12, Nigel Williams a écrit : On 06/09/2013, at 7:49 PM, "Bernhard Glomm" wrote: Can I introduce the cluster network later on, after the cluster is deployed and started working? (by editing ceph.conf, push it to the cluster members and restart the daemons?) Thanks Bernhard for

Re: [ceph-users] CORS not working

2013-09-06 Thread Yehuda Sadeh
Can you provide a log that includes the bucket creation, CORS settings and the OPTIONS call? It'd be best if you could do it with also 'debug ms = 1'. Thanks, Yehuda On Fri, Sep 6, 2013 at 7:54 AM, Paweł Stefański wrote: > Sorry for delay, > > static3 bucket was created on 0.56 afair, I've teste

Re: [ceph-users] quick-ceph-deploy

2013-09-06 Thread Alfredo Deza
On Fri, Sep 6, 2013 at 10:54 AM, sriram wrote: > I am running it on the same machine. > > "[abc@abc-ld ~]$ ceph-deploy install abc-ld" > > > On Fri, Sep 6, 2013 at 5:42 AM, Alfredo Deza > wrote: >> >> On Thu, Sep 5, 2013 at 8:25 PM, sriram wrote: >> > I am trying to deploy ceph reading the instr

Re: [ceph-users] trouble with ceph-deploy

2013-09-06 Thread Sage Weil
On Fri, 6 Sep 2013, Pavel Timoschenkov wrote: > >>>Try > >>>ceph-disk -v activate /dev/sdaa1 > > ceph-disk -v activate /dev/sdaa1 > /dev/sdaa1: ambivalent result (probably more filesystems on the device, use > wipefs(8) to see more details) Looks like thre are multiple fs signatures on that part

Re: [ceph-users] quick-ceph-deploy

2013-09-06 Thread sriram
sudo su -c 'rpm --import " https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc";' error: https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc: key 1 import failed. On Fri, Sep 6, 2013 at 8:01 AM, Alfredo Deza wrote: > On Fri, Sep 6, 2013 at 10:54 AM, sriram wrote: > > I

Re: [ceph-users] ceph-deploy depends on sudo

2013-09-06 Thread Alfredo Deza
On Fri, Sep 6, 2013 at 11:17 AM, Gilles Mocellin wrote: > Perhaps it's worth a bug report, or some changes in ceph-deploy : > > I've just deployed some test clusters with ceph-deploy on Debian Wheezy. > I had errors with ceph-deploy, when the destination node does not have sudo > installed. > Even

Re: [ceph-users] Remove HDD under OSD + rados request = not found

2013-09-06 Thread Gregory Farnum
On Fri, Sep 6, 2013 at 12:06 AM, Mihály Árva-Tóth wrote: > Hello, > > I have a server with hot swappable SATA disks. When I remove HDD from a > working server, OSD does not noice missing of HDD. ceph healt status write > HEALTH_OK and all of OSD "in" and "up". When I run a swift client on another

Re: [ceph-users] newbie question: rebooting the whole cluster, powerfailure

2013-09-06 Thread Alex Bligh
On 6 Sep 2013, at 13:46, Jens Kristian Søgaard wrote: > You created 7 mons in ceph. This is like having a parliament with 7 members. > > Whenever you want to do something, you need to convince a majority of > parliament to vote yes. A majority would then be 4 members voting yes. > > If two mem

Re: [ceph-users] newbie question: rebooting the whole cluster, powerfailure

2013-09-06 Thread Jens Kristian Søgaard
Hi, Perhaps not a great analogy. At least in the case of the UK Perhaps not, I don't know the UK system. I was merely trying to illustrate the difference between the number of mons that the system is configured with (the ones eligible to vote), and the number of mons actually alive and able

Re: [ceph-users] ceph-deploy depends on sudo

2013-09-06 Thread Gilles Mocellin
Le 06/09/2013 17:37, Alfredo Deza a écrit : On Fri, Sep 6, 2013 at 11:17 AM, Gilles Mocellin wrote: Perhaps it's worth a bug report, or some changes in ceph-deploy : I've just deployed some test clusters with ceph-deploy on Debian Wheezy. I had errors with ceph-deploy, when the destination nod