Re: [ceph-users] Reading from replica

2013-08-28 Thread Gregory Farnum
On Wednesday, August 28, 2013, daniel pol wrote: > I don't recall. It might be that I started with PG=2. > Trying get an even distribution of PGs accros my 2 OSDs now. Tried > different numbers (keeping pgp_num same as pg_num :) but I keep getting one > OSD with more PGs compared to the other. Sin

Re: [ceph-users] ceph-deploy pushy dependency problem

2013-08-28 Thread Gary Lowell
Hi Kevin - We've decided to remove ceph-deploy and pushy from the ceph-extras repo to reduce the confusion from having the packages in multiple places. That repo has now been rebuilt without the packages. The primary location for the ceph-deploy packages is the repo for the current stable re

Re: [ceph-users] xfsprogs not found in RHEL

2013-08-28 Thread sriram
Can anyone point me to which xfsprogs RPM to use for RHEL 6 On Wed, Aug 28, 2013 at 5:46 AM, Sriram wrote: > Yes I read that but I was not sure if installing from Centos 6 repository > can cause issues. > > On Aug 27, 2013, at 11:46 PM, "Stroppa Daniele (strp)" > wrote: > > Check this issue:

[ceph-users] Issues setting up ceph object storage

2013-08-28 Thread Gerd Jakobovitsch
Hello all, I am trying to install a ceph environment for testing, focused on block devices for virtualization and object storage. I am facing some issues. My environment consists of one server running ceph-deploy and mon; 3 cluster nodes with 3 disks each running a total of 3 OSD's; and one

Re: [ceph-users] Reading from replica

2013-08-28 Thread daniel pol
I don't recall. It might be that I started with PG=2. Trying get an even distribution of PGs accros my 2 OSDs now. Tried different numbers (keeping pgp_num same as pg_num :) but I keep getting one OSD with more PGs compared to the other. Since this is just for learning/testing I would like to s

Re: [ceph-users] Reading from replica

2013-08-28 Thread Gregory Farnum
On Wed, Aug 28, 2013 at 1:22 PM, daniel pol wrote: > Sorry, my bad. Only my second post and forgot the "reply all" > > Thanks for the info. I'm looking at the impact of pg number on performance. > Just trying to learn more about how Ceph works. > I didn't set pgp_num. It came by default with 2 in

Re: [ceph-users] Reading from replica

2013-08-28 Thread daniel pol
Sorry, my bad. Only my second post and forgot the "reply all" Thanks for the info. I'm looking at the impact of pg number on performance. Just trying to learn more about how Ceph works. I didn't set pgp_num. It came by default with 2 in my case. Have a nice day, Dani > Date: Wed, 28

Re: [ceph-users] Reading from replica

2013-08-28 Thread Gregory Farnum
[ Please keep list discussions on the list. :) ] On Wed, Aug 28, 2013 at 12:54 PM, daniel pol wrote: > Hi ! > > Any pointers to where I can find the contortions ? You don't really want to — read-from-replica isn't safe except in very specific circumstances. > I agree with you on > should be see

Re: [ceph-users] Reading from replica

2013-08-28 Thread Gregory Farnum
Read-from-replica does not happen unless you go through some contortions with config and developer setups. However, all n OSDs should be the primary for about 1/n% of the data, so you should be seeing reads to to both OSDs as long as you touch several objects at a time. -Greg On Wednesday, August

[ceph-users] Reading from replica

2013-08-28 Thread daniel pol
Hi ! I need a little help understanding reads from replicas. I've read a few conflicting messages and the documentation is not very clear to me on this subject (maybe I didn't find the proper doc). Here's the question: With default replication of 2 (size=2), when doing reads (big sequential

[ceph-users] v0.56.7 bobtail released

2013-08-28 Thread Sage Weil
We have another bugfix update for bobtail. Most of these fixes have been sitting in the bobtail branch (and were run by various users) for some time now. The newest patches fix a problem with multi-delete on rgw. We recommend that production bobtail clusters upgrade, especially if they are usi

Re: [ceph-users] Ceph-OSD on compute nodes?

2013-08-28 Thread Don Talton (dotalton)
We’re rolling this option out in Cisco Openstack Installer. Our testing shows that it’s okay for smaller scale clouds, although we have not fully tested it large scale yet. I’ve personally tested it on Cisco C240s (50GB RAM, 16 cores) with 3 OSD per compute node with positive results. For this s

Re: [ceph-users] ceph-deploy pushy dependency problem

2013-08-28 Thread Gary Lowell
Hi Kevin - it looks like something might be corrupted in ceph-extras repo. ceph-deploy is also in the rpm-dumpling repo and that's the one we tested against. http://ceph.com/rpm-dumpling/fc18/noarch/ceph-deploy-1.2.2-0.noarch.rpm http://ceph.com/rpm-dumpling/fc18/noarch/pushy-0.5.3-1.noarch.

Re: [ceph-users] ceph-deploy pushy dependency problem

2013-08-28 Thread Kevin Weiler
Also, when I download that package from the repo (http://ceph.com/packages/ceph-extras/rpm/fedora19/noarch/ceph-deploy-1.2.2-0.noarch.rpm), I get this: $ rpm -q --requires -p ceph-deploy-1.2.2-0.noarch.rpm warning: ceph-deploy-1.2.2-0.noarch.rpm: Header V4 RSA/SHA1 Signature, key ID 17ed316d: N

Re: [ceph-users] ceph-deploy pushy dependency problem

2013-08-28 Thread Kevin Weiler
Thanks for the response Gary. I'm still having a problem updating off the repos. I've pasted my yum command and my ceph repo configuration below: # yum update ceph-deploy Loaded plugins: priorities, protectbase ceph

Re: [ceph-users] Help needed porting Ceph to RSockets

2013-08-28 Thread Sage Weil
On Wed, 28 Aug 2013, Gandalf Corvotempesta wrote: > 2013/6/20 Matthew Anderson : > > Hi All, > > > > I've had a few conversations on IRC about getting RDMA support into Ceph and > > thought I would give it a quick attempt to hopefully spur some interest. > > What I would like to accomplish is an RS

Re: [ceph-users] Some help needed with ceph deployment

2013-08-28 Thread Sage Weil
>   "steps": [ > >     { "op": "take", > >   "item": -1}, > >     { "op": "chooseleaf_firstn", > >   "num": 0, > >   "type": "host"}, > >     { "op": "emit"}]}, > >     { "rule_id": 1, > >   "rule_name": "metadata", > >   "ruleset": 1, > >   "type": 1, > >   "min_size": 1, > >   "max_size": 10, > >       "steps": [ > >     { "op": "take", > >   "item": -1}, > >     { "op": "chooseleaf_firstn", > >   "num": 0, > >   "type": "host"}, > >     { "op": "emit"}]}, > >     { "rule_id": 2, > >   "rule_name": "rbd", > >   "ruleset": 2, > >   "type": 1, > >   "min_size": 1, > >   "max_size": 10, > >   "steps": [ > >     { "op": "take", > >   "item": -1}, > >     { "op": "chooseleaf_firstn", > >  "num": 0, > >   "type": "host"}, > >     { "op": "emit"}]}], > >   "tunables": { "choose_local_tries": 2, > >   "choose_local_fallback_tries": 5, > >   "choose_total_tries": 19, > >   "chooseleaf_descend_once": 0}} > >   > > > > __ Informatie van ESET Endpoint Antivirus, versie van database > viruskenmerken 8737 (20130828) __ > > Het bericht is gecontroleerd door ESET Endpoint Antivirus. > > http://www.eset.com > > > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Help needed porting Ceph to RSockets

2013-08-28 Thread Kasper Dieter
On Wed, Aug 28, 2013 at 04:24:59PM +0200, Gandalf Corvotempesta wrote: > 2013/6/20 Matthew Anderson : > > Hi All, > > > > I've had a few conversations on IRC about getting RDMA support into Ceph and > > thought I would give it a quick attempt to hopefully spur some interest. > > What I would like t

Re: [ceph-users] howto prepare exclusive partition for a monitor and OSD

2013-08-28 Thread Alfredo Deza
On Sun, Aug 25, 2013 at 11:55 AM, Johannes Klarenbeek < johannes.klarenb...@rigo.nl> wrote: > Dear ceph-users, > > ** ** > > I’m trying to get the ceph monitor use a exclusive partition on my ssd > drive. However, how should I prepare it? > > I want to do something like this: > > **

Re: [ceph-users] Help needed porting Ceph to RSockets

2013-08-28 Thread Gandalf Corvotempesta
2013/6/20 Matthew Anderson : > Hi All, > > I've had a few conversations on IRC about getting RDMA support into Ceph and > thought I would give it a quick attempt to hopefully spur some interest. > What I would like to accomplish is an RSockets only implementation so I'm > able to use Ceph, RBD and

Re: [ceph-users] xfsprogs not found in RHEL

2013-08-28 Thread Luc Dumaine
Hello, xfsprogs in available on RHEL6.4 - Mail original - De: "sriram" À: ceph-us...@ceph.com Envoyé: Mardi 27 Août 2013 23:29:06 Objet: [ceph-users] xfsprogs not found in RHEL I am trying to install CEPH and I get the following error - ---> Package ceph.x86_64 0:0.67.2-0

Re: [ceph-users] xfsprogs not found in RHEL

2013-08-28 Thread Sriram
Yes I read that but I was not sure if installing from Centos 6 repository can cause issues. On Aug 27, 2013, at 11:46 PM, "Stroppa Daniele (strp)" wrote: > Check this issue: http://tracker.ceph.com/issues/5193 > > You might need the RHEL Scalable File System add-on. > > Cheers, > -- > Daniele

Re: [ceph-users] Some help needed with ceph deployment

2013-08-28 Thread Johannes Klarenbeek
, { "op": "emit"}]}, { "rule_id": 1, "rule_name": "metadata", "ruleset": 1, "type": 1, "min_size": 1, "max_size": 10, "steps": [ { "op": "take", "item": -1}, { "op": "chooseleaf_firstn", "num": 0, "type": "host"}, { "op": "emit"}]}, { "rule_id": 2, "rule_name": "rbd", "ruleset": 2, "type": 1, "min_size": 1, "max_size": 10, "steps": [ { "op": "take", "item": -1}, { "op": "chooseleaf_firstn", "num": 0, "type": "host"}, { "op": "emit"}]}], "tunables": { "choose_local_tries": 2, "choose_local_fallback_tries": 5, "choose_total_tries": 19, "chooseleaf_descend_once": 0}} __ Informatie van ESET Endpoint Antivirus, versie van database viruskenmerken 8737 (20130828) __ Het bericht is gecontroleerd door ESET Endpoint Antivirus. http://www.eset.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph + Xen - RBD io hang

2013-08-28 Thread Oliver Daudey
Hi, On wo, 2013-08-28 at 10:10 +0200, Sylvain Munaut wrote: > Hi, > > > I am doing some experimentation with Ceph and Xen (on the same host) and I'm > > experiencing some problems with the rbd device that I'm using as the block > > device. My environment is: > > AFAIK running the OSD and the ke

Re: [ceph-users] Ceph + Xen - RBD io hang

2013-08-28 Thread Olivier Bonvalet
Le mercredi 28 août 2013 à 10:07 +0200, Sylvain Munaut a écrit : > Hi, > > > I use Ceph 0.61.8 and Xen 4.2.2 (Debian) in production, and can't use > > kernel 3.10.* on dom0, which hang very soon. But it's visible in kernel > > logs of the dom0, not the domU. > > Weird. I'm using 3.10.0 without i

Re: [ceph-users] Ceph + Xen - RBD io hang

2013-08-28 Thread Sylvain Munaut
Hi, > I am doing some experimentation with Ceph and Xen (on the same host) and I'm > experiencing some problems with the rbd device that I'm using as the block > device. My environment is: AFAIK running the OSD and the kernel driver inside the same host is not recommended at all ... Personally

Re: [ceph-users] Ceph + Xen - RBD io hang

2013-08-28 Thread Sylvain Munaut
Hi, > I use Ceph 0.61.8 and Xen 4.2.2 (Debian) in production, and can't use > kernel 3.10.* on dom0, which hang very soon. But it's visible in kernel > logs of the dom0, not the domU. Weird. I'm using 3.10.0 without issue here. What's the issue you're hitting ? Cheers, Sylvain _

Re: [ceph-users] Ceph + Xen - RBD io hang

2013-08-28 Thread James Dingwall
Sage Weil wrote: Can you post the contents of the hung task warning so we can see where it is stuck? The messages in the domU are: [35284.544137] INFO: task dd:4903 blocked for more than 120 seconds. [35284.544148] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [3528