Re: [ceph-users] Ceph and shared backend storage.

> We have a need to provide HA storage to a few thousand users, replacing our > aging windows storage server. > > Our storage all comes from a group of equallogic SANs, > and since we've invested in these and vmware, the obvious > > Our storage cluster mentioned above needs to export SMB and maybe

[ceph-users] EU mirror now supports rsync

Hi, I just enabled rsync on the eu.ceph.com mirror. eu.ceph.com mirrors from Ceph.com every 3 hours. Feel free to rsync all the contents to your local environment, might be useful for some large deployments where you want to save external bandwidth by not having each machine fetch the Deb/RPM pa

Re: [ceph-users] Questions about federated gateways configure

I posted inline. 1. Create Pools there are many us-east and us-west pools. Do I have to create both us-east and us-west pools in a ceph instance? Or, I just create us-east pools in us-east zone and create us-west pools in us-west zone? No, just create the us-east pools in the us-east cluster

Re: [ceph-users] Question about mark_unfound_lost on RGW metadata.

*Craig Lewis* Senior Systems Engineer Office +1.714.602.1309 Email cle...@centraldesktop.com *Central Desktop. Work together in ways you never thought possible.* Connect with us Website | Twitter

[ceph-users] Questions about federated gateways configure

Hello, everyone. I tried to confiure federated gateways but failed. I have read the document several times and had some quesions. OS: CentOS 6.5 Version: Ceph 0.67.7 1. Create Pools there are many us-east and us-west pools. Do I have to create both us-east and us-west pools in a ceph instance?

Re: [ceph-users] Ceph and shared backend storage.

Ceph is designed to handle reliability in its system rather than in an external one. You could set it up to use that storage and not do its own replication, but then you lose availability if the OSD process hosts disappear, etc. And the filesystem (which I guess is the part you're interested in) is

Re: [ceph-users] CephFS feature set mismatch with v0.79 and recent kernel

This flag won't be listed as required if you don't have any erasure coding parameters in your OSD/crush maps. So if you aren't using it, you should remove the EC rules and the kernel should be happy. -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com On Tue, Apr 8, 2014 at 6:08 PM

Re: [ceph-users] Question about mark_unfound_lost on RGW metadata.

On Tue, Apr 8, 2014 at 4:57 PM, Craig Lewis wrote: > >> >> pg query says the recovery state is: >> "might_have_unfound": [ >> { "osd": 11, >> "status": "querying"}, >> { "osd": 13, >> "status": "already probed"}], >> > I

Re: [ceph-users] CephFS feature set mismatch with v0.79 and recent kernel

On Tue, Apr 8, 2014 at 4:50 PM, Michael Nelson wrote: > I am trying to mount CephFS from a freshly installed v0.79 cluster using a > kernel built from git.kernel.org:kernel/git/sage/ceph-client.git > (for-linus a30be7cb) and running into the following dmesg errors on mount: > > libceph: mon0 198.1

Re: [ceph-users] Question about mark_unfound_lost on RGW metadata.

pg query says the recovery state is: "might_have_unfound": [ { "osd": 11, "status": "querying"}, { "osd": 13, "status": "already probed"}], I figured out why it wasn't probing osd.11. When I manually replaced the d

[ceph-users] CephFS feature set mismatch with v0.79 and recent kernel

I am trying to mount CephFS from a freshly installed v0.79 cluster using a kernel built from git.kernel.org:kernel/git/sage/ceph-client.git (for-linus a30be7cb) and running into the following dmesg errors on mount: libceph: mon0 198.18.32.12:6789 feature set mismatch, my 2b84a042aca < server's

[ceph-users] Ceph and shared backend storage.

Hi All, First post, so please excuse any ignorance! We have a need to provide HA storage to a few thousand users, replacing our aging windows storage server. I would like to use Ceph alongside (being sensible) xfs - or zfs if I'm feeling game, but need to understand something critical. Ceph it se

Re: [ceph-users] [Ceph-community] Ceph t-shirts are available

Cool idea. Unfortunately, International shipping is 20 Euros. Over $50 (37 euros) for a t-shirt is a bit pricey. Perhaps we can setup something for the US folks or sell them at the Atlanta meet up. Also, a larger logo (like the whole front of the t-shirt) could be nice looking. Let me know if

Re: [ceph-users] Hardware recommendations for small cluster (~15TB)

take a look at http://www.supermicro.com/products/nfo/FatTwin.cfm http://www.supermicro.com/products/system/4U/F617/SYS-F617H6-FTPTL_.cfm On 04/07/2014 01:13 PM, Michal Humpula wrote: Hi everybody, I'm looking for any hints on how to choose the hardware for small ceph cluster, roughly size of

Re: [ceph-users] Error when building ceph. fatal error: civetweb/civetweb.h: No such file or directory

Hi Kai, The issue resolved when I downloaded civetweb from https://github.com/ceph/civetweb/archive/rgw.zip, unzip rgw.zip, and link it to civetweb that is in the folder ceph/src. Maybe I miss updating submodule as you mentioned, I'll retry it once again. Thanks Kai. Best regards, Thanh Tran

Re: [ceph-users] How to detect journal problems

On Tuesday, April 8, 2014, Christian Balzer wrote: > On Tue, 08 Apr 2014 14:19:20 +0200 Josef Johansson wrote: > > > > On 08/04/14 10:39, Christian Balzer wrote: > > > On Tue, 08 Apr 2014 10:31:44 +0200 Josef Johansson wrote: > > > > > >> On 08/04/14 10:04, Christian Balzer wrote: > > >>> Hello,

Re: [ceph-users] How to detect journal problems

On Tue, 08 Apr 2014 14:19:20 +0200 Josef Johansson wrote: > > On 08/04/14 10:39, Christian Balzer wrote: > > On Tue, 08 Apr 2014 10:31:44 +0200 Josef Johansson wrote: > > > >> On 08/04/14 10:04, Christian Balzer wrote: > >>> Hello, > >>> > >>> On Tue, 08 Apr 2014 09:31:18 +0200 Josef Johansson wro

Re: [ceph-users] Hardware recommendations for small cluster (~15TB)

On Mon, 07 Apr 2014 19:13:32 +0200 Michal Humpula wrote: > Hi everybody, > > I'm looking for any hints on how to choose the hardware for small ceph > cluster, roughly size of a 10-20TB. Primary purpose of this cluster is > to have a centralized (from the client point of view), but fault > tolera

Re: [ceph-users] Ceph v0.79 Firefly RC :: erasure-code-profile command set not present

On Tue, 8 Apr 2014, Karan Singh wrote: > Thanks Developers for 0.79 , happy to see its announcement. > I have been using 0.78 in order to test EC and TP , with 0.78 i was not able > to test erasure code profile feature  ( # ceph osd erasure-code-profile > set myprofile ??) as erasure-code-profile c

Re: [ceph-users] Change object size from 4MB (default) to 16MB

Hi Wido, Thank you for your helping. I' m using network with 10Gbps speed for my Ceph Cluster. and I want to optimize it to read/write images faster with object size= 16/32MB. Any your idea? >> If you use the 'rbd' tool you can set the --order flag to set it to anything else then the default

[ceph-users] Hardware recommendations for small cluster (~15TB)

Hi everybody, I'm looking for any hints on how to choose the hardware for small ceph cluster, roughly size of a 10-20TB. Primary purpose of this cluster is to have a centralized (from the client point of view), but fault tolerant storage for images served by webserver (i.e. mostly read IO). I

[ceph-users] ceph osd creation error ---Please help me

Hi, I am trying to setup ceph cluster without using ceph-deploy. Followed the link http://ceph.com/docs/master/install/manual-deployment/ Successfully able to create monitor node and results are as expected I have copied *ceph.conf* and* ceph.client.admin.keyring* from monitor node to OSD node.

Re: [ceph-users] ceph osd creation error ---Please help me

Try ceph auth del osd.1 And then repeat step 6 Sébastien Han Cloud Engineer "Always give 100%. Unless you're giving blood.” Phone: +33 (0)1 49 70 99 72 Mail: sebastien@enovance.com Address : 11 bis, rue Roquépine - 75008 Paris Web : www.enovance.com - Twitter : @enovance On 08

Re: [ceph-users] ceph osd creation error ---Please help me

Correct error as below *Error EINVAL: entity osd.1 exists but key does not match* On Tue, Apr 8, 2014 at 7:51 PM, Srinivasa Rao Ragolu wrote: > Hi, > > I am trying to setup ceph cluster without using ceph-deploy. > > Followed the link http://ceph.com/docs/master/install/manual-deployment/ > > Su

Re: [ceph-users] OpenStack Survey

Not quite sure why my brain wanted to send you 1500 km away... But the OpenStack Developer Summit is in Atlanta (as the link shows). In any case, inquiring minds still want to know how you are using OpenStack and Ceph, so make sure to full out the survey before Friday if you can! Thanks. On Apr 7,

Re: [ceph-users] ceph-deploy fails to generate keys

On Tue, Apr 8, 2014 at 3:33 AM, Diedrich Ehlerding wrote: > Hi, > >> >> Have you increased the verbosity for the monitors, restarted them, and >> looked at the log output? > > First of all: The bug is still there, and the logs do not help. But I > seem to have found a workaround (just for myself,

Re: [ceph-users] How to detect journal problems

On 08/04/14 10:39, Christian Balzer wrote: > On Tue, 08 Apr 2014 10:31:44 +0200 Josef Johansson wrote: > >> On 08/04/14 10:04, Christian Balzer wrote: >>> Hello, >>> >>> On Tue, 08 Apr 2014 09:31:18 +0200 Josef Johansson wrote: >>> Hi all, I am currently benchmarking a standard setu

Re: [ceph-users] Cannot create a file system on the RBD

Maybe different kernel versions between the box that can format and the box that can't. When you created the rbd image, was it format 1 or 2? Jake On Thursday, April 3, 2014, Thorvald Hallvardsson < thorvald.hallvards...@gmail.com> wrote: > Hi, > > I have found that problem is somewhere within

Re: [ceph-users] radosgw multipart-uploaded downloads fail

Hi, > It was a 256 gig file > ERROR: S3 error: 416 (InvalidRange): I think this is a "MaxParts" default limit 1000, s3cmd default part size 15MB (see .s3cfg). I cant find right way how to change this limit on rgw side, so i change part size in .s3cfg or use multipart tar archive for large files. -

Re: [ceph-users] radosgw multipart-uploaded downloads fail

Hello Yehuda, 2014-04-04 9:35 GMT+02:00 Benedikt Fraunhofer : > I'm currently trying to find a faster box with enough free space to > reproduce that and capture logs. Here's the complete log with "debug rgw 20" and "debug ms 1" of a failed large-ish multipart upload. As it's 71mb gzipped i plac

Re: [ceph-users] Ceph v0.79 Firefly RC :: erasure-code-profile command set not present

Hi Loic Here is the output # ceph --version ceph version 0.79 (4c2d73a5095f527c3a2168deb5fa54b3c8991a6e) # # ceph osd erasure-code-profile no valid command found; 10 closest matches: osd tier add-cache osd tier set-overlay osd tier remove-overlay osd tier remove osd tier cache-mode none

Re: [ceph-users] Ceph v0.79 Firefly RC :: erasure-code-profile command set not present

I'm not sure if this is relevant, but my 0.78 (and currently building 0.79) are compiled from src git checkout (and packages built from the same src tree using dpkg-buildpackage Debian/Ubuntu package builder). Having said that - the above procedure *should* produce equivalent binaries to the o

Re: [ceph-users] Ceph v0.79 Firefly RC :: erasure-code-profile command set not present

Hi Karan, What is the output of ceph --version ? Cheers On 08/04/2014 11:44, Karan Singh wrote: > Thanks Mark for this quick checkup on Ubuntu distro. you saved my time , i > was also checking the same thing. > > All of my ceph components are on 0.79 , this looks to be a problem with ceph >

Re: [ceph-users] Ceph v0.79 Firefly RC :: erasure-code-profile command set not present

Thanks Mark for this quick checkup on Ubuntu distro. you saved my time , i was also checking the same thing. All of my ceph components are on 0.79 , this looks to be a problem with ceph binaries for RHEL. @ Ceph Developers : Any thought on this. # rpm -qa | egrep -i "ceph|rados|rbd" ceph-depl

Re: [ceph-users] Ceph v0.79 Firefly RC :: erasure-code-profile command set not present

Wow - that is a bit strange: $ cat /etc/issue Ubuntu 13.10 \n \l $ sudo ceph -v ceph version 0.78-569-g6a4c50d (6a4c50d7f27d2e7632d8c017d09e864e969a05f7) $ sudo ceph osd erasure-code-profile ls default myprofile profile profile1 I'd hazard a guess that some of your ceph components are at versi

[ceph-users] Ceph v0.79 Firefly RC :: erasure-code-profile command set not present

Thanks Developers for 0.79 , happy to see its announcement. I have been using 0.78 in order to test EC and TP , with 0.78 i was not able to test erasure code profile feature ( # ceph osd erasure-code-profile set myprofile ……) as erasure-code-profile command set is not present in 0.78 but its m

Re: [ceph-users] How to detect journal problems

On Tue, 08 Apr 2014 10:31:44 +0200 Josef Johansson wrote: > On 08/04/14 10:04, Christian Balzer wrote: > > Hello, > > > > On Tue, 08 Apr 2014 09:31:18 +0200 Josef Johansson wrote: > > > >> Hi all, > >> > >> I am currently benchmarking a standard setup with Intel DC S3700 disks > >> as journals and

Re: [ceph-users] How to detect journal problems

On 08/04/14 10:04, Christian Balzer wrote: > Hello, > > On Tue, 08 Apr 2014 09:31:18 +0200 Josef Johansson wrote: > >> Hi all, >> >> I am currently benchmarking a standard setup with Intel DC S3700 disks >> as journals and Hitachi 4TB-disks as data-drives, all on LACP 10GbE >> network. >> > Unless

Re: [ceph-users] How to detect journal problems

Hello, On Tue, 08 Apr 2014 09:31:18 +0200 Josef Johansson wrote: > Hi all, > > I am currently benchmarking a standard setup with Intel DC S3700 disks > as journals and Hitachi 4TB-disks as data-drives, all on LACP 10GbE > network. > Unless that is the 400GB version of the DC3700, you're already

[ceph-users] (no subject)

___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] ceph-deploy fails to generate keys

Hi, > > Have you increased the verbosity for the monitors, restarted them, and > looked at the log output? First of all: The bug is still there, and the logs do not help. But I seem to have found a workaround (just for myself, not generally) As for the bug: I appended "debug log=20" to ceph-

[ceph-users] How to detect journal problems

Hi all, I am currently benchmarking a standard setup with Intel DC S3700 disks as journals and Hitachi 4TB-disks as data-drives, all on LACP 10GbE network. The size of my journals are 25GB each, and I have two journals per machine, with 5 OSDs per journal, with 5 machines in total. We currently u

[ceph-users] radosgw return http 500 internal error

Hello! I am a newer to ceph, and I setup ceph object gateway following the guide (http://ceph.com/docs/master/radosgw/config/). But when started the radosgw daemon,two warnings came out: WARNING: libcurl doesn't support curl_multi_wait() WARNING: cross zone / region transfer performance may be a