Re: [ceph-users] radosgw-agent won't run

2014-04-04 Thread Jean-Charles Lopez
What is the status of your PGs on the slave zone side. A down or stale PG could definitely cause this. May be a quick ceph -s and ceph health detail could help locate the PG with a problem that could may be then help you get the correct ceph pg {pgid} query command to find out which OSD is

Re: [ceph-users] radosgw-agent won't run

2014-04-04 Thread Craig Lewis
The cluster is currently recovering from a failed disk: cluster 1604ec7a-6ceb-42fc-8c68-0a7896c4e120 health HEALTH_WARN 520 pgs backfill; 378 pgs degraded; 1 pgs recovering; 2 pgs recovery_wait; 523 pgs stuck unclean; 84 requests are blocked 32 sec; recovery 4324271/37841102 objects

Re: [ceph-users] radosgw multipart-uploaded downloads fail

2014-04-03 Thread Yehuda Sadeh
Ok, we were able to reproduce it. Opened issue #7978, and there's a fix pending for upstream. Thanks, Yehuda On Wed, Apr 2, 2014 at 7:20 AM, Yehuda Sadeh yeh...@inktank.com wrote: On Wed, Apr 2, 2014 at 2:08 AM, Benedikt Fraunhofer given.to.lists.ceph-users.ceph.com.toasta@traced.net

Re: [ceph-users] radosgw multipart-uploaded downloads fail

2014-04-02 Thread Benedikt Fraunhofer
Hi Yehuda, i tried your patch and it feels fine, except you might need some special handling for those already corrupt uploads, as trying to delete them gets radosgw in an endless loop and high cpu usage: 2014-04-02 11:03:15.045627 7fbf157d2700 0 RGWObjManifest::operator++(): result:

[ceph-users] radosgw multipart-uploaded downloads fail

2014-04-01 Thread Benedikt Fraunhofer
Hello everyone, I can't download anything that's been uploaded as a multipart-upload. I'm on 0.78 (f6c746c314d7b87b8419b6e584c94bfe4511dbd4) on a non-ec-pool. The upload is acknowledged as beeing ok 2014-03-31 14:56:56.722727 7f4080ff9700 2 req 8:0.023285:s3:POST

Re: [ceph-users] radosgw multipart-uploaded downloads fail

2014-04-01 Thread Benedikt Fraunhofer
Hi Yehuda, 2014-04-01 15:49 GMT+02:00 Yehuda Sadeh yeh...@inktank.com: It could be the gateway's fault, might be related to the new manifest that went in before 0.78. I'll need more logs though, can you reproduce with 'debug ms = 1', and 'debug rgw = 20', and provide a log for all the

[ceph-users] radosgw where to put

2014-03-12 Thread Sergejs . Glusnevs
Hello to everybody, does anbody know, if I need separate nodes to install radosgw (for example, to place into DMZ), or should I put radosgw daemons directly onto my storage nodes? Thank you in advance! Best wisches, Sergejs___ ceph-users mailing list

[ceph-users] radosgw swift client, Auth Get failed

2014-02-19 Thread JinHwan Hwang
After i followed radosgw install and configuration document( http://ceph.com/docs/next/radosgw/config/), I have got stucked on using swift client. It just returns me Auth GET failed, even though i can see that radosgw already have swift subuser and keys. how can i solve it? What i got from

Re: [ceph-users] radosgw swift client, Auth Get failed

2014-02-19 Thread Yehuda Sadeh
On Wed, Feb 19, 2014 at 6:36 PM, JinHwan Hwang calanc...@gmail.com wrote: After i followed radosgw install and configuration document(http://ceph.com/docs/next/radosgw/config/), I have got stucked on using swift client. It just returns me Auth GET failed, even though i can see that radosgw

Re: [ceph-users] radosgw swift client, Auth Get failed

2014-02-19 Thread JinHwan Hwang
Thanky you for reply. Belows are my version and -V 1.0 result. ceph version 0.72.2 swift 1.0 root@cephT:~/swiftApiTest# swift -V 1.0 -A http://cephT/authhttp://cepht/auth -U johndoe:swift -K 12hcpWyed4ycYNEV2btiI6qiaDR2EfgKhrLFpdfc post test Traceback (most recent call last): File

Re: [ceph-users] Radosgw / Chunked transfer / RHEL / Swift

2014-02-12 Thread Gregory Farnum
If you look at http://ceph.com/docs/master/install/install-ceph-gateway, the fcgi package you have installed is labeled as W/Out 100 Continue. You need to add a separate gitbuilder repository if you want it with 100-continue (supporting chunked transfers); it's all described on that page. -Greg

Re: [ceph-users] Radosgw / Chunked transfer / RHEL / Swift

2014-02-12 Thread alistair.whittle
: Investment Bank (LDN) Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Radosgw / Chunked transfer / RHEL / Swift If you look at http://ceph.com/docs/master/install/install-ceph-gateway, the fcgi package you have installed is labeled as W/Out 100 Continue. You need to add a separate

[ceph-users] Radosgw / Chunked transfer / RHEL / Swift

2014-02-10 Thread alistair.whittle
All, My radosgw seems to be working, generally, however I have been experiencing problems when trying to connect to it from CTERA via OpenStack Swift. I get the following errors: [client 10.125.190.59] chunked Transfer-Encoding forbidden:

Re: [ceph-users] radosgw machines virtualization

2014-02-07 Thread Dominik Mostowiec
Thakns! -- Regards Dominik 2014-02-06 14:18 GMT+01:00 Dan van der Ster daniel.vanders...@cern.ch: Hi, Our three radosgw's are OpenStack VMs. Seems to work for our (limited) testing, and I don't see a reason why it shouldn't work. Cheers, Dan -- Dan van der Ster || Data Storage Services ||

[ceph-users] radosgw machines virtualization

2014-02-06 Thread Dominik Mostowiec
Hi Ceph Users, What do you think about virtualization of the radosgw machines? Have somebody a production level experience with such architecture? -- Regards Dominik ___ ceph-users mailing list ceph-users@lists.ceph.com

Re: [ceph-users] radosgw machines virtualization

2014-02-06 Thread Dan van der Ster
Hi, Our three radosgw's are OpenStack VMs. Seems to work for our (limited) testing, and I don't see a reason why it shouldn't work. Cheers, Dan -- Dan van der Ster || Data Storage Services || CERN IT Department -- On Thu, Feb 6, 2014 at 2:12 PM, Dominik Mostowiec dominikmostow...@gmail.com

[ceph-users] Radosgw link/unlink problem

2014-01-30 Thread Mikhail Krotyuk
Hi, I have successfully upgraded production cluster to: ceph version 0.67.5 (a60ac9194718083a4b6a225fc17cad6096c69bd1) 1. after this upgrade i see in radosgw.log: WARNING: couldn't find acl header for bucket, generating default i found this http://tracker.ceph.com/issues/5691 and checked the

Re: [ceph-users] Radosgw link/unlink problem

2014-01-30 Thread mykr0t
fix: it was not python boto, it was https://github.com/dyarnell/rgwadmin but it doesn`t matter -- Regards, Mikhail On Thu, 30 Jan 2014 19:54:16 +0300 Mikhail Krotyuk kr0...@gmail.com wrote: Hi, I have successfully upgraded production cluster to: ceph version 0.67.5

Re: [ceph-users] Radosgw link/unlink problem

2014-01-30 Thread Derek Yarnell
Hi Mikhail, Sorry did you find an issue with the library I wrote? Let me test the bucket linking as I didn't have a good unit test for it yet. Thanks, derek On 1/30/14, 12:45 PM, myk...@gmail.com wrote: fix: it was not python boto, it was https://github.com/dyarnell/rgwadmin but it doesn`t

Re: [ceph-users] Radosgw link/unlink problem

2014-01-30 Thread mykr0t
no its not in the library, the problem is with radosgw -- Regards, Mikhail On Thu, 30 Jan 2014 13:17:41 -0500 Derek Yarnell de...@umiacs.umd.edu wrote: Hi Mikhail, Sorry did you find an issue with the library I wrote? Let me test the bucket linking as I didn't have a good unit test

[ceph-users] Radosgw ops and usage logging

2014-01-27 Thread Caius Howcroft
Hi all I would like to run op and usage log on a production cluster to aid in some debugging. The problem is it would have to run for several weeks. Does anyone have any feel for what the performance hit would be ? Are large ops logs and usage logs expensive? Also if I was to run with them on ,

Re: [ceph-users] Radosgw ops and usage logging

2014-01-27 Thread Yehuda Sadeh
On Mon, Jan 27, 2014 at 3:34 PM, Caius Howcroft caius.howcr...@gmail.com wrote: Hi all I would like to run op and usage log on a production cluster to aid in some debugging. The problem is it would have to run for several weeks. Does anyone have any feel for what the performance hit would be

Re: [ceph-users] RadosGW (?) slow parallel upload

2014-01-26 Thread Mihály Árva-Tóth
Hello, Have you got any idea? HDDs are fast, filesystem is XFS, mounted with nobarrier,noatime... I think everything is right for the great performance. Thank you, Mihaly 2014-01-14 Mihály Árva-Tóth mihaly.arva-t...@virtual-call-center.eu Hello, I have got 3 servers, with 3 HDD-OSD /

Re: [ceph-users] RadosGW S3 API - Bucket Versions

2014-01-24 Thread Yehuda Sadeh
On Thu, Jan 23, 2014 at 4:27 PM, Greg Poirier greg.poir...@opower.com wrote: Hello! I have a great deal of interest in the ability to version objects in buckets via the S3 API. Where is this on the roadmap for Ceph? This still needs to be prioritized. There was a discussion about it in the

Re: [ceph-users] RadosGW S3 API - Bucket Versions

2014-01-24 Thread Greg Poirier
On Fri, Jan 24, 2014 at 4:28 PM, Yehuda Sadeh yeh...@inktank.com wrote: For each object that rgw stores it keeps a version tag. However this version is not ascending, it's just used for identifying whether an object has changed. I'm not completely sure what is the problem that you're trying

[ceph-users] radosgw s3 api for java.

2014-01-17 Thread raj kumar
I tried using aws-java-sdk. I can list the buckets, but cant do any other functions like create/delete objects/buckets. getting 403/405 response code. pls let me know if anybody used it. sub domains are resolving properly in dns. Thanks. ___

[ceph-users] RadosGW browser-based uploads using POST?

2014-01-15 Thread Valery Tschopp
Hello, With AWS it is possible to do user browser-based uploads using POST [1]. Is it possible to do with RadosGW. Is the feature supported? Cheers, Valery [1] http://docs.aws.amazon.com/AmazonS3/latest/dev/UsingHTTPPOST.html -- SWITCH -- Valery Tschopp, Software

[ceph-users] RadosGW (?) slow parallel upload

2014-01-14 Thread Mihály Árva-Tóth
Hello, I have got 3 servers, with 3 HDD-OSD / server (4 TB WD RE). I'm using radosgw primary. Every .rgw.* pool has 3 replica. Every server is rados gateway with apache2+fastcgi (ceph patched version). Servers type: SuperMicro SSG-6047R-E1R36L. I've got 10 client machines which uploads objects

Re: [ceph-users] radosgw setting puplic ACLs fails.

2014-01-13 Thread Wido den Hollander
: [ceph-users] radosgw setting puplic ACLs fails. On 11/26/13, 3:31 PM, Shain Miley wrote: Micha, Did you ever figure out a work around for this issue? I also had plans of using s3cmd to put, and recursively set acl's on a nightly basis...however we are getting the 403 errors as well during our

Re: [ceph-users] radosgw swift java jars

2014-01-13 Thread Chmouel Boudjnah
fyi: there is this http://javaswift.org/ as well. Chmouel. On Mon, Jan 6, 2014 at 7:05 PM, raj kumar rajkumar600...@gmail.com wrote: Hi, could find all necessary jars required to run the java program. Is there any place to get all jars for both swift and s3? Thanks.

Re: [ceph-users] radosgw swift java jars

2014-01-13 Thread raj kumar
Thanks. there is one more jclouds(https://github.com/jclouds/jclouds). would like to know anybody used it. On Mon, Jan 13, 2014 at 9:08 PM, Chmouel Boudjnah chmo...@enovance.comwrote: fyi: there is this http://javaswift.org/ as well. Chmouel. On Mon, Jan 6, 2014 at 7:05 PM, raj kumar

Re: [ceph-users] radosgw package - missing deps on Ubuntu 13.04

2014-01-08 Thread Michael
Would also be interested to know about these performance issues, we have a 12.04 cluster using RBD caching we're about to double in size so it'd be good to know if we could be about to run into any potential bottlenecks. -Michael On 06/01/2014 21:03, LaSalle, Jurvis wrote: On 1/2/14, 1:42

Re: [ceph-users] radosgw swift java jars

2014-01-08 Thread raj kumar
Thank you for your time. Some would have used already the suitable java swift api for CS. Would like to hear from them. I tried using, https://github.com/rackerlabs/java-cloudfiles. Since it requires lot of other deps, the java program fails. I'm getting, java -classpath

Re: [ceph-users] radosgw swift java jars

2014-01-08 Thread Wido den Hollander
On 01/09/2014 06:37 AM, raj kumar wrote: Thank you for your time. Some would have used already the suitable java swift api for CS. Would like to hear from them. This is not a part of the Ceph project, so I'm not able to help you with that. You should contact the rackerlabs people abut

Re: [ceph-users] radosgw swift java jars

2014-01-07 Thread Wido den Hollander
On 01/07/2014 08:41 AM, Wido den Hollander wrote: On 01/07/2014 08:15 AM, raj kumar wrote: I meant could not find required jar files to run java swift program. I don't think nobody has a clue of what you mean. ^ anybody Ceph is completely written in C++,

[ceph-users] radosgw swift java jars

2014-01-06 Thread raj kumar
Hi, could find all necessary jars required to run the java program. Is there any place to get all jars for both swift and s3? Thanks. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] radosgw package - missing deps on Ubuntu 13.04

2014-01-06 Thread LaSalle, Jurvis
On 1/2/14, 1:42 PM, Sage Weil s...@inktank.com wrote: The precise version has a few annoying (though rare) bugs, and more importantly does not support caching properly. For clusters of any size this can become a performance problem, particularly when the cluster is stressed (lots of OSDs

Re: [ceph-users] radosgw swift java jars

2014-01-06 Thread raj kumar
I meant could not find required jar files to run java swift program. On Mon, Jan 6, 2014 at 11:35 PM, raj kumar rajkumar600...@gmail.com wrote: Hi, could find all necessary jars required to run the java program. Is there any place to get all jars for both swift and s3? Thanks.

Re: [ceph-users] radosgw swift java jars

2014-01-06 Thread Wido den Hollander
On 01/07/2014 08:15 AM, raj kumar wrote: I meant could not find required jar files to run java swift program. I don't think nobody has a clue of what you mean. Ceph is completely written in C++, so there are no Java JARs. The only piece of Java is the CephFS JNI integration and the RADOS

[ceph-users] radosgw package - missing deps on Ubuntu 13.04

2014-01-02 Thread Ritter Sławomir
We have a problem with upgrade ceph/radosgw to a latest version 0.67-5 on Ubuntu 12.04 LTS. It seems that there is a missing dependency for amd64 platform: http://ceph.com/debian-dumpling/dists/precise/main/binary-i386/Packages Package: radosgw Depends: libcurl3-gnutls (= 7.16.2-1)

Re: [ceph-users] radosgw package - missing deps on Ubuntu 13.04

2014-01-02 Thread Wido den Hollander
On 01/02/2014 02:03 PM, Ritter Sławomir wrote: We have a problem with upgrade ceph/radosgw to a latest version 0.67-5 on Ubuntu 12.04 LTS. It seems that there is a missing dependency for amd64 platform: http://ceph.com/debian-dumpling/dists/precise/main/binary-i386/Packages Package: radosgw

Re: [ceph-users] radosgw package - missing deps on Ubuntu 13.04

2014-01-02 Thread Ritter Sławomir
Hollander Sent: Thursday, January 02, 2014 2:53 PM To: ceph-users@lists.ceph.com Subject: Re: [ceph-users] radosgw package - missing deps on Ubuntu 13.04 On 01/02/2014 02:03 PM, Ritter Sławomir wrote: We have a problem with upgrade ceph/radosgw to a latest version 0.67-5 on Ubuntu 12.04 LTS

Re: [ceph-users] radosgw package - missing deps on Ubuntu 13.04

2014-01-02 Thread Sage Weil
On Thu, 2 Jan 2014, Wido den Hollander wrote: On 01/02/2014 02:03 PM, Ritter S?awomir wrote: We have a problem with upgrade ceph/radosgw to a latest version 0.67-5 on Ubuntu 12.04 LTS. It seems that there is a missing dependency for amd64 platform:

[ceph-users] [RadosGW] What's the invalid bucket name pattern ?

2013-12-29 Thread Kuo Hugo
Some of strings can not be the bucket name. What's the pattern wiftstack@bm01:~/hugo$ time swift upload b1 1G Error trying to create container 'b1': 400 Bad Request: InvalidBucketName Object HEAD failed: http://192.168.2.51:80/swift/v1/b1/1G 400 Bad Request Thanks

Re: [ceph-users] [RadosGW] What's the invalid bucket name pattern ?

2013-12-29 Thread Kuo Hugo
://ceph.com/docs/master/radosgw/s3/bucketops/#put-bucket Best Regards Wei *From:* ceph-users-boun...@lists.ceph.com [mailto: ceph-users-boun...@lists.ceph.com] *On Behalf Of *Kuo Hugo *Sent:* Monday, December 30, 2013 2:46 PM *To:* ceph-users@lists.ceph.com *Subject:* [ceph-users] [RadosGW

Re: [ceph-users] [RadosGW] FastCGI: comm with server /var/www/s3gw.fcgi aborted: read failed

2013-12-26 Thread Kuo Hugo
Hi all, I think the FastCGI module is the latest one on my server. root@p01:/var/log# dpkg -l | grep cgi ii libapache2-mod-fastcgi2.4.7~0910052141-2~bpo70+1.ceph Apache 2 FastCGI module for long-running CGI scripts ii libfcgi0ldbl 2.4.0-8.1 Shared library of

Re: [ceph-users] [RadosGW] FastCGI: comm with server /var/www/s3gw.fcgi aborted: read failed

2013-12-26 Thread Yehuda Sadeh
On Thu, Dec 26, 2013 at 3:00 AM, Kuo Hugo tonyt...@gmail.com wrote: Hi all, I think the FastCGI module is the latest one on my server. root@p01:/var/log# dpkg -l | grep cgi ii libapache2-mod-fastcgi2.4.7~0910052141-2~bpo70+1.ceph Apache 2 FastCGI module for long-running CGI

Re: [ceph-users] [RadosGW] FastCGI: comm with server /var/www/s3gw.fcgi aborted: read failed

2013-12-26 Thread Kuo Hugo
Hi Yehuda, I did hit the apache concurrent connections that limit to 150 by default in apache at beginning. Several parameters were been bumped up. After that the concurrent connections of apache looks sufficient for the benchmark run or those failed requests will not been sent to FastCGI sever

Re: [ceph-users] [RadosGW] FastCGI: comm with server /var/www/s3gw.fcgi aborted: read failed

2013-12-26 Thread Yehuda Sadeh
On Thu, Dec 26, 2013 at 7:58 AM, Kuo Hugo tonyt...@gmail.com wrote: Hi Yehuda, I did hit the apache concurrent connections that limit to 150 by default in apache at beginning. Several parameters were been bumped up. After that the concurrent connections of apache looks sufficient for the

[ceph-users] [RadosGW] FastCGI: comm with server /var/www/s3gw.fcgi aborted: read failed

2013-12-25 Thread Kuo Hugo
Hi folks, I'm in progress to tune the performance of RadosGW on my server. After some kindly helps from you guys. I figure out several problems for optimizing the RadosGW to handle higher concurrency requests from users. Apache optimization # radosgw open file # rgw thread pools # rgw_ops

Re: [ceph-users] [RadosGW] FastCGI: comm with server /var/www/s3gw.fcgi aborted: read failed

2013-12-25 Thread Yehuda Sadeh
On Wed, Dec 25, 2013 at 9:12 AM, Kuo Hugo tonyt...@gmail.com wrote: Hi folks, I'm in progress to tune the performance of RadosGW on my server. After some kindly helps from you guys. I figure out several problems for optimizing the RadosGW to handle higher concurrency requests from users.

Re: [ceph-users] [RadosGW] Does your RadosGW capable to handle 500+ concurrency connections?

2013-12-24 Thread Kuo Hugo
Hi folks, After some more tests. I can not addressed the bottleneck currently. Never hit CPU bound. OSD op threads : 60 rgw_thread_pool_size : 300 pg = 2000 pool size = 3 Try to find the max concurrency of 1KB write of this cluster Rados bench 1000~5000+ about 3000 reqs/sec mon.0 [INF] 2053

Re: [ceph-users] [RadosGW] Does your RadosGW capable to handle 500+ concurrency connections?

2013-12-24 Thread Yehuda Sadeh
On Tue, Dec 24, 2013 at 8:16 AM, Kuo Hugo tonyt...@gmail.com wrote: Hi folks, After some more tests. I can not addressed the bottleneck currently. Never hit CPU bound. OSD op threads : 60 rgw_thread_pool_size : 300 pg = 2000 pool size = 3 Try to find the max concurrency of 1KB write of

[ceph-users] [RadosGW] Failed to install due to libcurl3-gnutls version insufficient

2013-12-23 Thread Kuo Hugo
The libcurl-gnutls version is 7.22 on Ubuntu. But radosgw requires 7.28 Error on dependency check root@p01:~# radosgw -bash: /usr/bin/radosgw: No such file or directory root@p01:~# apt-get install radosgw Reading package lists... Done Building dependency tree Reading state information... Done

Re: [ceph-users] [RadosGW] Failed to install due to libcurl3-gnutls version insufficient

2013-12-23 Thread JJ Galvez
On Dec 23, 2013 10:50 AM, Kuo Hugo tonyt...@gmail.com wrote: The libcurl-gnutls version is 7.22 on Ubuntu. But radosgw requires 7.28 Make sure you have the Ceph extras repo setup. That solved it for me running dumpling on precise.

Re: [ceph-users] [RadosGW] Failed to install due to libcurl3-gnutls version insufficient

2013-12-23 Thread Sage Weil
On Mon, 23 Dec 2013, JJ Galvez wrote: On Dec 23, 2013 10:50 AM, Kuo Hugo tonyt...@gmail.com wrote: The libcurl-gnutls version is 7.22 on Ubuntu.  But radosgw requires 7.28 Make sure you have the Ceph extras repo setup. That solved it for me running dumpling on precise.

[ceph-users] [RadosGW] Does your RadosGW capable to handle 500+ concurrency connections?

2013-12-23 Thread Kuo Hugo
Hi folks, There're 30 HDDs on three 24 threads severs. Each has 2 10G NICs. one for public and one for cluster . A dedicated 32threads server for RadosGW. My setting is to achieve same availability as Swift. So that the pool size=3 anf min_size=2. for all RadosGW related pools. Each pool's pg

Re: [ceph-users] [RadosGW] Failed to install due to libcurl3-gnutls version insufficient

2013-12-23 Thread Kuo Hugo
Thanks It's solved by add ceph extra repo. appreciate ~~! Hugo 2013/12/24 Sage Weil s...@inktank.com On Mon, 23 Dec 2013, JJ Galvez wrote: On Dec 23, 2013 10:50 AM, Kuo Hugo tonyt...@gmail.com wrote: The libcurl-gnutls version is 7.22 on Ubuntu. But radosgw requires 7.28

[ceph-users] radosgw public url

2013-12-20 Thread Quenten Grasso
Hi All, Does Radosgw support a Public URL For static content? Being that I wish to share a File publicly but not give out username/passwords etc. I noticed in the http://ceph.com/docs/master/radosgw/swift/ it says Static Websites isn't supported.. which I assume is talking about this feature,

Re: [ceph-users] radosgw daemon stalls on download of some files

2013-12-19 Thread Joel van Velden
: [ceph-users] radosgw daemon stalls on download of some files Hi, we are currently using the patched fastcgi version (2.4.7-0910042141-6-gd4fffda) Updating to a more recent version is currently blocked by http://tracker.ceph.com/issues/6453 Is there a documentation for running radosgw with nginx? I

Re: [ceph-users] radosgw setup - not working

2013-12-19 Thread raj kumar
Working now. Removed escape char from the api_key, Thank you so much for your suggestions. On Thu, Dec 19, 2013 at 4:31 AM, Andrew Woodward xar...@gmail.com wrote: I see python 2.6 So I assume this is a RHEL6 distro. I've not been able to use mod-fcgid in any setup on RHEL6 variants. I'd

Re: [ceph-users] radosgw daemon stalls on download of some files

2013-12-19 Thread Kyle Bader
Do you have any futher detail on this radosgw bug? https://github.com/ceph/ceph/commit/0f36eddbe7e745665a634a16bf3bf35a3d0ac424 https://github.com/ceph/ceph/commit/0b9dc0e5890237368ba3dc34cb029010cb0b67fd Does it only apply to emperor? The bug is present in dumpling too.

Re: [ceph-users] radosgw daemon stalls on download of some files

2013-12-18 Thread Sebastian
-users-boun...@lists.ceph.com] On Behalf Of Sebastian Sent: mercredi 4 décembre 2013 10:29 To: ceph-users Subject: Re: [ceph-users] radosgw daemon stalls on download of some files Hi, we are currently using the patched fastcgi version (2.4.7-0910042141-6-gd4fffda) Updating to a more recent

Re: [ceph-users] radosgw daemon stalls on download of some files

2013-12-18 Thread Yehuda Sadeh
-boun...@lists.ceph.com [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Sebastian Sent: mercredi 4 décembre 2013 10:29 To: ceph-users Subject: Re: [ceph-users] radosgw daemon stalls on download of some files Hi, we are currently using the patched fastcgi version (2.4.7-0910042141-6

Re: [ceph-users] radosgw setup - not working

2013-12-17 Thread Yehuda Sadeh
On Tue, Dec 17, 2013 at 6:27 AM, raj kumar rajkumar600...@gmail.com wrote: Hi, I followed inst mentioned in ceph radosgw setup. I used swift python script to access it. I'm getting error like, Traceback (most recent call last): File a.py, line 8, in module

Re: [ceph-users] radosgw-agent, sync zone_info.us-east: Http error code 500 content

2013-12-16 Thread lin zhou 周林
Thanks for your reply. root@rceph0:~# radosgw-admin zone get --name client.radosgw.us-west-1 { domain_root: .us-west.rgw.root, control_pool: .us-west.rgw.control, gc_pool: .us-west.rgw.gc, log_pool: .us-west.log, intent_log_pool: .us-west.intent-log, usage_log_pool: .us-west.usage,

Re: [ceph-users] radosgw-agent, sync zone_info.us-east: Http error code 500 content

2013-12-16 Thread Yehuda Sadeh
On Mon, Dec 16, 2013 at 8:22 PM, lin zhou 周林 hnuzhou...@gmail.com wrote: Thanks for your reply. root@rceph0:~# radosgw-admin zone get --name client.radosgw.us-west-1 { domain_root: .us-west.rgw.root, control_pool: .us-west.rgw.control, gc_pool: .us-west.rgw.gc, log_pool: .us-west.log,

[ceph-users] radosgw-agent, sync zone_info.us-east: Http error code 500 content

2013-12-15 Thread hnuzhoulin
Hi,guys. I am using the character of geo-replication in ceph. I have two ceph clusters,so my plan is one region,in which two zones. Ceph version is ceph version 0.72.1 (4d923861868f6a15dcb33fef7f50f674997322de) Now I can sync users and buckets from master zone to slave zone. But the

Re: [ceph-users] radosgw-agent, sync zone_info.us-east: Http error code 500 content

2013-12-15 Thread Yehuda Sadeh
For some reason your bucket list seem to be returning some non-bucket metadata info. Sounds like there's a mixup in the pools. What does radosgw-admin zone get (for the us-west zone) return? What's your 'rgw zone root pool' and 'rgw region root pool'? Yehuda On Sun, Dec 15, 2013 at 9:03 PM,

Re: [ceph-users] radosgw Segmentation fault on obj copy

2013-12-03 Thread Dominik Mostowiec
Thanks. -- Regards Dominik 2013/12/3 Yehuda Sadeh yeh...@inktank.com: For bobtail at this point yes. You can try the unofficial version with that fix off the gitbuilder. Another option is to upgrade everything to dumpling. Yehuda On Mon, Dec 2, 2013 at 10:24 PM, Dominik Mostowiec

[ceph-users] Radosgw on Ubuntu vs CentOS

2013-12-03 Thread Andy McCrae
Hi ceph-users, I've been playing around with radosgw and I notice there is an inconsistency between the Ubuntu and CentOS startup scripts. On Ubuntu, if I run a start ceph-all (which will start radosgw), or I run the init script /etc/init.d/radosgw start - the radosgw process starts up fine, but

Re: [ceph-users] Radosgw on Ubuntu vs CentOS

2013-12-03 Thread Sage Weil
On Tue, 3 Dec 2013, Andy McCrae wrote: Hi ceph-users, I've been playing around with radosgw and I notice there is an inconsistency between the Ubuntu and CentOS startup scripts. On Ubuntu, if I run a start ceph-all (which will start radosgw), or I run the init script /etc/init.d/radosgw

Re: [ceph-users] Radosgw on Ubuntu vs CentOS

2013-12-03 Thread Andy McCrae
Tracked it down - its the start-stop-daemon command flag, -u isn't for user change, that should be -c, so I'll submit a fix soon. On Tue, Dec 3, 2013 at 4:06 PM, Sage Weil s...@inktank.com wrote: On Tue, 3 Dec 2013, Andy McCrae wrote: Hi ceph-users, I've been playing around with radosgw

[ceph-users] radosgw Segmentation fault on obj copy

2013-12-02 Thread Dominik Mostowiec
Hi, I have strange problem. Obj copy (0 size) killing radosgw. Head for this file: Content-Type: application/octet-stream Server: Apache/2.2.22 (Ubuntu) ETag: d41d8cd98f00b204e9800998ecf8427e-0 Last-Modified: 2013-12-01T10:37:15Z rgw log. 2013-12-02 08:18:59.196651 7f5308ff1700 1 ==

Re: [ceph-users] radosgw Segmentation fault on obj copy

2013-12-02 Thread Dominik Mostowiec
Hi, I found that issue is related with ETag: -0 (ends -0) This is known bug ? -- Regards Dominik 2013/12/2 Dominik Mostowiec dominikmostow...@gmail.com: Hi, I have strange problem. Obj copy (0 size) killing radosgw. Head for this file: Content-Type: application/octet-stream Server:

Re: [ceph-users] radosgw Segmentation fault on obj copy

2013-12-02 Thread Yehuda Sadeh
That's unknown bug. I have a guess as to how the original object was created. Can you read the original object, but only copy fails? On Dec 2, 2013 4:53 AM, Dominik Mostowiec dominikmostow...@gmail.com wrote: Hi, I found that issue is related with ETag: -0 (ends -0) This is known bug ?

Re: [ceph-users] radosgw Segmentation fault on obj copy

2013-12-02 Thread Dominik Mostowiec
Yes I can read it. Oryginal object is 0 size. Regards Dominik On Dec 2, 2013 6:14 PM, Yehuda Sadeh yeh...@inktank.com wrote: That's unknown bug. I have a guess as to how the original object was created. Can you read the original object, but only copy fails? On Dec 2, 2013 4:53 AM, Dominik

Re: [ceph-users] radosgw Segmentation fault on obj copy

2013-12-02 Thread Dominik Mostowiec
Hi, Another file with the same problems: 2013-12-01 11:37:15.556687 7f7891fd3700 1 == starting new request req=0x25406d0 = 2013-12-01 11:37:15.556739 7f7891fd3700 2 req 1314:0.52initializing 2013-12-01 11:37:15.556789 7f7891fd3700 10 s-object=files/192.txt s-bucket=testbucket

Re: [ceph-users] radosgw Segmentation fault on obj copy

2013-12-02 Thread Yehuda Sadeh
By any chance are you uploading empty objects through the multipart upload api? On Mon, Dec 2, 2013 at 12:08 PM, Dominik Mostowiec dominikmostow...@gmail.com wrote: Hi, Another file with the same problems: 2013-12-01 11:37:15.556687 7f7891fd3700 1 == starting new request req=0x25406d0

Re: [ceph-users] radosgw Segmentation fault on obj copy

2013-12-02 Thread Dominik Mostowiec
Yes, this is probably upload empty file. This is the problem? -- Regards Dominik 2013/12/2 Yehuda Sadeh yeh...@inktank.com: By any chance are you uploading empty objects through the multipart upload api? On Mon, Dec 2, 2013 at 12:08 PM, Dominik Mostowiec dominikmostow...@gmail.com wrote:

Re: [ceph-users] radosgw Segmentation fault on obj copy

2013-12-02 Thread Yehuda Sadeh
Looks like it. There should be a guard against it (mulitpart upload minimum is 5M). On Mon, Dec 2, 2013 at 12:32 PM, Dominik Mostowiec dominikmostow...@gmail.com wrote: Yes, this is probably upload empty file. This is the problem? -- Regards Dominik 2013/12/2 Yehuda Sadeh

Re: [ceph-users] radosgw Segmentation fault on obj copy

2013-12-02 Thread Yehuda Sadeh
Actually, I read that differently. It only says that if there's more than 1 part, all parts except for the last one need to be 5M. Which means that for uploads that are smaller than 5M there should be zero or one parts. On Mon, Dec 2, 2013 at 12:54 PM, Dominik Mostowiec

Re: [ceph-users] radosgw Segmentation fault on obj copy

2013-12-02 Thread Yehuda Sadeh
I'm having trouble reproducing the issue. What version are you using? Thanks, Yehuda On Mon, Dec 2, 2013 at 2:16 PM, Yehuda Sadeh yeh...@inktank.com wrote: Actually, I read that differently. It only says that if there's more than 1 part, all parts except for the last one need to be 5M. Which

Re: [ceph-users] radosgw Segmentation fault on obj copy

2013-12-02 Thread Dominik Mostowiec
0.56.7 On Dec 2, 2013 11:30 PM, Yehuda Sadeh yeh...@inktank.com wrote: I'm having trouble reproducing the issue. What version are you using? Thanks, Yehuda On Mon, Dec 2, 2013 at 2:16 PM, Yehuda Sadeh yeh...@inktank.com wrote: Actually, I read that differently. It only says that if

Re: [ceph-users] radosgw Segmentation fault on obj copy

2013-12-02 Thread Yehuda Sadeh
I see. Do you have backtrace for the crash? On Mon, Dec 2, 2013 at 6:19 PM, Dominik Mostowiec dominikmostow...@gmail.com wrote: 0.56.7 W dniu poniedziałek, 2 grudnia 2013 użytkownik Yehuda Sadeh napisał: I'm having trouble reproducing the issue. What version are you using? Thanks, Yehuda

Re: [ceph-users] radosgw Segmentation fault on obj copy

2013-12-02 Thread Dominik Mostowiec
for another object. http://pastebin.com/VkVAYgwn 2013/12/3 Yehuda Sadeh yeh...@inktank.com: I see. Do you have backtrace for the crash? On Mon, Dec 2, 2013 at 6:19 PM, Dominik Mostowiec dominikmostow...@gmail.com wrote: 0.56.7 W dniu poniedziałek, 2 grudnia 2013 użytkownik Yehuda Sadeh

Re: [ceph-users] radosgw Segmentation fault on obj copy

2013-12-02 Thread Yehuda Sadeh
I created earlier an issue (6919) and updated it with the relevant issue. This has been fixed in dumpling, although I don't remember hitting the scenario that you did. Was probably hitting it as part of the development work that was done then. In any case I created a branch with the relevant fixes

Re: [ceph-users] radosgw daemon stalls on download of some files

2013-11-30 Thread Artem Silenkov
Good day! Is it possible to change frontend to something different then Apache? For example Nginx. Regards, Artem Silenkov 2013/11/30 Sebastian webmas...@mailz.de Hi Yehuda, It's interesting, the responses are received but seems that they aren't being handled (hence the following

Re: [ceph-users] radosgw daemon stalls on download of some files

2013-11-30 Thread Andrew Woodward
: [ceph-users] radosgw daemon stalls on download of some files *De:* Sebastian webmas...@mailz.de *Para:* ceph-users ceph-users@lists.ceph.com *Fecha:* Friday, 29/11/2013 16:18 Hi Yehuda, It's interesting, the responses are received but seems that they aren't being handled (hence the following

Re: [ceph-users] radosgw setting puplic ACLs fails.

2013-11-29 Thread Micha Krause
Hi, So how does AWS S3 handle Public access to objects? You have to explicitly set public ACL on each object. Ok, but this also does not work with radosgw + s3cmd: s3cmd setacl -P s3://test/fstab ERROR: S3 error: 403 (AccessDenied): Micha Krause

Re: [ceph-users] radosgw daemon stalls on download of some files

2013-11-29 Thread Sebastian
Hi, thanks for the hint. I tried this again and noticed that the time out message does seem to be unrelated. Here is the log file for a stalling request with debug turned on: http://pastebin.com/DcQuc9wP I really cannot really find a real error in the log. The download stalls at about 500kb

Re: [ceph-users] radosgw daemon stalls on download of some files

2013-11-29 Thread Artem Silenkov
Good day! We ve noticed such things recently during some osd recovery things like scrubbing or so. Restarting OSD did the trick. We had even 404 errors until deep scrubbing ended. Any noise in ceph -w? Regards, Artem S. 29 нояб. 2013 г. 22:28 пользователь Sebastian webmas...@mailz.de написал:

Re: [ceph-users] radosgw daemon stalls on download of some files

2013-11-29 Thread Sebastian
Hi, our ceph -w is clean: cluster e54d66c5-5191-4296-a217-f818e1f92830 health HEALTH_OK monmap e1: 4 mons at {a=5.9.67.9:6789/0,b=5.9.67.8:6789/0,c=5.9.67.7:6789/0,d=5.9.67.6:6789/0}, election epoch 19724, quorum 0,1,2,3 a,b,c,d osdmap e1629: 4 osds: 4 up, 4 in pgmap v4896303:

Re: [ceph-users] radosgw daemon stalls on download of some files

2013-11-29 Thread Yehuda Sadeh
It's interesting, the responses are received but seems that they aren't being handled (hence the following pings). There are a few things that you could look at. First, try to connect to the admin socket and see if you get any useful information from there. This could include in-flight requests,

Re: [ceph-users] radosgw daemon stalls on download of some files

2013-11-29 Thread Sebastian
Hi Yehuda, It's interesting, the responses are received but seems that they aren't being handled (hence the following pings). There are a few things that you could look at. First, try to connect to the admin socket and see if you get any useful information from there. This could include

Re: [ceph-users] radosgw daemon stalls on download of some files

2013-11-29 Thread German Anders
regards, German Anders --- Original message --- Asunto: Re: [ceph-users] radosgw daemon stalls on download of some files De: Sebastian webmas...@mailz.de Para: ceph-users ceph-users@lists.ceph.com Fecha: Friday, 29/11/2013 16:18 Hi Yehuda, It's interesting, the responses

[ceph-users] radosgw-admin log show

2013-11-28 Thread Dan Van Der Ster
Dear users/experts, Does anyone know how to use radosgw-admin log show? It seems to not properly read the --bucket parameter. # radosgw-admin log show --bucket=asdf --date=2013-11-28-09 --bucket-id=default.7750582.1 error reading log 2013-11-28-09-default.7750582.1-: (2) No such file or

[ceph-users] radosgw read from obj copy

2013-11-28 Thread Dominik Mostowiec
Hi, I I have replication = 3, obj A - PG - [1,2,3]. Osd.1 -master, 2,3 replica. osd.1 - host1, osd.2 - host2, osd.3 - host3. Radosgw on host2 requests(GET) for obj A to osd.1 or to local osd.2 ? -- Regards Dominik ___ ceph-users mailing list

Re: [ceph-users] radosgw setting puplic ACLs fails.

2013-11-28 Thread Micha Krause
Hi, Note this breaks AWS S3 compatibility and is why it is a configurable. So how does AWS S3 handle Public access to objects? Micha Krause ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] radosgw setting puplic ACLs fails.

2013-11-28 Thread Derek Yarnell
On 11/28/13, 4:44 AM, Micha Krause wrote: Hi, Note this breaks AWS S3 compatibility and is why it is a configurable. So how does AWS S3 handle Public access to objects? You have to explicitly set public ACL on each object. -- Derek T. Yarnell University of Maryland Institute for

<    3   4   5   6   7   8   9   10   >