Re: [ceph-users] Radosgw refusing to even attempt to use keystone auth

2014-10-17 Thread lakshmi k s
Sure Mark, I saw that thread last night. It will be interesting to see the resolution. Thanks, Lakshmi. On Friday, October 17, 2014 12:21 AM, Mark Kirkwood mark.kirkw...@catalyst.net.nz wrote: Keep an eye on the new thread OSD (and probably other settings) not being picked up outside of

Re: [ceph-users] Radosgw refusing to even attempt to use keystone auth

2014-10-16 Thread lakshmi k s
Hello Mark - Can you please paste your keystone.conf? Also It seems that Icehouse install that I have does not have keystone.conf. Do we need to create one? Like I said, adding WSGIChunkedRequest On in Keystone.conf did not solve my issue. Thanks, Lakshmi. On Wednesday, October 15, 2014 10:17

Re: [ceph-users] Radosgw refusing to even attempt to use keystone auth

2014-10-16 Thread Mark Kirkwood
Hi, While I certainly can (attached) - if your install has keystone running it *must* have one. It will be hiding somewhere! Cheers Mark On 17/10/14 05:12, lakshmi k s wrote: Hello Mark - Can you please paste your keystone.conf? Also It seems that Icehouse install that I have does not

Re: [ceph-users] Radosgw refusing to even attempt to use keystone auth

2014-10-16 Thread lakshmi k s
Thank you Mark. Strangely, Icehouse install that I have didn't seem to have one. At least not in /etc/apache2/ sub-directories. Like I said earlier, I can make the keystone openstack integration work seamlessly if I move all the keystone related flags under global section. Not otherwise. I am

[ceph-users] [radosgw] object copy implementation

2014-10-16 Thread Blair Bethwaite
Hi there rgw folks, Just wondering if the server-side copy operation ties up the radosgw host to actually proxy the data or if the copy is handled transparently by rados and the backend OSDs? -- Cheers, ~Blairo ___ ceph-users mailing list

Re: [ceph-users] Radosgw refusing to even attempt to use keystone auth

2014-10-15 Thread Mark Kirkwood
On 16/10/14 09:08, lakshmi k s wrote: I am trying to integrate Openstack keystone with radosgw. I have followed the instructions as per the link - http://ceph.com/docs/master/radosgw/keystone/. But for some reason, keystone flags under [client.radosgw.gateway] section are not being honored. That

Re: [ceph-users] Radosgw refusing to even attempt to use keystone auth

2014-10-15 Thread lakshmi k s
Hello Mark - Changing the rwg keystone url to http://192.168.122.165:35357 did not help. I continue to get 401 error. Also, I am trying to integrate with Icehouse this time. I did not see any keystone.conf in /etc/apache2/sites-available for adding WSGI chunked encoding. That said, I am

Re: [ceph-users] Radosgw refusing to even attempt to use keystone auth

2014-10-15 Thread Mark Kirkwood
On 16/10/14 10:37, Mark Kirkwood wrote: On 16/10/14 09:08, lakshmi k s wrote: I am trying to integrate Openstack keystone with radosgw. I have followed the instructions as per the link - http://ceph.com/docs/master/radosgw/keystone/. But for some reason, keystone flags under

Re: [ceph-users] Radosgw refusing to even attempt to use keystone auth

2014-10-15 Thread lakshmi k s
I still think that there is problem with the way radosgw is setup. Two things I want to point out - 1. rgw keystone url - If this flag is under radosgw section of ceph.conf file, I do not see the packets being exchanged between keystone and gateway node when radosgw is restarted. I tried to

Re: [ceph-users] Radosgw refusing to even attempt to use keystone auth

2014-10-15 Thread lakshmi k s
Has anyone seen this issue? Appreciate your time. On Wednesday, October 15, 2014 4:50 PM, lakshmi k s lux...@yahoo.com wrote: I still think that there is problem with the way radosgw is setup. Two things I want to point out - 1. rgw keystone url - If this flag is under radosgw section of

[ceph-users] radosGW balancer best practices

2014-10-14 Thread Simone Spinelli
Dear all, we are going to add rados-gw to our ceph cluster (144 OSD on 12 servers + 3 monitors connected via 10giga network) and we have a couple of questions. The first question is about the load balancer, do you have some advice based on real-world experience? Second question is about

Re: [ceph-users] RadosGW over HTTPS

2014-10-09 Thread Marco Garcês
Hi guys, thanks for the hints... I was able to fix it, by adding the line to nginx.conf (or fastcgi_params file): fastcgi_param SERVER_PORT_SECURE $server_port; Thank you so much! Marco Garcês #sysadmin Maputo - Mozambique On Wed, Oct 8, 2014 at 6:25 PM, Yehuda Sadeh yeh...@redhat.com

Re: [ceph-users] RadosGW over HTTPS

2014-10-09 Thread Marco Garcês
I spoke to soon... Now if I use HTTP I get errors! Let me try to debug, and post back. Thanks, Marco Garcês #sysadmin Maputo - Mozambique [Phone] +258 84 4105579 [Skype] marcogarces On Thu, Oct 9, 2014 at 10:38 AM, Marco Garcês ma...@garces.cc wrote: Hi guys, thanks for the hints... I was

Re: [ceph-users] RadosGW over HTTPS

2014-10-09 Thread Marco Garcês
Fixed.. I attach the server part, for nginx/tengine config file: server { listen 80; server_name gateway.local; error_log logs/error_http.log debug; client_max_body_size 100m; fastcgi_request_buffering off; location / {

[ceph-users] RadosGW over HTTPS

2014-10-08 Thread Marco Garcês
Hi there, I am using RadosGW over NGINX, with Swift API, and everything is working great, over HTTP, but with HTTPS, I keep getting errors, and I'm guessing is something on the gateway itself. Does anyone have a working HTTPS gateway with nginx? Can you provide it, so I can compare to mine? If

Re: [ceph-users] RadosGW over HTTPS

2014-10-08 Thread Marco Garcês
I made some tests: curl -D - -H X-Auth-Key: QoakiyY0tg8jULacsJLsmAbyZHJbY5g/Rc/dOHK3 -H X-Auth-User: frontend:swf0002 https://gateway.local/auth HTTP/1.1 204 Server: Tengine/2.0.3 Date: Wed, 08 Oct 2014 14:04:18 GMT Content-Type: application/json Connection: keep-alive X-Storage-Url:

Re: [ceph-users] RadosGW over HTTPS

2014-10-08 Thread David Moreau Simard
Hi Marco, While I do not have a RadosGW implementation right now, I do have a successful setup with tengine and Swift - it should be pretty similar. What version of tengine are you trying to use ? It dates back to a while.. but I remember having issues with the 2.0.x branch of tengine. We

Re: [ceph-users] RadosGW over HTTPS

2014-10-08 Thread Marco Garcês
Hi David, I am indeed using Tengine 2.0.3, but I feel very strange that the default config is returning X-Storage-Url in the headers, in http, not https as the original request. I will try your options, and perhaps downgrading to 1.5.*, and report back. Thank you! Marco Garcês #sysadmin Maputo

Re: [ceph-users] RadosGW over HTTPS

2014-10-08 Thread Yehuda Sadeh
Try passing in 'Server-Port-Secure: 443' header to the auth request. Yehuda On Wed, Oct 8, 2014 at 7:41 AM, Marco Garcês ma...@garces.cc wrote: Hi David, I am indeed using Tengine 2.0.3, but I feel very strange that the default config is returning X-Storage-Url in the headers, in http, not

Re: [ceph-users] RadosGW over HTTPS

2014-10-08 Thread Marco Garcês
Same thing: curl -D - -H Server-Port-Secure: 443 -H X-Auth-Key: QoakiyY0tg8jULacsJLsmAbyZHJbY5g/Rc/dOHK3 -H X-Auth-User: frontend:swf0002 https://gateway.local/auth HTTP/1.1 204 Server: Tengine/2.0.3 Date: Wed, 08 Oct 2014 15:04:27 GMT Content-Type: application/json Connection: keep-alive

Re: [ceph-users] RadosGW over HTTPS

2014-10-08 Thread Yehuda Sadeh
Does the header reach the gateway? Bump up the log (debug rgw = 20) to verify. Yehuda On Wed, Oct 8, 2014 at 8:05 AM, Marco Garcês ma...@garces.cc wrote: Same thing: curl -D - -H Server-Port-Secure: 443 -H X-Auth-Key: QoakiyY0tg8jULacsJLsmAbyZHJbY5g/Rc/dOHK3 -H X-Auth-User: frontend:swf0002

Re: [ceph-users] RadosGW over HTTPS

2014-10-08 Thread Marco Garcês
I believe so: 2014-10-08 18:19:38.438133 7f9119b90700 2 RGWDataChangesLog::ChangesRenewThread: start 2014-10-08 18:19:44.151527 7f90ea7fc700 20 enqueued request req=0x1b9e400 2014-10-08 18:19:44.151558 7f90ea7fc700 20 RGWWQ: 2014-10-08 18:19:44.151561 7f90ea7fc700 20 req: 0x1b9e400 2014-10-08

Re: [ceph-users] RadosGW over HTTPS

2014-10-08 Thread Yehuda Sadeh
On Wed, Oct 8, 2014 at 9:21 AM, Marco Garcês ma...@garces.cc wrote: I believe so: 2014-10-08 18:19:38.438133 7f9119b90700 2 RGWDataChangesLog::ChangesRenewThread: start 2014-10-08 18:19:44.151527 7f90ea7fc700 20 enqueued request req=0x1b9e400 2014-10-08 18:19:44.151558 7f90ea7fc700 20 RGWWQ:

[ceph-users] Radosgw, keystone, ceph : Temporary URL :(

2014-10-06 Thread Jimmy Goffaux
English version and French Version // En anglais et en Français English : hello, I set up and working properly CEPH via S3, librbd etc etc. .. I set up and configure the Keystone radosgw so he can talk together, so far it seemed to work. However I have a concern about the temporary URL. I

[ceph-users] [radosgw] Admin REST API wrong results

2014-09-30 Thread Patrycja Szabłowska
Hi, I'm using the radosgw REST API (via Python's boto library and also using some radosgw-agent methods) to fetch some data from Ceph (version 0.85). When I try to get the admin log for some specific dates, the radosgw seems to give me bad results. For example when I try to get entries since

[ceph-users] [radosgw] Admin REST API wrong results

2014-09-30 Thread Patrycja Szabłowska
Sending this again, because it wasn't published to the mailing list (I think because I wasn't a subscriber). Hi, I'm using the radosgw REST API (via Python's boto library and also using some radosgw-agent methods) to fetch some data from Ceph (version 0.85). When I try to get the admin log for

[ceph-users] RadosGW + Keystone = 403 Forbidden

2014-09-24 Thread Florent Bautista
Hi all, I want to set-up a RadosGW (Firefly) + Keystone (IceHouse) environment, but I have a problem I can't solve. It seems that authentication is OK, user get a token. But when he wants to create a bucket, he get 403 error. I have this in RadosGW logs : 2014-09-24 13:02:37.894674

Re: [ceph-users] RadosGW + Keystone = 403 Forbidden

2014-09-24 Thread Florent Bautista
Sorry, problem solved, I forgot /swift/v1 at the end of URLs in Keystone endpoint creation... ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] radosgw-admin pools list error

2014-09-17 Thread John Wilkins
Does radosgw-admin have authentication keys available and with appropriate permissions? http://ceph.com/docs/master/radosgw/config/#create-a-user-and-keyring On Fri, Sep 12, 2014 at 3:13 AM, Santhosh Fernandes santhosh.fernan...@gmail.com wrote: Hi, Anyone help me why my radosgw-admin pool

Re: [ceph-users] radosgw-admin pools list error

2014-09-17 Thread Santhosh Fernandes
Hi john, I specify the name then I got this error. #radosgw-admin pools list -n client.radosgw.in-west-1 could not list placement set: (2) No such file or directory Regards, Santhosh On Thu, Sep 18, 2014 at 3:44 AM, John Wilkins john.wilk...@inktank.com wrote: Does radosgw-admin have

[ceph-users] radosgw-admin pools list error

2014-09-12 Thread Santhosh Fernandes
Hi, Anyone help me why my radosgw-admin pool list give me this error #radosgw-admin pools list couldn't init storage provider But the rados lspools list all the pools, Regards, Santhosh ___ ceph-users mailing list ceph-users@lists.ceph.com

[ceph-users] radosgw user creation in secondary site error

2014-09-11 Thread Santhosh Fernandes
Hi All, When I try to create user in federated gateway secondary site I get following error. radosgw-admin user create --uid=eu-east --display-name=Region-EU Zone-East --name client.radosgw.eu-east-1 --system 2014-09-11 22:34:50.234269 7f3da41327c0 -1 ERROR: region map does not specify master

Re: [ceph-users] RadosGW problems

2014-08-21 Thread Marco Garcês
I have noticed that when I make the request to HTTPS, the responde comes in http form with port 443... Where is this happening, do you have any idea? On Wed, Aug 20, 2014 at 1:30 PM, Marco Garcês ma...@garces.cc wrote: swift --insecure -V 1 -A https://gateway.bcitestes.local/auth -U

Re: [ceph-users] RadosGW problems

2014-08-20 Thread Marco Garcês
Hello, Yehuda, I know I was using the correct fastcgi module, it was the one on Ceph repositories; I had also disabled in apache, all other modules; I tried to create a second swift user, using the provided instructions, only to get the following: # radosgw-admin user create --uid=marcogarces

Re: [ceph-users] RadosGW problems

2014-08-19 Thread Marco Garcês
you resolve bucket.gateway.testes.local from your client? Kurt Original message From: Marco Garcês Date:08/18/2014 6:33 AM (GMT-05:00) To: Linux Chips Cc: Bachelder, Kurt , ceph-users@lists.ceph.com Subject: Re: [ceph-users] RadosGW problems Hi there, I have

Re: [ceph-users] RadosGW problems

2014-08-19 Thread Marco Garcês
) To: Linux Chips Cc: Bachelder, Kurt , ceph-users@lists.ceph.com Subject: Re: [ceph-users] RadosGW problems Hi there, I have FastCgiWrapper Off in fastcgi.conf file; I also have SELinux in permissive state; 'ps aux | grep rados' shows me radosgw is running; The problems stays the same... I can

Re: [ceph-users] RadosGW problems

2014-08-19 Thread Yehuda Sadeh
On Tue, Aug 19, 2014 at 5:32 AM, Marco Garcês ma...@garces.cc wrote: UPDATE: I have installed Tengine (nginx fork) and configured both HTTP and HTTPS to use radosgw socket. Looking back at this thread, and considering this solution it seems to me that you were running the wrong apache

Re: [ceph-users] RadosGW problems

2014-08-18 Thread Marco Garcês
...@lists.ceph.com] *On Behalf Of *Marco Garcês *Sent:* Friday, August 15, 2014 12:46 PM *To:* ceph-users@lists.ceph.com *Subject:* [ceph-users] RadosGW problems Hi there, I am using CentOS 7 with Ceph version 0.80.5 (38b73c67d375a2552d8ed67843c8a65c2c0feba6), 3 OSD, 3 MON, 1 RadosGW (which also

[ceph-users] [radosgw-admin] bilog list confusion

2014-08-18 Thread Patrycja Szabłowska
Hi, Is there any configuration option in ceph.conf for enabling/disabling the bilog list? I mean the result of this command: radosgw-admin bilog list One ceph cluster gives me results - list of operations which were made to the bucket, and the other one gives me just an empty list. I can't see

Re: [ceph-users] RadosGW problems

2014-08-18 Thread Bachelder, Kurt
bucket.gateway.testes.local from your client? Kurt Original message From: Marco Garcês Date:08/18/2014 6:33 AM (GMT-05:00) To: Linux Chips Cc: Bachelder, Kurt , ceph-users@lists.ceph.com Subject: Re: [ceph-users] RadosGW problems Hi there, I have FastCgiWrapper Off in fastcgi.conf file

Re: [ceph-users] RadosGW problems

2014-08-18 Thread Marco Garcês
: Marco Garcês Date:08/18/2014 6:33 AM (GMT-05:00) To: Linux Chips Cc: Bachelder, Kurt , ceph-users@lists.ceph.com Subject: Re: [ceph-users] RadosGW problems Hi there, I have FastCgiWrapper Off in fastcgi.conf file; I also have SELinux in permissive state; 'ps aux | grep rados' shows me

Re: [ceph-users] [radosgw-admin] bilog list confusion

2014-08-18 Thread Craig Lewis
I have the same results. The primary zone (with log_meta and log_data true) have bilog data, the secondary zone (with log_meta and log_data false) do not have bilog data. I'm just guessing here (I can't test it right now)... I would think that disabling log_meta and log_data will stop adding

Re: [ceph-users] RadosGW problems

2014-08-17 Thread Bachelder, Kurt
and ceph-radosgw afterward. Kurt From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Marco Garcês Sent: Friday, August 15, 2014 12:46 PM To: ceph-users@lists.ceph.com Subject: [ceph-users] RadosGW problems Hi there, I am using CentOS 7 with Ceph version 0.80.5

Re: [ceph-users] RadosGW problems

2014-08-17 Thread Linux Chips
Off Give that a try, if you haven’t already – restart httpd and ceph-radosgw afterward. Kurt *From:*ceph-users [mailto:ceph-users-boun...@lists.ceph.com] *On Behalf Of *Marco Garcês *Sent:* Friday, August 15, 2014 12:46 PM *To:* ceph-users@lists.ceph.com *Subject:* [ceph-users] RadosGW problems

[ceph-users] RadosGW problems

2014-08-15 Thread Marco Garcês
Hi there, I am using CentOS 7 with Ceph version 0.80.5 (38b73c67d375a2552d8ed67843c8a65c2c0feba6), 3 OSD, 3 MON, 1 RadosGW (which also serves as ceph-deploy node) I followed all the instructions in the docs, regarding setting up a basic Ceph cluster, and then followed the one to setup RadosGW. I

Re: [ceph-users] radosgw monitoring

2014-07-26 Thread pragya jain
...@lists.ceph.com] On Behalf Of pragya jain Sent: Friday, July 25, 2014 6:39 PM To: ceph-users@lists.ceph.com Subject: [ceph-users] radosgw monitoring   Hi all,   Please suggest me some open source monitoring tools which can monitor radosgw instances for coming user request traffic for uploading and downloading

Re: [ceph-users] radosgw-agent failed to parse

2014-07-22 Thread Peter
yes, im scratching my head over this too. It doesn't seem to be an authentication issue as the radosgw-agent never reaches the us-secondary gateway (i've kept an eye on us-secondary logs as i execute radosgw-agent on us-master). On 22/07/14 03:51, Craig Lewis wrote: I was hoping for some

Re: [ceph-users] radosgw-agent failed to parse

2014-07-22 Thread Peter
radosgw-admin regionmap update after making region/zone changes. Bouncing the RGW’s probably wouldn’t hurt either. *From:*ceph-users [mailto:ceph-users-boun...@lists.ceph.com] *On Behalf Of *Peter *Sent:* Tuesday, July 22, 2014 4:51 AM *To:* Craig Lewis *Cc:* Ceph Users *Subject:* Re: [ceph-users

Re: [ceph-users] radosgw-agent failed to parse

2014-07-22 Thread Bachelder, Kurt
Cc: Ceph Users Subject: Re: [ceph-users] radosgw-agent failed to parse thanks for the suggestion. ive attempted a regionmap update but im hitting this error: failed to list regions: (2) No such file or directory 2014-07-22 14:13:04.096601 7ff825ac77c0 -1 failed to list objects

Re: [ceph-users] radosgw-agent failed to parse

2014-07-21 Thread Peter
hello again, i couldn't find 'http://us-secondary.example.comhttp://us-secondary.example.com/ http://us-secondary.example.com/' in any zone or regions config files. How could it be getting the URL from someplace else if i am specifying as command line option after radosgw-agent ? Here is

Re: [ceph-users] radosgw-agent failed to parse

2014-07-21 Thread Peter
typo, should read: { name: us-secondary, endpoints: [ http:\/\/us-secondary.example.com:80\/], log_meta: true, log_data: true} in region config below On 21/07/14 15:13, Peter wrote: hello again, i couldn't find

Re: [ceph-users] radosgw-agent failed to parse

2014-07-21 Thread Craig Lewis
I was hoping for some easy fixes :-P I created two system users, in both zones. Each user has different access and secret, but I copied the access and secret from the primary to the secondary. I can't imaging that this would cause the problem you're seeing, but it is something different from

[ceph-users] [radosgw] Creating buckets with different owner

2014-07-16 Thread Patrycja Szabłowska
Hi, Is it possible to set owner of a bucket or an object to someone else? I've got a user who was created with flag --system and is able to create buckets and objects. I've created a bucket using boto and I've got FULL CONTROL over it: Policy: http://acs.amazonaws.com/groups/global/AllUsers =

Re: [ceph-users] radosgw-agent failed to parse

2014-07-09 Thread Peter
thank you for your reply. I am running ceph 0.80.1, radosgw-agent 1.2 on Ubuntu 14.04 LTS (GNU/Linux 3.13.0-24-generic x86_64) . I also ran into this same issue with ubuntu 12.04 previously. There are no special characters in the access or secret key (ive had issues with this before so i make

Re: [ceph-users] radosgw-agent failed to parse

2014-07-09 Thread Craig Lewis
Just to ask a couple obvious questions... You didn't accidentally put 'http://us-secondary.example.comhttp:// us-secondary.example.com/' in any of your region or zone configuration files? The fact that it's missing the :80 makes me think it's getting that URL from someplace that isn't the

Re: [ceph-users] radosgw scalability questions

2014-07-08 Thread Craig Lewis
You can and should run multiple RadosGW and Apache instances per zone. The whole point of Ceph is eliminating as many points of failure as possible. You'll want to setup a load balancer just like you would for any website. You'll want your load balancer to recognize and forward both

Re: [ceph-users] radosgw issues

2014-07-08 Thread lists+ceph
Guess I'll try again. I gave this another shot, following the documentation, and still end up with basically a fork bomb rather than the nice ListAllMyBucketsResult output that the docs say I should get. Everything else about the cluster works fine, and I see others talking about the gateway

[ceph-users] radosgw scalability questions

2014-07-07 Thread Fred Yang
I'm setting up federated gateway following https://ceph.com/docs/master/radosgw/federated-config/, it seems one cluster can have multiple instances serving multiple zone each(be it master or slave), but it's not clear whether I can have multiple radosgw/httpd instances in the same cluster to serve

Re: [ceph-users] radosgw-agent failed to parse

2014-07-07 Thread Josh Durgin
On 07/04/2014 08:36 AM, Peter wrote: i am having issues running radosgw-agent to sync data between two radosgw zones. As far as i can tell both zones are running correctly. My issue is when i run the radosgw-agent command: radosgw-agent -v --src-access-key access_key --src-secret-key

[ceph-users] radosgw-agent failed to parse

2014-07-04 Thread Peter
i am having issues running radosgw-agent to sync data between two radosgw zones. As far as i can tell both zones are running correctly. My issue is when i run the radosgw-agent command: radosgw-agent -v --src-access-key access_key --src-secret-key secret_key --dest-access-key access_key

Re: [ceph-users] radosgw issues

2014-06-30 Thread lists+ceph
On 2014-06-16 13:16, lists+c...@deksai.com wrote: I've just tried setting up the radosgw on centos6 according to http://ceph.com/docs/master/radosgw/config/ While I can run the admin commands just fine to create users etc., making a simple wget request to the domain I set up returns a 500 due

Re: [ceph-users] RadosGW data striping

2014-06-30 Thread Craig Lewis
RadosGW stripes data by default. Objects larger than 4MiB are broken up into 4MiB chunks. On Wed, Jun 25, 2014 at 3:49 AM, Florent B flor...@coppint.com wrote: Hi, Is it possible to get data striped with radosgw, as in RBD or CephFS ? Thank you

Re: [ceph-users] radosgw ERROR: can't get key: ret=-2

2014-06-29 Thread Benjamin Lynch
Thanks JC. - Ben On Fri, Jun 27, 2014 at 5:05 PM, Jean-Charles LOPEZ jc.lo...@inktank.com wrote: Hi Benjamin, code extract sync_all_users() erroring is the sync of user stats /* * thread, full sync all users stats periodically * * only sync non idle users or ones that never got synced

[ceph-users] radosgw ERROR: can't get key: ret=-2

2014-06-27 Thread Benjamin Lynch
Hello Ceph users, Has anyone seen a radosgw error like this: 2014-06-27 14:02:39.254210 7f06b11587c0 0 ceph version 0.80.1 (a38fe1169b6d2ac98b427334c12d7cf81f809b74), process radosgw, pid 15471 2014-06-27 14:02:39.341198 7f06955ea700 0 ERROR: can't get key: ret=-2 2014-06-27 14:02:39.341212

Re: [ceph-users] radosgw ERROR: can't get key: ret=-2

2014-06-27 Thread Jean-Charles LOPEZ
Hi Benjamin, code extract sync_all_users() erroring is the sync of user stats /* * thread, full sync all users stats periodically * * only sync non idle users or ones that never got synced before, this is needed so that * users that didn't have quota turned on before (or existed before the

Re: [ceph-users] radosgw-agent SSL certificate verify failed

2014-06-19 Thread Fabrizio G. Ventola
I've done a dirty workaround editing by hand the code into /usr/lib/python2.7/dist-packages/requests/sessions.py. Is there any more orthodox method to do it? Fabrizio On 18 June 2014 17:00, Fabrizio G. Ventola fabrizio.vent...@uniba.it wrote: Hi everyone, I'm trying to sync data and metadata

Re: [ceph-users] RADOSGW + OpenStack basic question

2014-06-19 Thread Craig Lewis
Unfortunately, I can't help much. I'm just using the S3 interface for object storage. Looking back at the archives, this question does come up a lot, and there aren't a lot of replies. The best thread I see in the archive is

[ceph-users] radosgw-agent SSL certificate verify failed

2014-06-18 Thread Fabrizio G. Ventola
Hi everyone, I'm trying to sync data and metadata between zones of different regions through the Ceph REST interface with radosgw-agent. There's a way to set radosgw-agent to do NOT verify the SSL certificate (of remote host)? I've looked into python source code on github but didn't helped, I've

[ceph-users] RADOSGW + OpenStack basic question

2014-06-18 Thread Vickey Singh
Hello Cephers I have been following ceph documentation to install and configure RGW and fortunately everything went fine and RGW is correctly setup. Next i would like to use RGW with OpenStack , and for this i have followed http://ceph.com/docs/master/radosgw/keystone/ , as per the document i

[ceph-users] Radosgw fastcgi problem - comm with server /var/www/s3gw.fcgi aborted: idle timeout (30 sec)

2014-06-17 Thread Patrycja Szabłowska
Hi, I've got a problem with uploading files into buckets I've created. I'm using the python boto client for my tests. My code creates the bucket and then uploads the file. The apache server is working, the bucket gets created, I can access it via browser. However, when trying to upload files the

Re: [ceph-users] radosgw issues

2014-06-16 Thread lists+ceph
On 2014-06-17 07:30, John Wilkins wrote: You followed this intallation guide: http://ceph.com/docs/master/install/install-ceph-gateway/ [16] An then you, followed this http://ceph.com/docs/master/radosgw/config/ [1] configuration guide and then you executed: sudo /etc/init.d/ceph-radosgw start

[ceph-users] radosgw issues

2014-06-15 Thread lists+ceph
I've just tried setting up the radosgw on centos6 according to http://ceph.com/docs/master/radosgw/config/ There didn't seem to be an init script in the rpm I installed, so I copied the one from here:

[ceph-users] radosgw-agent - syncing two zones and regions

2014-06-05 Thread Patrycja Szabłowska
Hi, I'm new with ceph and I'm trying to understand how replicating data between two regions/zones work. I've read this http://ceph.com/docs/master/radosgw/federated-config/ and this http://www.sebastien-han.fr/blog/2013/01/28/ceph-geo-replication-sort-of/ and tried that

Re: [ceph-users] radosgw-admin log show

2014-06-05 Thread Derek Yarnell
On 11/28/13, 4:18 AM, Dan Van Der Ster wrote: Dear users/experts, Does anyone know how to use radosgw-admin log show? It seems to not properly read the --bucket parameter. # radosgw-admin log show --bucket=asdf --date=2013-11-28-09 --bucket-id=default.7750582.1 error reading log

Re: [ceph-users] radosgw-admin log show

2014-06-05 Thread Yehuda Sadeh
On Thu, Jun 5, 2014 at 8:42 PM, Derek Yarnell de...@umiacs.umd.edu wrote: On 11/28/13, 4:18 AM, Dan Van Der Ster wrote: Dear users/experts, Does anyone know how to use radosgw-admin log show? It seems to not properly read the --bucket parameter. # radosgw-admin log show --bucket=asdf

Re: [ceph-users] Radosgw Timeout

2014-05-23 Thread Georg Höllrigl
On 22.05.2014 15:36, Yehuda Sadeh wrote: On Thu, May 22, 2014 at 6:16 AM, Georg Höllrigl georg.hoellr...@xidras.com wrote: Hello List, Using the radosgw works fine, as long as the amount of data doesn't get too big. I have created one bucket that holds many small files, separated into

Re: [ceph-users] Radosgw Timeout

2014-05-23 Thread Georg Höllrigl
Thank you very much - I think I've solved the whole thing. It wasn't in radosgw. The solution was, - increase the timeout in Apache conf. - when using haproxy, also increase the timeouts there! Georg On 22.05.2014 15:36, Yehuda Sadeh wrote: On Thu, May 22, 2014 at 6:16 AM, Georg Höllrigl

Re: [ceph-users] Radosgw Timeout

2014-05-23 Thread Georg Höllrigl
On 22.05.2014 17:30, Craig Lewis wrote: On 5/22/14 06:16 , Georg Höllrigl wrote: I have created one bucket that holds many small files, separated into different directories. But whenever I try to acess the bucket, I only run into some timeout. The timeout is at around 30 - 100 seconds. This

Re: [ceph-users] Radosgw Timeout

2014-05-23 Thread Craig Lewis
On 5/23/14 03:47 , Georg Höllrigl wrote: On 22.05.2014 17:30, Craig Lewis wrote: On 5/22/14 06:16 , Georg Höllrigl wrote: I have created one bucket that holds many small files, separated into different directories. But whenever I try to acess the bucket, I only run into some timeout. The

[ceph-users] Radosgw Timeout

2014-05-22 Thread Georg Höllrigl
Hello List, Using the radosgw works fine, as long as the amount of data doesn't get too big. I have created one bucket that holds many small files, separated into different directories. But whenever I try to acess the bucket, I only run into some timeout. The timeout is at around 30 - 100

Re: [ceph-users] Radosgw Timeout

2014-05-22 Thread Yehuda Sadeh
On Thu, May 22, 2014 at 6:16 AM, Georg Höllrigl georg.hoellr...@xidras.com wrote: Hello List, Using the radosgw works fine, as long as the amount of data doesn't get too big. I have created one bucket that holds many small files, separated into different directories. But whenever I try to

Re: [ceph-users] Radosgw Timeout

2014-05-22 Thread Craig Lewis
On 5/22/14 06:16 , Georg Höllrigl wrote: I have created one bucket that holds many small files, separated into different directories. But whenever I try to acess the bucket, I only run into some timeout. The timeout is at around 30 - 100 seconds. This is smaller then the Apache timeout of

[ceph-users] [radosgw] unable to perform any operation using s3 api

2014-05-20 Thread Dererk
Dear ceph users! I've been running into some issues trying to use the radosgw S3 API for talking to my ceph cluster. For avoiding carrying away some issues from older installations, I reinstalled everything from ground up using 0.79 and 0.80.1, running on Debian and Ubuntu as well, with the

[ceph-users] radosgw-agent failed to parse

2014-04-24 Thread Peter
Hello, I am testing radosgw-agent for federation. I have a fully working two cluster master/secondary zones. When I try to run radosgw-agent, I receive the following error: root@us-master:/etc/ceph# radosgw-agent -c inter-sync.conf ERROR:root:Could not retrieve region map from destination

Re: [ceph-users] RadosGW Quotas

2014-04-22 Thread Derek Yarnell
Hi Yehuda, So i finally got to testing the quota stuff per the info from lines 712-758 in rgw_rest_user.cc. I am using the query parameters version and getting a 409 error out. Below in the debug log of the gateway running 0.79. 2014-04-22 10:46:56.852360 7fa46bfff700 20 enqueued request

Re: [ceph-users] RadosGW Quotas

2014-04-22 Thread Yehuda Sadeh
On Tue, Apr 22, 2014 at 7:51 AM, Derek Yarnell de...@umiacs.umd.edu wrote: Hi Yehuda, So i finally got to testing the quota stuff per the info from lines 712-758 in rgw_rest_user.cc. I am using the query parameters version and getting a 409 error out. Below in the debug log of the gateway

Re: [ceph-users] RadosGW Quotas

2014-04-22 Thread Derek Yarnell
Hi, Switching to a POST gives a 200 with the user JSON returned though this does not include any quota information back. I am guessing this is a bug and will start a ticket for it, unless you think I am doing something wrong here. {u'display_name': u' Mr. Test', u'keys': [{u'access_key':

Re: [ceph-users] Radosgw and s3cmd

2014-04-15 Thread Yehuda Sadeh
On Mon, Apr 14, 2014 at 10:12 PM, Shashank Puntamkar spuntam...@gmail.com wrote: I am setting up a ceph cluster with amazon s3 like capabilities. I have configured Ceph Object Gateway, radowgw on Ubuntu12.04 as described in ceph documentation.(http://ceph.com/docs/master/radosgw/config/).

Re: [ceph-users] Radosgw and s3cmd

2014-04-15 Thread Yehuda Sadeh
On Tue, Apr 15, 2014 at 9:10 AM, Shashank Puntamkar spuntam...@gmail.com wrote: Thanks Yehuda for quick response. I added the buckentname.servername in /etc/hosts file on the server on which I am running radosgw. From that server only, I run the command s3cmd mb s3://test. now the error

[ceph-users] Radosgw and s3cmd

2014-04-14 Thread Shashank Puntamkar
I am setting up a ceph cluster with amazon s3 like capabilities. I have configured Ceph Object Gateway, radowgw on Ubuntu12.04 as described in ceph documentation.(http://ceph.com/docs/master/radosgw/config/). While I am testing in with s3cmd tool , I am geeting error. though command s3cmd ls

Re: [ceph-users] RadosGW: bad request

2014-04-09 Thread Gandalf Corvotempesta
2014-04-07 20:24 GMT+02:00 Yehuda Sadeh yeh...@inktank.com: Try bumping up logs (debug rgw = 20, debug ms = 1). Not enough info here to say much, note that it takes exactly 30 seconds for the gateway to send the error response, may be some timeout. I'd verify that the correct fastcgi module is

[ceph-users] radosgw return http 500 internal error

2014-04-08 Thread Liucheng (B)
Hello! I am a newer to ceph, and I setup ceph object gateway following the guide (http://ceph.com/docs/master/radosgw/config/). But when started the radosgw daemon,two warnings came out: WARNING: libcurl doesn't support curl_multi_wait() WARNING: cross zone / region transfer performance may be

Re: [ceph-users] radosgw multipart-uploaded downloads fail

2014-04-08 Thread mykr0t
Hi, It was a 256 gig file ERROR: S3 error: 416 (InvalidRange): I think this is a MaxParts default limit 1000, s3cmd default part size 15MB (see .s3cfg). I cant find right way how to change this limit on rgw side, so i change part size in .s3cfg or use multipart tar archive for large files. --

[ceph-users] RadosGW: bad request

2014-04-07 Thread Gandalf Corvotempesta
I'm getting these trying to upload any file: 2014-04-07 14:33:27.084369 7f5268f86700 5 Getting permissions id=testuser owner=testuser perm=2 2014-04-07 14:33:27.084372 7f5268f86700 10 uid=testuser requested perm (type)=2, policy perm=2, user_perm_mask=2, acl perm=2 2014-04-07 14:33:27.084377

Re: [ceph-users] RadosGW: bad request

2014-04-07 Thread Yehuda Sadeh
On Mon, Apr 7, 2014 at 5:38 AM, Gandalf Corvotempesta gandalf.corvotempe...@gmail.com wrote: I'm getting these trying to upload any file: 2014-04-07 14:33:27.084369 7f5268f86700 5 Getting permissions id=testuser owner=testuser perm=2 2014-04-07 14:33:27.084372 7f5268f86700 10 uid=testuser

[ceph-users] RadosGW Quotas

2014-04-07 Thread Derek Yarnell
Hi, Most likely Yehuda can speak to this. So there is some documentation on the way to set quotas for a user in master (src/rgw/rgw_rest_user.cc line 712) but these are not in the docs it seems yet. I have started to incorporate them but I don't see anything as an example for how to document the

Re: [ceph-users] RadosGW Quotas

2014-04-07 Thread Yehuda Sadeh
On Mon, Apr 7, 2014 at 4:34 PM, Derek Yarnell de...@umiacs.umd.edu wrote: Hi, Most likely Yehuda can speak to this. So there is some documentation on the way to set quotas for a user in master (src/rgw/rgw_rest_user.cc line 712) but these are not in the docs it seems yet. I have started to

Re: [ceph-users] RadosGW Quotas

2014-04-07 Thread John Wilkins
Derek, I have some. I'll get them by the end of the week at the latest. On Mon, Apr 7, 2014 at 4:52 PM, Yehuda Sadeh yeh...@inktank.com wrote: On Mon, Apr 7, 2014 at 4:34 PM, Derek Yarnell de...@umiacs.umd.edu wrote: Hi, Most likely Yehuda can speak to this. So there is some

Re: [ceph-users] radosgw multipart-uploaded downloads fail

2014-04-04 Thread Benedikt Fraunhofer
2014-04-04 0:31 GMT+02:00 Yehuda Sadeh yeh...@inktank.com: Hi Yehuda, sorry for the delay. We ran into another problem and this took up all the time. Are you running the version off the master branch, or did you just cherry-pick the patch? I can't seem to reproduce the problem. I just patched

[ceph-users] radosgw-agent won't run

2014-04-04 Thread Craig Lewis
I've been seeing this warning on ceph -w for a while: 2014-04-04 11:26:29.438992 osd.3 [WRN] 84 slow requests, 1 included below; oldest blocked for 90124.336765 secs 2014-04-04 11:26:29.438996 osd.3 [WRN] slow request 1920.199044 seconds old, received at 2014-04-04 10:54:29.239906:

<    2   3   4   5   6   7   8   9   10   >