Re: [ceph-users] radosgw setting puplic ACLs fails.

2013-11-27 Thread Micha Krause
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi, No solution so far, but I also asked in IRC and linuxkidd told me they where looking for a workaround. Micha Krause -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird -

Re: [ceph-users] radosgw setting puplic ACLs fails.

2013-11-27 Thread Derek Yarnell
On 11/26/13, 3:31 PM, Shain Miley wrote: Micha, Did you ever figure out a work around for this issue? I also had plans of using s3cmd to put, and recursively set acl's on a nightly basis...however we are getting the 403 errors as well during our testing. I was just wondering if you

Re: [ceph-users] radosgw daemon stalls on download of some files

2013-11-27 Thread Yehuda Sadeh
On Wed, Nov 27, 2013 at 4:46 AM, Sebastian webmas...@mailz.de wrote: Hi, we have a setup of 4 Servers running ceph and radosgw. We use it as an internal S3 service for our files. The Servers run Debian Squeeze with Ceph 0.67.4. The cluster has been running smoothly for quite a while, but

Re: [ceph-users] [radosgw] increase avg get time after sharding

2013-11-26 Thread Yehuda Sadeh
On Tue, Nov 26, 2013 at 1:27 PM, Dominik Mostowiec dominikmostow...@gmail.com wrote: Hi, We have 2 clusters with copy of objects. On one of them we splited all large buckets (largest 17mln objects) to 256 buckets each (shards) and we have added 3 extra servers (6-9). Old bucket was created in

Re: [ceph-users] radosgw-agent AccessDenied 403

2013-11-20 Thread Mark Kirkwood
On 13/11/13 21:16, lixuehui wrote: Hi ,list We've ever reflected that ,radosgw-agent sync data failed all the time ,before. We paste the concert log here to seek any help now . application/json; charset=UTF-8 Wed, 13 Nov 2013 07:24:45 GMT x-amz-copy-source:sss%2Frgwconf /sss/rgwconf

Re: [ceph-users] radosgw-agent AccessDenied 403

2013-11-19 Thread Josh Durgin
On 11/13/2013 09:06 PM, lixuehui wrote: And on the slave zone gateway instence ,the info is like this : 2013-11-14 12:54:24.516840 7f51e7fef700 1 == starting new request req=0xb1e3b0 = 2013-11-14 12:54:24.526640 7f51e7fef700 1 == req done req=0xb1e3b0

[ceph-users] radosgw-agent AccessDenied 403

2013-11-13 Thread lixuehui
Hi ,list We've ever reflected that ,radosgw-agent sync data failed all the time ,before. We paste the concert log here to seek any help now . application/json; charset=UTF-8 Wed, 13 Nov 2013 07:24:45 GMT x-amz-copy-source:sss%2Frgwconf /sss/rgwconf 2013-11-13T15:24:45.510

Re: [ceph-users] radosgw won't start

2013-11-09 Thread Sebastian Deutsch
My ceph.conf looks like this: ... [client.admin] keyring = /etc/ceph/ceph.client.admin.keyring [client.radosgw.gateway] host = eatr keyring = /etc/ceph/keyring.radosgw.gateway rgw socket path = /tmp/radosgw.sock log file = /var/log/ceph/radosgw.log

Re: [ceph-users] radosgw won't start

2013-11-09 Thread Sebastian Deutsch
When I do: ceph daemon osd.0 config show | grep socket admin_socket: \/var\/run\/ceph\/ceph-osd.0.asok, ms_inject_socket_failures: 0, rgw_socket_path: , rgw_ops_log_socket_path: , why is the rgw_socket_path ? Best Sebastian Am 09.11.2013 um 06:16 schrieb Yehuda Sadeh

Re: [ceph-users] radosgw won't start

2013-11-09 Thread Sebastian Deutsch
Hello, I was able to fix the problem by removing the client from the auth list: ceph auth del client.radosgw.gateway then adding again: ceph auth add client.radosgw.gateway --in-file=/etc/ceph/keyring.radosgw.gateway The keyring has the following caps: [client.radosgw.gateway] key =

[ceph-users] radosgw configuration problems - Swift access

2013-11-08 Thread alistair.whittle
All, I have configured a rados gateway as per the Dumpling quick instructions on a Red Hat 6 server. The idea is to use Swift API to access my cluster via this interface. Have configured FastCGI, httpd, as per the guides, did all the user creations/authtool commands for the Swift

[ceph-users] radosgw setting puplic ACLs fails.

2013-11-08 Thread Micha Krause
Hi, I'm trying to set public ACLs to an object, so that I can access the object via Web-browser. unfortunately without success: s3cmd setacl --acl-public s3://test/hosts ERROR: S3 error: 403 (AccessDenied): The radosgw log says: x-amz-date:Fri, 08 Nov 2013 12:56:55 + /test/hosts?acl

Re: [ceph-users] radosgw setting puplic ACLs fails.

2013-11-08 Thread Yehuda Sadeh
On Fri, Nov 8, 2013 at 5:09 AM, Micha Krause mi...@krausam.de wrote: Hi, I'm trying to set public ACLs to an object, so that I can access the object via Web-browser. unfortunately without success: s3cmd setacl --acl-public s3://test/hosts ERROR: S3 error: 403 (AccessDenied): The radosgw

Re: [ceph-users] radosgw questions

2013-11-07 Thread John Wilkins
For #2, I just wrote a document on setting up a federated architecture. You can view it here: http://ceph.com/docs/master/radosgw/federated-config/ This functionality will be available in the Emperor release. The use case I described involved two zones in a master region talking to the same

Re: [ceph-users] radosgw questions

2013-11-07 Thread Kyle Bader
1. To build a high performance yet cheap radosgw storage, which pools should be placed on ssd and which on hdd backed pools? Upon installation of radosgw, it created the following pools: .rgw, .rgw.buckets, .rgw.buckets.index, .rgw.control, .rgw.gc, .rgw.root, .usage, .users, .users.email.

Re: [ceph-users] radosgw-agent failed to sync object

2013-11-07 Thread Josh Durgin
On 11/07/2013 09:48 AM, lixuehui wrote: Hi all : After we build a region with two zones distributed in two ceph cluster.Start the agent ,it start works! But what we find in the radosgw-agent stdout is that it failed to sync objects all the time .Paste the info:

[ceph-users] radosgw-agent sync object:state is error

2013-11-07 Thread lixuehui
Hi list We deploied a master zone and a slave zone in two clusters to test the multi-locals backup . The radosgw-anget sync buckets successfully .We can find the same buckets info in the slave zone . But the running radosgw-agent throw out error info that objects failed to sync , just like

[ceph-users] radosgw questions

2013-11-06 Thread Alessandro Brega
Good day ceph users, I'm new to ceph but installation went well so far. Now I have a lot of questions regarding radosgw. Hope you don't mind... 1. To build a high performance yet cheap radosgw storage, which pools should be placed on ssd and which on hdd backed pools? Upon installation of

Re: [ceph-users] radosgw-agent error

2013-11-05 Thread lixuehui
It works so cool !Thanks so much from your help! lixuehui From: Josh Durgin Date: 2013-10-31 01:31 To: Mark Kirkwood; lixuehui; ceph-users Subject: Re: [ceph-users] radosgw-agent error On 10/30/2013 01:54 AM, Mark Kirkwood wrote: On 29/10/13 20:53, lixuehui wrote: Hi,list From

Re: [ceph-users] radosgw fails to start

2013-11-04 Thread Gruher, Joseph R
Sorry to bump this, but does anyone have any idea what could be wrong here? To resummarize, radosgw fails to start. Debug output seems to indicate it is complaining about the keyring, but the keyring is present and readable, and other Ceph functions which require the keyring can success. So

Re: [ceph-users] radosgw fails to start

2013-11-04 Thread Yehuda Sadeh
Not sure why you're able to run the 'rados' and 'ceph' command, and not 'radosgw', just note that the former two don't connect to the osds, whereas the latter does, so it might fail on a different level. You're using the default client.admin as the user for radosgw, but your ceph.conf file doesn't

Re: [ceph-users] radosgw fails to start

2013-11-04 Thread Gruher, Joseph R
-Original Message- From: Yehuda Sadeh [mailto:yeh...@inktank.com] Sent: Monday, November 04, 2013 12:40 PM To: Gruher, Joseph R Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] radosgw fails to start Not sure why you're able to run the 'rados' and 'ceph' command, and not 'radosgw

Re: [ceph-users] radosgw fails to start

2013-11-01 Thread Gruher, Joseph R
Adding some debug arguments has generated output which I believe indicates the problem is my keyring is missing, but the keyring seems to be here. Why would this complain about the keyring and fail to start? [ceph@joceph08 ceph]$ sudo /usr/bin/radosgw -d --debug-rgw 20 --debug-ms 1 start

Re: [ceph-users] radosgw fails to start

2013-11-01 Thread Derek Yarnell
On 11/1/13, 2:07 PM, Gruher, Joseph R wrote: Adding some debug arguments has generated output which I believe indicates the problem is my keyring is missing, but the keyring seems to be here. Why would this complain about the keyring and fail to start? Hi, Are you sure the user you are

Re: [ceph-users] radosgw fails to start

2013-11-01 Thread Gruher, Joseph R
-Original Message- From: Derek Yarnell [mailto:de...@umiacs.umd.edu] Sent: Friday, November 01, 2013 12:20 PM To: Gruher, Joseph R; ceph-users@lists.ceph.com Subject: Re: [ceph-users] radosgw fails to start On 11/1/13, 2:07 PM, Gruher, Joseph R wrote: Adding some debug arguments has

[ceph-users] radosgw - complete_multipart errors

2013-10-31 Thread Dominik Mostowiec
Hi, I have strange radosgw error: == 2013-10-26 21:18:29.844676 7f637beaf700 0 setting object tag=_ZPeVs7d6W8GjU8qKr4dsilbGeo6NOgw 2013-10-26 21:18:30.049588 7f637beaf700 0 WARNING: set_req_state_err err_no=125 resorting to 500 2013-10-26 21:18:30.049738 7f637beaf700 2 req

Re: [ceph-users] radosgw - complete_multipart errors

2013-10-31 Thread Gregory Farnum
On Thu, Oct 31, 2013 at 6:22 AM, Dominik Mostowiec dominikmostow...@gmail.com wrote: Hi, I have strange radosgw error: == 2013-10-26 21:18:29.844676 7f637beaf700 0 setting object tag=_ZPeVs7d6W8GjU8qKr4dsilbGeo6NOgw 2013-10-26 21:18:30.049588 7f637beaf700 0 WARNING: set_req_state_err

Re: [ceph-users] Radosgw and large files

2013-10-31 Thread Shain Miley
To: de...@umiacs.umd.edu; Shain Miley; ceph-us...@ceph.com Subject: Re: [ceph-users] Radosgw and large files Along those lines, you might want to use something similar to the attached to check for any failed/partial uploads that are taking up space (note cannot be gc'd away automatically). I just got

Re: [ceph-users] Radosgw and large files

2013-10-31 Thread Shain Miley
: ceph-users-boun...@lists.ceph.com [ceph-users-boun...@lists.ceph.com] on behalf of Shain Miley [smi...@npr.org] Sent: Thursday, October 31, 2013 1:27 PM To: Mark Kirkwood; de...@umiacs.umd.edu; ceph-us...@ceph.com Subject: Re: [ceph-users] Radosgw and large files Mark, Thanks for the update

Re: [ceph-users] Radosgw and large files

2013-10-31 Thread Mark Kirkwood
, October 31, 2013 1:27 PM To: Mark Kirkwood; de...@umiacs.umd.edu; ceph-us...@ceph.com Subject: Re: [ceph-users] Radosgw and large files Mark, Thanks for the update. Just an FYI I ran into an issue using the script when it turned out that the last part of the file was exactly 0 bytes. in length

Re: [ceph-users] Radosgw and large files

2013-10-31 Thread Mark Kirkwood
...@lists.ceph.com] on behalf of Shain Miley [smi...@npr.org] Sent: Thursday, October 31, 2013 1:27 PM To: Mark Kirkwood; de...@umiacs.umd.edu; ceph-us...@ceph.com Subject: Re: [ceph-users] Radosgw and large files Mark, Thanks for the update. Just an FYI I ran into an issue using the script when it turned

Re: [ceph-users] Radosgw usage

2013-10-30 Thread Valery Tschopp
Hi Derek, I've the same problem with the usage. How does your pools list look like now ('radosgw-admin pools list') ? Cheers, Valery On 23/10/13 22:32 , Derek Yarnell wrote: Hi, So the problem was that '.usage' pool was not created. I haven't traversed the code well enough yet to know

Re: [ceph-users] radosgw-agent error

2013-10-30 Thread Mark Kirkwood
On 29/10/13 20:53, lixuehui wrote: Hi,list From the document that a radosgw-agent's right info should like this INFO:radosgw_agent.sync:Starting incremental sync INFO:radosgw_agent.worker:17910 is processing shard number 0 INFO:radosgw_agent.worker:shard 0 has 0 entries

Re: [ceph-users] Radosgw usage

2013-10-30 Thread Matt Thompson
Hi Derek, I'm wondering if your radosgw client does not have read-write (rw) caps on mon? See the section Monitor Key CAPS on http://ceph.com/docs/next/radosgw/config/ for more info. -Matt On Wed, Oct 23, 2013 at 9:32 PM, Derek Yarnell de...@umiacs.umd.edu wrote: Hi, So the problem was

Re: [ceph-users] Radosgw usage

2013-10-30 Thread Derek Yarnell
On 10/30/13, 5:48 AM, Matt Thompson wrote: Hi Derek, I'm wondering if your radosgw client does not have read-write (rw) caps on mon? See the section Monitor Key CAPS on http://ceph.com/docs/next/radosgw/config/ for more info. Hi Matt, You are right. I had forgotten that I didn't allow

Re: [ceph-users] Radosgw usage

2013-10-30 Thread Derek Yarnell
On 10/30/13, 4:53 AM, Valery Tschopp wrote: radosgw-admin pools list Hi Valery, That command lists the data placement pool(s) within radosgw (different than what I was having problems with). My problem was that I didn't have the correct underlying rados pool(s) created. They are listed here:

Re: [ceph-users] radosgw-agent error

2013-10-30 Thread Josh Durgin
On 10/30/2013 01:54 AM, Mark Kirkwood wrote: On 29/10/13 20:53, lixuehui wrote: Hi,list From the document that a radosgw-agent's right info should like this INFO:radosgw_agent.sync:Starting incremental sync INFO:radosgw_agent.worker:17910 is processing shard number 0

[ceph-users] radosgw fails to start, leaves no clues why

2013-10-30 Thread Gruher, Joseph R
Hi all- Trying to set up object storage on CentOS. I've done this successfully on Ubuntu but I'm having some trouble on CentOS. I think I have everything configured but when I try to start the radosgw service it reports starting, but then the status is not running, with no helpful output as

Re: [ceph-users] radosgw-agent error

2013-10-30 Thread Mark Kirkwood
On 31/10/13 06:31, Josh Durgin wrote: Note that the wip in the url means it's a work-in-progress branch, so it's not totally ready yet either. If anything is confusing or missing, let us know. It's great people are interested in trying this early. It's very helpful to find issues sooner (like

Re: [ceph-users] Radosgw and large files

2013-10-30 Thread Mark Kirkwood
Along those lines, you might want to use something similar to the attached to check for any failed/partial uploads that are taking up space (note cannot be gc'd away automatically). I just got caught by this. In fact the previous code I posted should probably use a try:... except: block to

Re: [ceph-users] Radosgw partial gc

2013-10-30 Thread Mark Kirkwood
On 29/10/13 18:08, Mark Kirkwood wrote: On 29/10/13 17:46, Yehuda Sadeh wrote: The multipart abort operation is supposed to remove the objects (no gc needed for these). Were there any other issues during the run, e.g., restarted gateways, failed requests, etc.? Note that the objects here are

[ceph-users] radosgw-agent error

2013-10-29 Thread lixuehui
Hi,list From the document that a radosgw-agent's right info should like this INFO:radosgw_agent.sync:Starting incremental sync INFO:radosgw_agent.worker:17910 is processing shard number 0 INFO:radosgw_agent.worker:shard 0 has 0 entries after '' INFO:radosgw_agent.worker:finished processing shard 0

Re: [ceph-users] Radosgw and large files

2013-10-28 Thread Shain Miley
: Monday, October 28, 2013 1:04 AM To: de...@umiacs.umd.edu; Shain Miley; ceph-us...@ceph.com Subject: Re: [ceph-users] Radosgw and large files I was looking at the same thing myself, and Boto seems to work ok (tested a 6G file - some sample code attached). Regards Mark On 27/10/13 11:46, Derek

Re: [ceph-users] radosgw-agent 403 error

2013-10-28 Thread John Wilkins
That looks like a permissions problem. I've updated the draft document here: http://ceph.com/docs/wip-doc-radosgw/radosgw/federated-config/ On Mon, Oct 28, 2013 at 2:25 AM, lixuehui lixue...@chinacloud.com.cn wrote: Hi all Today I'd like to replicated one cluster with gateway.After master

[ceph-users] Radosgw partial gc

2013-10-28 Thread Mark Kirkwood
I have a radosgw instance (ceph 0.71-299-g5cba838 src build), running on Ubuntu 13.10. I've been experimenting with multipart uploads (which are working fine). However while *most* objects (from radosgw perspective) have their storage space gc'd after a while post deletion, I'm seeing what

Re: [ceph-users] Radosgw and large files

2013-10-27 Thread Mark Kirkwood
I was looking at the same thing myself, and Boto seems to work ok (tested a 6G file - some sample code attached). Regards Mark On 27/10/13 11:46, Derek Yarnell wrote: Hi Shain, Yes we have tested and have working S3 Multipart support for files 5GB (RHEL64/0.67.4). However, crossftp unless

Re: [ceph-users] radosgw-admin object unlink

2013-10-26 Thread Dominik Mostowiec
Hi, radosgw-admin object unlink can do stomething like 'blind bucket' (object in bucket without rgw index)? -- Regards Dominik 2013/10/13 Dominik Mostowiec dominikmostow...@gmail.com: hmm, 'tail' - do you mean file/object content? I thought that this command might be workaround for 'blind

Re: [ceph-users] radosgw-admin object unlink

2013-10-26 Thread Yehuda Sadeh
No. The object unlink option is to delete an object via radosgw-admin. It has nothing to do with index-less buckets. On Sat, Oct 26, 2013 at 2:01 PM, Dominik Mostowiec dominikmostow...@gmail.com wrote: Hi, radosgw-admin object unlink can do stomething like 'blind bucket' (object in bucket

[ceph-users] Radosgw and large files

2013-10-26 Thread Shain Miley
Hi, I am wondering if anyone has successfully been able to upload files larger than 5GB using radosgw. I have tried using various clients, including dragondisk, crossftp, s3cmd, etc...all of them have failed with a 'permission denied' response. Each of the clients say they support multi-part

Re: [ceph-users] Radosgw and large files

2013-10-26 Thread Derek Yarnell
Hi Shain, Yes we have tested and have working S3 Multipart support for files 5GB (RHEL64/0.67.4). However, crossftp unless you have pro it would seem does not support multipart. Dragondisk gives the error that I have seen when using a PUT and not multipart, EntityTooLarge. My guess is that it

Re: [ceph-users] Radosgw and large files

2013-10-26 Thread Shain Miley
; ceph-us...@ceph.com Subject: Re: [ceph-users] Radosgw and large files Hi Shain, Yes we have tested and have working S3 Multipart support for files 5GB (RHEL64/0.67.4). However, crossftp unless you have pro it would seem does not support multipart. Dragondisk gives the error that I have seen when

Re: [ceph-users] Radosgw and large files

2013-10-26 Thread Shain Miley
[smi...@npr.org] Sent: Saturday, October 26, 2013 7:25 PM To: de...@umiacs.umd.edu; ceph-us...@ceph.com Subject: Re: [ceph-users] Radosgw and large files I'll try the pro version of crossftp as soon as I have a chance. Here is the output using s3cmd version 1.1.0-beta3: root@theneykov:/mnt/samba

Re: [ceph-users] Radosgw and large files

2013-10-26 Thread Shain Miley
...@lists.ceph.com] on behalf of Shain Miley [smi...@npr.org] Sent: Saturday, October 26, 2013 7:25 PM To: de...@umiacs.umd.edu; ceph-us...@ceph.com Subject: Re: [ceph-users] Radosgw and large files I'll try the pro version of crossftp as soon as I have a chance. Here is the output using s3cmd version 1.1.0-beta3

Re: [ceph-users] radosgw s3 API feature

2013-10-23 Thread Wido den Hollander
On 10/23/2013 09:27 AM, lixuehui wrote: Hi all We know that radosgw supported a subset of Amazon s3 functional features.Does radosgw support server-side encryption algorithm ,when creating an object,through Amazon s3 api support AES256 on server-side? Or can we use client-side encryption

Re: [ceph-users] Radosgw usage

2013-10-21 Thread Yehuda Sadeh
On Sun, Oct 20, 2013 at 9:04 PM, Derek Yarnell de...@umiacs.umd.edu wrote: So I have tried to enable usage logging on a new production Ceph RadosGW cluster but nothing seems to show up. I have added to the [client.radosgw.] section the following rgw enable usage log = true rgw usage log

Re: [ceph-users] Radosgw usage

2013-10-21 Thread Derek Yarnell
Try moving the above configurables to the global section, if it's working then you're probably using the wrong section. Moving sections doesn't seem to change the behavior. My two other test gateways seems to be working fine with similar configs all running 0.67.4 (slightly patched for

[ceph-users] Radosgw usage

2013-10-20 Thread Derek Yarnell
So I have tried to enable usage logging on a new production Ceph RadosGW cluster but nothing seems to show up. I have added to the [client.radosgw.] section the following rgw enable usage log = true rgw usage log tick interval = 30 rgw usage log flush threshold = 1024 rgw usage max shards = 32

Re: [ceph-users] radosgw-admin doesn't list user anymore

2013-10-17 Thread Valery Tschopp
Hi Derek, Sorry, I added the caps, but didn't restarted the radosgw process. After a restart it works :) Cheers, Valery On 16/10/13 17:20 , Derek Yarnell wrote: On 10/16/13 4:26 AM, Valery Tschopp wrote: Hi Derek, Thanks for your example. I've added caps='metadata=*', but I still have an

[ceph-users] radosgw public access problem

2013-10-16 Thread Fabio - NS3 srl
Hello, when i set a read permission for all users to the bucket i read only the content of the bucket but i received access denied for all directory and sub-directory inside this bucket. Where i wrong??? Many thanks Fabio ___ ceph-users mailing list

Re: [ceph-users] radosgw public access problem

2013-10-16 Thread Derek Yarnell
On 10/16/13 5:15 AM, Fabio - NS3 srl wrote: Hello, when i set a read permission for all users to the bucket i read only the content of the bucket but i received access denied for all directory and sub-directory inside this bucket. Where i wrong??? Hi Fabio, This is the default S3

Re: [ceph-users] radosgw-admin doesn't list user anymore

2013-10-16 Thread Derek Yarnell
On 10/16/13 4:26 AM, Valery Tschopp wrote: Hi Derek, Thanks for your example. I've added caps='metadata=*', but I still have an error and get: send: 'GET /admin/metadata/user?format=json HTTP/1.1\r\nHost: objects.bcc.switch.ch\r\nAccept-Encoding: identity\r\nDate: Wed, 16 Oct 2013

Re: [ceph-users] radosgw can still get the object even if this object's physical file is removed on OSDs

2013-10-15 Thread david zhang
Thanks, Yehuda, for your reply. I think you may be right because I did another experiment which seems there might be a reference to an object. I am just curious to do that for some corner case. On Tue, Oct 15, 2013 at 12:39 AM, Yehuda Sadeh yeh...@inktank.com wrote: On Mon, Oct 14, 2013 at

Re: [ceph-users] radosgw-admin doesn't list user anymore

2013-10-15 Thread Valery Tschopp
Hi Derek, Thanks. Is the 'radosgw-admin metadata list user' also available as REST API? Cheers, Valery On 15/10/13 03:21 , Derek Yarnell wrote: root@ineri:~# radosgw-admin user info could not fetch user info: no user info saved Hi Valery, You need to use radosgw-admin metadata list

Re: [ceph-users] radosgw-admin doesn't list user anymore

2013-10-15 Thread Derek Yarnell
On 10/15/13 12:00 PM, Valery Tschopp wrote: Hi Derek, Thanks. Is the 'radosgw-admin metadata list user' also available as REST API? Hi Valery, Yes, it is. Not well documented I believe right now. I have this tested and working in my python bindings[1] for the radosgw (get_users). You

Re: [ceph-users] radosgw-admin doesn't list user anymore

2013-10-14 Thread Valery Tschopp
We upgraded from 0.61.8 to 0.67.4. The metadata commands works for the users and the buckets: root@ineri ~$ radosgw-admin metadata list bucket [ a4mesh, 61a75c04-34a5-11e3-9bea-8f8d15b5cf20, 6e22de72-34a5-11e3-afc4-d3f70b676c52, ... root@ineri ~$ radosgw-admin metadata list user [

[ceph-users] radosgw can still get the object even if this object's physical file is removed on OSDs

2013-10-14 Thread david zhang
Hi ceph-users, I uploaded an object successfully to radosgw with 3 replicas. And I located all the physical paths of 3 replicas on different OSDs. i.e, one of the 3 physical paths is /var/lib/ceph/osd/ceph-2/current/3.5_head/DIR_D/default.4896.65\\u20131014\\u1__head_0646563D__3 Then I manually

Re: [ceph-users] radosgw can still get the object even if this object's physical file is removed on OSDs

2013-10-14 Thread Yehuda Sadeh
On Mon, Oct 14, 2013 at 4:04 AM, david zhang zhang.david2...@gmail.com wrote: Hi ceph-users, I uploaded an object successfully to radosgw with 3 replicas. And I located all the physical paths of 3 replicas on different OSDs. i.e, one of the 3 physical paths is

Re: [ceph-users] radosgw-admin doesn't list user anymore

2013-10-14 Thread Derek Yarnell
root@ineri:~# radosgw-admin user info could not fetch user info: no user info saved Hi Valery, You need to use radosgw-admin metadata list user Thanks, derek -- --- Derek T. Yarnell University of Maryland Institute for Advanced Computer Studies

Re: [ceph-users] radosgw-admin object unlink

2013-10-13 Thread Yehuda Sadeh
This sends the objects through the removal process. If the object has a 'tail', then it's going to be removed later by the garbage collector. On Sat, Oct 12, 2013 at 11:02 PM, Dominik Mostowiec dominikmostow...@gmail.com wrote: Thanks :-) This command removes object from rgw index (not mark

Re: [ceph-users] radosgw-admin object unlink

2013-10-13 Thread Dominik Mostowiec
hmm, 'tail' - do you mean file/object content? I thought that this command might be workaround for 'blind bucket'. Am I wrong? -- Regards Dominik 2013/10/13 Yehuda Sadeh yeh...@inktank.com: This sends the objects through the removal process. If the object has a 'tail', then it's going to be

[ceph-users] radosgw-admin object unlink

2013-10-12 Thread Dominik Mostowiec
Hi, How works radosgw-admin object unlink? After: radosgw-admin object unlink --bucket=testbucket 'test_file_1001.txt' File still exists in bucket list: s3 -u list testbucket | grep 'test_file_1001.txt' test_file_1001.txt 2013-10-11T11:46:54Z 5 ceph -v ceph

Re: [ceph-users] radosgw-admin object unlink

2013-10-12 Thread Yehuda Sadeh
On Sat, Oct 12, 2013 at 4:00 PM, Dominik Mostowiec dominikmostow...@gmail.com wrote: Hi, How works radosgw-admin object unlink? After: radosgw-admin object unlink --bucket=testbucket 'test_file_1001.txt' Try: $ radosgw-admin object unlink --bucket=testbucket --object='test_file_1001.txt'

[ceph-users] radosgw-admin doesn't list user anymore

2013-10-11 Thread Valery Tschopp
Hi, Since we upgraded ceph to 0.67.4, the radosgw-admin doesn't list all the users anymore: root@ineri:~# radosgw-admin user info could not fetch user info: no user info saved But it still work for single user: root@ineri:~# radosgw-admin user info --uid=valery { user_id: valery,

Re: [ceph-users] radosgw-admin doesn't list user anymore

2013-10-11 Thread Yehuda Sadeh
On Fri, Oct 11, 2013 at 7:46 AM, Valery Tschopp valery.tsch...@switch.ch wrote: Hi, Since we upgraded ceph to 0.67.4, the radosgw-admin doesn't list all the users anymore: root@ineri:~# radosgw-admin user info could not fetch user info: no user info saved But it still work for single

Re: [ceph-users] Radosgw Admin REST API

2013-10-10 Thread Alexis GÜNST HORN
Hello again, In fact, I have still a problem... I can do GET requests without problems, but when I try to do a PUT request, to create a user, then I get a Code: AccessDenied return. I do it with this code : def user_create (uid, acess_key, secret_key, email): url =

Re: [ceph-users] Radosgw Admin REST API

2013-10-10 Thread Derek Yarnell
On 10/10/13 2:36 PM, Matt Thompson wrote: Accidentally replied to Alexis directly, but this works for me: url = 'http://%s/admin/user?uid=someuserdisplay-name=somenameformat=json' % server r = requests.put(url, auth=S3Auth(aws_key, secret, server)) Note that display-name is a required

[ceph-users] Radosgw Admin REST API

2013-10-09 Thread Alexis GÜNST HORN
Hello to all, I can't succeed in using the Admin Ops REST API for radosgw. Where can I find an example, in any language (Perl, Python, Bash) ? For instance, how to proceed to get info for user xxx ? Via cli, i do radosgw user info --uid=xxx but with the REST API ? Thanks for your answers.

Re: [ceph-users] Radosgw Admin REST API

2013-10-09 Thread Derek Yarnell
Via cli, i do radosgw user info --uid=xxx but with the REST API ? Hi Alexis, Here is a simple python example on how to use the admin api. You will need to get a few packages from the cheese shop (virtualenv + pip makes this easy). pip install requests-aws You will also need to set the

Re: [ceph-users] Radosgw Admin REST API

2013-10-09 Thread Alexis GÜNST HORN
Great ! Thanks a lot. It works. I didn't know awsauth module. Thanks again. 2013/10/9 Derek Yarnell de...@umiacs.umd.edu: Via cli, i do radosgw user info --uid=xxx but with the REST API ? Hi Alexis, Here is a simple python example on how to use the admin api. You will need to get a few

Re: [ceph-users] radosgw S3 permissions

2013-10-02 Thread Derek Yarnell
On 10/1/13 11:37 AM, Fuchs, Andreas (SwissTXT) wrote: What we need to do is to have a key/secret with read write permission and one with read only permission to a certain bucket, is this possible? How? Hi Andi, Yes this is possible. You can either create accounts for the radosgw through the

Re: [ceph-users] radosgw-admin show all users

2013-09-30 Thread Yehuda Sadeh
On Mon, Sep 30, 2013 at 10:57 AM, Jefferson Alcantara jefferson22alcant...@gmail.com wrote: hi , I need help for show all users created on radosgw-admin all users using buckets or not ,I dont find any attribute for show this , I tried radosgw-admin user info -iud=* but this options does

[ceph-users] radosgw-admin unable to list or store user info after upgrade

2013-09-26 Thread Mike O'Toole
After upgrading from Cuddlefish to Dumpling I am no longer able to obtain user information from the rados gateway. radosgw-admin user infocould not fetch user info: no user info saved radosgw-admin user create --uid=bob --display-name=bobcould not create user: unable to create user, unable to

Re: [ceph-users] radosgw-admin unable to list or store user info after upgrade

2013-09-26 Thread Yehuda Sadeh
On Thu, Sep 26, 2013 at 7:42 AM, Mike O'Toole mike.oto...@outlook.com wrote: After upgrading from Cuddlefish to Dumpling I am no longer able to obtain user information from the rados gateway. radosgw-admin user info could not fetch user info: no user info saved radosgw-admin user create

Re: [ceph-users] radosgw-admin unable to list or store user info after upgrade

2013-09-26 Thread Fuchs, Andreas (SwissTXT)
- From: ceph-users-boun...@lists.ceph.com [mailto:ceph-users- boun...@lists.ceph.com] On Behalf Of Yehuda Sadeh Sent: Donnerstag, 26. September 2013 16:52 To: Mike O'Toole Cc: ceph-us...@ceph.com Subject: Re: [ceph-users] radosgw-admin unable to list or store user info after upgrade On Thu

Re: [ceph-users] radosgw-admin unable to list or store user info after upgrade

2013-09-26 Thread Yehuda Sadeh
: { access_key: , secret_key: }, placement_pools: []} rados lspools data metadata rbd .rgw .rgw.gc .rgw.control .users.uid .users .users.email .rgw.buckets .log .usage .rgw.root Date: Thu, 26 Sep 2013 09:05:08 -0700 Subject: Re: [ceph-users] radosgw-admin unable to list

Re: [ceph-users] radosgw-admin unable to list or store user info after upgrade

2013-09-26 Thread Yehuda Sadeh
/radosgw_user_create.out Date: Thu, 26 Sep 2013 10:02:51 -0700 Subject: Re: [ceph-users] radosgw-admin unable to list or store user info after upgrade From: yeh...@inktank.com To: mike.oto...@outlook.com; ceph-de...@vger.kernel.org On Thu, Sep 26, 2013 at 9:41 AM, Mike O'Toole mike.oto...@outlook.com

[ceph-users] radosgw-admin users list?

2013-09-25 Thread Valery Tschopp
Hi guys, How do I get a list of all users with the radosgw-admin command and/or REST API? # radosgw-admin --version ceph version 0.61.8 (a6fdcca3bddbc9f177e4e2bf0d9cdd85006b028b) Cheers, Valery -- SWITCH -- Valery Tschopp, Software Engineer, Peta Solutions Werdstrasse

[ceph-users] radosGW namespace

2013-09-16 Thread Fuchs, Andreas (SwissTXT)
Hi Ceph Users We setup a radosgw per ceph doku. While everything works fine we found out that different access_keys share the same bucket namespace. So when access_key A creates a bucket test access_key B cannot create a bucket with name test. Is it possible to separate the account's so that

[ceph-users] radosgw admin api

2013-09-16 Thread
hello i do not understand what is mean An admin API request will be done on a URI that starts with the configurable ‘admin’ resource entry point. live in http://ceph.com/docs/master/radosgw/adminops/ , can anyone explain what should i do in my ceph ! it is mean configure the ceph.conf??

Re: [ceph-users] radosGW namespace

2013-09-16 Thread Yehuda Sadeh
Hi, currently different users share the same namespace. This follows the S3 semantics, and allows accessing buckets directly via a virtual host name. We do have multiple namespaces in mind though, and I also prototyped it not too long ago:

[ceph-users] radosgw bucket question

2013-09-16 Thread
hi So what am I doing wrong? when i run commond: radosgw-admin bucket list --uid=johdone the return is [] and the commond radosgw-admin bucket list --uid=wkp4666 the return is [] and the commond radosgw-admin bucket listthe return is [mybucket1, mybucket2] mybucket1's owner is

Re: [ceph-users] radosgw bucket question

2013-09-16 Thread Yehuda Sadeh
On Mon, Sep 16, 2013 at 7:21 PM, 鹏 wkp4...@126.com wrote: hi So what am I doing wrong? when i run commond: radosgw-admin bucket list --uid=johdone the return is [] and the commond radosgw-admin bucket list --uid=wkp4666 the return is [] and the commond radosgw-admin bucket list

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

2013-09-12 Thread Kuo Hugo
Thanks, I'll disable it later. perhaps that's related to another problem I had here. By my network topology plan. I expect that the max bandwidth could reach to 10Gb. I double checked every connection in this cluster by iperf. *[Iperf]* From BM to RadosGW local 192.168.2.51 port 5001 connected

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

2013-09-12 Thread Fuchs, Andreas (SwissTXT)
= false to client.radosgw01.hostname in ceph.conf No change in terms of performance -Original Message- From: Yehuda Sadeh [mailto:yeh...@inktank.com] Sent: Donnerstag, 12. September 2013 06:38 To: Kuo Hugo Cc: Fuchs, Andreas (SwissTXT); ceph-users@lists.ceph.com Subject: Re: [ceph-users

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

2013-09-12 Thread Yehuda Sadeh
to use also the radosgw admin socket (if you manage to set it up). Yehuda -Original Message- From: Yehuda Sadeh [mailto:yeh...@inktank.com] Sent: Donnerstag, 12. September 2013 06:38 To: Kuo Hugo Cc: Fuchs, Andreas (SwissTXT); ceph-users@lists.ceph.com Subject: Re: [ceph-users] [RadosGW

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

2013-09-12 Thread Yehuda Sadeh
Cc: Fuchs, Andreas (SwissTXT); ceph-users@lists.ceph.com Subject: Re: [ceph-users] [RadosGW] Performance for Concurrency Connections On Wed, Sep 11, 2013 at 9:34 PM, Kuo Hugo tonyt...@gmail.com wrote: Hi Yehuda, Here's my ceph.conf root@p01:/tmp# cat /etc/ceph/ceph.conf

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

2013-09-11 Thread Kuo Hugo
Hi Yehuda, Here's my ceph.conf root@p01:/tmp# cat /etc/ceph/ceph.conf [global] fsid = 6e05675c-f545-4d88-9784-ea56ceda750e mon_initial_members = s01, s02, s03 mon_host = 192.168.2.61,192.168.2.62,192.168.2.63 auth_supported = cephx osd_journal_size = 1024 filestore_xattr_use_omap = true

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

2013-09-11 Thread Yehuda Sadeh
On Wed, Sep 11, 2013 at 9:34 PM, Kuo Hugo tonyt...@gmail.com wrote: Hi Yehuda, Here's my ceph.conf root@p01:/tmp# cat /etc/ceph/ceph.conf [global] fsid = 6e05675c-f545-4d88-9784-ea56ceda750e mon_initial_members = s01, s02, s03 mon_host = 192.168.2.61,192.168.2.62,192.168.2.63

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

2013-09-11 Thread Kuo Hugo
Hmm Interesting now. I have no admin socket opened around. root@p01:/var/run/ceph# ls /var/run/ceph -al total 0 drwxr-xr-x 2 root root 40 Sep 9 07:47 . drwxr-xr-x 17 root root 600 Sep 11 21:23 .. root@p01:/var/run/ceph# lsof | grep radosgw.asok root@p01:/var/run/ceph# I review the

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

2013-09-11 Thread Yehuda Sadeh
On Wed, Sep 11, 2013 at 9:57 PM, Kuo Hugo tonyt...@gmail.com wrote: Hmm Interesting now. I have no admin socket opened around. Maybe your radosgw process doesn't have permissions to write into /var/run/ceph? root@p01:/var/run/ceph# ls /var/run/ceph -al total 0 drwxr-xr-x 2 root root

<    4   5   6   7   8   9   10   >