thanks
1) I'm sure there's no asok socket filer for the radosgw in my RadosGW
host.
2) The rgw_thread_pool_size was set to 200 in my ceph.conf. So that the
radosgw is using the value now generally.
3) If so, the tweaking of rgw_thread_pool_size value from 100-200 was not
help for improve the
On Wed, Sep 11, 2013 at 10:25 PM, Kuo Hugo tonyt...@gmail.com wrote:
thanks
1) I'm sure there's no asok socket filer for the radosgw in my RadosGW host.
2) The rgw_thread_pool_size was set to 200 in my ceph.conf. So that the
radosgw is using the value now generally.
3) If so, the tweaking
Yes. I restart it by /etc/init.d/radosgw for times before. :D
btw, I check several things here to prevent any permission issue.
root@p01:/var/run# /etc/init.d/radosgw start
Starting client.radosgw.gateway...
root@p01:/var/run# ps aux | grep rados
root 25823 1.8 0.0 16436340 7096 ?
On Wed, Sep 11, 2013 at 10:37 PM, Kuo Hugo tonyt...@gmail.com wrote:
Yes. I restart it by /etc/init.d/radosgw for times before. :D
btw, I check several things here to prevent any permission issue.
root@p01:/var/run# /etc/init.d/radosgw start
Starting client.radosgw.gateway...
What do you mean by directly from Rados?
-Sam
On Wed, Sep 4, 2013 at 1:40 AM, Art M. artwork...@gmail.com wrote:
Hello,
As I know, radosgw calculates MD5 of the uploaded file and compares it with
MD5 provided in header.
Is it possible to get calculated MD5 of uploaded file directly from
Hi Folks,
I found that RadosGW created the following pools. The copies number is 2 by
default. I'd like to tweak the replicas to 3 for better reliability. I
tried to find the definition/usage of each pool but no luck.
Could someone provide related information about the usage of each pool and
Thanks for the quick reply.
+Hugo Kuo+
(+886) 935004793
2013/9/10 Yehuda Sadeh yeh...@inktank.com
by default .rgw.buckets holds the objects data.
On Mon, Sep 9, 2013 at 8:39 PM, Kuo Hugo tonyt...@gmail.com wrote:
Hi Folks,
I found that RadosGW created the following pools. The copies
-Original Message-
From: Yehuda Sadeh [mailto:yeh...@inktank.com]
Sent: Dienstag, 3. September 2013 19:08
To: Fuchs, Andreas (SwissTXT)
Cc: ceph-users@lists.ceph.com
Subject: Re: [ceph-users] radosgw warnings in apache error.log
On Tue, Sep 3, 2013 at 9:13 AM, Fuchs, Andreas
Hello,
As I know, radosgw calculates MD5 of the uploaded file and compares it with
MD5 provided in header.
Is it possible to get calculated MD5 of uploaded file directly from Rados.
We want to keep it as a file attribute for future use.
How radosgw calculates MD5? Is it realtime block by block
On 03/09/13 15:25, Yehuda Sadeh wrote:
Boto prog:
#!/usr/bin/python
import boto
import boto.s3.connection
access_key = 'X5E5BXJHCZGGII3HAWBB',
secret_key = '' # redacted
conn = boto.connect_s3(
aws_access_key_id = access_key,
aws_secret_access_key =
We are testing radosgw with cyberduck, so far we see the following issues
1. In apache error log for each file put we see:
[Tue Sep 03 17:35:24 2013] [warn] FastCGI: 193.218.104.138 PUT
https://193.218.100.131/test/tesfile04.iso auth AWS ***
[Tue Sep 03 17:35:24 2013] [warn] FastCGI: JJJ
On Tue, Sep 3, 2013 at 9:13 AM, Fuchs, Andreas (SwissTXT)
andreas.fu...@swisstxt.ch wrote:
We are testing radosgw with cyberduck, so far we see the following issues
1. In apache error log for each file put we see:
[Tue Sep 03 17:35:24 2013] [warn] FastCGI: 193.218.104.138 PUT
On Tue, Sep 3, 2013 at 2:30 PM, Derek Yarnell de...@umiacs.umd.edu wrote:
Hi,
So say a usera has full control (and is the owner) of a bucket in s3 and
gives userb 'FULL_CONTROL' on the bucket. Userb writes a file and it
seems that by default the ACL for that key is going to be 'FULL_CONTROL'
Hi,
So what am I doing wrong? As I read the docs
(http://ceph.com/docs/master/radosgw/adminops/) i need users=read which
I applied with the command,
radosgw-admin caps add --uid=derek --caps=users=read
But when I try to access /admin/users I get the following in the
radosgw.log and a 403 to
You're not specifying which user you're trying to get info for. The
request needs extra 'uid' param that specifies the target user. Other
than that you're ok.
Yehuda
Hi Yehuda,
But the docs say I should get back a list of users if no uid is specified.
On Fri, Aug 23, 2013 at 5:31 AM, Mihály Árva-Tóth
mihaly.arva-t...@virtual-call-center.eu wrote:
Hello,
I have an user with 3 subuser:
{ user_id: johndoe,
display_name: John Doe,
email: ,
suspended: 0,
max_buckets: 1000,
auid: 0,
subusers: [
{ id: johndoe:readonly,
On 22.08.2013 16:26, Yehuda Sadeh wrote:
On Thu, Aug 22, 2013 at 5:18 AM, Pawel Stefanski pejo...@gmail.com wrote:
4: (RGWMultiDelDelete::xml_end(char const*)+0x13a) [0x54060a] 5:
(RGWXMLParser::xml_end(char const*)+0x22) [0x4d88d2] 6:
/usr/bin/radosgw() [0x4d889a] 7: (()+0xa6f4)
Hi guys!
Maube someone knows…
Does radosgw have file limit?
I tried to upload 7GB of data using swift with no hope.
Is it possible somehow to increase this limit?
___
ceph-users mailing list
ceph-users@lists.ceph.com
On Sat, Aug 24, 2013 at 5:21 AM, Art M. artwork...@gmail.com wrote:
Hi guys!
Maube someone knows…
Does radosgw have file limit?
I tried to upload 7GB of data using swift with no hope.
Is it possible somehow to increase this limit?
For objects 5GB you need to use the large object upload
Hello,
I have an user with 3 subuser:
{ user_id: johndoe,
display_name: John Doe,
email: ,
suspended: 0,
max_buckets: 1000,
auid: 0,
subusers: [
{ id: johndoe:readonly,
permissions: read},
{ id: johndoe:swift,
permissions: full-control},
{
On Fri, Aug 23, 2013 at 1:35 AM, Tobias Brunner tob...@tobru.ch wrote:
Hi,
My RadosGW (0.67.2) setup keeps complaining about the following error:
2013-08-23 10:20:32.920808 7f9e298fb7c0 0 WARNING: cannot read region map
# radosgw-admin region-map get
failed to read region map: (2) No such
hello!
Today our radosgw crashed while running multiple deletions via s3 api.
Is this known bug ?
POST
WSTtobXBlBrm2r78B67LtQ==
Thu, 22 Aug 2013 11:38:34 GMT
/inna-a/?delete
-11 2013-08-22 13:39:26.650499 7f36347d8700 2 req 95:0.000555:s3:POST
/inna-a/:multi_object_delete:reading
Hi,
Reading the URL http://ceph.com/docs/next/radosgw/adminops/#create-user , I'm
trying to create a new user with:
curl -v -X PUT -d '{uid: alvaro, display-name: alvaro}
http://myradosgw/admin/user?format=json
and a 403 response is received :(
So, Do I need a token? A token of who? Do I
On Thu, Jul 18, 2013 at 12:50 AM, Alvaro Izquierdo Jimeno
aizquie...@aubay.es wrote:
Hi,
Reading the URL http://ceph.com/docs/next/radosgw/adminops/#create-user ,
I’m trying to create a new user with:
curl -v -X PUT -d '{uid: alvaro, display-name: alvaro}
On Thu, Jul 18, 2013 at 12:50 AM, Alvaro Izquierdo Jimeno
aizquie...@aubay.es wrote:
Hi,
Reading the URL http://ceph.com/docs/next/radosgw/adminops/#create-user ,
I’m trying to create a new user with:
curl -v -X PUT -d '{uid: alvaro, display-name: alvaro}
On Wed, Jul 10, 2013 at 6:28 PM, Derek Yarnell de...@umiacs.umd.edu wrote:
I have been running a development radosgw instance for awhile and now
looking to start a larger production one. I am trying to track down
some issues with PUT on larger files I am having from certain S3
clients. I am
Hello,
I am using Ubuntu 13.04 with the testing branch (0.65-1) of ceph.
I have had no problem at all setting up a 3 node cluster and I currently have
several vm's booting off of rbd as a test.
Last night I decided to try and setup radosgw along with it, using the
following docs:
You're specifying an explicit keyeing when trying to add the new RGW key,
but letting the system pick one when running ceph -s. it's probably finding
and using a different one to do that; you should check your key rings and
their contents. :)
-Greg
On Tuesday, July 2, 2013, Shain Miley wrote:
Shain Miley | Manager of Systems and Infrastructure, Digital Media |
smi...@npr.org | 202.513.3649
From: Gregory Farnum [g...@inktank.com]
Sent: Tuesday, July 02, 2013 12:16 PM
To: Shain Miley
Cc: ceph-us...@ceph.com
Subject: Re: [ceph-users] Radosgw
Il 25/06/13 12:17, Fabio - NS3 srl ha scritto:
We have a working ceph with rados version 0.61.4, we are try to use some
example applications [1,2] to test the direct upload to rados using cors.
News?
___
ceph-users mailing list
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
Hello,
Two question about SWIFT RadosGW
At this time i've got no official information but it seems that
temporary urls are not supported by the RGW
My first question is: does the SWIFT temporary url feature will be
implemented?
Or is it a
On Tue, Jun 25, 2013 at 3:17 AM, Fabio - NS3 srl fa...@ns3.it wrote:
We have a working ceph with rados version 0.61.4, we are try to use some
example applications [1,2] to test the direct upload to rados using cors.
With a patched boto [3], we are able to get and set xml cors on a bucket, by
It is possible to create all of the pools manually before starting
radosgw. That allows control of the pg_num used. The pools are:
.rgw, .rgw.control, .rgw.gc, .log, .intent-log, .usage, .users,
.users.email, .users.swift, .users.uid
On Wed, Jun 19, 2013 at 6:13 PM, Derek Yarnell
Hi,
So when bootstrapping radosgw you are not given the option to create the
pools (and therefor set a specific pg_num). There are a lot of pools
created .rgw, .rgw.gc, .rgw.control, .users.uid, .users.email, .users.
I know I can set osd_pool_default_pg_num but that will apply to all
those
Hi all,
We are trying to run radosgw with nginx.
We've found an example https://gist.github.com/guilhem/4964818
And changed our nginx.conf like below:
http {
server {
listen 0.0.0.0:80 http://0.0.0.0/;
server_name _;
access_log off;
location / {
Hi all,
Well, looks like DragonDisk (http://www.dragondisk.com/) deal with RRDNS
well, it just run with both RGWs ;)
But what actually I need to know now is why RGW not start at boot time with
Initialization timeout, failed to initialize error in logs. It
run successful by hands after that.
On
Anybody?
On Tue, May 7, 2013 at 1:19 PM, Igor Laskovy igor.lask...@gmail.com wrote:
I tried do that and put behind RR DNS, but unfortunately only one host can
server requests from clients - second host does not responds totally. I
am not to good familiar with apache, in standard log files
For High availability RGW you would need a load balancer. HA Proxy is
an example of a load balancer that has been used successfully with
rados gateway endpoints.
On Thu, May 9, 2013 at 5:51 AM, Igor Laskovy igor.lask...@gmail.com wrote:
Anybody?
On Tue, May 7, 2013 at 1:19 PM, Igor Laskovy
On 05/09/2013 09:57 AM, Tyler Brekke wrote:
For High availability RGW you would need a load balancer. HA Proxy is
an example of a load balancer that has been used successfully with
rados gateway endpoints.
Strictly speaking for HA you need an HA solution. E.g. heartbeat. Main
difference
I tried do that and put behind RR DNS, but unfortunately only one host can
server requests from clients - second host does not responds totally. I am
not to good familiar with apache, in standard log files nothing helpful.
Maybe this whole HA design is wrong? Does anybody resolve HA for Rados
Hello and thanks again!
Push help back to community:
1. Please correct this doc
http://ceph.com/docs/master/start/quick-rgw/#create-a-gateway-configuration-file
2. I have successful tested this clients - DragonDisk (
http://www.dragondisk.com/), CrossFTP (http://www.crossftp.com/) and
S3Browser
Hello,
Whether any best practices how to make Hing Availability of RadosGW?
For example, is this right way to create two or tree RadosGW (keys for
ceph-auth, directory and so on) and having for example this is ceph.conf:
[client.radosgw.a]
host = ceph01
...options...
[client.radosgw.b]
host =
Ok. I will try, thanks.
One further question - does needed manually start /etc/init.d/radosgw all
time when this host have been rebooted? Why it is not part of service ceph
-a start?
On Tue, Apr 23, 2013 at 11:05 PM, Lorieri lori...@gmail.com wrote:
I've made some tests again with s3cmd
you
Sorry for delayed reply,
I am not good familiar with apache.
For RGW I use one of the OSD nodes. This is clear minimum installation of
Ubunut 12.04 and ceph deployment on it, no another services.
I must to say that I use default apache2 package from Ubuntu repository and
have rgw print continue =
On Tue, Apr 23, 2013 at 7:51 AM, Igor Laskovy igor.lask...@gmail.com wrote:
Sorry for delayed reply,
I am not good familiar with apache.
For RGW I use one of the OSD nodes. This is clear minimum installation of
Ubunut 12.04 and ceph deployment on it, no another services.
I must to say that I
On Tue, Apr 23, 2013 at 11:33 AM, Igor Laskovy igor.lask...@gmail.com wrote:
In /etc/apache2/httpd.conf I have :
ServerName osd01.ceph.labspace.studiogrizzly.com
In /etc/apache2/sites-available/rgw.conf :
FastCgiExternalServer /var/www/s3gw.fcgi -socket /tmp/radosgw.sock
VirtualHost *:80
So, I totally lost in this, but I did it, and now CrossFTP report:
[R1] Connect to osd01.ceph.labspace.studiogrizzly.com
[R1] Current path: /
[R1] Current path: /
[R1] LIST /
[R1] Request Error [!DOCTYPE HTML PUBLIC -//IETF//DTD HTML 2.0//EN
htmlhead
title404 Not Found/title
/headbody
h1Not
Ok, I removed right lines. Now CrossFTP connected, but when I trying
create bucket it report:
[R1] S3 Error: -1 (null) error: Request Error:
java.net.UnknownHostException:
fdfdf.osd01.ceph.labspace.studiogrizzly.com; XML Error Message: null
[R1] -1 (null) error: Request Error:
I've made some tests again with s3cmd
you need to have a valid and accessible host_bucket key in the .s3cfg
for example:
host_bucket = %(bucket)s.myhostname.com
if you dont have it, it does not allow you to use lowercase buckets
I believe it checks if the bucket name is a valid dns name, etc
Hi,
We use radosgw and s3 API and we recently needed to update metadata on some
files.
So we used the copy part of the S3 API for an in place replacement of the file
adding some meta.
We quickly saw some very high response time for some of those uploaded file.
But there was no slow request.
On Mon, Apr 22, 2013 at 1:03 AM, Yann ROBIN yann.ro...@youscribe.com wrote:
Hi,
We use radosgw and s3 API and we recently needed to update metadata on some
files.
So we used the copy part of the S3 API for an in place replacement of the
file adding some meta.
We quickly saw some very
On Sun, Apr 21, 2013 at 3:02 AM, Igor Laskovy igor.lask...@gmail.com wrote:
A little bit more.
I have tried deploy RGW via http://ceph.com/docs/master/radosgw/ and than
connect S3 Browser, CrossFTP and CloudBerry Explorer clients, but all
unsuccessfully.
Again my question, does anybody use
On Sun, Apr 21, 2013 at 9:39 AM, Igor Laskovy igor.lask...@gmail.com wrote:
Well, in each case something specific. For CrossFTP, for example, it says
that asking the server it receive text data instead of XML.
When doing what? Are you able to do anything?
In logs on servers side I don't found
On Sun, Apr 21, 2013 at 10:05 AM, Igor Laskovy igor.lask...@gmail.com wrote:
Just initial connect to rgw server, nothing further.
Please see below behavior for CrossFTP and S3Browser cases.
On CrossFTP side:
[R1] Connect to rgw.labspace
[R1] Current path: /
[R1] Current path: /
[R1] LIST
Hello!
Does anybody use Rados Gateway via S3-compatible clients on desktop systems?
--
Igor Laskovy
facebook.com/igor.laskovy
studiogrizzly.com
___
ceph-users mailing list
ceph-users@lists.ceph.com
Hi,
We see a reproducible Internal Server Error when doing something like
--
#!/usr/bin/env python
import boto
import boto.s3.connection
access_key = '...'
secret_key = '...'
conn = boto.connect_s3(
aws_access_key_id = access_key,
aws_secret_access_key = secret_key,
Hey Arne,
Could you send me your RGW logs and your Apache RGW configuration?
Caleb
--
Developer, inktank
On Apr 11, 2013 8:53 AM, Arne Wiebalck arne.wieba...@cern.ch wrote:
Hi,
We see a reproducible Internal Server Error when doing something like
--
#!/usr/bin/env python
import boto
On Thu, Apr 11, 2013 at 5:53 AM, Arne Wiebalck arne.wieba...@cern.ch wrote:
Hi,
We see a reproducible Internal Server Error when doing something like
--
#!/usr/bin/env python
import boto
import boto.s3.connection
access_key = '...'
secret_key = '...'
conn = boto.connect_s3(
Yehuda, Caleb,
Thanks for your quick replies.
Setting
rgw print continue = false
helped indeed, the problem has gone. We apparently misunderstood the line
saying
if you do NOT use a modified fastcgi … in the radosgw manual install
documentation.
Thanks again for your help!
Cheers,
Arne
Hi,
I was testing RadosGW setup and observed strange behavior - RGW becomes
unresponsive or won't start whenever cluster health is degraded (e.g.
restarting one of the OSDs). Probably I'm doing something wrong but I
couldn't find any information about this.
I'm running 0.56.3 on 3 node
Hi all
I want to create a bucket using radosgw-admin,but I got a error -95.
my environment is Ubuntu 12, ceph 0.56.3.
root@:~# radosgw-admin bucket link --bucket=testtt
--uid=liuj
error linking bucket to user: r=-95
another question.
Not that I'm aware of. Make sure you're really using the module you
think you're using.
On Mon, Mar 4, 2013 at 9:54 AM, Nick Bartos n...@pistoncloud.com wrote:
I'm actually using that one already (compiled from source). Is there
something I'm missing in httpd.conf?
On Mon, Mar 4, 2013 at
When trying to create a swift container with a length of 1 or 2
characters, I get a 400 error. When choosing a container name with at
least 3 characters, this does not happen. Is this an arbitrary limit
that can be easily changed?
Mar 5 05:57:19 172.18.0.13 radosgw: 2013-03-05 05:57:19.798928
On Thu, Feb 28, 2013 at 12:09 AM, Mihály Árva-Tóth
mihaly.arva-t...@virtual-call-center.eu wrote:
2013/2/27 Yehuda Sadeh yeh...@inktank.com
On Wed, Feb 27, 2013 at 3:44 AM, Mihály Árva-Tóth
mihaly.arva-t...@virtual-call-center.eu wrote:
Hello,
When I create a subuser to access objects
2013/2/28 Yehuda Sadeh yeh...@inktank.com
Thank you. Where can I find more detailed information about these
permissions? Read and write are okay, but what is the different readwrite
and full? If you give me RTFM that is great.
full also provides read-acp + write-acp, that is -- reading
On Wed, Feb 27, 2013 at 3:44 AM, Mihály Árva-Tóth
mihaly.arva-t...@virtual-call-center.eu wrote:
Hello,
When I create a subuser to access objects via swift, I have to specify
access level.I found 'full' in every documentations. What types can I add
else?
read, write, readwrite, full
901 - 966 of 966 matches
Mail list logo
