[ceph-users] RadosGW performance s3 many objects

2016-01-24 Thread Stefan Rogge
Hi,we are using the Ceph with RadosGW and S3 setting.With more and more objects in the storage the writing speed slows down significantly. With 5 million object in the storage we had a writing speed of 10MS/s. With 10 million objects in the storage its only 5MB/s. Is this a common issue?Is the

Re: [ceph-users] radosgw bucket index sharding tips?

2015-12-21 Thread Florian Haas
On Mon, Dec 21, 2015 at 10:20 AM, Wido den Hollander wrote: >>> > Oh, and to answer this part. I didn't do that much experimentation >>> > unfortunately. I actually am using about 24 index shards per bucket >>> > currently and we delete each bucket once it hits about a million

Re: [ceph-users] radosgw bucket index sharding tips?

2015-12-21 Thread Wido den Hollander
On 12/17/2015 05:27 PM, Florian Haas wrote: > Hey Wido, > > On Dec 17, 2015 09:52, "Wido den Hollander" > wrote: >> >> On 12/17/2015 06:29 AM, Ben Hines wrote: >> > >> > >> > On Wed, Dec 16, 2015 at 11:05 AM, Florian Haas

Re: [ceph-users] radosgw bucket index sharding tips?

2015-12-21 Thread Florian Haas
On Mon, Dec 21, 2015 at 12:36 PM, Wido den Hollander wrote: > > > On 21-12-15 10:34, Florian Haas wrote: >> On Mon, Dec 21, 2015 at 10:20 AM, Wido den Hollander wrote: >> Oh, and to answer this part. I didn't do that much experimentation >> unfortunately.

Re: [ceph-users] radosgw bucket index sharding tips?

2015-12-21 Thread Wido den Hollander
On 21-12-15 10:34, Florian Haas wrote: > On Mon, Dec 21, 2015 at 10:20 AM, Wido den Hollander wrote: > Oh, and to answer this part. I didn't do that much experimentation > unfortunately. I actually am using about 24 index shards per bucket > currently and we delete

Re: [ceph-users] radosgw bucket index sharding tips?

2015-12-17 Thread Wido den Hollander
On 12/17/2015 06:29 AM, Ben Hines wrote: > > > On Wed, Dec 16, 2015 at 11:05 AM, Florian Haas > wrote: > > Hi Ben & everyone, > > > Ben, you wrote elsewhere > >

[ceph-users] radosgw problem - 411 http status

2015-12-17 Thread Jacek Jarosiewicz
Hi, I have a strange problem with the rados gateway. I'm getting Http 411 status code (Missing Content Length) whenever I upload any file to ceph. The setup is: ceph 0.94.5, ubuntu 14.04, tengine (patched nginx). The strange thing is - everything worked like a charm until today, when I

Re: [ceph-users] radosgw bucket index sharding tips?

2015-12-17 Thread Florian Haas
Hey Wido, On Dec 17, 2015 09:52, "Wido den Hollander" wrote: > > On 12/17/2015 06:29 AM, Ben Hines wrote: > > > > > > On Wed, Dec 16, 2015 at 11:05 AM, Florian Haas > > wrote: > > > > Hi Ben & everyone, > > > > > > Ben,

Re: [ceph-users] radosgw bucket index sharding tips?

2015-12-16 Thread Wade Holler
I'm interested in this too. Should start testing next week at 1B+ objects and I sure would like a recommendation of what config to start with. We learned the hard way that not sharding is very bad at scales like this. On Wed, Dec 16, 2015 at 2:06 PM Florian Haas wrote: > Hi

Re: [ceph-users] radosgw bucket index sharding tips?

2015-12-16 Thread Florian Haas
Hi Ben & everyone, just following up on this one from July, as I don't think there's been a reply here then. On Wed, Jul 8, 2015 at 7:37 AM, Ben Hines wrote: > Anyone have any data on optimal # of shards for a radosgw bucket index? > > We've had issues with bucket index

Re: [ceph-users] radosgw bucket index sharding tips?

2015-12-16 Thread Ben Hines
Great, glad to see that others are concerned about this. One serious problem is that the number of index shards cannot be changed once it's been created. So if you have a bucket that you can't just recreate easily, you're screwed. Fortunately for my use case i can delete the contents of our

Re: [ceph-users] radosgw bucket index sharding tips?

2015-12-16 Thread Ben Hines
On Wed, Dec 16, 2015 at 11:05 AM, Florian Haas wrote: > Hi Ben & everyone, > > > Ben, you wrote elsewhere > ( > http://lists.ceph.com/pipermail/ceph-users-ceph.com/2015-August/003955.html > ) > that you found approx. 900k objects to be the threshold where index > sharding

Re: [ceph-users] radosgw in 0.94.5 leaking memory?

2015-12-02 Thread Dan van der Ster
On Wed, Dec 2, 2015 at 11:09 AM, Dan van der Ster wrote: > Hi, > > We've had increased user activity on our radosgw boxes the past two > days and are finding that the radosgw is growing quickly in used > memory. Most of our gateways are VMs with 4GB of memory and these are >

[ceph-users] radosgw in 0.94.5 leaking memory?

2015-12-02 Thread Dan van der Ster
Hi, We've had increased user activity on our radosgw boxes the past two days and are finding that the radosgw is growing quickly in used memory. Most of our gateways are VMs with 4GB of memory and these are getting OOM-killed after ~30 mins of high user load. We added a few physical gateways with

[ceph-users] Radosgw broken files

2015-11-11 Thread George Mihaiescu
Hi, I have created a bug report for an issue affecting our Ceph Hammer environment, and I was wondering if anybody has some input on what can we do to troubleshoot/fix it: http://tracker.ceph.com/issues/13764 Thank you, George ___ ceph-users mailing

[ceph-users] Radosgw admin MNG Tools to create and report usage of Object accounts

2015-11-08 Thread Florent MONTHEL
Hi Cephers, I’ve just released toolkit on python to report usage and inventory of buckets / accounts / S3 and Swift keys - In the same way, we have script to create account and S3/Swift keys (and initial buckets) Tool is using rgwadmin python module

Re: [ceph-users] radosgw get quota

2015-10-29 Thread Yehuda Sadeh-Weinraub
On Thu, Oct 29, 2015 at 11:29 AM, Derek Yarnell wrote: > Sorry, the information is in the headers. So I think the valid question > to follow up is why is this information in the headers and not the body > of the request. I think this is a bug, but maybe I am not aware of a

Re: [ceph-users] radosgw get quota

2015-10-29 Thread Derek Yarnell
Sorry, the information is in the headers. So I think the valid question to follow up is why is this information in the headers and not the body of the request. I think this is a bug, but maybe I am not aware of a subtly. It would seem this json comes from this line[0]. [0] -

[ceph-users] radosgw get quota

2015-10-28 Thread Derek Yarnell
I have had this issue before, and I don't think I have resolved it. I have been using the RGW admin api to set quota based on the docs[0]. But I can't seem to be able to get it to cough up and show me the quota now. Any ideas I get a 200 back but no body, I have tested this on a Firefly

Re: [ceph-users] radosgw keystone accepted roles not matching

2015-10-17 Thread Mike Lowe
I think I figured it out, for my install the admin token is broken for v2 auth and I needed to use user:password w/ admin role. It is the more correct way to do things but is conspicuously missing from here http://docs.ceph.com/docs/master/radosgw/keystone/

[ceph-users] radosgw limiting requests

2015-10-15 Thread Luis Periquito
I've been trying to find a way to limit the number of request an user can make the radosgw per unit of time - first thing developers done here is as fast as possible parallel queries to the radosgw, making it very slow. I've looked into quotas, but they only refer to space, objects and buckets.

[ceph-users] radosgw keystone accepted roles not matching

2015-10-15 Thread Mike Lowe
I’m having some trouble with radosgw and keystone integration, I always get the following error: user does not hold a matching role; required roles: Member,user,_member_,admin Despite my token clearly having one of the roles: "user": { "id":

Re: [ceph-users] radosgw limiting requests

2015-10-15 Thread Wido den Hollander
On 15-10-15 13:56, Luis Periquito wrote: > I've been trying to find a way to limit the number of request an user > can make the radosgw per unit of time - first thing developers done > here is as fast as possible parallel queries to the radosgw, making it > very slow. > > I've looked into

Re: [ceph-users] radosgw keystone accepted roles not matching

2015-10-15 Thread Yehuda Sadeh-Weinraub
On Thu, Oct 15, 2015 at 8:34 AM, Mike Lowe wrote: > I’m having some trouble with radosgw and keystone integration, I always get > the following error: > > user does not hold a matching role; required roles: Member,user,_member_,admin > > Despite my token clearly having

Re: [ceph-users] radosgw keystone accepted roles not matching

2015-10-15 Thread Mike Lowe
I think so, unless I misunderstand how it works. (openstack) role list --user jomlowe --project jomlowe +--+--+-+-+ | ID | Name | Project | User|

[ceph-users] RadosGW failing to upload multipart.

2015-10-13 Thread Tyler Bishop
This just started after we removed some old osd hardware, I feel like it may be related but at the same time I'm not sure how? All of my pools have the same ruleset and everything else is working and uploads do work but the testing for multipart process fails. Any help would be greatly

[ceph-users] radosgw gc errors

2015-10-01 Thread Dominik Mostowiec
Hi, In my cluster I have on one OSD with many strange logs 0 cls/rgw/cls_rgw.cc:1555: couldn't find tag in name index tag=default. zgrep -c 'find tag in name index tag' /var/log/ceph/ceph-osd.151.log.1.gz 7531 This osd is overloaded on CPU iostat seems to be ok. It has many slow request.

Re: [ceph-users] radosgw and keystone version 3 domains

2015-09-30 Thread Yehuda Sadeh-Weinraub
http://172.25.60.2:8080/swift/v1/containerV3 401 Unauthorized AccessDenied > > > Niothing in the keystone log except > 2015-09-30 10:30:15.598 28751 WARNING keystone.common.wsgi [-] Authorization > failed. Non-default domain is not supported > > Thanks, > Rob. > &g

Re: [ceph-users] radosgw and keystone version 3 domains

2015-09-29 Thread Robert Duncan
Hi Shinobu, My keystone version is 2014.2.2 Thanks again. Rob. The information contained and transmitted in this e-mail is confidential information, and is intended only for the named recipient to which it is addressed. The content of this e-mail may not have

Re: [ceph-users] radosgw and keystone version 3 domains

2015-09-29 Thread Shinobu Kinjo
15 8:48:57 PM Subject: Re: [ceph-users] radosgw and keystone version 3 domains Hi Shinobu, My keystone version is 2014.2.2 Thanks again. Rob. The information contained and transmitted in this e-mail is confidential information, and is intended only for the named rec

[ceph-users] radosgw and keystone users

2015-09-28 Thread Xabier Elkano
Hi, I'm just deployed the ceph object gateway as an object storage in OpenStack. I've followed this doc to achieve the integration with Keystone: http://docs.ceph.com/docs/master/radosgw/keystone/ "It is possible to integrate the Ceph Object Gateway with Keystone, the OpenStack identity

Re: [ceph-users] radosgw Storage policies

2015-09-28 Thread Yehuda Sadeh-Weinraub
On Mon, Sep 28, 2015 at 4:00 AM, Luis Periquito wrote: > Hi All, > > I was hearing the ceph talk about radosgw and Yehuda talks about storage > policies. I started looking for it in the documentation, on how to > implement/use and couldn't much information: >

[ceph-users] radosgw Storage policies

2015-09-28 Thread Luis Periquito
Hi All, I was hearing the ceph talk about radosgw and Yehuda talks about storage policies. I started looking for it in the documentation, on how to implement/use and couldn't much information: http://docs.ceph.com/docs/master/radosgw/s3/ says it doesn't currently support it, and

Re: [ceph-users] radosgw and keystone version 3 domains

2015-09-25 Thread Shinobu Kinjo
o" <periqu...@gmail.com>, "Abhishek L" <abhishek.lekshma...@gmail.com>, "ceph-users" <ceph-us...@ceph.com> Sent: Saturday, September 26, 2015 12:03:17 PM Subject: Re: [ceph-users] radosgw and keystone version 3 domains > and need to use openstack client. Yes, you

Re: [ceph-users] radosgw and keystone version 3 domains

2015-09-25 Thread Shinobu Kinjo
bhishek L" <abhishek.lekshma...@gmail.com>, "ceph-users" <ceph-us...@ceph.com> Sent: Friday, September 25, 2015 11:29:14 PM Subject: RE: [ceph-users] radosgw and keystone version 3 domains A few other things that don’t work – -appending /v3 into the rgw.conf file (wor

Re: [ceph-users] radosgw and keystone version 3 domains

2015-09-25 Thread Robert Duncan
; ceph-users Subject: Re: [ceph-users] radosgw and keystone version 3 domains Thanks for the info. Shinobu - Original Message - From: "Luis Periquito" <periqu...@gmail.com> To: "Shinobu Kinjo" <ski...@redhat.com> Cc: "Abhishek L" <abhishek.lekshm

Re: [ceph-users] radosgw and keystone version 3 domains

2015-09-25 Thread Luis Periquito
, Shinobu Kinjo <ski...@redhat.com> wrote: > What's error message you saw when you tried? > > Shinobu > > - Original Message - > From: "Abhishek L" <abhishek.lekshma...@gmail.com> > To: "Robert Duncan" <robert.dun...@ncirl.ie> > Cc: c

Re: [ceph-users] radosgw and keystone version 3 domains

2015-09-25 Thread Shinobu Kinjo
>, "ceph-users" <ceph-us...@ceph.com> Sent: Friday, September 25, 2015 8:52:48 PM Subject: Re: [ceph-users] radosgw and keystone version 3 domains I'm having the exact same issue, and after looking it seems that radosgw is hardcoded to authenticate using v2 api. from th

Re: [ceph-users] radosgw and keystone version 3 domains

2015-09-25 Thread Luis Periquito
If anyone gets this to work I would be most obliged > > -Original Message- > From: Shinobu Kinjo [mailto:ski...@redhat.com] > Sent: 25 September 2015 13:31 > To: Luis Periquito > Cc: Abhishek L; Robert Duncan; ceph-users > Subject: Re: [ceph-users] radosgw and k

Re: [ceph-users] radosgw and keystone version 3 domains

2015-09-25 Thread Robert Duncan
tack.identity-v2.0+json"}, {"base": "application/xml", "type": "application/vnd.openstack.identity-v2.0+xml"}], "id": "v2.0", "links": [{"href": "http://172.25.60

Re: [ceph-users] radosgw + civetweb latency issue on Hammer

2015-09-22 Thread Giridhar Yasa
I encountered the same issue in my setup (with an AWS SDK client) and on further investigation found that 'rgw print continue' was set to false for a civetweb driven rgw. Updated http://tracker.ceph.com/issues/12640 Giridhar -- Giridhar Yasa | Flipkart Engineering | http://www.flipkart.com/ On

Re: [ceph-users] radosgw + civetweb latency issue on Hammer

2015-09-22 Thread Giridhar Yasa
I encountered the same issue in my setup (with an AWS SDK client) and on further investigation found that 'rgw print continue' was set to false for a civetweb driven rgw. Updated http://tracker.ceph.com/issues/12640 Giridhar -- Giridhar Yasa | Flipkart Engineering | http://www.flipkart.com/ On

Re: [ceph-users] radosgw and keystone version 3 domains

2015-09-18 Thread Shinobu Kinjo
What's error message you saw when you tried? Shinobu - Original Message - From: "Abhishek L" <abhishek.lekshma...@gmail.com> To: "Robert Duncan" <robert.dun...@ncirl.ie> Cc: ceph-us...@ceph.com Sent: Friday, September 18, 2015 12:29:20 PM Subject: Re: [

[ceph-users] radosgw and keystone version 3 domains

2015-09-17 Thread Robert Duncan
Hi It seems that radosgw cannot find users in Keystone V3 domains, that is, When keystone is configured for domain specific drivers radossgw cannot find the users in the keystone users table (as they are not there) I have a deployment in which ceph providers object block ephemeral and user

Re: [ceph-users] radosgw and keystone version 3 domains

2015-09-17 Thread Abhishek L
On Fri, Sep 18, 2015 at 4:38 AM, Robert Duncan wrote: > > Hi > > > > It seems that radosgw cannot find users in Keystone V3 domains, that is, > > When keystone is configured for domain specific drivers radossgw cannot find > the users in the keystone users table (as they

Re: [ceph-users] RadosGW not working after upgrade to Hammer

2015-09-11 Thread James Page
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Hi Arnoud On 26/05/15 16:53, Arnoud de Jonge wrote: > Hi, [...] > > 2015-05-26 17:43:37.352569 7f0fce0ff840 0 ceph version 0.94.1 > (e4bfad3a3c51054df7e537a724c8d0bf9be972ff), process radosgw, pid > 4259 2015-05-26 17:43:37.435921 7f0f8a4f2700 0

Re: [ceph-users] radosgw secret_key

2015-09-01 Thread Saverio Proto
Look at this: https://github.com/ncw/rclone/issues/47 Because this is a json dump, it is encoding the / as \/. It was source of confusion also for me. Best regards Saverio 2015-08-24 16:58 GMT+02:00 Luis Periquito : > When I create a new user using radosgw-admin most

Re: [ceph-users] RadosGW - multiple dns names

2015-08-26 Thread Luis Periquito
On Mon, Feb 23, 2015 at 10:18 PM, Yehuda Sadeh-Weinraub yeh...@redhat.com wrote: -- *From: *Shinji Nakamoto shinji.nakam...@mgo.com *To: *ceph-us...@ceph.com *Sent: *Friday, February 20, 2015 3:58:39 PM *Subject: *[ceph-users] RadosGW - multiple dns names We

Re: [ceph-users] RadosGW - multiple dns names

2015-08-26 Thread Robin H. Johnson
, 2015 3:58:39 PM *Subject: *[ceph-users] RadosGW - multiple dns names We have multiple interfaces on our Rados gateway node, each of which is assigned to one of our many VLANs with a unique IP address. Is it possible to set multiple DNS names for a single Rados GW, so it can handle

[ceph-users] radosgw secret_key

2015-08-24 Thread Luis Periquito
When I create a new user using radosgw-admin most of the time the secret key gets escaped with a backslash, making it not work. Something like secret_key: xx\/\/. Why would the / need to be escaped? Why is it printing the \/ instead of / that does work?

Re: [ceph-users] radosgw hanging - blocking rgw.bucket_list ops

2015-08-21 Thread Sam Wouters
tried removing, but no luck: rados -p .be-east.rgw.buckets rm be-east.5436.1__:2bpm.1OR-cqyOLUHek8m2RdPVRZ.pDT__sanity error removing .be-east.rgw.bucketsbe-east.5436.1__:2bpm.1OR-cqyOLUHek8m2RdPVRZ.pDT__sanity: (2) anyone? On 21-08-15 13:06, Sam Wouters wrote: I suspect these to be the cause:

Re: [ceph-users] radosgw hanging - blocking rgw.bucket_list ops

2015-08-21 Thread Sam Wouters
I suspect these to be the cause: rados ls -p .be-east.rgw.buckets | grep sanitybe-east.5436.1__:2bpm.1OR-cqyOLUHek8m2RdPVRZ.pDT__sanity be-east.5436.1__sanity be-east.5436.1__:2vBijaGnVQF4Q0IjZPeyZSKeUmBGn9X__sanity be-east.5436.1__sanity

[ceph-users] radosgw only delivers whats cached if latency between keyrequest and actual download is above 90s

2015-08-21 Thread Sean
We heavily use radosgw here for most of our work and we have seen a weird truncation issue with radosgw/s3 requests. We have noticed that if the time between the initial ticket to grab the object key and grabbing the data is greater than 90 seconds the object returned is truncated to whatever

Re: [ceph-users] radosgw only delivers whats cached if latency between keyrequest and actual download is above 90s

2015-08-21 Thread Ben Hines
I just tried this (with some smaller objects, maybe 4.5 MB, as well as with a 16 GB file and it worked fine. However, i am using apache + fastcgi interface to rgw, rather than civetweb. -Ben On Fri, Aug 21, 2015 at 12:19 PM, Sean seapasu...@uchicago.edu wrote: We heavily use radosgw here for

[ceph-users] radosgw hanging - blocking rgw.bucket_list ops

2015-08-21 Thread Sam Wouters
Hi, We are running hammer 0.94.2 and have an increasing amount of heartbeat_map is_healthy 'RGWProcess::m_tp thread 0x7f38c77e6700' had timed out after 600 messages in our radosgw logs, with radosgw eventually stalling. A restart of the radosgw helps for a few minutes, but after that it hangs

[ceph-users] radosgw-agent keeps syncing most active bucket - ignoring others

2015-08-18 Thread Sam Wouters
Hi, from the doc of radosgw-agent and some items in this list, I understood that the max-entries argument was there to prevent a very active bucket to keep the other buckets from keeping synced. In our agent logs however we saw a lot of bucket instance bla has 1000 entries after bla, and the

Re: [ceph-users] radosgw-agent keeps syncing most active bucket - ignoring others

2015-08-18 Thread Sam Wouters
Hmm, looks like intended behaviour: SNIP CommitDate: Mon Mar 3 06:08:42 2014 -0800 worker: process all bucket instance log entries at once Currently if there are more than max_entries in a single bucket instance's log, only max_entries of those will be processed, and the bucket

[ceph-users] radosgw keystone integration

2015-08-17 Thread Logan V.
After setting up radosgw federated configuration last week and integrating with openstack keystone auth, I have a question regarding the configuration. In the Keystone setup instructions for Kilo, the admin token auth method is disabled:

[ceph-users] RadosGW problems on Ubuntu

2015-08-14 Thread Stolte, Felix
Hello everyone, we are currently testing ceph (Hammer) and Openstack (Kilo) on Ubuntu 14.04 LTS Servers. Yesterday I tried to setup the radosgateway with keystone integration for swift via ceph-deploy. I followed the instructions on http://ceph.com/docs/master/radosgw/keystone/ and

Re: [ceph-users] radosgw + civetweb latency issue on Hammer

2015-08-06 Thread Mark Nelson
Hi Srikanth, Can you make a ticket on tracker.ceph.com for this? We'd like to not loose track of it. Thanks! Mark On 08/05/2015 07:01 PM, Srikanth Madugundi wrote: Hi, After upgrading to Hammer and moving from apache to civetweb. We started seeing high PUT latency in the order of 2 sec

[ceph-users] radosgw + civetweb latency issue on Hammer

2015-08-05 Thread Srikanth Madugundi
Hi, After upgrading to Hammer and moving from apache to civetweb. We started seeing high PUT latency in the order of 2 sec for every PUT request. The GET request lo Attaching the radosgw logs for a single request. The ceph.conf has the following configuration for civetweb.

[ceph-users] RadosGW - radosgw-agent start error

2015-07-28 Thread Italo Santos
Hello everyone, I’m setting up a federated configuration of radosgw but when I start a radosgw-agent I face with the error bellow and I’d like to know if I’m doing something wrong…? See the error: root@cephgw0001:~# radosgw-agent -v -c /etc/ceph/radosgw-agent/default.conf 2015-07-28

[ceph-users] RadosGW - Negative bucket stats

2015-07-07 Thread Italo Santos
Hello, I realize that one of buckets in my cluster have some strange stats and I see that a issue like that was resolved on previously on issue #3127 (http://tracker.ceph.com/issues/3127), so I’d like to know how can I identify if my case is that as described on that issue? See the stats:

[ceph-users] radosgw bucket index sharding tips?

2015-07-07 Thread Ben Hines
Anyone have any data on optimal # of shards for a radosgw bucket index? We've had issues with bucket index contention with a few million+ objects in a single bucket so i'm testing out the sharding. Perhaps at least one shard per OSD? Or, less? More? I noticed some discussion here regarding slow

[ceph-users] Radosgw-agent with version enabled bucket - duplicate objects

2015-07-03 Thread Sam Wouters
Hi, I've upgraded to from hammer 0.94.1 to 0.94.2 and radosgw-agent-1.2.2-0.el7.centos.noarch from 1.2.1 and after restart of the agent (with versioned set to true), I noticed duplicate objects in a version-ed enabled bucket on the replication site. For example: on source side: object: Key:

Re: [ceph-users] radosgw backup

2015-06-29 Thread Konstantin Ivanov
*From:* ceph-users [mailto:ceph-users-boun...@lists.ceph.com] *On Behalf Of *Konstantin Ivanov *Sent:* Thursday, May 28, 2015 1:44 AM *To:* ceph-users@lists.ceph.com *Subject:* [ceph-users] radosgw backup Hi everyone. I'm wondering - is there way to backup radosgw data? What i

Re: [ceph-users] radosgw crash within libfcgi

2015-06-26 Thread GuangYang
Sadly we don't have a core dump when the crash happened, so that we are not able to dump the registers.. The latest status - we changed the rgw thread number from 600 to 300, and we haven't seen the same crash since, but still it is hard to tell if that is related and how it is related..

Re: [ceph-users] radosgw crash within libfcgi

2015-06-24 Thread Yehuda Sadeh-Weinraub
- Original Message - From: GuangYang yguan...@outlook.com To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-de...@vger.kernel.org, ceph-users@lists.ceph.com Sent: Wednesday, June 24, 2015 2:12:23 PM Subject: RE: radosgw crash within libfcgi

Re: [ceph-users] radosgw crash within libfcgi

2015-06-24 Thread Yehuda Sadeh-Weinraub
Also, looking at the code, I see an extra call to FCGX_Finish_r(): diff --git a/src/rgw/rgw_main.cc b/src/rgw/rgw_main.cc index 9a8aa5f..0aa7ded 100644 --- a/src/rgw/rgw_main.cc +++ b/src/rgw/rgw_main.cc @@ -669,8 +669,6 @@ void RGWFCGXProcess::handle_request(RGWRequest *r) dout(20)

Re: [ceph-users] RadosGW - Multiple instances on same host

2015-06-24 Thread Somnath Roy
Subject: Re: [ceph-users] RadosGW - Multiple instances on same host Thanks Somnath, In this case I’ll need create a ceph.conf like bellow Also, I’ll need to create two different .fcgi files on /var/www/ one for each instance, as same with the apache config, right? [client.radosgw.instance-01

Re: [ceph-users] RadosGW - Multiple instances on same host

2015-06-24 Thread Somnath Roy
Santos Sent: Wednesday, June 24, 2015 1:05 PM To: ceph-users@lists.ceph.com Subject: [ceph-users] RadosGW - Multiple instances on same host Hello everyone, I’d like to know if someone knows if its possible run multiples radosgw instances on the same host? What I’m trying to do is have two

Re: [ceph-users] RadosGW - Multiple instances on same host

2015-06-24 Thread Somnath Roy
: Wednesday, June 24, 2015 3:53 PM To: Somnath Roy Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] RadosGW - Multiple instances on same host Hello Somnath, I’ve create the files, one for each instance but when I restart the radosgw I see the message bellow on radosgw logs: 2015-06-24 18:46

Re: [ceph-users] radosgw crash within libfcgi

2015-06-24 Thread GuangYang
Thanks Yehuda for the response. We already patched libfcgi to use poll instead of select to overcome the limitation. Thanks, Guang Date: Wed, 24 Jun 2015 14:40:25 -0400 From: yeh...@redhat.com To: yguan...@outlook.com CC:

Re: [ceph-users] RadosGW - Multiple instances on same host

2015-06-24 Thread Italo Santos
-users-boun...@lists.ceph.com] On Behalf Of Italo Santos Sent: Wednesday, June 24, 2015 1:05 PM To: ceph-users@lists.ceph.com (mailto:ceph-users@lists.ceph.com) Subject: [ceph-users] RadosGW - Multiple instances on same host Hello everyone, I’d like to know if someone knows

Re: [ceph-users] RadosGW - Multiple instances on same host

2015-06-24 Thread Italo Santos
. Thanks Regards Somnath From: Italo Santos [mailto:okd...@gmail.com] Sent: Wednesday, June 24, 2015 1:46 PM To: Somnath Roy Cc: ceph-users@lists.ceph.com (mailto:ceph-users@lists.ceph.com) Subject: Re: [ceph-users] RadosGW - Multiple instances on same host Thanks Somnath

Re: [ceph-users] RadosGW - Multiple instances on same host

2015-06-24 Thread Robin H. Johnson
Somnath From: Italo Santos [mailto:okd...@gmail.com] Sent: Wednesday, June 24, 2015 1:46 PM To: Somnath Roy Cc: ceph-users@lists.ceph.com (mailto:ceph-users@lists.ceph.com) Subject: Re: [ceph-users] RadosGW - Multiple instances on same host Thanks Somnath

Re: [ceph-users] RadosGW - Multiple instances on same host

2015-06-24 Thread Italo Santos
-users@lists.ceph.com (mailto:ceph-users@lists.ceph.com) Subject: Re: [ceph-users] RadosGW - Multiple instances on same host Thanks guys! Doing this I’ll need have a load balancer in front of instances (like haproxy, nginx, etc…) to to redirect requests to each instance right

[ceph-users] RadosGW - Restrict access to bucket

2015-06-24 Thread Italo Santos
Hello guys, I have a object that I’ve set READ acl permission to all users, but I’d like to restrict the access to that object to a specific subnet, anyone knows if it’s possible? Regards. Italo Santos http://italosantos.com.br/ ___ ceph-users

Re: [ceph-users] RadosGW - Multiple instances on same host

2015-06-24 Thread Italo Santos
. Thanks Regards Somnath From: Italo Santos [mailto:okd...@gmail.com] Sent: Wednesday, June 24, 2015 1:46 PM To: Somnath Roy Cc: ceph-users@lists.ceph.com (mailto:ceph-users@lists.ceph.com) Subject: Re: [ceph-users] RadosGW - Multiple instances on same host Thanks

Re: [ceph-users] RadosGW - Multiple instances on same host

2015-06-24 Thread Somnath Roy
is the criteria. Thanks Regards Somnath From: Italo Santos [mailto:okd...@gmail.com] Sent: Wednesday, June 24, 2015 4:12 PM To: Somnath Roy Cc: Robin H. Johnson; ceph-users@lists.ceph.com Subject: Re: [ceph-users] RadosGW - Multiple instances on same host Thanks, I’ll make some tests using your

Re: [ceph-users] RadosGW - Multiple instances on same host

2015-06-24 Thread Italo Santos
, June 24, 2015 4:12 PM To: Somnath Roy Cc: Robin H. Johnson; ceph-users@lists.ceph.com (mailto:ceph-users@lists.ceph.com) Subject: Re: [ceph-users] RadosGW - Multiple instances on same host Thanks, I’ll make some tests using your recommendations. Also did you guys recommend

Re: [ceph-users] radosgw crash within libfcgi

2015-06-24 Thread Yehuda Sadeh-Weinraub
- Original Message - From: GuangYang yguan...@outlook.com To: ceph-de...@vger.kernel.org, ceph-users@lists.ceph.com, yeh...@redhat.com Sent: Wednesday, June 24, 2015 10:09:58 AM Subject: radosgw crash within libfcgi Hello Cephers, Recently we have several radosgw daemon crashes

[ceph-users] radosgw crash within libfcgi

2015-06-24 Thread GuangYang
Hello Cephers, Recently we have several radosgw daemon crashes with the same following kernel log: Jun 23 14:17:38 xxx kernel: radosgw[68180]: segfault at f0 ip 7ffa069996f2 sp 7ff55c432710 error 6 in libfcgi.so.0.0.0[7ffa06995000+a000] in libfcgi.so.0.0.0[7ffa06995000+a000] Looking

[ceph-users] RadosGW - Multiple instances on same host

2015-06-24 Thread Italo Santos
Hello everyone, I’d like to know if someone knows if its possible run multiples radosgw instances on the same host? What I’m trying to do is have two diferente radosgw instances responding by different rgw dns... Regards. Italo Santos http://italosantos.com.br/

Re: [ceph-users] radosgw socket is not created

2015-06-23 Thread Makkelie, R (ITCDCC) - KLM
Of Makkelie, R (ITCDCC) - KLM Sent: Monday, June 22, 2015 8:22 PM To: ceph-users@lists.ceph.commailto:ceph-users@lists.ceph.com Subject: [ceph-users] radosgw socket is not created i followed the following doc http://docs.ceph.com/docs/master/radosgw/config/ and have set this to [client.radosgw.gateway

Re: [ceph-users] radosgw socket is not created

2015-06-23 Thread B, Naga Venkata
PM To: ceph-users@lists.ceph.commailto:ceph-users@lists.ceph.com Subject: [ceph-users] radosgw socket is not created i followed the following doc http://docs.ceph.com/docs/master/radosgw/config/ and have set this to [client.radosgw.gateway] host = qj6xe keyring = /etc/ceph

Re: [ceph-users] radosgw socket is not created

2015-06-23 Thread Makkelie, R (ITCDCC) - KLM
: [ceph-users] radosgw socket is not created i followed the following doc http://docs.ceph.com/docs/master/radosgw/config/ and have set this to [client.radosgw.gateway] host = qj6xe keyring = /etc/ceph/keyring.radosgw.gateway rgw socket path = /var/run/ceph/ceph.radosgw.gateway.fastcgi.sock

Re: [ceph-users] radosgw socket is not created

2015-06-22 Thread B, Naga Venkata
: [ceph-users] radosgw socket is not created i followed the following doc http://docs.ceph.com/docs/master/radosgw/config/ and have set this to [client.radosgw.gateway] host = qj6xe keyring = /etc/ceph/keyring.radosgw.gateway rgw socket path = /var/run/ceph/ceph.radosgw.gateway.fastcgi.sock log_file

[ceph-users] radosgw socket is not created

2015-06-22 Thread Makkelie, R (ITCDCC) - KLM
i followed the following doc http://docs.ceph.com/docs/master/radosgw/config/ and have set this to [client.radosgw.gateway] host = qj6xe keyring = /etc/ceph/keyring.radosgw.gateway rgw socket path = /var/run/ceph/ceph.radosgw.gateway.fastcgi.sock log_file = /var/log/ceph/radosgw.log

Re: [ceph-users] radosgw did not create auth url for swift

2015-06-22 Thread Vickie ch
Dear all, I tried another way that use command ceph-deploy to create radosgw. After that I can get list or create container finally. But new problem is if I tried to upload files or delete container that radosgw will return the message Access denied. Totally have no idea. Any help will be

Re: [ceph-users] radosgw did not create auth url for swift

2015-06-22 Thread Vickie ch
Dear Venkat, Finally, create user and make sure subuser created that I can upload files and test on Hammer. But I still need to find out why not working on apache and how to make this work on Firefly. I wrote a simple steps, FYR. Hope it helps! Dear Best wishes, Mika 2015-06-22 14:34

[ceph-users] RadosGW Performance

2015-06-19 Thread Stuart Harland
I'm trying to evaluate various object stores/distributed file systems for use in our company and have a little experience of using Ceph in the past. However I'm running into a few issues when running some benchmarks against RadosGW. Basically my script is pretty dumb, but it captures one of our

Re: [ceph-users] radosgw did not create auth url for swift

2015-06-18 Thread venkat
can you please let me know if you solved this issue please ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] radosgw did not create auth url for swift

2015-06-17 Thread Vickie ch
Hi all, I want to use swift-client to connect ceph cluster. I have done s3 test on this cluster before. So I follow the guide to create a subuser and use swift client to test it. But always got an error 404 Not Found How can I create the auth page?Any help will be appreciated. - 1

[ceph-users] radosgw backup

2015-06-11 Thread Konstantin Ivanov
Hi everyone. I'm wondering - is there way to backup radosgw data? What i already tried. create backup pool - copy .rgw.buckets to backup pool. Then i delete object via s3 client. And then i copy data from backup pool to .rgw.buckets. I still can't see object in s3 client, but can get it via http

Re: [ceph-users] radosgw backup

2015-06-11 Thread Michael Kuriger
/2015/03/13/radosgw-simple-replication-example From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Konstantin Ivanov Sent: Thursday, May 28, 2015 1:44 AM To: ceph-users@lists.ceph.com Subject: [ceph-users] radosgw backup Hi everyone. I'm wondering - is there way to backup

[ceph-users] radosgw sync agent against aws s3

2015-06-07 Thread Blair Bethwaite
Has anyone had any luck using the radosgw-sync-agent to push or pull to/from real S3? -- Cheers, ~Blairo ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] radosgw backup

2015-05-29 Thread Konstantin Ivanov
Hi everyone. I'm wondering - is there way to backup radosgw data? What i already tried. create backup pool - copy .rgw.buckets to backup pool. Then i delete object via s3 client. And then i copy data from backup pool to .rgw.buckets. I still can't see object in s3 client, but can get it via http

[ceph-users] RadosGW not working after upgrade to Hammer

2015-05-26 Thread Arnoud de Jonge
Hi, After upgrading our OpenStack cluster to Kilo and upgrading Ceph from Giant to Hammer, RadosGW stopped working. All other services using Ceph work fine. RadosGW is configured to use Keystone for authentication. # swift list Account GET failed:

[ceph-users] radosgw load/performance/crashing

2015-05-25 Thread Daniel Hoffman
Hi All. We are trying to cope with radosGW crashing every 5-15mins. This seems to be getting worse and worse but we are unable to determine the cause, nothing in the logs as it appears to be a radosgw hang. The port is open, accepts a connect but there is no response to a HEAD/GET etc etc. We

<    1   2   3   4   5   6   7   8   9   10   >