Re: [ceph-users] Scaling radosgw module

2013-10-29 Thread hadi golestani
I've found nothing related in Apache logs, I believe it's something related to Radosgw, Anyone else tested the same thing on owned Radosgw? Regards On Mon, Oct 28, 2013 at 11:52 PM, Mark Nelson mark.nel...@inktank.comwrote: I'm not really an apache expert, but you could try looking at the

Re: [ceph-users] Scaling radosgw module

2013-10-28 Thread hadi golestani
Any answer to this question? I'm hitting almost the same issue with radosgw, Read performance is not fine with radosgw Regards ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Scaling radosgw module

2013-10-28 Thread Mark Nelson
Hi Hadi, Can you tell me a bit about the tests you are doing and seeing poor performance on? Mark On 10/28/2013 01:32 PM, hadi golestani wrote: Any answer to this question? I'm hitting almost the same issue with radosgw, Read performance is not fine with radosgw Regards

Re: [ceph-users] Scaling radosgw module

2013-10-28 Thread hadi golestani
My test is so simple, On a cluster with 3 MON, 4 OSD, 1 RGW I can't download a big file from two different clients concurrently, One of them will wait till the other finish downloading it. Regards On Mon, Oct 28, 2013 at 10:19 PM, Mark Nelson mark.nel...@inktank.comwrote: Hi Hadi, Can you

Re: [ceph-users] Scaling radosgw module

2013-10-28 Thread Yehuda Sadeh
Sounds like an issue with your apache config. How did you install your apache? What distribution are you running on? Are you using it as mpm-worker? Do you have non-default radosgw settings? Yehuda On Mon, Oct 28, 2013 at 11:58 AM, hadi golestani hadi.golest...@gmail.com wrote: My test is so

Re: [ceph-users] Scaling radosgw module

2013-10-28 Thread Mark Nelson
Strange! I'm not sure I've actually ever seen two concurrent downloads fail to work properly. Is there anything unusual about the setup? Mark On 10/28/2013 01:58 PM, hadi golestani wrote: My test is so simple, On a cluster with 3 MON, 4 OSD, 1 RGW I can't download a big file from two

Re: [ceph-users] Scaling radosgw module

2013-10-28 Thread hadi golestani
I'm running Ubuntu 12 on all my nodes and I've just installed every package with default configs like what is mentioned in quick installtion guide of Ceph Anyone else experiancing the same issue? Regards On Mon, Oct 28, 2013 at 11:09 PM, Mark Nelson mark.nel...@inktank.comwrote: Strange!

Re: [ceph-users] Scaling radosgw module

2013-10-28 Thread Mark Nelson
I'm not really an apache expert, but you could try looking at the apache and rgw logs and see if you can trace where the 2nd request is hanging up. Also, just to be sure, both clients can download data independently, just not together? Mark On 10/28/2013 02:54 PM, hadi golestani wrote: I'm

Re: [ceph-users] Scaling radosgw module

2013-09-27 Thread Mark Nelson
-users@lists.ceph.com; Anirban Ray; ceph-de...@vger.kernel.org Subject: Re: [ceph-users] Scaling radosgw module You specify the relative performance, but what the actual numbers that you're seeing? How many GETs per second, and how many PUTs per second do you see? On Thu, Sep 26, 2013 at 4:00 PM

Re: [ceph-users] Scaling radosgw module

2013-09-27 Thread Somnath Roy
: Mark Nelson [mailto:mark.nel...@inktank.com] Sent: Friday, September 27, 2013 11:50 AM To: Somnath Roy Cc: Yehuda Sadeh; ceph-users@lists.ceph.com; Anirban Ray; ceph-de...@vger.kernel.org Subject: Re: [ceph-users] Scaling radosgw module Hi Somnath, With SSDs, you almost certainly are going

Re: [ceph-users] Scaling radosgw module

2013-09-27 Thread Mark Nelson
[mailto:mark.nel...@inktank.com] Sent: Friday, September 27, 2013 11:50 AM To: Somnath Roy Cc: Yehuda Sadeh; ceph-users@lists.ceph.com; Anirban Ray; ceph-de...@vger.kernel.org Subject: Re: [ceph-users] Scaling radosgw module Hi Somnath, With SSDs, you almost certainly are going to be running into bottlenecks

Re: [ceph-users] Scaling radosgw module

2013-09-26 Thread Somnath Roy
, 2013 4:08 PM To: 'Mark Nelson' Cc: ceph-users@lists.ceph.com Subject: RE: [ceph-users] Scaling radosgw module Hi Mark, It's a test cluster and I will try with the new release. As I mentioned in the mail, I think number of rados client instance is the limitation. Could you please let me know how

Re: [ceph-users] Scaling radosgw module

2013-09-26 Thread Mark Nelson
the single rados bench output! Any other suggestion ? Thanks Regards Somnath -Original Message- From: Somnath Roy Sent: Friday, September 20, 2013 4:08 PM To: 'Mark Nelson' Cc: ceph-users@lists.ceph.com Subject: RE: [ceph-users] Scaling radosgw module Hi Mark, It's a test cluster and I will try

Re: [ceph-users] Scaling radosgw module

2013-09-26 Thread Mark Nelson
-devel-ow...@vger.kernel.org [mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Mark Nelson Sent: Thursday, September 26, 2013 3:33 PM To: Somnath Roy Cc: ceph-users@lists.ceph.com; ceph-de...@vger.kernel.org; Anirban Ray Subject: Re: [ceph-users] Scaling radosgw module It's kind of annoying

Re: [ceph-users] Scaling radosgw module

2013-09-26 Thread Somnath Roy
-Original Message- From: Mark Nelson [mailto:mark.nel...@inktank.com] Sent: Thursday, September 26, 2013 3:50 PM To: Somnath Roy Cc: ceph-users@lists.ceph.com; ceph-de...@vger.kernel.org; Anirban Ray Subject: Re: [ceph-users] Scaling radosgw module Ah, that's very good to know! And RGW CPU usage

Re: [ceph-users] Scaling radosgw module

2013-09-26 Thread Somnath Roy
, September 26, 2013 3:59 PM To: Mark Nelson Cc: ceph-users@lists.ceph.com; ceph-de...@vger.kernel.org; Anirban Ray Subject: RE: [ceph-users] Scaling radosgw module Nope...With one client hitting the radaosgw , the daemon cpu usage is going up till 400-450% i.e taking in avg 4 core..In one client

Re: [ceph-users] Scaling radosgw module

2013-09-26 Thread Yehuda Sadeh
@lists.ceph.com; ceph-de...@vger.kernel.org; Anirban Ray Subject: RE: [ceph-users] Scaling radosgw module Nope...With one client hitting the radaosgw , the daemon cpu usage is going up till 400-450% i.e taking in avg 4 core..In one client scenario, the server node (having radosgw + osds) cpu

Re: [ceph-users] Scaling radosgw module

2013-09-26 Thread Somnath Roy
: [ceph-users] Scaling radosgw module You specify the relative performance, but what the actual numbers that you're seeing? How many GETs per second, and how many PUTs per second do you see? On Thu, Sep 26, 2013 at 4:00 PM, Somnath Roy somnath@sandisk.com wrote: Mark, One more thing, all my

Re: [ceph-users] Scaling radosgw module

2013-09-20 Thread Mark Nelson
Hi, A couple of things that might be worth trying: use multiple containers in swift-bench. Newer versions should support this. Also, if this is a test cluster, you may want to try the ceph wip-6286 branch as we have a rather major performance improvement in it when dealing with small

Re: [ceph-users] Scaling radosgw module

2013-09-20 Thread Somnath Roy
@lists.ceph.com Subject: Re: [ceph-users] Scaling radosgw module Hi, A couple of things that might be worth trying: use multiple containers in swift-bench. Newer versions should support this. Also, if this is a test cluster, you may want to try the ceph wip-6286 branch as we have a rather major

Re: [ceph-users] Scaling radosgw module

2013-09-20 Thread Mark Nelson
-Original Message- From: ceph-users-boun...@lists.ceph.com [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Mark Nelson Sent: Friday, September 20, 2013 3:03 PM To: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Scaling radosgw module Hi, A couple of things that might

Re: [ceph-users] Scaling radosgw module

2013-09-20 Thread Somnath Roy
Regards Somnath -Original Message- From: Mark Nelson [mailto:mark.nel...@inktank.com] Sent: Friday, September 20, 2013 4:02 PM To: Somnath Roy Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Scaling radosgw module On 09/20/2013 05:49 PM, Somnath Roy wrote: Hi Mark, Thanks for your