Re: RadosGW performance and disk space usage

2013-01-25 Thread Sam Lang
On Thu, Jan 24, 2013 at 9:27 AM, Cesar Mello wrote: > Hi! > > I have successfully prototyped read/write access to ceph from Windows > using the S3 API, thanks so much for the help. > > Now I would like to do some prototypes targeting performance > evaluation. My scenario typically requires paralle

Re: RadosGW performance and disk space usage

2013-01-25 Thread Dan Mick
If the S3 API is not well suited to my scenario, then my effort should be better directed to porting or writing a native ceph client for Windows. I just need an API to read and write/append blocks to files. Any comments are really appreciated. Hopefully someone with more windows experience wil

Re: RadosGW performance and disk space usage

2013-01-25 Thread Marcus Sorensen
Have you tried rest-bench on localhost at the rados gateway? I was playing with the rados gateway in a VM the other day, and was getting up to 400/s on 4k objects. Above that I was getting connection failures, but I think it was just due to a default max connections setting somewhere or something.

Re: RadosGW performance and disk space usage

2013-01-26 Thread Cesar Mello
Dear Sam, Dan and Marcus, Thank you a lot for the replies. I'll do more tests today. The length of each object used in my test is just 20 bytes. I'm glad you got 400 objects/s! Iif I get that with a length of 8 KB using a 2-node cluster, then ceph with rados will be already faster than my current

Re: RadosGW performance and disk space usage

2013-01-27 Thread Cesar Mello
Hi, Just tried rest-bench. This little tool is wonderful, thanks! I still have to learn lots of things. So please don't spend much time explaining me, but instead please give me any pointers to documentation or source code that can be useful. As a curiosity, I'm pasting the results from my laptop

Re: RadosGW performance and disk space usage

2013-01-27 Thread Dan Mick
On 1/25/2013 9:35 PM, Dan Mick wrote: If the S3 API is not well suited to my scenario, then my effort should be better directed to porting or writing a native ceph client for Windows. I just need an API to read and write/append blocks to files. Any comments are really appreciated. Hopefully s

Re: RadosGW performance and disk space usage

2013-01-28 Thread Joao Eduardo Luis
On 01/27/2013 11:10 PM, Cesar Mello wrote: Hi, Just tried rest-bench. This little tool is wonderful, thanks! I still have to learn lots of things. So please don't spend much time explaining me, but instead please give me any pointers to documentation or source code that can be useful. As a curi

Re: RadosGW performance and disk space usage

2013-01-28 Thread Yehuda Sadeh
On Mon, Jan 28, 2013 at 6:28 AM, Joao Eduardo Luis wrote: > On 01/27/2013 11:10 PM, Cesar Mello wrote: >> >> Hi, >> >> Just tried rest-bench. This little tool is wonderful, thanks! >> >> I still have to learn lots of things. So please don't spend much time >> explaining me, but instead please give

Re: RadosGW performance and disk space usage

2013-01-28 Thread Yehuda Sadeh
On Sun, Jan 27, 2013 at 3:10 PM, Cesar Mello wrote: > Hi, > > Just tried rest-bench. This little tool is wonderful, thanks! > > I still have to learn lots of things. So please don't spend much time > explaining me, but instead please give me any pointers to > documentation or source code that can

Re: RadosGW performance and disk space usage

2013-01-28 Thread Cesar Mello
Sure I can later when I arrive home. With the end of my vacation, I'll be able to devote a couple of hours after my 3-year-old sleeps. :-) I guess my laptop hard disk has horrible seek times. I'll repeat the tests in my desktop as soon as possible. Thanks a lot for the attention! Best regards Me