RE: ACS + Riak-CS, works?

2013-10-31 Thread Sanjeev Neelarapu
Hi, Cloudstack with Riak-CS works fine. If we register template more than 5GB we use multipart upload to push the files to Riak. But this does not work for snapshots and volumes. This will be fixed in CS4.2.1 . But for template registration it should work fine. Thanks, Sanjeev -Original

Re: ACS + Riak-CS, works?

2013-10-31 Thread Darren Shepherd
My template is less than 5gb and it still uses multipart. I actually don't think this is a CloudStack issue but more of an issue with Riak-CS. I was just wondering if anybody has specifically ran the setup or knows more about Riak-CS and can tell me whats up. I've been trying off and on for the

Re: ACS + Riak-CS, works?

2013-10-31 Thread John Burwell
Darren, Since S3/Riak CS can receive the contents of a file out of order and re-assemble upon completion of transfer of all parts, the underlying driver uses the TransferManager which automatically breaks files up into multi-part uploads to increase parallelism to decrease the time required to

Re: ACS + Riak-CS, works?

2013-10-31 Thread Darren Shepherd
Uploading without multipart works with s3cmd. The s3cmd I was using didn't have multipart support, so I'll download a newer one and try it tonight. Would you happen to know what the below means? I get a 200 response for parts 1,2,3,4,etc and then randomly one part will fail with the below.

Re: ACS + Riak-CS, works?

2013-10-31 Thread John Burwell
Darren, Your are receiving a 403 which indicates that the ACLs/user is not properly configured. Which version of Riak CS are you using? Can you send your app.config and vm.args for Riak and Riak CS? Personally, I use the vagrant-riak-cs-cluster [1] project to build local instances for

Re: ACS + Riak-CS, works?

2013-10-31 Thread Min Chen
...@gmail.commailto:darren.s.sheph...@gmail.com Cc: dev@cloudstack.apache.orgmailto:dev@cloudstack.apache.org dev@cloudstack.apache.orgmailto:dev@cloudstack.apache.org Subject: Re: ACS + Riak-CS, works? Darren, Since S3/Riak CS can receive the contents of a file out of order and re-assemble upon completion

Re: ACS + Riak-CS, works?

2013-10-31 Thread John Burwell
@cloudstack.apache.orgmailto:dev@cloudstack.apache.org Subject: Re: ACS + Riak-CS, works? Darren, Since S3/Riak CS can receive the contents of a file out of order and re-assemble upon completion of transfer of all parts, the underlying driver uses the TransferManager which automatically breaks files up

Re: ACS + Riak-CS, works?

2013-10-31 Thread Min Chen
...@gmail.commailto:darren.s.sheph...@gmail.com Cc: dev@cloudstack.apache.orgmailto:dev@cloudstack.apache.org dev@cloudstack.apache.orgmailto:dev@cloudstack.apache.org Subject: Re: ACS + Riak-CS, works? Darren, Since S3/Riak CS can receive the contents of a file out of order and re-assemble upon

Re: ACS + Riak-CS, works?

2013-10-31 Thread Darren Shepherd
This is actually running in docker and I followed the quickstart [1] to set it up. I'll send the config tonight, I don't have access to the machine at the moment. I know the 403 seems to indicate the setup is wrong, but all parts prior to part 18 got a 200 (as you can see in the access log). So

Re: ACS + Riak-CS, works?

2013-10-31 Thread John Burwell
Darren, One silly question, how much disk space is free in the container? Additionally, how much RAM have allocated? I recommend a minimum of 2 GB for testing (memory is consumed largely by the bitcask backend holding keys in memory). When disk space or memory runs out, odd errors can

Re: ACS + Riak-CS, works?

2013-10-31 Thread Darren Shepherd
Memory is 4gb and disk is about 1gb free (kinda low on disk space). But the system is overtaxed and slow and swapping a bit. I'll give the vagrant setup a try. Darren On Oct 31, 2013, at 11:29 AM, John Burwell jburw...@basho.com wrote: Darren, One silly question, how much disk space