Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-08 Thread Patrycja Szabłowska
Thank you Josh,

I'm not sure if this is ceph's fault or perhaps FastCGI's or Boto's.
When trying to upload 10KB chunk I've had those mysterious FastCGI's
errors on server side and boto.exception.BotoServerError:
BotoServerError: 500 Internal Server Error on client side.
I've tried now to upload 4MB part - the error on client's side was as
expected EntityTooSmall - but returned at the end, when I've called
the method complete_upload.

Perhaps this output can be helpful to someone:

$ python boto_multi.py
  begin upload of Bosphorus_1920x1080_30fps_420_8bit_AVC_MP4.mp4
  size 7507998, 2 parts
upload part 1 size 4194304
upload part 2 size 3313694
  end upload
Traceback (most recent call last):
  File boto_multi.py, line 48, in module
part.complete_upload()
  File local/lib/python2.7/site-packages/boto/s3/multipart.py, line
319, in complete_upload
self.id, xml)
  File local/lib/python2.7/site-packages/boto/s3/bucket.py, line
1779, in complete_multipart_upload
response.status, response.reason, body)
boto.exception.S3ResponseError: S3ResponseError: 400 Bad Request
?xml version=1.0 encoding=UTF-8?ErrorCodeEntityTooSmall/Code/Error


Cheers,

Patrycja Szabłowska





2014-07-08 0:10 GMT+02:00 Josh Durgin josh.dur...@inktank.com:
 On 07/07/2014 05:41 AM, Patrycja Szabłowska wrote:

 OK, the mystery is solved.

  From https://www.mail-archive.com/ceph-users@lists.ceph.com/msg10368.html
 During a multi part upload you can't upload parts smaller than 5M

 I've tried to upload smaller chunks, like 10KB. I've changed chunk size
 to 5MB and it works now.

 It's a pity that the Ceph's docs don't mention the limit (or I couldn't
 found it anywhere). And that the error wasn't helpful at all.


 Glad you figured it out. This is in the s3 docs [1], but the lack of
 error message is a regression. I added a couple tickets for this:

 http://tracker.ceph.com/issues/8764
 http://tracker.ceph.com/issues/8766

 Josh

 [1] http://docs.aws.amazon.com/AmazonS3/latest/API/mpUploadUploadPart.html
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-07 Thread Patrycja Szabłowska
I've installed Ubuntu 12.04 in order to test multiupload with the ceph's
modified fastcgi (according to this:
https://ceph.com/docs/master/install/install-ceph-gateway/#apache-fastcgi-w-100-continue
).

The problem is still the same: I can initiate the multi part upload or
upload single part, but when trying to put a part of multi part upload I
get the error with Fastcgi as I've shown before.

Here's a part of the error log once again:

== apache.error.log ==
[Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from server
/home/pszablow/ceph/src/htdocs/rgw.fcgi
[Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
(111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
connect to server /home/pszablow/ceph/src/htdocs/rgw.fcgi: connect()
failed
[Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from server
/home/pszablow/ceph/src/htdocs/rgw.fcgi


It seems to me that it doesn't matter if I turn the rgw print continue on
or off.

I've got no idea what to try next to make it work... Are there any other
pools needed to put parts in upload?


Thanks,

Patrycja Szabłowska



2014-07-04 16:26 GMT+02:00 Patrycja Szabłowska 
szablowska.patry...@gmail.com:

 Still not sure do I need the ceph's modified fastcgi or not.
 But I guess this explains my problem with the installation:
 http://tracker.ceph.com/issues/8233


 It would be nice to have at least a workaround for this...

 Thanks,

 Patrycja Szabłowska



 2014-07-04 16:02 GMT+02:00 Patrycja Szabłowska 
 szablowska.patry...@gmail.com:

 Thank you Luis for your response.

 Quite unbelievable, but your solution worked!
 Unfortunately, I'm stuck again when trying to upload parts of the file.

 Apache's logs:


 == apache.access.log ==
 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT /bucketbig/ HTTP/1.1 200
 477 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic
 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] POST
 /bucketbig/Bosphorus?uploads HTTP/1.1 200 249 {Referer}i Boto/2.30.0
 Python/2.7.6 Linux/3.13.0-30-generic

 == apache.error.log ==
 [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from
 server /home/pszablow/ceph/src/htdocs/rgw.fcgi

 == apache.access.log ==
 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT
 /bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9partNumber=1
 HTTP/1.1 500 531 {Referer}i Boto/2.30.0 Python/2.7.6
 Linux/3.13.0-30-generic

 == apache.error.log ==
 [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
 (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
 connect to server /home/pszablow/ceph/src/htdocs/rgw.fcgi: connect()
 failed
 [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from
 server /home/pszablow/ceph/src/htdocs/rgw.fcgi



 I'm using the default fastcgi module, not the one provided by Ceph. I've
 tried installing it on my ubuntu 14.04, but unfortunately I keep getting
 the error:

 libapache2-mod-fastcgi : requires: apache2.2-common (= 2.2.4)


 Is the modified fastcgi module mandatory in order to use multi part
 upload?


 Thanks,

 Patrycja Szabłowska


 2014-07-03 18:34 GMT+02:00 Luis Periquito luis.periqu...@ocado.com:

 I was at this issue this morning. It seems radosgw requires you to have
 a pool named '' to work with multipart. I just created a pool with that
 name
 rados mkpool ''

 either that or allow the pool be created by the radosgw...


 On 3 July 2014 16:27, Patrycja Szabłowska szablowska.patry...@gmail.com
  wrote:

 Hi,

 I'm trying to make multi part upload work. I'm using ceph
 0.80-702-g9bac31b (from the ceph's github).

 I've tried the code provided by Mark Kirkwood here:


 http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html


 But unfortunately, it gives me the error:

 (multitest)pszablow@pat-desktop:~/$ python boto_multi.py
   begin upload of abc.yuv
   size 746496, 7 parts
 Traceback (most recent call last):
   File boto_multi.py, line 36, in module
 part = bucket.initiate_multipart_upload(objname)
   File
 /home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py,
 line 1742, in initiate_multipart_upload
 response.status, response.reason, body)
 boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
 ?xml version=1.0
 encoding=UTF-8?ErrorCodeAccessDenied/Code/Error


 The single part upload works for me. I am able to create buckets and
 objects.
 I've tried also other similar examples, but none of them works.


 Any ideas what's wrong? Does the ceph's multi part upload actually
 work for anybody?


 Thanks,

 Patrycja Szabłowska
 ___
 ceph-users mailing list
 ceph-users@lists.ceph.com
 

Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-07 Thread Patrycja Szabłowska
OK, the mystery is solved.

From https://www.mail-archive.com/ceph-users@lists.ceph.com/msg10368.html
During a multi part upload you can't upload parts smaller than 5M

I've tried to upload smaller chunks, like 10KB. I've changed chunk size to
5MB and it works now.

It's a pity that the Ceph's docs don't mention the limit (or I couldn't
found it anywhere). And that the error wasn't helpful at all.


Cheers,

Patrycja Szabłowska




2014-07-07 14:05 GMT+02:00 Patrycja Szabłowska 
szablowska.patry...@gmail.com:

 I've installed Ubuntu 12.04 in order to test multiupload with the ceph's
 modified fastcgi (according to this:
 https://ceph.com/docs/master/install/install-ceph-gateway/#apache-fastcgi-w-100-continue
 ).

 The problem is still the same: I can initiate the multi part upload or
 upload single part, but when trying to put a part of multi part upload I
 get the error with Fastcgi as I've shown before.

  Here's a part of the error log once again:


 == apache.error.log ==
 [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from
 server /home/pszablow/ceph/src/htdocs/rgw.fcgi
 [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
 (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
 connect to server /home/pszablow/ceph/src/htdocs/rgw.fcgi: connect()
 failed
 [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from
 server /home/pszablow/ceph/src/htdocs/rgw.fcgi


 It seems to me that it doesn't matter if I turn the rgw print continue on
 or off.

 I've got no idea what to try next to make it work... Are there any other
 pools needed to put parts in upload?


 Thanks,

 Patrycja Szabłowska



 2014-07-04 16:26 GMT+02:00 Patrycja Szabłowska 
 szablowska.patry...@gmail.com:

 Still not sure do I need the ceph's modified fastcgi or not.
 But I guess this explains my problem with the installation:
 http://tracker.ceph.com/issues/8233


 It would be nice to have at least a workaround for this...

 Thanks,

 Patrycja Szabłowska



 2014-07-04 16:02 GMT+02:00 Patrycja Szabłowska 
 szablowska.patry...@gmail.com:

 Thank you Luis for your response.

 Quite unbelievable, but your solution worked!
 Unfortunately, I'm stuck again when trying to upload parts of the file.

 Apache's logs:


 == apache.access.log ==
 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT /bucketbig/ HTTP/1.1
 200 477 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic
 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] POST
 /bucketbig/Bosphorus?uploads HTTP/1.1 200 249 {Referer}i Boto/2.30.0
 Python/2.7.6 Linux/3.13.0-30-generic

 == apache.error.log ==
 [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from
 server /home/pszablow/ceph/src/htdocs/rgw.fcgi

 == apache.access.log ==
 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT
 /bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9partNumber=1
 HTTP/1.1 500 531 {Referer}i Boto/2.30.0 Python/2.7.6
 Linux/3.13.0-30-generic

 == apache.error.log ==
 [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
 (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
 connect to server /home/pszablow/ceph/src/htdocs/rgw.fcgi: connect()
 failed
 [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from
 server /home/pszablow/ceph/src/htdocs/rgw.fcgi



 I'm using the default fastcgi module, not the one provided by Ceph. I've
 tried installing it on my ubuntu 14.04, but unfortunately I keep getting
 the error:

 libapache2-mod-fastcgi : requires: apache2.2-common (= 2.2.4)


 Is the modified fastcgi module mandatory in order to use multi part
 upload?


 Thanks,

 Patrycja Szabłowska


 2014-07-03 18:34 GMT+02:00 Luis Periquito luis.periqu...@ocado.com:

 I was at this issue this morning. It seems radosgw requires you to have
 a pool named '' to work with multipart. I just created a pool with that
 name
 rados mkpool ''

 either that or allow the pool be created by the radosgw...


 On 3 July 2014 16:27, Patrycja Szabłowska 
 szablowska.patry...@gmail.com wrote:

 Hi,

 I'm trying to make multi part upload work. I'm using ceph
 0.80-702-g9bac31b (from the ceph's github).

 I've tried the code provided by Mark Kirkwood here:


 http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html


 But unfortunately, it gives me the error:

 (multitest)pszablow@pat-desktop:~/$ python boto_multi.py
   begin upload of abc.yuv
   size 746496, 7 parts
 Traceback (most recent call last):
   File boto_multi.py, line 36, in module
 part = bucket.initiate_multipart_upload(objname)
   File
 /home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py,
 line 1742, in initiate_multipart_upload
   

Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-07 Thread Josh Durgin

On 07/07/2014 05:41 AM, Patrycja Szabłowska wrote:

OK, the mystery is solved.

 From https://www.mail-archive.com/ceph-users@lists.ceph.com/msg10368.html
During a multi part upload you can't upload parts smaller than 5M

I've tried to upload smaller chunks, like 10KB. I've changed chunk size
to 5MB and it works now.

It's a pity that the Ceph's docs don't mention the limit (or I couldn't
found it anywhere). And that the error wasn't helpful at all.


Glad you figured it out. This is in the s3 docs [1], but the lack of
error message is a regression. I added a couple tickets for this:

http://tracker.ceph.com/issues/8764
http://tracker.ceph.com/issues/8766

Josh

[1] http://docs.aws.amazon.com/AmazonS3/latest/API/mpUploadUploadPart.html
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-04 Thread Patrycja Szabłowska
Thank you Luis for your response.

Quite unbelievable, but your solution worked!
Unfortunately, I'm stuck again when trying to upload parts of the file.

Apache's logs:


== apache.access.log ==
127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT /bucketbig/ HTTP/1.1 200
477 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic
127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] POST
/bucketbig/Bosphorus?uploads HTTP/1.1 200 249 {Referer}i Boto/2.30.0
Python/2.7.6 Linux/3.13.0-30-generic

== apache.error.log ==
[Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from server
/home/pszablow/ceph/src/htdocs/rgw.fcgi

== apache.access.log ==
127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT
/bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9partNumber=1
HTTP/1.1 500 531 {Referer}i Boto/2.30.0 Python/2.7.6
Linux/3.13.0-30-generic

== apache.error.log ==
[Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
(111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
connect to server /home/pszablow/ceph/src/htdocs/rgw.fcgi: connect()
failed
[Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from server
/home/pszablow/ceph/src/htdocs/rgw.fcgi



I'm using the default fastcgi module, not the one provided by Ceph. I've
tried installing it on my ubuntu 14.04, but unfortunately I keep getting
the error:
libapache2-mod-fastcgi : requires: apache2.2-common (= 2.2.4)


Is the modified fastcgi module mandatory in order to use multi part upload?


Thanks,

Patrycja Szabłowska


2014-07-03 18:34 GMT+02:00 Luis Periquito luis.periqu...@ocado.com:

 I was at this issue this morning. It seems radosgw requires you to have a
 pool named '' to work with multipart. I just created a pool with that name
 rados mkpool ''

 either that or allow the pool be created by the radosgw...


 On 3 July 2014 16:27, Patrycja Szabłowska szablowska.patry...@gmail.com
 wrote:

 Hi,

 I'm trying to make multi part upload work. I'm using ceph
 0.80-702-g9bac31b (from the ceph's github).

 I've tried the code provided by Mark Kirkwood here:


 http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html


 But unfortunately, it gives me the error:

 (multitest)pszablow@pat-desktop:~/$ python boto_multi.py
   begin upload of abc.yuv
   size 746496, 7 parts
 Traceback (most recent call last):
   File boto_multi.py, line 36, in module
 part = bucket.initiate_multipart_upload(objname)
   File
 /home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py,
 line 1742, in initiate_multipart_upload
 response.status, response.reason, body)
 boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
 ?xml version=1.0
 encoding=UTF-8?ErrorCodeAccessDenied/Code/Error


 The single part upload works for me. I am able to create buckets and
 objects.
 I've tried also other similar examples, but none of them works.


 Any ideas what's wrong? Does the ceph's multi part upload actually
 work for anybody?


 Thanks,

 Patrycja Szabłowska
 ___
 ceph-users mailing list
 ceph-users@lists.ceph.com
 http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




 --

 Luis Periquito

 Unix Engineer

 Ocado.com http://www.ocado.com/

 Head Office, Titan Court, 3 Bishop Square, Hatfield Business Park,
 Hatfield, Herts AL10 9NE

 Notice:  This email is confidential and may contain copyright material of
 members of the Ocado Group. Opinions and views expressed in this message
 may not necessarily reflect the opinions and views of the members of the
 Ocado Group.

 If you are not the intended recipient, please notify us immediately and
 delete all copies of this message. Please note that it is your
 responsibility to scan this message for viruses.

 References to the “Ocado Group” are to Ocado Group plc (registered in
 England and Wales with number 7098618) and its subsidiary undertakings (as
 that expression is defined in the Companies Act 2006) from time to time.
 The registered office of Ocado Group plc is Titan Court, 3 Bishops Square,
 Hatfield Business Park, Hatfield, Herts. AL10 9NE.




-- 
Pozdrawiam
Patrycja Szabłowska
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-04 Thread Patrycja Szabłowska
Still not sure do I need the ceph's modified fastcgi or not.
But I guess this explains my problem with the installation:
http://tracker.ceph.com/issues/8233


It would be nice to have at least a workaround for this...

Thanks,

Patrycja Szabłowska



2014-07-04 16:02 GMT+02:00 Patrycja Szabłowska 
szablowska.patry...@gmail.com:

 Thank you Luis for your response.

 Quite unbelievable, but your solution worked!
 Unfortunately, I'm stuck again when trying to upload parts of the file.

 Apache's logs:


 == apache.access.log ==
 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT /bucketbig/ HTTP/1.1 200
 477 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic
 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] POST
 /bucketbig/Bosphorus?uploads HTTP/1.1 200 249 {Referer}i Boto/2.30.0
 Python/2.7.6 Linux/3.13.0-30-generic

 == apache.error.log ==
 [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from
 server /home/pszablow/ceph/src/htdocs/rgw.fcgi

 == apache.access.log ==
 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT
 /bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9partNumber=1
 HTTP/1.1 500 531 {Referer}i Boto/2.30.0 Python/2.7.6
 Linux/3.13.0-30-generic

 == apache.error.log ==
 [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
 (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
 connect to server /home/pszablow/ceph/src/htdocs/rgw.fcgi: connect()
 failed
 [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from
 server /home/pszablow/ceph/src/htdocs/rgw.fcgi



 I'm using the default fastcgi module, not the one provided by Ceph. I've
 tried installing it on my ubuntu 14.04, but unfortunately I keep getting
 the error:

 libapache2-mod-fastcgi : requires: apache2.2-common (= 2.2.4)


 Is the modified fastcgi module mandatory in order to use multi part upload?


 Thanks,

 Patrycja Szabłowska


 2014-07-03 18:34 GMT+02:00 Luis Periquito luis.periqu...@ocado.com:

 I was at this issue this morning. It seems radosgw requires you to have a
 pool named '' to work with multipart. I just created a pool with that name
 rados mkpool ''

 either that or allow the pool be created by the radosgw...


 On 3 July 2014 16:27, Patrycja Szabłowska szablowska.patry...@gmail.com
 wrote:

 Hi,

 I'm trying to make multi part upload work. I'm using ceph
 0.80-702-g9bac31b (from the ceph's github).

 I've tried the code provided by Mark Kirkwood here:


 http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html


 But unfortunately, it gives me the error:

 (multitest)pszablow@pat-desktop:~/$ python boto_multi.py
   begin upload of abc.yuv
   size 746496, 7 parts
 Traceback (most recent call last):
   File boto_multi.py, line 36, in module
 part = bucket.initiate_multipart_upload(objname)
   File
 /home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py,
 line 1742, in initiate_multipart_upload
 response.status, response.reason, body)
 boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
 ?xml version=1.0
 encoding=UTF-8?ErrorCodeAccessDenied/Code/Error


 The single part upload works for me. I am able to create buckets and
 objects.
 I've tried also other similar examples, but none of them works.


 Any ideas what's wrong? Does the ceph's multi part upload actually
 work for anybody?


 Thanks,

 Patrycja Szabłowska
 ___
 ceph-users mailing list
 ceph-users@lists.ceph.com
 http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




 --

 Luis Periquito

 Unix Engineer

 Ocado.com http://www.ocado.com/

 Head Office, Titan Court, 3 Bishop Square, Hatfield Business Park,
 Hatfield, Herts AL10 9NE

 Notice:  This email is confidential and may contain copyright material of
 members of the Ocado Group. Opinions and views expressed in this message
 may not necessarily reflect the opinions and views of the members of the
 Ocado Group.

 If you are not the intended recipient, please notify us immediately and
 delete all copies of this message. Please note that it is your
 responsibility to scan this message for viruses.

 References to the “Ocado Group” are to Ocado Group plc (registered in
 England and Wales with number 7098618) and its subsidiary undertakings (as
 that expression is defined in the Companies Act 2006) from time to time.
 The registered office of Ocado Group plc is Titan Court, 3 Bishops Square,
 Hatfield Business Park, Hatfield, Herts. AL10 9NE.




 --
 Pozdrawiam
 Patrycja Szabłowska

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


[ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-03 Thread Patrycja Szabłowska
Hi,

I'm trying to make multi part upload work. I'm using ceph
0.80-702-g9bac31b (from the ceph's github).

I've tried the code provided by Mark Kirkwood here:

http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html


But unfortunately, it gives me the error:

(multitest)pszablow@pat-desktop:~/$ python boto_multi.py
  begin upload of abc.yuv
  size 746496, 7 parts
Traceback (most recent call last):
  File boto_multi.py, line 36, in module
part = bucket.initiate_multipart_upload(objname)
  File 
/home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py,
line 1742, in initiate_multipart_upload
response.status, response.reason, body)
boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
?xml version=1.0 encoding=UTF-8?ErrorCodeAccessDenied/Code/Error


The single part upload works for me. I am able to create buckets and objects.
I've tried also other similar examples, but none of them works.


Any ideas what's wrong? Does the ceph's multi part upload actually
work for anybody?


Thanks,

Patrycja Szabłowska
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-03 Thread Luis Periquito
I was at this issue this morning. It seems radosgw requires you to have a
pool named '' to work with multipart. I just created a pool with that name
rados mkpool ''

either that or allow the pool be created by the radosgw...


On 3 July 2014 16:27, Patrycja Szabłowska szablowska.patry...@gmail.com
wrote:

 Hi,

 I'm trying to make multi part upload work. I'm using ceph
 0.80-702-g9bac31b (from the ceph's github).

 I've tried the code provided by Mark Kirkwood here:


 http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html


 But unfortunately, it gives me the error:

 (multitest)pszablow@pat-desktop:~/$ python boto_multi.py
   begin upload of abc.yuv
   size 746496, 7 parts
 Traceback (most recent call last):
   File boto_multi.py, line 36, in module
 part = bucket.initiate_multipart_upload(objname)
   File
 /home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py,
 line 1742, in initiate_multipart_upload
 response.status, response.reason, body)
 boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
 ?xml version=1.0
 encoding=UTF-8?ErrorCodeAccessDenied/Code/Error


 The single part upload works for me. I am able to create buckets and
 objects.
 I've tried also other similar examples, but none of them works.


 Any ideas what's wrong? Does the ceph's multi part upload actually
 work for anybody?


 Thanks,

 Patrycja Szabłowska
 ___
 ceph-users mailing list
 ceph-users@lists.ceph.com
 http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




-- 

Luis Periquito

Unix Engineer

Ocado.com http://www.ocado.com/

Head Office, Titan Court, 3 Bishop Square, Hatfield Business Park,
Hatfield, Herts AL10 9NE

-- 


Notice:  This email is confidential and may contain copyright material of 
members of the Ocado Group. Opinions and views expressed in this message 
may not necessarily reflect the opinions and views of the members of the 
Ocado Group.

If you are not the intended recipient, please notify us immediately and 
delete all copies of this message. Please note that it is your 
responsibility to scan this message for viruses.  

References to the “Ocado Group” are to Ocado Group plc (registered in 
England and Wales with number 7098618) and its subsidiary undertakings (as 
that expression is defined in the Companies Act 2006) from time to time.  
The registered office of Ocado Group plc is Titan Court, 3 Bishops Square, 
Hatfield Business Park, Hatfield, Herts. AL10 9NE.
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com