Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?
Thank you Josh, I'm not sure if this is ceph's fault or perhaps FastCGI's or Boto's. When trying to upload 10KB chunk I've had those mysterious FastCGI's errors on server side and boto.exception.BotoServerError: BotoServerError: 500 Internal Server Error on client side. I've tried now to upload 4MB part - the error on client's side was as expected EntityTooSmall - but returned at the end, when I've called the method complete_upload. Perhaps this output can be helpful to someone: $ python boto_multi.py begin upload of Bosphorus_1920x1080_30fps_420_8bit_AVC_MP4.mp4 size 7507998, 2 parts upload part 1 size 4194304 upload part 2 size 3313694 end upload Traceback (most recent call last): File boto_multi.py, line 48, in module part.complete_upload() File local/lib/python2.7/site-packages/boto/s3/multipart.py, line 319, in complete_upload self.id, xml) File local/lib/python2.7/site-packages/boto/s3/bucket.py, line 1779, in complete_multipart_upload response.status, response.reason, body) boto.exception.S3ResponseError: S3ResponseError: 400 Bad Request ?xml version=1.0 encoding=UTF-8?ErrorCodeEntityTooSmall/Code/Error Cheers, Patrycja Szabłowska 2014-07-08 0:10 GMT+02:00 Josh Durgin josh.dur...@inktank.com: On 07/07/2014 05:41 AM, Patrycja Szabłowska wrote: OK, the mystery is solved. From https://www.mail-archive.com/ceph-users@lists.ceph.com/msg10368.html During a multi part upload you can't upload parts smaller than 5M I've tried to upload smaller chunks, like 10KB. I've changed chunk size to 5MB and it works now. It's a pity that the Ceph's docs don't mention the limit (or I couldn't found it anywhere). And that the error wasn't helpful at all. Glad you figured it out. This is in the s3 docs [1], but the lack of error message is a regression. I added a couple tickets for this: http://tracker.ceph.com/issues/8764 http://tracker.ceph.com/issues/8766 Josh [1] http://docs.aws.amazon.com/AmazonS3/latest/API/mpUploadUploadPart.html ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?
I've installed Ubuntu 12.04 in order to test multiupload with the ceph's modified fastcgi (according to this: https://ceph.com/docs/master/install/install-ceph-gateway/#apache-fastcgi-w-100-continue ). The problem is still the same: I can initiate the multi part upload or upload single part, but when trying to put a part of multi part upload I get the error with Fastcgi as I've shown before. Here's a part of the error log once again: == apache.error.log == [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from server /home/pszablow/ceph/src/htdocs/rgw.fcgi [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200] (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to connect to server /home/pszablow/ceph/src/htdocs/rgw.fcgi: connect() failed [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from server /home/pszablow/ceph/src/htdocs/rgw.fcgi It seems to me that it doesn't matter if I turn the rgw print continue on or off. I've got no idea what to try next to make it work... Are there any other pools needed to put parts in upload? Thanks, Patrycja Szabłowska 2014-07-04 16:26 GMT+02:00 Patrycja Szabłowska szablowska.patry...@gmail.com: Still not sure do I need the ceph's modified fastcgi or not. But I guess this explains my problem with the installation: http://tracker.ceph.com/issues/8233 It would be nice to have at least a workaround for this... Thanks, Patrycja Szabłowska 2014-07-04 16:02 GMT+02:00 Patrycja Szabłowska szablowska.patry...@gmail.com: Thank you Luis for your response. Quite unbelievable, but your solution worked! Unfortunately, I'm stuck again when trying to upload parts of the file. Apache's logs: == apache.access.log == 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT /bucketbig/ HTTP/1.1 200 477 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] POST /bucketbig/Bosphorus?uploads HTTP/1.1 200 249 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic == apache.error.log == [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from server /home/pszablow/ceph/src/htdocs/rgw.fcgi == apache.access.log == 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT /bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9partNumber=1 HTTP/1.1 500 531 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic == apache.error.log == [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200] (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to connect to server /home/pszablow/ceph/src/htdocs/rgw.fcgi: connect() failed [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from server /home/pszablow/ceph/src/htdocs/rgw.fcgi I'm using the default fastcgi module, not the one provided by Ceph. I've tried installing it on my ubuntu 14.04, but unfortunately I keep getting the error: libapache2-mod-fastcgi : requires: apache2.2-common (= 2.2.4) Is the modified fastcgi module mandatory in order to use multi part upload? Thanks, Patrycja Szabłowska 2014-07-03 18:34 GMT+02:00 Luis Periquito luis.periqu...@ocado.com: I was at this issue this morning. It seems radosgw requires you to have a pool named '' to work with multipart. I just created a pool with that name rados mkpool '' either that or allow the pool be created by the radosgw... On 3 July 2014 16:27, Patrycja Szabłowska szablowska.patry...@gmail.com wrote: Hi, I'm trying to make multi part upload work. I'm using ceph 0.80-702-g9bac31b (from the ceph's github). I've tried the code provided by Mark Kirkwood here: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html But unfortunately, it gives me the error: (multitest)pszablow@pat-desktop:~/$ python boto_multi.py begin upload of abc.yuv size 746496, 7 parts Traceback (most recent call last): File boto_multi.py, line 36, in module part = bucket.initiate_multipart_upload(objname) File /home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py, line 1742, in initiate_multipart_upload response.status, response.reason, body) boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden ?xml version=1.0 encoding=UTF-8?ErrorCodeAccessDenied/Code/Error The single part upload works for me. I am able to create buckets and objects. I've tried also other similar examples, but none of them works. Any ideas what's wrong? Does the ceph's multi part upload actually work for anybody? Thanks, Patrycja Szabłowska ___ ceph-users mailing list ceph-users@lists.ceph.com
Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?
OK, the mystery is solved. From https://www.mail-archive.com/ceph-users@lists.ceph.com/msg10368.html During a multi part upload you can't upload parts smaller than 5M I've tried to upload smaller chunks, like 10KB. I've changed chunk size to 5MB and it works now. It's a pity that the Ceph's docs don't mention the limit (or I couldn't found it anywhere). And that the error wasn't helpful at all. Cheers, Patrycja Szabłowska 2014-07-07 14:05 GMT+02:00 Patrycja Szabłowska szablowska.patry...@gmail.com: I've installed Ubuntu 12.04 in order to test multiupload with the ceph's modified fastcgi (according to this: https://ceph.com/docs/master/install/install-ceph-gateway/#apache-fastcgi-w-100-continue ). The problem is still the same: I can initiate the multi part upload or upload single part, but when trying to put a part of multi part upload I get the error with Fastcgi as I've shown before. Here's a part of the error log once again: == apache.error.log == [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from server /home/pszablow/ceph/src/htdocs/rgw.fcgi [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200] (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to connect to server /home/pszablow/ceph/src/htdocs/rgw.fcgi: connect() failed [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from server /home/pszablow/ceph/src/htdocs/rgw.fcgi It seems to me that it doesn't matter if I turn the rgw print continue on or off. I've got no idea what to try next to make it work... Are there any other pools needed to put parts in upload? Thanks, Patrycja Szabłowska 2014-07-04 16:26 GMT+02:00 Patrycja Szabłowska szablowska.patry...@gmail.com: Still not sure do I need the ceph's modified fastcgi or not. But I guess this explains my problem with the installation: http://tracker.ceph.com/issues/8233 It would be nice to have at least a workaround for this... Thanks, Patrycja Szabłowska 2014-07-04 16:02 GMT+02:00 Patrycja Szabłowska szablowska.patry...@gmail.com: Thank you Luis for your response. Quite unbelievable, but your solution worked! Unfortunately, I'm stuck again when trying to upload parts of the file. Apache's logs: == apache.access.log == 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT /bucketbig/ HTTP/1.1 200 477 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] POST /bucketbig/Bosphorus?uploads HTTP/1.1 200 249 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic == apache.error.log == [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from server /home/pszablow/ceph/src/htdocs/rgw.fcgi == apache.access.log == 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT /bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9partNumber=1 HTTP/1.1 500 531 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic == apache.error.log == [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200] (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to connect to server /home/pszablow/ceph/src/htdocs/rgw.fcgi: connect() failed [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from server /home/pszablow/ceph/src/htdocs/rgw.fcgi I'm using the default fastcgi module, not the one provided by Ceph. I've tried installing it on my ubuntu 14.04, but unfortunately I keep getting the error: libapache2-mod-fastcgi : requires: apache2.2-common (= 2.2.4) Is the modified fastcgi module mandatory in order to use multi part upload? Thanks, Patrycja Szabłowska 2014-07-03 18:34 GMT+02:00 Luis Periquito luis.periqu...@ocado.com: I was at this issue this morning. It seems radosgw requires you to have a pool named '' to work with multipart. I just created a pool with that name rados mkpool '' either that or allow the pool be created by the radosgw... On 3 July 2014 16:27, Patrycja Szabłowska szablowska.patry...@gmail.com wrote: Hi, I'm trying to make multi part upload work. I'm using ceph 0.80-702-g9bac31b (from the ceph's github). I've tried the code provided by Mark Kirkwood here: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html But unfortunately, it gives me the error: (multitest)pszablow@pat-desktop:~/$ python boto_multi.py begin upload of abc.yuv size 746496, 7 parts Traceback (most recent call last): File boto_multi.py, line 36, in module part = bucket.initiate_multipart_upload(objname) File /home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py, line 1742, in initiate_multipart_upload
Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?
On 07/07/2014 05:41 AM, Patrycja Szabłowska wrote: OK, the mystery is solved. From https://www.mail-archive.com/ceph-users@lists.ceph.com/msg10368.html During a multi part upload you can't upload parts smaller than 5M I've tried to upload smaller chunks, like 10KB. I've changed chunk size to 5MB and it works now. It's a pity that the Ceph's docs don't mention the limit (or I couldn't found it anywhere). And that the error wasn't helpful at all. Glad you figured it out. This is in the s3 docs [1], but the lack of error message is a regression. I added a couple tickets for this: http://tracker.ceph.com/issues/8764 http://tracker.ceph.com/issues/8766 Josh [1] http://docs.aws.amazon.com/AmazonS3/latest/API/mpUploadUploadPart.html ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?
Thank you Luis for your response. Quite unbelievable, but your solution worked! Unfortunately, I'm stuck again when trying to upload parts of the file. Apache's logs: == apache.access.log == 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT /bucketbig/ HTTP/1.1 200 477 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] POST /bucketbig/Bosphorus?uploads HTTP/1.1 200 249 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic == apache.error.log == [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from server /home/pszablow/ceph/src/htdocs/rgw.fcgi == apache.access.log == 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT /bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9partNumber=1 HTTP/1.1 500 531 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic == apache.error.log == [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200] (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to connect to server /home/pszablow/ceph/src/htdocs/rgw.fcgi: connect() failed [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from server /home/pszablow/ceph/src/htdocs/rgw.fcgi I'm using the default fastcgi module, not the one provided by Ceph. I've tried installing it on my ubuntu 14.04, but unfortunately I keep getting the error: libapache2-mod-fastcgi : requires: apache2.2-common (= 2.2.4) Is the modified fastcgi module mandatory in order to use multi part upload? Thanks, Patrycja Szabłowska 2014-07-03 18:34 GMT+02:00 Luis Periquito luis.periqu...@ocado.com: I was at this issue this morning. It seems radosgw requires you to have a pool named '' to work with multipart. I just created a pool with that name rados mkpool '' either that or allow the pool be created by the radosgw... On 3 July 2014 16:27, Patrycja Szabłowska szablowska.patry...@gmail.com wrote: Hi, I'm trying to make multi part upload work. I'm using ceph 0.80-702-g9bac31b (from the ceph's github). I've tried the code provided by Mark Kirkwood here: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html But unfortunately, it gives me the error: (multitest)pszablow@pat-desktop:~/$ python boto_multi.py begin upload of abc.yuv size 746496, 7 parts Traceback (most recent call last): File boto_multi.py, line 36, in module part = bucket.initiate_multipart_upload(objname) File /home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py, line 1742, in initiate_multipart_upload response.status, response.reason, body) boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden ?xml version=1.0 encoding=UTF-8?ErrorCodeAccessDenied/Code/Error The single part upload works for me. I am able to create buckets and objects. I've tried also other similar examples, but none of them works. Any ideas what's wrong? Does the ceph's multi part upload actually work for anybody? Thanks, Patrycja Szabłowska ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Luis Periquito Unix Engineer Ocado.com http://www.ocado.com/ Head Office, Titan Court, 3 Bishop Square, Hatfield Business Park, Hatfield, Herts AL10 9NE Notice: This email is confidential and may contain copyright material of members of the Ocado Group. Opinions and views expressed in this message may not necessarily reflect the opinions and views of the members of the Ocado Group. If you are not the intended recipient, please notify us immediately and delete all copies of this message. Please note that it is your responsibility to scan this message for viruses. References to the “Ocado Group” are to Ocado Group plc (registered in England and Wales with number 7098618) and its subsidiary undertakings (as that expression is defined in the Companies Act 2006) from time to time. The registered office of Ocado Group plc is Titan Court, 3 Bishops Square, Hatfield Business Park, Hatfield, Herts. AL10 9NE. -- Pozdrawiam Patrycja Szabłowska ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?
Still not sure do I need the ceph's modified fastcgi or not. But I guess this explains my problem with the installation: http://tracker.ceph.com/issues/8233 It would be nice to have at least a workaround for this... Thanks, Patrycja Szabłowska 2014-07-04 16:02 GMT+02:00 Patrycja Szabłowska szablowska.patry...@gmail.com: Thank you Luis for your response. Quite unbelievable, but your solution worked! Unfortunately, I'm stuck again when trying to upload parts of the file. Apache's logs: == apache.access.log == 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT /bucketbig/ HTTP/1.1 200 477 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] POST /bucketbig/Bosphorus?uploads HTTP/1.1 200 249 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic == apache.error.log == [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from server /home/pszablow/ceph/src/htdocs/rgw.fcgi == apache.access.log == 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] PUT /bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9partNumber=1 HTTP/1.1 500 531 {Referer}i Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic == apache.error.log == [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200] (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to connect to server /home/pszablow/ceph/src/htdocs/rgw.fcgi: connect() failed [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from server /home/pszablow/ceph/src/htdocs/rgw.fcgi I'm using the default fastcgi module, not the one provided by Ceph. I've tried installing it on my ubuntu 14.04, but unfortunately I keep getting the error: libapache2-mod-fastcgi : requires: apache2.2-common (= 2.2.4) Is the modified fastcgi module mandatory in order to use multi part upload? Thanks, Patrycja Szabłowska 2014-07-03 18:34 GMT+02:00 Luis Periquito luis.periqu...@ocado.com: I was at this issue this morning. It seems radosgw requires you to have a pool named '' to work with multipart. I just created a pool with that name rados mkpool '' either that or allow the pool be created by the radosgw... On 3 July 2014 16:27, Patrycja Szabłowska szablowska.patry...@gmail.com wrote: Hi, I'm trying to make multi part upload work. I'm using ceph 0.80-702-g9bac31b (from the ceph's github). I've tried the code provided by Mark Kirkwood here: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html But unfortunately, it gives me the error: (multitest)pszablow@pat-desktop:~/$ python boto_multi.py begin upload of abc.yuv size 746496, 7 parts Traceback (most recent call last): File boto_multi.py, line 36, in module part = bucket.initiate_multipart_upload(objname) File /home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py, line 1742, in initiate_multipart_upload response.status, response.reason, body) boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden ?xml version=1.0 encoding=UTF-8?ErrorCodeAccessDenied/Code/Error The single part upload works for me. I am able to create buckets and objects. I've tried also other similar examples, but none of them works. Any ideas what's wrong? Does the ceph's multi part upload actually work for anybody? Thanks, Patrycja Szabłowska ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Luis Periquito Unix Engineer Ocado.com http://www.ocado.com/ Head Office, Titan Court, 3 Bishop Square, Hatfield Business Park, Hatfield, Herts AL10 9NE Notice: This email is confidential and may contain copyright material of members of the Ocado Group. Opinions and views expressed in this message may not necessarily reflect the opinions and views of the members of the Ocado Group. If you are not the intended recipient, please notify us immediately and delete all copies of this message. Please note that it is your responsibility to scan this message for viruses. References to the “Ocado Group” are to Ocado Group plc (registered in England and Wales with number 7098618) and its subsidiary undertakings (as that expression is defined in the Companies Act 2006) from time to time. The registered office of Ocado Group plc is Titan Court, 3 Bishops Square, Hatfield Business Park, Hatfield, Herts. AL10 9NE. -- Pozdrawiam Patrycja Szabłowska ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Multipart upload on ceph 0.8 doesn't work?
Hi, I'm trying to make multi part upload work. I'm using ceph 0.80-702-g9bac31b (from the ceph's github). I've tried the code provided by Mark Kirkwood here: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html But unfortunately, it gives me the error: (multitest)pszablow@pat-desktop:~/$ python boto_multi.py begin upload of abc.yuv size 746496, 7 parts Traceback (most recent call last): File boto_multi.py, line 36, in module part = bucket.initiate_multipart_upload(objname) File /home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py, line 1742, in initiate_multipart_upload response.status, response.reason, body) boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden ?xml version=1.0 encoding=UTF-8?ErrorCodeAccessDenied/Code/Error The single part upload works for me. I am able to create buckets and objects. I've tried also other similar examples, but none of them works. Any ideas what's wrong? Does the ceph's multi part upload actually work for anybody? Thanks, Patrycja Szabłowska ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?
I was at this issue this morning. It seems radosgw requires you to have a pool named '' to work with multipart. I just created a pool with that name rados mkpool '' either that or allow the pool be created by the radosgw... On 3 July 2014 16:27, Patrycja Szabłowska szablowska.patry...@gmail.com wrote: Hi, I'm trying to make multi part upload work. I'm using ceph 0.80-702-g9bac31b (from the ceph's github). I've tried the code provided by Mark Kirkwood here: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html But unfortunately, it gives me the error: (multitest)pszablow@pat-desktop:~/$ python boto_multi.py begin upload of abc.yuv size 746496, 7 parts Traceback (most recent call last): File boto_multi.py, line 36, in module part = bucket.initiate_multipart_upload(objname) File /home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py, line 1742, in initiate_multipart_upload response.status, response.reason, body) boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden ?xml version=1.0 encoding=UTF-8?ErrorCodeAccessDenied/Code/Error The single part upload works for me. I am able to create buckets and objects. I've tried also other similar examples, but none of them works. Any ideas what's wrong? Does the ceph's multi part upload actually work for anybody? Thanks, Patrycja Szabłowska ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Luis Periquito Unix Engineer Ocado.com http://www.ocado.com/ Head Office, Titan Court, 3 Bishop Square, Hatfield Business Park, Hatfield, Herts AL10 9NE -- Notice: This email is confidential and may contain copyright material of members of the Ocado Group. Opinions and views expressed in this message may not necessarily reflect the opinions and views of the members of the Ocado Group. If you are not the intended recipient, please notify us immediately and delete all copies of this message. Please note that it is your responsibility to scan this message for viruses. References to the “Ocado Group” are to Ocado Group plc (registered in England and Wales with number 7098618) and its subsidiary undertakings (as that expression is defined in the Companies Act 2006) from time to time. The registered office of Ocado Group plc is Titan Court, 3 Bishops Square, Hatfield Business Park, Hatfield, Herts. AL10 9NE. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com