OK, the mystery is solved. >From https://www.mail-archive.com/ceph-users@lists.ceph.com/msg10368.html "During a multi part upload you can't upload parts smaller than 5M"
I've tried to upload smaller chunks, like 10KB. I've changed chunk size to 5MB and it works now. It's a pity that the Ceph's docs don't mention the limit (or I couldn't found it anywhere). And that the error wasn't helpful at all. Cheers, Patrycja Szabłowska 2014-07-07 14:05 GMT+02:00 Patrycja Szabłowska < szablowska.patry...@gmail.com>: > I've installed Ubuntu 12.04 in order to test multiupload with the ceph's > modified fastcgi (according to this: > https://ceph.com/docs/master/install/install-ceph-gateway/#apache-fastcgi-w-100-continue > ). > > The problem is still the same: I can initiate the multi part upload or > upload single part, but when trying to put a part of multi part upload I > get the error with Fastcgi as I've shown before. > > Here's a part of the error log once again: > > > ==> apache.error.log <== > [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client > 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from > server "/home/pszablow/ceph/src/htdocs/rgw.fcgi" > [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200] > (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to > connect to server "/home/pszablow/ceph/src/htdocs/rgw.fcgi": connect() > failed > [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client > 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from > server "/home/pszablow/ceph/src/htdocs/rgw.fcgi" > > > It seems to me that it doesn't matter if I turn the rgw print continue on > or off. > > I've got no idea what to try next to make it work... Are there any other > pools needed to put parts in upload? > > > Thanks, > > Patrycja Szabłowska > > > > 2014-07-04 16:26 GMT+02:00 Patrycja Szabłowska < > szablowska.patry...@gmail.com>: > > Still not sure do I need the ceph's modified fastcgi or not. >> But I guess this explains my problem with the installation: >> http://tracker.ceph.com/issues/8233 >> >> >> It would be nice to have at least a workaround for this... >> >> Thanks, >> >> Patrycja Szabłowska >> >> >> >> 2014-07-04 16:02 GMT+02:00 Patrycja Szabłowska < >> szablowska.patry...@gmail.com>: >> >> Thank you Luis for your response. >>> >>> Quite unbelievable, but your solution worked! >>> Unfortunately, I'm stuck again when trying to upload parts of the file. >>> >>> Apache's logs: >>> >>> >>> ==> apache.access.log <== >>> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT /bucketbig/ HTTP/1.1" >>> 200 477 "{Referer}i" "Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic" >>> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "POST >>> /bucketbig/Bosphorus?uploads HTTP/1.1" 200 249 "{Referer}i" "Boto/2.30.0 >>> Python/2.7.6 Linux/3.13.0-30-generic" >>> >>> ==> apache.error.log <== >>> [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client >>> 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from >>> server "/home/pszablow/ceph/src/htdocs/rgw.fcgi" >>> >>> ==> apache.access.log <== >>> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT >>> /bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9&partNumber=1 >>> HTTP/1.1" 500 531 "{Referer}i" "Boto/2.30.0 Python/2.7.6 >>> Linux/3.13.0-30-generic" >>> >>> ==> apache.error.log <== >>> [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200] >>> (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to >>> connect to server "/home/pszablow/ceph/src/htdocs/rgw.fcgi": connect() >>> failed >>> [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client >>> 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from >>> server "/home/pszablow/ceph/src/htdocs/rgw.fcgi" >>> >>> >>> >>> I'm using the default fastcgi module, not the one provided by Ceph. I've >>> tried installing it on my ubuntu 14.04, but unfortunately I keep getting >>> the error: >>> >>> libapache2-mod-fastcgi : requires: apache2.2-common (>= 2.2.4) >>> >>> >>> Is the modified fastcgi module mandatory in order to use multi part >>> upload? >>> >>> >>> Thanks, >>> >>> Patrycja Szabłowska >>> >>> >>> 2014-07-03 18:34 GMT+02:00 Luis Periquito <luis.periqu...@ocado.com>: >>> >>>> I was at this issue this morning. It seems radosgw requires you to have >>>> a pool named '' to work with multipart. I just created a pool with that >>>> name >>>> rados mkpool '' >>>> >>>> either that or allow the pool be created by the radosgw... >>>> >>>> >>>> On 3 July 2014 16:27, Patrycja Szabłowska < >>>> szablowska.patry...@gmail.com> wrote: >>>> >>>>> Hi, >>>>> >>>>> I'm trying to make multi part upload work. I'm using ceph >>>>> 0.80-702-g9bac31b (from the ceph's github). >>>>> >>>>> I've tried the code provided by Mark Kirkwood here: >>>>> >>>>> >>>>> http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html >>>>> >>>>> >>>>> But unfortunately, it gives me the error: >>>>> >>>>> (multitest)pszablow@pat-desktop:~/$ python boto_multi.py >>>>> begin upload of abc.yuv >>>>> size 7464960000, 7 parts >>>>> Traceback (most recent call last): >>>>> File "boto_multi.py", line 36, in <module> >>>>> part = bucket.initiate_multipart_upload(objname) >>>>> File >>>>> "/home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py", >>>>> line 1742, in initiate_multipart_upload >>>>> response.status, response.reason, body) >>>>> boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden >>>>> <?xml version="1.0" >>>>> encoding="UTF-8"?><Error><Code>AccessDenied</Code></Error> >>>>> >>>>> >>>>> The single part upload works for me. I am able to create buckets and >>>>> objects. >>>>> I've tried also other similar examples, but none of them works. >>>>> >>>>> >>>>> Any ideas what's wrong? Does the ceph's multi part upload actually >>>>> work for anybody? >>>>> >>>>> >>>>> Thanks, >>>>> >>>>> Patrycja Szabłowska >>>>> _______________________________________________ >>>>> ceph-users mailing list >>>>> ceph-users@lists.ceph.com >>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>> >>>> >>>> >>>> >>>> -- >>>> >>>> Luis Periquito >>>> >>>> Unix Engineer >>>> >>>> Ocado.com <http://www.ocado.com/> >>>> >>>> Head Office, Titan Court, 3 Bishop Square, Hatfield Business Park, >>>> Hatfield, Herts AL10 9NE >>>> >>>> Notice: This email is confidential and may contain copyright material >>>> of members of the Ocado Group. Opinions and views expressed in this message >>>> may not necessarily reflect the opinions and views of the members of the >>>> Ocado Group. >>>> >>>> If you are not the intended recipient, please notify us immediately and >>>> delete all copies of this message. Please note that it is your >>>> responsibility to scan this message for viruses. >>>> >>>> References to the “Ocado Group” are to Ocado Group plc (registered in >>>> England and Wales with number 7098618) and its subsidiary undertakings (as >>>> that expression is defined in the Companies Act 2006) from time to time. >>>> The registered office of Ocado Group plc is Titan Court, 3 Bishops Square, >>>> Hatfield Business Park, Hatfield, Herts. AL10 9NE. >>>> >>> >>> >>> >>> -- >>> Pozdrawiam >>> Patrycja Szabłowska >>> >> >> >> >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
