[ceph-users] Re: [EXTERNAL] Re: RGW Bucket Notifications and MultiPart Uploads

2022-08-04 Thread Yuval Lifshitz
, July 21, 2022 at 12:21 AM > *To: *Mark Selby > *Cc: *"d...@redhat.com" , "ceph-users@ceph.io" < > ceph-users@ceph.io> > *Subject: *Re: [ceph-users] Re: [EXTERNAL] Re: RGW Bucket Notifications > and MultiPart Uploads > > > > Hi Mark,

[ceph-users] Re: [EXTERNAL] Re: RGW Bucket Notifications and MultiPart Uploads

2022-07-21 Thread Mark Selby
Re: [ceph-users] Re: [EXTERNAL] Re: RGW Bucket Notifications and MultiPart Uploads Hi Mark, Starting from quincy, we send 1 notification, "ObjectCreated:CompleteMultipartUpload", when the upload is complete. See: https://docs.ceph.com/en/quincy/radosgw/s3-notification-com

[ceph-users] Re: [EXTERNAL] Re: RGW Bucket Notifications and MultiPart Uploads

2022-07-21 Thread Yuval Lifshitz
Hi Mark, Starting from quincy, we send 1 notification, "ObjectCreated:CompleteMultipartUpload", when the upload is complete. See: https://docs.ceph.com/en/quincy/radosgw/s3-notification-compatibility/ We don't send the "ObjectCreated:Post" notification when the upload starts as it will be confusing

[ceph-users] Re: [EXTERNAL] Re: RGW Bucket Notifications and MultiPart Uploads

2022-07-20 Thread Mark Selby
I have not tested with Quincy/17.x yet so I do not know which notifications are sent for Multipart uploads in this release set. I know that for Pacific.16.x I needed to add some code/logic to only act on notifications that represented the end state of an Object creation. My tests show that when

[ceph-users] Re: [EXTERNAL] Re: RGW Bucket Notifications and MultiPart Uploads

2022-07-20 Thread Daniel Gryniewicz
Seems like the notification for a multipart upload should look different to a normal upload? Daniel On 7/20/22 08:53, Yehuda Sadeh-Weinraub wrote: Can maybe leverage one of the other calls to check for upload completion: list multipart uploads and/or list parts. The latter should work if you h

[ceph-users] Re: [EXTERNAL] Re: RGW Bucket Notifications and MultiPart Uploads

2022-07-20 Thread Yehuda Sadeh-Weinraub
Can maybe leverage one of the other calls to check for upload completion: list multipart uploads and/or list parts. The latter should work if you have the upload id at hand. Yehuda On Wed, Jul 20, 2022, 8:40 AM Casey Bodley wrote: > On Wed, Jul 20, 2022 at 12:57 AM Yuval Lifshitz > wrote: > >

[ceph-users] Re: [EXTERNAL] Re: RGW Bucket Notifications and MultiPart Uploads

2022-07-20 Thread Casey Bodley
On Wed, Jul 20, 2022 at 12:57 AM Yuval Lifshitz wrote: > > yes, that would work. you would get a "404" until the object is fully > uploaded. just note that you won't always get 404 before multipart complete, because multipart uploads can overwrite existing objects ___

[ceph-users] Re: [EXTERNAL] Re: RGW Bucket Notifications and MultiPart Uploads

2022-07-19 Thread Yuval Lifshitz
yes, that would work. you would get a "404" until the object is fully uploaded. On Tue, Jul 19, 2022 at 6:00 PM Mark Selby wrote: > If you can that would be great. As it is likely to be a while before we > make the 16 -> 17 switch. > > > > Question: If I receive the 1st put notification for the

[ceph-users] Re: [EXTERNAL] Re: RGW Bucket Notifications and MultiPart Uploads

2022-07-19 Thread Mark Selby
If you can that would be great. As it is likely to be a while before we make the 16 -> 17 switch. Question: If I receive the 1st put notification for the partial object and I check RGW to see if the object actually exists – do you know if RGW will tell me that it is missing until the Object