Re: [ceph-users] Luminous 12.2.1 - RadosGW Multisite doesnt replicate multipart uploads

2017-10-12 Thread Casey Bodley
Thanks Enrico. I wrote a test case that reproduces the issue, and opened http://tracker.ceph.com/issues/21772 to track the bug. It sounds like this is a regression in luminous. On 10/11/2017 06:41 PM, Enrico Kern wrote: or this: { "shard_id": 22, "entries": [ {

Re: [ceph-users] Luminous 12.2.1 - RadosGW Multisite doesnt replicate multipart uploads

2017-10-11 Thread Enrico Kern
or this: { "shard_id": 22, "entries": [ { "id": "1_1507761448.758184_10459.1", "section": "data", "name": "testbucket:6a9448d2-bdba-4bec-aad6-aba72cd8eac6.21344646.3/Wireshark-win64-2.2.7.exe", "timestam

Re: [ceph-users] Luminous 12.2.1 - RadosGW Multisite doesnt replicate multipart uploads

2017-10-11 Thread Enrico Kern
its 45MB, but it happens with all multipart uploads. sync error list shows { "shard_id": 31, "entries": [ { "id": "1_1507761459.607008_8197.1", "section": "data", "name": "testbucket:6a9448d2-bdba-4bec-aad6-aba72cd8eac

Re: [ceph-users] Luminous 12.2.1 - RadosGW Multisite doesnt replicate multipart uploads

2017-10-11 Thread Yehuda Sadeh-Weinraub
What is the size of the object? Is it only this one? Try this command: 'radosgw-admin sync error list'. Does it show anything related to that object? Thanks, Yehuda On Wed, Oct 11, 2017 at 3:26 PM, Enrico Kern wrote: > if i change permissions the sync status shows that it is syncing 1 shard,

Re: [ceph-users] Luminous 12.2.1 - RadosGW Multisite doesnt replicate multipart uploads

2017-10-11 Thread Enrico Kern
in addition i noticed that if you delete a bucket that had multipart upload files which were not replicated in it that the files are not deleted in the pool, while the bucket is gone the data stil remains in the pool where the multipart upload was initiated. On Thu, Oct 12, 2017 at 12:26 AM, Enric

Re: [ceph-users] Luminous 12.2.1 - RadosGW Multisite doesnt replicate multipart uploads

2017-10-11 Thread Enrico Kern
if i change permissions the sync status shows that it is syncing 1 shard, but no files ends up in the pool (testing with empty data pool). after a while it shows that data is back in sync but there is no file On Wed, Oct 11, 2017 at 11:26 PM, Yehuda Sadeh-Weinraub wrote: > Thanks for your report

Re: [ceph-users] Luminous 12.2.1 - RadosGW Multisite doesnt replicate multipart uploads

2017-10-11 Thread Yehuda Sadeh-Weinraub
Thanks for your report. We're looking into it. You can try to see if touching the object (e.g., modifying its permissions) triggers the sync. Yehuda On Wed, Oct 11, 2017 at 1:36 PM, Enrico Kern wrote: > Hi David, > > yeah seems you are right, they are stored as different filenames in the > data

Re: [ceph-users] Luminous 12.2.1 - RadosGW Multisite doesnt replicate multipart uploads

2017-10-11 Thread Enrico Kern
Hi David, yeah seems you are right, they are stored as different filenames in the data bucket when using multisite upload. But anyway it stil doesnt get replicated. As example i have files like 6a9448d2-bdba-4bec-aad6-aba72cd8eac6.21344646.1__multipart_Wireshark-win64-2.2.7.exe.2~0LAfq93OMdk7hrij

Re: [ceph-users] Luminous 12.2.1 - RadosGW Multisite doesnt replicate multipart uploads

2017-10-11 Thread David Turner
Multipart is a client side setting when uploading. Multisite in and of itself is a client and it doesn't use multipart (at least not by default). I have a Jewel RGW Multisite cluster and one site has the object as multi-part while the second site just has it as a single object. I had to change fr

[ceph-users] Luminous 12.2.1 - RadosGW Multisite doesnt replicate multipart uploads

2017-10-11 Thread Enrico Kern
Hi all, i just setup multisite replication according to the docs from http://docs.ceph.com/docs/master/radosgw/multisite/ and everything works except that if a client uploads via multipart the files dont get replicated. If i in one zone rename a file that was uploaded via multipart it gets replic