[ceph-users] Manual resharding with multisite

Hi folks, I am aware that dynamic resharding isn't supported before Reef with multisite. However, does manual resharding work? It doesn't seem to be so, either. First of all, running "bucket reshard" has to be in the master zone. But if the objects of that bucket isn't in the master zone,

[ceph-users] Re: Rados object transformation

, 2023 at 4:43 PM Yixin Jin wrote: > > Hi folks, > Is it possible through object classes to transform object content? For > example, I'd like this transformer to change the content of the object when > it is read and when it is written. In this way, I can potentially encrypt the &

[ceph-users] Rados object transformation

Hi folks, Is it possible through object classes to transform object content? For example, I'd like this transformer to change the content of the object when it is read and when it is written. In this way, I can potentially encrypt the object content in storage without the need to make ceph/osd

[ceph-users] Re: [multisite] The purpose of zonegroup

ide some flexibility to control the isolation of data and metadata separately On Thu, Jun 29, 2023 at 5:48 PM Yixin Jin wrote: > > Hi folks, > In the multisite environment, we can get one realm that contains multiple > zonegroups, each in turn can have multiple zones. However, the purpose o

[ceph-users] [multisite] The purpose of zonegroup

Hi folks, In the multisite environment, we can get one realm that contains multiple zonegroups, each in turn can have multiple zones. However, the purpose of zonegroup isn't clear to me. It seems that when a user is created, its metadata is synced to all zones within the same realm, regardless

[ceph-users] Re: [multisite] period update and zonegroup

Mystery solved. I loaded the zonegroup up with 100K hostnanes. That caused the period to fail to decode when other zones try to pick up the new period. Apparently, there is a size limit on how big zonegroup info can be but implicitly.  Regards, Yixin Sent from Yahoo Mail on Android

[ceph-users] [multisite] period update and zonegroup

Hi folks, Has anyone experienced the situation where "radosgw-admin period get" shows the latest zonegroup information but "radosgw-admin zonegroup get" shows the old one? I am now seeing this with v17.2.6. I used to play with v17.2.5 but never saw this situation. I tried to do various "period

[ceph-users] [rgw multisite] Perpetual behind

Hi ceph gurus, I am experimenting with rgw multisite sync feature using Quincy release (17.2.5). I am using the zone-level sync, not bucket-level sync policy. During my experiment, somehow my setup got into a situation that it doesn't seem to get out of. One zone is perpetually behind the

[ceph-users] [rgw] Multi-zone per storage cluster

Hi folks, For multi-site environment, it seems that the common practice is to have one rgw zone backed by one storage cluster. However, after gaining some experience with such a setup, it appears to me that it is possible to have multiple zones with the same storage cluster. The first evidence

[ceph-users] Bucket-level redirect_zone

Hi folks, I created a feature request ticket to call for bucket-level redirect_zone (https://tracker.ceph.com/issues/61199), which is basically an extension from zone-level redirect_zone. I found it helpful in realizing CopyObject with (x-copy-source) in multisite environments where bucket

[ceph-users] multisite sync and multipart uploads

Hi guys, With Quincy release, does anyone know how multisite sync deals with multipart uploads? I mean those part objects of some incomplete multipart uploads. Are those objects also sync-ed over either with full-sync or incremental sync? I did a quick experiment and notice that these objects

[ceph-users] multisite synchronization and multipart uploads

Hi folks, ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] [multisite] "bucket sync status" takes a while

Hi folks, With a multi-site environment, when I create a bucket-level sync policy with a symmetric flow between the master zone and another zone, "bucket sync status" immediately shows that the sync is now enabled in the master zone. But it takes a while for it to show that in the other zone.

[ceph-users] [multisite] Resetting an empty bucket

Hi folks, Armed with bucket-specific sync policy feature, I found that we could move objects of a bucket between zones. It is migration via sync followed by object removal at the source. This allows us to better utilize available capacities in different clusters/zones. However, to achieve

[ceph-users] Reset a bucket in a zone

Hi folks, Within a zonegroup, once a bucket is created, its metadata is sync-ed over to all zones. With bucket-level sync policy, however, its content may or may not be sync-ed over. To simplify the sync process, sometime I'd like to pick the bucket in a zone as the absolute truth and sync its

[ceph-users] Re: Bucket sync policy

Re-post my rely to make sure it goes through the mailing list. - Forwarded Message - From: Yixin Jin To: Soumya Koduri Sent: Monday, April 24, 2023 at 02:37:46 p.m. EDTSubject: Re: [ceph-users] Re: Bucket sync policy An update: After creating and enabling the bucket sync policy, I

[ceph-users] Re: Bucket sync policy

Actually, "bucket sync run" somehow made it worse since now the destination zone shows "bucket is caught up with source" from "bucket sync status" even though it clearly missed an object. On Monday, April 24, 2023 at 02:37:46 p.m. EDT, Yixin Jin wrote:

[ceph-users] Bucket sync policy

Hello ceph gurus, We are trying bucket-specific sync policy feature with Quincy release and we encounter something strange. Our test setup is very simple. I use mstart.sh to spin up 3 clusters, configure them with a single realm, a single zonegroup and 3 zones – z0, z1, z2, with z0 being the