[ceph-users] Re: Check allocated RGW bucket/object size after enabling Bluestore compression
On Thu, Aug 17, 2023 at 12:14 PM wrote: > > Hello, > > Yes, I can see that there are metrics to check the size of the compressed > data stored in a pool with ceph df detail (relevant columns are USED COMPR > and UNDER COMPR) > > Also the size of compressed data can be checked on osd level using perf dump > (relevant values "bluestore_compressed_allocated": and > "bluestore_compressed_original") > > I would like to see the size of the compressed data per S3 bucket and not > only per pool or osd. > > Is that even possible ? bluestore's compression is at a different layer than rgw's compression: https://docs.ceph.com/en/reef/radosgw/compression/ 'radosgw-admin bucket stats' can report on the latter (size vs. size_utilized), but i don't believe rgw has any visibility into bluestore's compression > > Thanks > Yosr > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: Check allocated RGW bucket/object size after enabling Bluestore compression
Hello, Yes, I can see that there are metrics to check the size of the compressed data stored in a pool with ceph df detail (relevant columns are USED COMPR and UNDER COMPR) Also the size of compressed data can be checked on osd level using perf dump (relevant values "bluestore_compressed_allocated": and "bluestore_compressed_original") I would like to see the size of the compressed data per S3 bucket and not only per pool or osd. Is that even possible ? Thanks Yosr ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: Check allocated RGW bucket/object size after enabling Bluestore compression
Hi, > On 17 Aug 2023, at 18:21, yosr.kchao...@gmail.com wrote: > > Thanks for your reply. By the Bluestore compression I mean the compression > enabled on the pool level. It is also called inline compression. > https://docs.ceph.com/en/reef/rados/configuration/bluestore-config-ref/#inline-compression > > Do you see what I mean now ? Yes, you can check metrics 'compress_bytes_used', 'compress_under_bytes', see [1] [1] https://github.com/ceph/ceph/pull/37289 k ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: Check allocated RGW bucket/object size after enabling Bluestore compression
Hello Konstantin, Thanks for your reply. By the Bluestore compression I mean the compression enabled on the pool level. It is also called inline compression. https://docs.ceph.com/en/reef/rados/configuration/bluestore-config-ref/#inline-compression Do you see what I mean now ? Thanks Yosr ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: Check allocated RGW bucket/object size after enabling Bluestore compression
Hi, What you mean, Bluestore compression? The rgw compression is a rados compression, not the compress by rgw itself. You can setup different storage classes and upload to same pool uncompressed, or compressed objects The compression ratio you can determine with exporter [1] [1] https://github.com/blemmenes/radosgw_usage_exporter k Sent from my iPhone > On 17 Aug 2023, at 17:58, yosr.kchao...@gmail.com wrote: > I see that if we enable RGW compression, we can see the actual (before > compression) and utilized (after compression) size of the bucket. > Is it possible to find the same information but with Bluestore compression ? ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
