[ceph-users] Re: RGW/Lua script does not show logs

Hi Lee, RGWDebugLog logs at the debug level. Do you have the correct logging levels on your rados gateways? Should be 20. Cheers, Tom On Mon, 8 Apr 2024 at 23:31, wrote: > Hello, I wrote a Lua script in order to retrieve RGW logs such as bucket > name, bucket owner, etc. > However, when I

[ceph-users] Re: Setting S3 bucket policies with multi-tenants

updates - https://docs.ceph.com/en/quincy/radosgw/bucketpolicy/ to indicate that usfolks in the example is the tenant name? On Wed, 1 Nov 2023 at 18:27, Thomas Bennett wrote: > Hi, > > I'm running Ceph Quincy (17.2.6) with a rados-gateway. I have muti > tenants, for example: >

[ceph-users] Setting S3 bucket policies with multi-tenants

Hi, I'm running Ceph Quincy (17.2.6) with a rados-gateway. I have muti tenants, for example: - Tenant1$manager - Tenant1$readwrite I would like to set a policy on a bucket (backups for example) owned by *Tenant1$manager* to allow *Tenant1$readwrite* access to that bucket. I can't find any

[ceph-users] Re: S3 user with more than 1000 buckets

ally like > ListObjectsv1 if the S3 client provides the appropriate "marker" parameter > values. COS does this too, I noticed. I'm not sure which S3 clients can > be relied on to do this, though. > > Matt > > On Tue, Oct 3, 2023 at 9:06 AM Thomas Bennett wrote: >

[ceph-users] Re: S3 user with more than 1000 buckets

; Hi, > > You should increase these default settings: > > rgw_list_buckets_max_chunk // for buckets > rgw_max_listing_results // for objects > > On Tue, Oct 3, 2023 at 12:59 PM Thomas Bennett wrote: > >> Hi, >> >> I'm running a Ceph 17.2.5 Rados Gateway and I

[ceph-users] S3 user with more than 1000 buckets

Hi, I'm running a Ceph 17.2.5 Rados Gateway and I have a user with more than 1000 buckets. When the client tries to list all their buckets using s3cmd, rclone and python boto3, they all three only ever return the first 1000 bucket names. I can confirm the buckets are all there (and more than

[ceph-users] Dashboard daemon logging not working

Hey, Has anyone else had issues with exploring Loki after deploying ceph monitoring services ? I'm running 17.2.6. When clicking on the Ceph dashboard daemon logs (i.e Cluster -> Logs -> Daemon Logs), it took me through to an embedded

[ceph-users] Re: Best practice for expanding Ceph cluster

-hooks Cheers, Tom On Wed, 17 May 2023 at 14:40, Thomas Bennett wrote: > Hey, > > A question slightly related to this: > > > I would suggest that you add all new hosts and make the OSDs start >> > with a super-low initial weight (0.0001 or so), which means

[ceph-users] Re: Best practice for expanding Ceph cluster

Hey, A question slightly related to this: > I would suggest that you add all new hosts and make the OSDs start > > with a super-low initial weight (0.0001 or so), which means they will > > be in and up, but not receive any PGs. Is it possible to have the correct weight set and use ceph osd set

[ceph-users] Re: Lua scripting in the rados gateway

: cephadm shell radosgw-admin script put --infile=/rootfs/tmp/preRequest.lua --context=preRequest This injects the lua script into the pre request context. Cheers, Tom On Fri, 28 Apr 2023 at 15:19, Thomas Bennett wrote: > Hey Yuval, > > No problem. It was interesting to me to figur

[ceph-users] osd pause

Hi, FYI - This might be pedantic, but there does not seem to be any difference between using these two sets of commands: - ceph osd pause / ceph osd unpause - ceph osd set pause / ceph osd unset pause I can see that they both set/unset the pauserd,pausewr flags, but since they don't

[ceph-users] Re: Lua scripting in the rados gateway

er tested in a cephadm deployment :-( > Opened a tracker: https://tracker.ceph.com/issues/59574 to make sure this > would work out of the box. > > Yuval > > > On Tue, Apr 25, 2023 at 10:25 PM Thomas Bennett wrote: > >> Hi ceph users, >> >> I've been trying

[ceph-users] Re: For suggestions and best practices on expanding Ceph cluster and removing old nodes

p; Tricks" section of the docs. > > -- dan > > __ > Clyso GmbH | https://www.clyso.com > > > > > On Wed, Apr 26, 2023 at 7:46 AM Thomas Bennett wrote: > > > > I would second Joachim's suggestion - this is exactly what we're in t

[ceph-users] Re: For suggestions and best practices on expanding Ceph cluster and removing old nodes

I would second Joachim's suggestion - this is exactly what we're in the process of doing for a client, i.e migrating from Luminous to Quincy. However below would also work if you're moving to Nautilus. The only catch with this plan would be if you plan to reuse any hardware - i.e the hosts

[ceph-users] Lua scripting in the rados gateway

Hi ceph users, I've been trying out the lua scripting for the rados gateway (thanks Yuval). As in my previous email I mentioned that there is an error when trying to load the luasocket module. However, I thought it was a good time to report on my progress. My 'hello world' example below is

[ceph-users] Rados gateway lua script-package error lib64

Hi, I've noticed that when my lua script runs I get the following error on my radosgw container. It looks like the lib64 directory is not included in the path when looking for shared libraries. Copying the content of lib64 into the lib directory solves the issue on the running container. Here

[ceph-users] Re: Ceph Object Gateway and lua scripts

ash when using the lua "CopyFrom" > field.Opened a tracker: https://tracker.ceph.com/issues/59381Will > <https://tracker.ceph.com/issues/59381Will> > fix SASP and keep you updated.YuvalOn Wed, Apr 5, 2023 at 6:58 PM Thomas > Bennet

[ceph-users] Ceph Object Gateway and lua scripts

Hi, We're currently testing out lua scripting in the Ceph Object Gateway (Radosgw). Ceph version: 17.2.5 We've tried a simple experiment with the simple lua script which is based on the documentation (see fixed width text below). However, the issue we're having is that we can't find the log

[ceph-users] Re: speed up individual backfills

092 092 010Pre-fail Always - *31688* Lots of reallocated sectors, so the drive was "working" but not usable. In the end it had nothing to do with Ceph at all. Regards, On Thu, Jun 4, 2020 at 1:59 PM Thomas Bennett wrote: > Hi, > > I have 1562

[ceph-users] speed up individual backfills

Hi, I have 15628 misplaced objects that are currently backfilling as follows: 1. pgid:14.3ce1 from:osd.1321 to:osd.3313 2. pgid:14.4dd9 from:osd.1693 to:osd.2980 3. pgid:14.680b from:osd.362 to:osd.3313 These are remnant backfills from a pg-upmap/rebalance campaign after we've added 2

[ceph-users] pg-upmap-items

Hi, I've been using pg-upmap items both in the ceph balancer and by hand running osdmaptool for a while now (on Ceph 12.2.13). But I've noticed a side effect of up-map-items which can sometimes lead to some unnecessary data movement. My understanding is that the ceph osdmap keeps track of

[ceph-users] Re: Aging in S3 or Moving old data to slow OSDs

Hi Khodayar, Yes, you are correct. I would have to move objects manually between (more > than one) buckets if I use "Pool placements and Storage classes" > > So you have successfully used this method and it was OK? > After we set up the new placement rule in the zone and zonegroups we modified

[ceph-users] Re: Large omap

the default 1. > > -- > May the most significant bit of your life be positive. > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > -- Thomas Bennett Storage Engineer at SARAO ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Re: Aging in S3 or Moving old data to slow OSDs

_ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > -- Thomas Bennett Storage Engineer at SARAO ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Re: Adding new non-containerised hosts to current contanerised environment and moving away from containers forward

of Cape Town > > Tel: 021 959 4137 <0219592327> > Web: www.idia.ac.za <http://www.uwc.ac.za/> > E-mail (IDIA): jer...@idia.ac.za > Rondebosch, Cape Town, 7600, South Africa > ___________ > ceph-us

[ceph-users] Re: Lower mem radosgw config?

ers mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > -- Thomas Bennett Storage Engineer at SARAO ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io