[ceph-users] rgw replication sync issue

2023-08-23 Thread ankit raikwar
Hello Users, We have the environment as below. Both environments are the zones of one RGW multisite zonegroup, whereas the DC zone is the primary and the DR zone is the secondary at this point. DC Ceph Version: 17.2.6 (d7ff0d10654d2280e08f1ab989c7cdf3064446a5) quincy (stable) Numb

[ceph-users] Re: CephFS: convert directory into subvolume

2023-08-23 Thread Milind Changire
well, you should've used the ceph command to create the subvol it's much simpler that way $ ceph fs subvolume create mycephfs subvol2 The above command creates a new subvol (subvol2) in the default subvolume group. So, in your case the actual path to the subvolume would be /mnt/volumes/_nogroup/

[ceph-users] Re: 16.2.14 pacific QE validation status

2023-08-23 Thread Laura Flores
Rados summary is here: https://tracker.ceph.com/projects/rados/wiki/PACIFIC#Pacific-v16214-httpstrackercephcomissues62527note-1 Most are known, except for two new trackers I raised: 1. https://tracker.ceph.com/issues/62557 - rados/dashboard: Teuthology test failure due to "MDS_CLIENTS_LAGGY

[ceph-users] Re: Rados object transformation

2023-08-23 Thread Casey Bodley
you could potentially create a cls_crypt object class that exposes functions like crypt_read() and crypt_write() to do this. but your application would have to use cls_crypt for all reads/writes instead of the normal librados read/write operations. would that work for you? On Wed, Aug 23, 2023 at

[ceph-users] Re: snaptrim number of objects

2023-08-23 Thread Angelo Hongens
On 23/08/2023 08:27, Sridhar Seshasayee wrote: This also leads me to agree with you there's 'something wrong' with the mclock scheduler. I was almost starting to suspect hardware issues or something like that, I was at my wit's end. Could you update this thread with the exact qui

[ceph-users] Rados object transformation

2023-08-23 Thread Yixin Jin
Hi folks, Is it possible through object classes to transform object content? For example, I'd like this transformer to change the content of the object when it is read and when it is written. In this way, I can potentially encrypt the object content in storage without the need to make ceph/osd t

[ceph-users] Re: User + Dev Monthly Meeting happening next week

2023-08-23 Thread Laura Flores
The User + Dev Monthly Meeting will be held tomorrow,* Thursday, August 24th* *@ 2:00 PM UTC *at this link: https://meet.jit.si/ceph-user-dev-monthly Please add any topics you'd like to discuss to the agenda! https://pad.ceph.com/p/ceph-user-dev-monthly-minutes Thanks, Laura Flores On Tue, Aug 1

[ceph-users] Re: 16.2.14 pacific QE validation status

2023-08-23 Thread Laura Flores
Thanks Yuri! I will take a look for rados and get back to this thread. On Wed, Aug 23, 2023 at 9:41 AM Yuri Weinstein wrote: > Details of this release are summarized here: > > https://tracker.ceph.com/issues/62527#note-1 > Release Notes - TBD > > Seeking approvals for: > > smoke - Venky > rados

[ceph-users] Re: Patch change for CephFS subvolume

2023-08-23 Thread Eugen Block
Okay, that works, I didn't realize I need a group for that. Maybe that's something for the docs to clarify a bit. Zitat von Anh Phan Tuan : Not really sure what you want, but for simplicity, just move folder to following structure: /volumes/[Sub Volume Group Name]/[Sub Volume Name] ceph wil

[ceph-users] Re: cephadm to setup wal/db on nvme

2023-08-23 Thread Adam King
this should be possible by specifying a "data_devices" and "db_devices" fields in the OSD spec file each with different filters. There's some examples in the docs https://docs.ceph.com/en/latest/cephadm/services/osd/#the-simple-case that show roughly how that's done, and some other sections ( https

[ceph-users] cephadm to setup wal/db on nvme

2023-08-23 Thread Satish Patel
Folks, I have 3 nodes with each having 1x NvME (1TB) and 3x 2.9TB SSD. Trying to build ceph storage using cephadm on Ubuntu 22.04 distro. If I want to use NvME for Journaling (WAL/DB) for my SSD based OSDs then how does cephadm handle it? Trying to find a document where I can tell cephadm to dep

[ceph-users] Re: Patch change for CephFS subvolume

2023-08-23 Thread Anh Phan Tuan
Not really sure what you want, but for simplicity, just move folder to following structure: /volumes/[Sub Volume Group Name]/[Sub Volume Name] ceph will recognize it (no extend attr needed), if you use subvolumegroup name difference than "_nogroup", you must provide it in all subvolume command [-

[ceph-users] 16.2.14 pacific QE validation status

2023-08-23 Thread Yuri Weinstein
Details of this release are summarized here: https://tracker.ceph.com/issues/62527#note-1 Release Notes - TBD Seeking approvals for: smoke - Venky rados - Radek, Laura rook - Sébastien Han cephadm - Adam K dashboard - Ernesto rgw - Casey rbd - Ilya krbd - Ilya fs - Venky, Patrick upgrade

[ceph-users] Re: [quincy] Migrating ceph cluster to new network, bind OSDs to multple public_nework

2023-08-23 Thread Boris Behrens
Well, I've read that different in older threads, but now that I know it, I can work around it. Thanks Am Di., 22. Aug. 2023 um 16:41 Uhr schrieb Konstantin Shalygin < k0...@k0ste.ru>: > Hi, > > This how OSD's woks. For change the network subnet you need to setup > reachability of both: old and n

[ceph-users] Re: Patch change for CephFS subvolume

2023-08-23 Thread Eugen Block
Hi, I started a new thread [2] to not hijack yours. [2] https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/CTD5WHDATBGAYA33MBKQMX4FKFFYIASN/ Zitat von Michal Strnad : Hi Eugen, thank you for the message. I've already tried the process of changing the classic directory to a

[ceph-users] Re: Listing S3 buckets of a tenant using admin API

2023-08-23 Thread Michal Strnad
Hi. Did you manage to access the specific bucket? Is it possible and if so, how to obtain information about a bucket storage_class and placement through the API, in addition to the regular information? Thanks Michal On 2/1/22 18:01, Daniel Iwan wrote: It seems that REST API and CLI suppor

[ceph-users] Re: Client failing to respond to capability release

2023-08-23 Thread Eugen Block
I see, that was also SUSE's recommendation [2] but without a real explanation, just some assumptions about a possible network disconnect. [2] https://www.suse.com/support/kb/doc/?id=19628 Zitat von Frank Schilder : Hi Eugen, thanks for that :D This time it was something different. Possi

[ceph-users] Re: Client failing to respond to capability release

2023-08-23 Thread Frank Schilder
Hi Dhairya, this is the thing, the client appeared to be responsive and worked fine (file system was on-line and responsive as usual). There was something off though; see my response to Eugen. Thanks and best regards, = Frank Schilder AIT Risø Campus Bygning 109, rum S14 __

[ceph-users] Re: Client failing to respond to capability release

2023-08-23 Thread Frank Schilder
Hi Eugen, thanks for that :D This time it was something different. Possibly a bug in the kclient. On these nodes I found sync commands stuck in D-state. I guess a file/dir was not possible to sync or there was some kind of corruption of buffer data. We had to reboot the servers to clear that ou

[ceph-users] Re: Client failing to respond to capability release

2023-08-23 Thread Dhairya Parmar
Hi Frank, This usually happens when the client is buggy/unresponsive. This warning is triggered when the client fails to respond to MDS's request to release caps in time which is determined by session_timeout(defaults to 60 secs). Did you make any config changes? *Dhairya Parmar* Associate Soft