[ceph-users] Re: How to determine if a filesystem is allow_standby_replay = true

2022-10-20 Thread Dhairya Parmar
Hi Wesley, It's 17.0.0-14319-ga686eb80799 (a686eb80799dc503a45002f4b9181f4573e8e0b3) quincy (dev) On Fri, Oct 21, 2022 at 3:29 AM Wesley Dillingham wrote: > Thanks Dhairya, what version are you using? I am 16.2.10 > > [root@alma3-4 ~]# ceph fs dump | grep -i replay > dumped fsmap epoch 90 >

[ceph-users] Re: Quincy - Support with NFS Ganesha on Alma

2022-10-20 Thread Lokendra Rathour
Hi, Thanks for the update, it worked. Thanks once again. On Wed, Oct 19, 2022 at 11:32 AM Tahder Xunil wrote: > Hi Lokendra > > It seems Alma doesn't support quincy version, for more info > . > If you do 'rpm -qa | grep

[ceph-users] Re: How to determine if a filesystem is allow_standby_replay = true

2022-10-20 Thread Xiubo Li
Hi Wesley, You can also just run: $ ceph fs get MyFS|grep flags flags    32 joinable allow_snaps allow_multimds_snaps allow_standby_replay And if you can see "allow_standby_replay" flag as above that means it's enabled, or disabled already. - Xiubo On 21/10/2022 05:58, Wesley Dillingham

[ceph-users] Re: How to determine if a filesystem is allow_standby_replay = true

2022-10-20 Thread Wesley Dillingham
Thanks Dhairya, what version are you using? I am 16.2.10 [root@alma3-4 ~]# ceph fs dump | grep -i replay dumped fsmap epoch 90 [mds.alma3-6{0:10340349} state up:standby-replay seq 1 addr [v2: 10.0.24.6:6803/937383171,v1:10.0.24.6:6818/937383171] compat {c=[1],r=[1],i=[7ff]}] as you can see i

[ceph-users] Any concerns using EC with CLAY in Quincy (or Pacific)?

2022-10-20 Thread Sean Matheny
HI all, We've deployed a new cluster on Quincy 17.2.3 with 260x 18TB spinners across 11 chassis that will be used exclusively in the next year or so as a S3 store. 100Gb per chassis shared by both cluster and public networks, NVMe DB/WAL, 32 phys cores @ 2.3Ghz base, 192GB chassis ram (per 24

[ceph-users] CephFS performance

2022-10-20 Thread quag...@bol.com.br
Hello everyone,     I have some considerations and doubts to ask...     I work at an HPC center and my doubts stem from performance in this environment. All clusters here was suffering from NFS performance and also problems of a single point of failure it has. We were suffering from the

[ceph-users] Re: How to determine if a filesystem is allow_standby_replay = true

2022-10-20 Thread Dhairya Parmar
Hi Wesley, You can find if the `allow_standby_replay` is turned on or off by looking at the fs dump, run `ceph fs dump | grep allow_standby_replay` and if it is turned on you will find something like: $ ./bin/ceph fs dump | grep allow_standby_replay *** DEVELOPER MODE: setting PATH, PYTHONPATH

[ceph-users] Re: s3gw v0.7.0 released

2022-10-20 Thread Matt Benjamin
And to clarify, too, this Aquarium work is the first attempt by folks to build a file backed storage setup, it's great to see innovation around this. Matt On Thu, Oct 20, 2022 at 1:50 PM Joao Eduardo Luis wrote: > On 2022-10-20 17:46, Matt Benjamin wrote: > > The ability to run as a

[ceph-users] Re: s3gw v0.7.0 released

2022-10-20 Thread Joao Eduardo Luis
On 2022-10-20 17:46, Matt Benjamin wrote: The ability to run as a stand-alone service without a RADOS service comes from the Zipper API work, which is part of upstream Ceph RGW, obviously. It should relatively soon be possible to load new Zipper store drivers (backends) at runtime, so there

[ceph-users] Re: s3gw v0.7.0 released

2022-10-20 Thread Matt Benjamin
The ability to run as a stand-alone service without a RADOS service comes from the Zipper API work, which is part of upstream Ceph RGW, obviously. It should relatively soon be possible to load new Zipper store drivers (backends) at runtime, so there won't be a need to maintain a fork of Ceph RGW.

[ceph-users] How to determine if a filesystem is allow_standby_replay = true

2022-10-20 Thread Wesley Dillingham
I am building some automation for version upgrades of MDS and part of the process I would like to determine if a filesystem has allow_standby_replay set to true and if so then disable it. Granted I could just issue: "ceph fs set MyFS allow_standby_replay false" and be done with it but Its got me

[ceph-users] s3gw v0.7.0 released

2022-10-20 Thread Joao Eduardo Luis
# s3gw v0.7.0 The s3gw team is announcing the release of s3gw v0.7.0. This release contains fixes to known bugs and new features. This includes an early version of an object explorer via the web-based UI. See the CHANGELOG below for more information. This project is still under early-stage

[ceph-users] Re: Quincy 22.04/Jammy packages

2022-10-20 Thread Goutham Pacha Ravi
On Tue, Oct 18, 2022 at 8:22 AM Reed Dier wrote: > Curious if there is a timeline for when quincy will start getting packages > for Ubuntu Jammy/22.04. > It looks like quincy started getting builds for EL9 with 17.2.4, and now > with the 17.2.5 there are still only bullseye and focal dists

[ceph-users] Re: radosgw networking

2022-10-20 Thread Boris
AFAIK radosgw uses the public network to talk to the OSDs. You could ditch the cluster network and have the public network use the high speed cluster network connections? Maybe there is another way, which I don't know. Cheers Boris > Am 20.10.2022 um 18:58 schrieb Wyll Ingersoll > : > >

[ceph-users] radosgw networking

2022-10-20 Thread Wyll Ingersoll
What network does radosgw use when it reads/writes the objects to the cluster? We have a high-speed cluster_network and want the radosgw to write data over that instead of the slower public_network if possible, is it configurable? thanks! Wyllys Ingersoll

[ceph-users] What is the use case of your Ceph cluster? Developers want to know!

2022-10-20 Thread Laura Flores
Dear Ceph Users, Ceph developers and doc writers are looking for responses from people in the user/dev community who have experience with a Ceph cluster. Our question: *What is the use case of your Ceph cluster?* Since the first official Argonaut release in 2012, Ceph has greatly expanded its

[ceph-users] Re: Status of Quincy 17.2.5 ?

2022-10-20 Thread Chris Palmer
I do agree with Christian. I would like to see the Ceph repositories handled in a similar way to most others: * Testing or pre-release packages go into one (or more) testing repos * Production-ready packages go into the production repo I don't care about the minor mirror-synch delay. What I

[ceph-users] cluster network change

2022-10-20 Thread Andrei Mikhailovsky
Hello cephers, I've got a few questions for the community to help us with migrating ceph cluster from Infiniband networking to 10G Ethernet with no or minimal downtime. Please find below the details of the cluster as well as info on what we are trying to achieve. 1. Cluster Info: Ceph

[ceph-users] Re: Grafana without presenting data from the first Host

2022-10-20 Thread Murilo Morais
Ernesto, thanks for replying. The service is UP on all hosts. Performing a direct query from Prometheus also doesn't return anything about the first Host. Em qui., 20 de out. de 2022 às 06:27, Ernesto Puerta escreveu: > Hi Murilo, > > Is node-exporter running on that node? Most host page

[ceph-users] Re: Grafana without presenting data from the first Host

2022-10-20 Thread Murilo Morais
Hi Marc, thanks for replying. I already checked, nothing appears about the first Host even if I perform a direct query from the Prometheus GUI. Ernesto mentioned node-exporter, this service is running on all hosts. Em qui., 20 de out. de 2022 às 04:21, Marc escreveu: > > > > > > I'm

[ceph-users] Re: Getting started with cephfs-top, how to install

2022-10-20 Thread Frank Schilder
Hi all, I'm stuck with a similar problem with cephfs-shell for octopus (https://docs.ceph.com/en/octopus/cephfs/cephfs-shell/#cephfs-shell). I can't figure out where to get it from. Its not part of the octopus container and also seems not to be available through the octopus repos. Anyone here

[ceph-users] Re: Grafana without presenting data from the first Host

2022-10-20 Thread Ernesto Puerta
Hi Murilo, Is node-exporter running on that node? Most host page metrics are node-exporter's. As Marc suggested, you can also confirm it by checking whether there are "node_*" metrics for that node in the Prometheus web UI. Kind Regards, Ernesto On Thu, Oct 20, 2022 at 2:52 AM Murilo Morais

[ceph-users] Re: Status of Quincy 17.2.5 ?

2022-10-20 Thread Christian Rohmann
On 19/10/2022 16:30, Laura Flores wrote: Dan is correct that 17.2.5 is a hotfix release. There was a flaw in the release process for 17.2.4 in which five commits were not included in the release. The users mailing list will hear an official announcement about this hotfix release later this

[ceph-users] Mirror de.ceph.com broken?

2022-10-20 Thread Christian Rohmann
Hey ceph-users, it seems that the German ceph mirror http://de.ceph.com/ listed at https://docs.ceph.com/en/latest/install/mirrors/#locations does not hold any data. The index page shows some plesk default page and also deeper links like

[ceph-users] Re: Grafana without presenting data from the first Host

2022-10-20 Thread Marc
> > I'm experiencing something strange on a cluster regarding monitoring. In > Grafana I can't see any data referring to the first Host, I've already > tried to redeploy Grafana and Prometheus, but the first Host never > appears, > if I go to Dashboard -> Hosts -> Performance Detail the first