[ceph-users] MDS stuck in rejoin

2022-05-30 Thread Dave Schulz
Hi Everyone, I have a down system that has the MDS stuck in the rejoin state. When I run ceph-mds with -d and --debug_mds 10 I get this repeating: 2022-05-31 00:33:03.554 7fac80ee3700 10 mds.trex-ceph4  my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=defa

[ceph-users] Crashing MDS

2022-06-08 Thread Dave Schulz
Hi Everyone, I have an MDS server that's crashing moments after it starts. The filesystem is set to max_mds=5 and mds.[1-4] are all up and active but mds.0 keeps crashing.  all I can see is the following in the /var/log/ceph/ceph-mds. logfile.  Any thoughts?     -2> 2022-06-08 10:02:59.

[ceph-users] Re: Crashing MDS

2022-06-08 Thread Dave Schulz
checked if the host has free inode available? On Wed, 8 Jun 2022 at 19:22, Dave Schulz wrote: Hi Everyone, I have an MDS server that's crashing moments after it starts. The filesystem is set to max_mds=5 and mds.[1-4] are all up and active but mds.0 keeps crashing.  all I

[ceph-users] Re: OSDs growing beyond full ratio

2022-08-29 Thread Dave Schulz
Hi Wyll, Any chance you're using CephFS and have some really large files in the CephFS filesystem?  Erasure coding? I recently encountered a similar problem and as soon as the end-user deleted the really large files our problem became much more managable. I had issues reweighting OSDs too an

[ceph-users] Re: OSDs growing beyond full ratio

2022-08-30 Thread Dave Schulz
--- *From:* Josh Baergen *Sent:* Tuesday, August 30, 2022 9:46 AM *To:* Wyll Ingersoll *Cc:* Dave Schulz ; ceph-users@ceph.io *Subject:* Re: [ceph-users] Re: OSDs growing beyond full ratio Hey Wyll, I haven't been following this thread very closely so my apologies if this has already bee

[ceph-users] Re: OSDs growing beyond full ratio

2022-08-30 Thread Dave Schulz
a.m., 胡 玮文 wrote: [△EXTERNAL] 在 2022年8月30日,23:20,Dave Schulz 写道: Is a file in ceph assigned to a specific PG?  In my case it seems like a file that's close to the size of a single OSD gets moved from one OSD to the next filling it up and domino-ing around the cluster filling up OSDs.