Re: [ceph-users] cephfs: how to repair damaged mds rank?

2017-10-09 Thread Daniel Baumann
Hi John, On 10/09/2017 10:47 AM, John Spray wrote: > When a rank is "damaged", that means the MDS rank is blocked from > starting because Ceph thinks the on-disk metadata is damaged -- no > amount of restarting things will help. thanks. > The place to start with the investigation is to find the

Re: [ceph-users] cephfs: how to repair damaged mds rank?

2017-10-09 Thread John Spray
On Mon, Oct 9, 2017 at 8:17 AM, Daniel Baumann wrote: > Hi all, > > we have a Ceph Cluster (12.2.1) with 9 MDS ranks in multi-mds mode. > > "out of the blue", rank 6 is marked as damaged (and all other MDS are in > state up:resolve) and I can't bring the FS up again. > >

Re: [ceph-users] cephfs: how to repair damaged mds rank?

2017-10-09 Thread Daniel Baumann
On 10/09/2017 09:17 AM, Daniel Baumann wrote: > The relevant portion from the ceph-mds log (when starting mds9 which > should then take up rank 6; I'm happy to provide any logs): i've turned up the logging (see attachment).. could it be that we hit this bug here?

[ceph-users] cephfs: how to repair damaged mds rank?

2017-10-09 Thread Daniel Baumann
Hi all, we have a Ceph Cluster (12.2.1) with 9 MDS ranks in multi-mds mode. "out of the blue", rank 6 is marked as damaged (and all other MDS are in state up:resolve) and I can't bring the FS up again. 'ceph -s' says: [...] 1 filesystem is degraded 1 mds daemon damaged