[ceph-users] ceph mds in death loop from client trying to remove a file

2021-08-27 Thread Pickett, Neale T
In case anybody is concerned, we aren't trying to put it back into service for anything other than rsync --delete. We're about to enter year 3 of the recovery effort! From: Pickett, Neale T Sent: Tuesday, August 24, 2021 15:23 To: Dan van der Ster Cc: ceph

[ceph-users] fsck error: found stray omap data on omap_head

2021-05-19 Thread Pickett, Neale T
We just upgraded to pacific, and I'm trying to clear warnings about legacy bluestore omap usage stats by running 'ceph-bluestore-tool repair`, as instructed by the warning message. It's been going fine, but we are now getting this error: [root@vanilla bin]# ceph-bluestore-tool repair --path $o

[ceph-users] Re: [EXTERNAL] Re: fsck error: found stray omap data on omap_head

2021-05-20 Thread Pickett, Neale T
e like "warning: there was an error on this one non-critical task" :) We'll probably just destroy and rebuild that OSD once we're back to HEALTH_OK. Thank you! From: Igor Fedotov Sent: Thursday, May 20, 2021 05:15 To: Pickett, Neale T; ce

[ceph-users] mds in death loop with [ERR] loaded dup inode XXX [2,head] XXX at XXX, but inode XXX already exists at XXX

2021-08-23 Thread Pickett, Neale T
hello, ceph-users! We have an old cephfs that is ten different kinds of broken, which we are attempting to (slowly) pull files from. The most recent issue we've hit is that the mds will start up, log hundreds of messages like below, then crash. This is happening in a loop; we can never actuall

[ceph-users] Re: [EXTERNAL] Re: mds in death loop with [ERR] loaded dup inode XXX [2,head] XXX at XXX, but inode XXX already exists at XXX

2021-08-24 Thread Pickett, Neale T
41517500160 / ms_dispatch 140641567856384 / safe_timer 140641626605312 / msgr-worker-2 max_recent 1 max_new1 log_file /var/lib/ceph/crash/2021-08-24T21:17:38.319894Z_4561a8f4-f452-45ef-82f5-3a3f2ffe682e/log --- end dump of recent events --- __________

[ceph-users] Re: [EXTERNAL] Re: mds in death loop with [ERR] loaded dup inode XXX [2,head] XXX at XXX, but inode XXX already exists at XXX

2021-08-24 Thread Pickett, Neale T
at rbytes on single dirfrag 0x100028e597b, inode has n(v1963 rc2021-08-23T17:51:55.994745+ b2195090776 5729=5728+1), dirfrag has n(v1963 rc2021-08-23T17:51:55.994745+) ____ From: Pickett, Neale T Sent: Tuesday, August 24, 2021 15:20 To: Dan van der Ster Cc