Hi,

after an controlled shutdown of the whole cluster do to external circumstances we decided to update from 19.2 to 20.2 after the restart. The system was health before and after the update. The nodes mounting the filesystem were not equally lucky and were partially shutdown hard. Storage was kept running additional ~30min after node shutdown, all inflight operations should have finished.

Now we discover the some of the user files seem to be replaced with zeros. For example:

stat .gitignore
  File: .gitignore
Size: 4429 Blocks: 9 IO Block: 4194304 regular file
Device: 0,48    Inode: 1100241384598  Links: 1


hexdump -C .gitignore
00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
*
00001140  00 00 00 00 00 00 00 00  00 00 00 00 00  |.............|
0000114d


Scanning for files containing only zeros show several issues of files that were likely accessed before or during the shutdown of the nodes.

How should I progress from here?


Cheers
Dominik
_______________________________________________
ceph-users mailing list -- [email protected]
To unsubscribe send an email to [email protected]

Reply via email to