Hello, since some month all our bluestore OSDs keep crashing from time to time. Currently about 5 OSDs per day.
All of them show the following trace: Trace: 2019-07-24 08:36:48.995397 7fb19a711700 -1 rocksdb: submit_transaction error: Corruption: block checksum mismatch code = 2 Rocksdb transaction: Put( Prefix = M key = 0x00000000000009a5'.0000916366.00000000000074680351' Value size = 184) Put( Prefix = M key = 0x00000000000009a5'._fastinfo' Value size = 186) Put( Prefix = O key = 0x7f8000000000000003bb605f'd!rbd_data.afe49a6b8b4567.0000000000003c11!='0xfffffffffffffffeffffffffffffffff6f00240000'x' Value size = 530) Put( Prefix = O key = 0x7f8000000000000003bb605f'd!rbd_data.afe49a6b8b4567.0000000000003c11!='0xfffffffffffffffeffffffffffffffff'o' Value size = 510) Put( Prefix = L key = 0x0000000010ba60f1 Value size = 4135) 2019-07-24 08:36:49.012110 7fb19a711700 -1 /build/ceph/src/os/bluestore/BlueStore.cc: In function 'void BlueStore::_kv_sync_thread()' thread 7fb19a711700 time 2019-07-24 08:36:48.995415 /build/ceph/src/os/bluestore/BlueStore.cc: 8808: FAILED assert(r == 0) ceph version 12.2.12-7-g1321c5e91f (1321c5e91f3d5d35dd5aa5a0029a54b9a8ab9498) luminous (stable) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x5653a010e222] 2: (BlueStore::_kv_sync_thread()+0x24c5) [0x56539ff964b5] 3: (BlueStore::KVSyncThread::entry()+0xd) [0x56539ffd708d] 4: (()+0x7494) [0x7fb1ab2f6494] 5: (clone()+0x3f) [0x7fb1aa37dacf] I already opend up a tracker: https://tracker.ceph.com/issues/41367 Can anybody help? Is this known? Greets, Stefan _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
