Re: [ceph-users] OSD bluestore initialization failed

2019-06-21 Thread Saulo Silva
After read a lot of documentation I started to try to recover my data doing PG export and import to try get my pool up but all command that I did result a error . I started the work to list all PG to create a simple import/export script . but I can neither list the PGs . ceph-objectstore-tool --bl

Re: [ceph-users] OSD bluestore initialization failed

2019-06-21 Thread Saulo Silva
HI Igor , Here the assert line and the 10 line that goes before and after . -4> 2019-06-21 10:54:45.161493 7f689291ed00 20 bluefs _read left 0x8000 len 0x8000 -3> 2019-06-21 10:54:45.161497 7f689291ed00 20 bluefs _read got 32768 -2> 2019-06-21 10:54:45.161533 7f689291ed00 10 bluefs _r

Re: [ceph-users] OSD bluestore initialization failed

2019-06-21 Thread Saulo Silva
Hi Igor , I am looking at the log and I am not sure what is the exactly line that I shuold send . I tried to tail -f /var/log/ceph/ceph-osd.6.log | grep -i assertion -A 5 But no valid result returned . What you be the regex to get this specific line ? I also could send the entire log . Best Rega

Re: [ceph-users] OSD bluestore initialization failed

2019-06-21 Thread Igor Fedotov
Saulo, please share a few log lines immediately before the assertion, not the starting ones. Thanks, Igor On 6/21/2019 5:37 PM, Saulo Silva wrote: Hi Igor , thanks for helping , Here part of the log : head ceph-osd.6.log -n80 2019-06-21 10:50:56.090891 7f462db84d00  0 set uid:gid to 167:

Re: [ceph-users] OSD bluestore initialization failed

2019-06-21 Thread Saulo Silva
Hi Igor , thanks for helping , Here part of the log : head ceph-osd.6.log -n80 2019-06-21 10:50:56.090891 7f462db84d00 0 set uid:gid to 167:167 (ceph:ceph) 2019-06-21 10:50:56.090910 7f462db84d00 0 ceph version 12.2.10-551-gbb089269ea (bb089269ea0c1272294c6b9777123ac81662b6d2) luminous (stable)

Re: [ceph-users] OSD bluestore initialization failed

2019-06-21 Thread Igor Fedotov
Hi Saulo, looks like disk I/O error. Will you set debug_bluefs to 20 and collect the log, then share a few lines prior to the assertion? Checking smartctl output might be a good idea too. Thanks, Igor On 6/21/2019 11:30 AM, Saulo Silva wrote: Hi, After a power failure all OSD´s from a po

[ceph-users] OSD bluestore initialization failed

2019-06-21 Thread Saulo Silva
Hi, After a power failure all OSD´s from a pool are fail with the following error : -5> 2019-06-20 13:32:58.886299 7f146bcb2d00 4 rocksdb: [/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:db/MANIFEST-003373 succeeded,mani