Hi Saulo,
looks like disk I/O error.
Will you set debug_bluefs to 20 and collect the log, then share a few
lines prior to the assertion?
Checking smartctl output might be a good idea too.
Thanks,
Igor
On 6/21/2019 11:30 AM, Saulo Silva wrote:
Hi,
After a power failure all OSD´s from a pool are fail with the
following error :
-5> 2019-06-20 13:32:58.886299 7f146bcb2d00 4 rocksdb:
[/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/rocksdb/db/version_set.cc:2859]
Recovered from manifest file:db/MANIFEST-003373
succeeded,manifest_file_number is 3373, next_file_number is 3598,
last_sequence is 319489940, log_number is 0,prev_log_number is
0,max_column_family is 0
-4> 2019-06-20 13:32:58.886330 7f146bcb2d00 4 rocksdb:
[/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/rocksdb/db/version_set.cc:2867]
Column family [default] (ID 0), log number is 3594
-3> 2019-06-20 13:32:58.886401 7f146bcb2d00 4 rocksdb:
EVENT_LOG_v1 {"time_micros": 1561048378886391, "job": 1, "event":
"recovery_started", "log_files": [3592, 3594]}
-2> 2019-06-20 13:32:58.886407 7f146bcb2d00 4 rocksdb:
[/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/rocksdb/db/db_impl_open.cc:482]
Recovering log #3592 mode 0
-1> 2019-06-20 13:33:06.629066 7f146bcb2d00 4 rocksdb:
[/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/rocksdb/db/db_impl_open.cc:482]
Recovering log #3594 mode 0
0> 2019-06-20 13:33:10.086512 7f146bcb2d00 -1
/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/os/bluestore/BlueFS.cc:
In function 'int BlueFS::_read(BlueFS::FileReader*,
BlueFS::FileReaderBuffer*, uint64_t, size_t, ceph::bufferlist*,
char*)' thread 7f146bcb2d00 time 2019-06-20 13:33:10.073021
/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/os/bluestore/BlueFS.cc:
996: FAILED assert(r == 0)
All of OSD only read 2 log and return the error .
Is it possible to delete the rocksdb log and start the OSD again?
Best Regards,
Saulo Augusto Silva
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
