Deleted old messages... Here is what I am seeing.. Home contains copy from OSD2. root@OSD1:/var/lib/ceph/osd# find ./ceph-*/current/meta | grep osdmap | grep 16024./ceph-0/current/meta/DIR_E/DIR_3/inc\uosdmap.16024__0_46887E3E__none./ceph-0/current/meta/DIR_9/DIR_D/osdmap.16024__0_4E98A1D9__none./ceph-1/current/meta/DIR_9/DIR_D/osdmap.16024__0_4E98A1D9__none./ceph-1/current/meta/DIR_E/DIR_3/inc\uosdmap.16024__0_46887E3E__none./ceph-2/current/meta/DIR_9/DIR_D/osdmap.16024__0_4E98A1D9__none./ceph-2/current/meta/DIR_E/DIR_3/inc\uosdmap.16024__0_46887E3E__noneroot@OSD1:/var/lib/ceph/osd# diff ./ceph-0/current/meta/DIR_E/DIR_3/inc\\uosdmap.16024__0_46887E3E__none ./ceph-1/current/meta/DIR_E/DIR_3/inc\\uosdmap.16024__0_46887E3E__noneroot@OSD1:/var/lib/ceph/osd# diff ./ceph-0/current/meta/DIR_E/DIR_3/inc\\uosdmap.16024__0_46887E3E__none ./ceph-2/current/meta/DIR_E/DIR_3/inc\\uosdmap.16024__0_46887E3E__noneroot@OSD1:/var/lib/ceph/osd# diff ./ceph-0/current/meta/DIR_9/DIR_D/osdmap.16024__0_4E98A1D9__none ./ceph-1/current/meta/DIR_9/DIR_D/osdmap.16024__0_4E98A1D9__noneroot@OSD1:/var/lib/ceph/osd# diff ./ceph-0/current/meta/DIR_9/DIR_D/osdmap.16024__0_4E98A1D9__none ./ceph-2/current/meta/DIR_9/DIR_D/osdmap.16024__0_4E98A1D9__noneroot@OSD1:/var/lib/ceph/osd# diff ./ceph-0/current/meta/DIR_9/DIR_D/osdmap.16024__0_4E98A1D9__none ~/osdmap.16024__0_4E98A1D9__noneroot@OSD1:/var/lib/ceph/osd# root@OSD2:/var/lib/ceph/osd# find ./ceph-*/current/meta | grep osdmap | grep 16024./ceph-3/current/meta/DIR_E/DIR_3/inc\uosdmap.16024__0_46887E3E__none./ceph-3/current/meta/DIR_9/DIR_D/osdmap.16024__0_4E98A1D9__none./ceph-4/current/meta/DIR_9/DIR_D/osdmap.16024__0_4E98A1D9__none./ceph-4/current/meta/DIR_E/DIR_3/inc\uosdmap.16024__0_46887E3E__none./ceph-5/current/meta/DIR_E/DIR_3/inc\uosdmap.16024__0_46887E3E__none./ceph-5/current/meta/DIR_9/DIR_D/osdmap.16024__0_4E98A1D9__noneroot@OSD2:/var/lib/ceph/osd# diff ./ceph-3/current/meta/DIR_E/DIR_3/inc\\uosdmap.16024__0_46887E3E__none ./ceph-4/current/meta/DIR_E/DIR_3/inc\\uosdmap.16024__0_46887E3E__noneroot@OSD2:/var/lib/ceph/osd# diff ./ceph-3/current/meta/DIR_E/DIR_3/inc\\uosdmap.16024__0_46887E3E__none ./ceph-5/current/meta/DIR_E/DIR_3/inc\\uosdmap.16024__0_46887E3E__noneroot@OSD2:/var/lib/ceph/osd# diff ./ceph-3/current/meta/DIR_9/DIR_D/osdmap.16024__0_4E98A1D9__none ./ceph-4/current/meta/DIR_9/DIR_D/osdmap.16024__0_4E98A1D9__noneroot@OSD2:/var/lib/ceph/osd# diff ./ceph-3/current/meta/DIR_9/DIR_D/osdmap.16024__0_4E98A1D9__none ./ceph-5/current/meta/DIR_9/DIR_D/osdmap.16024__0_4E98A1D9__none Regards,Hong
On Saturday, April 16, 2016 12:35 AM, hjcho616 <hjcho...@yahoo.com> wrote: osd.3 did have a full version when I wrote last time. I just diffed the those two files across all OSDs and they all seem to match. What else can I try? Regards,Hong On Saturday, April 16, 2016 12:30 AM, huang jun <hjwsm1...@gmail.com> wrote: can you find the full osdmap.16024 in other osd? seems like the osd::init doesnt read the incremental osdmap but the full osdmap, if you find it, then copy to osd.3. 2016-04-16 13:27 GMT+08:00 hjcho616 <hjcho...@yahoo.com>: > I found below file missing on osd.3 so I copied over. Still fails with the > similar message. What can I try next? > > -1> 2016-04-16 00:22:32.579622 7f8d5c340800 20 osd.3 0 get_map 16024 - > loading and decoding 0x7f8d65d04900 > 0> 2016-04-16 00:22:32.584406 7f8d5c340800 -1 osd/OSD.h: In function > 'OSDMapRef OSDService::get_map(epoch_t)' thread 7f8d5c340800 time 2016-04-16 > 00:22:32.579890 > osd/OSD.h: 885: FAILED assert(ret) > > ceph version 10.1.2 (4a2a6f72640d6b74a3bbd92798bb913ed380dcd4) > 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char > const*)+0x82) [0x7f8d5bdc64f2] > 2: (OSDService::get_map(unsigned int)+0x3d) [0x7f8d5b74d83d] > 3: (OSD::init()+0x1862) [0x7f8d5b6fba52] > 4: (main()+0x2b05) [0x7f8d5b661735] > 5: (__libc_start_main()+0xf5) [0x7f8d581f7b45] > 6: (()+0x337197) [0x7f8d5b6ac197] > NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to > interpret this. > > Regards, > Hong > >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com