Dear Ceph Users,

I have the following situation in my small 3-node cluster:

--snip
root@ceph2:~# ceph status
    cluster d1af2097-8535-42f2-ba8c-0667f90cab61
     health HEALTH_WARN
            1 mons down, quorum 0,1 ceph0,ceph1
     monmap e1: 3 mons at 
{ceph0=10.0.0.30:6789/0,ceph1=10.0.0.31:6789/0,ceph2=10.0.0.32:6789/0}
            election epoch 538, quorum 0,1 ceph0,ceph1
     osdmap e2574: 9 osds: 9 up, 9 in
      pgmap v4397840: 768 pgs, 3 pools, 112 GB data, 28339 objects
            347 GB used, 8018 GB / 8365 GB avail
                 768 active+clean
  client io 0 B/s rd, 3283 B/s wr, 2 op/s
--snip

Seems a monitor couldn't start, so I tried to start it on console:

--snip
root@ceph2:~#  /usr/bin/ceph-mon --cluster=ceph -i ceph2 -f
Corruption: 12 missing files; e.g.: 
/var/lib/ceph/mon/ceph-ceph2/store.db/811920.ldb
2016-04-20 13:16:49.019857 7f39a9cbe800 -1 error opening mon data directory at 
'/var/lib/ceph/mon/ceph-ceph2': (22) Invalid argument
--snip

Seems there are indeed some files missing in the monitor directory:

--snip
root@ceph2:~# find /var/lib/ceph/mon/ceph-ceph2/store.db
/var/lib/ceph/mon/ceph-ceph2/store.db
/var/lib/ceph/mon/ceph-ceph2/store.db/LOG
/var/lib/ceph/mon/ceph-ceph2/store.db/811944.ldb
/var/lib/ceph/mon/ceph-ceph2/store.db/811943.ldb
/var/lib/ceph/mon/ceph-ceph2/store.db/811945.ldb
/var/lib/ceph/mon/ceph-ceph2/store.db/811939.log
/var/lib/ceph/mon/ceph-ceph2/store.db/811936.ldb
/var/lib/ceph/mon/ceph-ceph2/store.db/811952.ldb
/var/lib/ceph/mon/ceph-ceph2/store.db/811947.ldb
/var/lib/ceph/mon/ceph-ceph2/store.db/811946.ldb
/var/lib/ceph/mon/ceph-ceph2/store.db/MANIFEST-753605
/var/lib/ceph/mon/ceph-ceph2/store.db/811935.ldb
/var/lib/ceph/mon/ceph-ceph2/store.db/811942.ldb
/var/lib/ceph/mon/ceph-ceph2/store.db/811951.ldb
/var/lib/ceph/mon/ceph-ceph2/store.db/811949.ldb
/var/lib/ceph/mon/ceph-ceph2/store.db/811948.ldb
/var/lib/ceph/mon/ceph-ceph2/store.db/CURRENT
/var/lib/ceph/mon/ceph-ceph2/store.db/LOCK
/var/lib/ceph/mon/ceph-ceph2/store.db/LOG.old
/var/lib/ceph/mon/ceph-ceph2/store.db/811950.ldb
--snip

What I should/have to do to get that monitor up and working again ?

Thanks in advance any help is appreciated.

Kind Regards, Daniel
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to