femi,
CC'ing ceph-user as this discussion probably belongs there.
Could you send a copy of your crushmap? DNE is typically what we see
when someone explicitly removes an osd with something like: 'ceph osd
rm 90' (Does Not Exist).
Also, out of curiosity, how did you upgrade you cluster? One box at a
time? Take the whole thing down and upgrade everything? something
else? Just interested to see how you got to where you are. Feel free
to stop by irc and ask for scuttlemonkey if you want a more direct
discussion. Thanks.
Best Regards,
Patrick
On Fri, Feb 15, 2013 at 8:50 AM, femi anjorin wrote:
> Hi All,
>
> Pls I got this result after i did an upgrade to 0.56.3. I'm not sure
> if its a problem with upgrade or some other things.
>
> # ceph osd tree
>
> # idweight type name up/down reweight
> -1 96 root default
> -3 96 rack unknownrack
> -2 4 host server109
> 0 1 osd.0 DNE
> 1 1 osd.1 DNE
> 2 1 osd.2 DNE
> 3 1 osd.3 up 1
> -4 4 host server111
> 10 1 osd.10 DNE
> 11 1 osd.11 DNE
> 8 1 osd.8 DNE
> 9 1 osd.9 up 1
> -5 4 host server112
> 12 1 osd.12 DNE
> 13 1 osd.13 DNE
> 14 1 osd.14 DNE
> 15 1 osd.15 up 1
> -6 4 host server113
> 16 1 osd.16 DNE
> 17 1 osd.17 DNE
> 18 1 osd.18 DNE
> 19 1 osd.19 up 1
> -7 4 host server114
> 20 1 osd.20 DNE
> 21 1 osd.21 DNE
> 22 1 osd.22 DNE
> 23 1 osd.23 up 1
> -8 4 host server115
> 24 1 osd.24 DNE
> 25 1 osd.25 DNE
> 26 1 osd.26 DNE
> 27 1 osd.27 up 1
> -9 4 host server116
> 28 1 osd.28 DNE
> 29 1 osd.29 DNE
> 30 1 osd.30 DNE
> 31 1 osd.31 up 1
> -10 4 host server209
> 32 1 osd.32 DNE
> 33 1 osd.33 DNE
> 34 1 osd.34 DNE
> 35 1 osd.35 up 1
> -11 4 host server210
> 36 1 osd.36 DNE
> 37 1 osd.37 DNE
> 38 1 osd.38 DNE
> 39 1 osd.39 up 1
> -12 4 host server110
> 4 1 osd.4 DNE
> 5 1 osd.5 DNE
> 6 1 osd.6 DNE
> 7 1 osd.7 up 1
> -13 4 host server211
> 40 1 osd.40 DNE
> 41 1 osd.41 DNE
> 42 1 osd.42 DNE
> 43 1 osd.43 up 1
> -14 4 host server212
> 44 1 osd.44 DNE
> 45 1 osd.45 DNE
> 46 1 osd.46 DNE
> 47 1 osd.47 up 1
> -15 4 host server213
> 48 1 osd.48 DNE
> 49 1 osd.49 DNE
> 50 1 osd.50 DNE
> 51 1 osd.51 up 1
> -16 4 host server214
> 52 1 osd.52 DNE
> 53 1 osd.53 DNE
> 54 1 osd.54 DNE
> 55 1 osd.55 up 1
> -17 4 host server215
> 56 1 osd.56 DNE
> 57 1 osd.57 DNE
> 58 1 osd.58 DNE
> 59 1 osd.59 up 1
> -18 4 host ser
