Re: [ceph-users] trying to understand stuck_unclean

2014-01-10 Thread YIP Wai Peng
Dear all, I've solved the issue. Turns out my CRUSH map was a bit wonky. The weight of a datacenter bucket was not equal to the weight of all the osds below it. I must have edited it manually accidentally. was -9 3 datacenter COM1 -6 6 room 02-WIRECEN -4 3 host ceph2 -2 3 host ceph1 should b

Re: [ceph-users] trying to understand stuck_unclean

2014-01-09 Thread YIP Wai Peng
Hi Wido, Thanks for the reply. I've dumped the query below. "recovery_state" doesn't say anything, there are also no missing or unfounded objects. What else could be wrong? - WP P.S: I am running tunables optimal already. { "state": "active+remapped", "epoch": 6500, "up": [ 7],

Re: [ceph-users] trying to understand stuck_unclean

2014-01-09 Thread Wido den Hollander
On 01/10/2014 05:13 AM, YIP Wai Peng wrote: Dear all, I have some pgs that are stuck_unclean, I'm trying to understand why. Hopefully someone can help me shed some light on it. For example, one of them is # ceph pg dump_stuck unclean 1.fa000active+remapped2014-01-10 11:18:53.1478420'06452:

[ceph-users] trying to understand stuck_unclean

2014-01-09 Thread YIP Wai Peng
Dear all, I have some pgs that are stuck_unclean, I'm trying to understand why. Hopefully someone can help me shed some light on it. For example, one of them is # ceph pg dump_stuck unclean 1.fa 0 0 0 0 0 0 0 active+remapped 2014-01-10 11:18:53.147842 0'0 6452:4272 [7] [7,3] 0'0 2014-01-09 11:37