Public bug reported: Our ceph ring has some osds that are not balanced
We are using the 0.48.3-0ubuntu1~cloud0 version of ceph on precise Full settings: "full_ratio": "0.950000", "near_full_ratio": "0.850000", ceph osd tree weight 12 1 osd.12 up 1 11 1 osd.11 up 1 13 1 osd.13 up 1 23 2 osd.23 up 1 27 2 osd.27 up 1 24 2 osd.24 up 1 25 2 osd.25 up 1 26 2 osd.26 up 1 48 2 osd.48 up 1 51 2 osd.51 up 1 55 2 osd.55 up 1 df of ceph-osd node: /dev/sdc1 917G 716G 202G 79% /var/lib/ceph/osd/ceph-11 /dev/sdd1 917G 347G 571G 38% /var/lib/ceph/osd/ceph-12 /dev/sdb1 917G 791G 127G 87% /var/lib/ceph/osd/ceph-13 /dev/sdf1 1.8T 1.1T 729G 61% /var/lib/ceph/osd/ceph-23 /dev/sdh1 1.8T 1.1T 727G 61% /var/lib/ceph/osd/ceph-24 /dev/sde1 1.8T 1.2T 610G 67% /var/lib/ceph/osd/ceph-25 /dev/sdi1 1.8T 1.1T 731G 61% /var/lib/ceph/osd/ceph-26 /dev/sdg1 1.8T 1.1T 756G 59% /var/lib/ceph/osd/ceph-27 /dev/sdj1 1.9T 989G 874G 54% /var/lib/ceph/osd/ceph-48 /dev/sdk1 1.9T 1007G 856G 55% /var/lib/ceph/osd/ceph-51 /dev/sdl1 1.9T 960G 903G 52% /var/lib/ceph/osd/ceph-55 Notice ceph-13 is at 87% and ceph-11 is at 79% while ceph-12 which has the same size and weight is only at 38% What is causing this imbalance? Manual re-balancing causes downtime in our environment, what can we do to solve this? ** Affects: ceph (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to ceph in Ubuntu. https://bugs.launchpad.net/bugs/1261501 Title: ceph osds unbalanced To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1261501/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs