[ceph-users] Re: Balancer Distribution Help

2022-09-22 Thread Bailey Allison
Hi Reed, Just taking a quick glance at the Pastebin provided I have to say your cluster balance is already pretty damn good all things considered. We've seen the upmap balancer at it's best in practice provides a deviation of about 10-20% percent across OSDs which seems to be matching up on yo

[ceph-users] Re: Balancer Distribution Help

2022-09-22 Thread Stefan Kooman
On 9/22/22 21:48, Reed Dier wrote: Any tips or help would be greatly appreciated. Try JJ's Ceph balancer [1]. In our case it turned out to be *way* more efficient than built-in balancer (faster conversion, less movements involved). And able to achieve a very good PG distribution and "reclai

[ceph-users] Re: Balancer Distribution Help

2022-09-22 Thread Eugen Block
+1 for increasing PG numbers, those are quite low. Zitat von Bailey Allison : Hi Reed, Just taking a quick glance at the Pastebin provided I have to say your cluster balance is already pretty damn good all things considered. We've seen the upmap balancer at it's best in practice provides

[ceph-users] Re: Balancer Distribution Help

2022-09-23 Thread Wyll Ingersoll
epeat the above 3 steps until balance is achieved, then re-enable the balancer and unset the "no" flags set earlier? From: Eugen Block Sent: Friday, September 23, 2022 2:21 AM To: ceph-users@ceph.io Subject: [ceph-users] Re: Balancer Distributi

[ceph-users] Re: Balancer Distribution Help

2022-09-23 Thread Stefan Kooman
On 9/23/22 17:05, Wyll Ingersoll wrote: When doing manual remapping/rebalancing with tools like pgremapper and placementoptimizer, what are the recommended settings for norebalance, norecover, nobackfill? Should the balancer module be disabled if we are manually issuing the pg remap commands

[ceph-users] Re: Balancer Distribution Help

2022-09-23 Thread Josh Baergen
Hey Wyll, > $ pgremapper cancel-backfill --yes # to stop all pending operations > $ placementoptimizer.py balance --max-pg-moves 100 | tee upmap-moves > $ bash upmap-moves > > Repeat the above 3 steps until balance is achieved, then re-enable the > balancer and unset the "no" flags set earlier?

[ceph-users] Re: Balancer Distribution Help

2022-09-23 Thread Wyll Ingersoll
-users] Re: Balancer Distribution Help Hey Wyll, > $ pgremapper cancel-backfill --yes # to stop all pending operations > $ placementoptimizer.py balance --max-pg-moves 100 | tee upmap-moves > $ bash upmap-moves > > Repeat the above 3 steps until balance is achieved, the