Re: [ceph-users] Increasing number of PGs by not a factor of two?

2018-05-25 Thread Jesus Cea
On 25/05/18 20:21, David Turner wrote: > If you start your pool with 12 PGs, 4 of them will have double the size > of the other 8.  It is 100% based on a power of 2 and has absolutely > nothing to do with the number you start with vs the number you increase > to.  If your PG count is not a power of

Re: [ceph-users] Increasing number of PGs by not a factor of two?

2018-05-25 Thread Jesus Cea
OK, I am writing this so you don't waste your time correcting me. I beg your pardon. On 25/05/18 18:28, Jesus Cea wrote: > So, if I understand correctly, ceph tries to do the minimum splits. If > you increase PG from 8 to 12, it will split 4 PGs and leave the other 4 > PGs alone, creating an imba

Re: [ceph-users] Increasing number of PGs by not a factor of two?

2018-05-25 Thread David Turner
If you start your pool with 12 PGs, 4 of them will have double the size of the other 8. It is 100% based on a power of 2 and has absolutely nothing to do with the number you start with vs the number you increase to. If your PG count is not a power of 2 then you will have 2 different sizes of PGs

Re: [ceph-users] Increasing number of PGs by not a factor of two?

2018-05-25 Thread Jesus Cea
On 17/05/18 20:36, David Turner wrote: > By sticking with PG numbers as a base 2 number (1024, 16384, etc) all of > your PGs will be the same size and easier to balance and manage.  What > happens when you have a non base 2 number is something like this.  Say > you have 4 PGs that are all 2GB in si

Re: [ceph-users] Increasing number of PGs by not a factor of two?

2018-05-18 Thread Bryan Banister
+1 From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Kai Wagner Sent: Thursday, May 17, 2018 4:20 PM To: David Turner Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Increasing number of PGs by not a factor of two? Great summary David. Wouldn't this be wo

Re: [ceph-users] Increasing number of PGs by not a factor of two?

2018-05-17 Thread Kai Wagner
Great summary David. Wouldn't this be worth a blog post? On 17.05.2018 20:36, David Turner wrote: > By sticking with PG numbers as a base 2 number (1024, 16384, etc) all > of your PGs will be the same size and easier to balance and manage.  > What happens when you have a non base 2 number is some

Re: [ceph-users] Increasing number of PGs by not a factor of two?

2018-05-17 Thread David Turner
You would actually need to go through one last time to get to your target PGs, but anyway, like all commands you come across online, test them and make sure they do what you intend. On Thu, May 17, 2018 at 2:36 PM David Turner wrote: > By sticking with PG numbers as a base 2 number (1024, 16384,

Re: [ceph-users] Increasing number of PGs by not a factor of two?

2018-05-17 Thread David Turner
By sticking with PG numbers as a base 2 number (1024, 16384, etc) all of your PGs will be the same size and easier to balance and manage. What happens when you have a non base 2 number is something like this. Say you have 4 PGs that are all 2GB in size. If you increase pg(p)_num to 6, then you w

Re: [ceph-users] Increasing number of PGs by not a factor of two?

2018-05-17 Thread Kai Wagner
Hi Oliver, a good value is 100-150 PGs per OSD. So in your case between 20k and 30k. You can increase your PGs, but keep in mind that this will keep the cluster quite busy for some while. That said I would rather increase in smaller steps than in one large move. Kai On 17.05.2018 01:29, Oliver

[ceph-users] Increasing number of PGs by not a factor of two?

2018-05-16 Thread Oliver Schulz
Dear all, we have a Ceph cluster that has slowly evolved over several years and Ceph versions (started with 18 OSDs and 54 TB in 2013, now about 200 OSDs and 1.5 PB, still the same cluster, with data continuity). So there are some "early sins" in the cluster configuration, left over from the earl