Re: [ceph-users] pool distribution quality report script

2015-03-05 Thread Mark Nelson
Hi David, Mind sending me the output of "ceph pg dump -f json"? thanks! Mark On 03/05/2015 12:52 PM, David Burley wrote: Mark, It worked for me earlier this morning but the new rev is throwing a traceback: $ ceph pg dump -f json | python ./readpgdump.py > pgdump_analysis.txt dumped all in fo

Re: [ceph-users] pool distribution quality report script

2015-03-05 Thread David Burley
Mark, It worked for me earlier this morning but the new rev is throwing a traceback: $ ceph pg dump -f json | python ./readpgdump.py > pgdump_analysis.txt dumped all in format json Traceback (most recent call last): File "./readpgdump.py", line 294, in parse_json(data) File "./readpgdump

Re: [ceph-users] pool distribution quality report script

2015-03-05 Thread Mark Nelson
Hi Blair, I've updated the script and it now (theoretically) computes optimal crush weights based on both primary and secondary acting set OSDs. It also attempts to show you the efficiency of equal weights vs using weights optimized for different pools (or all pools). This is done by lookin

Re: [ceph-users] pool distribution quality report script

2015-03-04 Thread Blair Bethwaite
Hi Mark, Cool, that looks handy. Though it'd be even better if it could go a step further and recommend re-weighting values to balance things out (or increased PG counts where needed). Cheers, On 5 March 2015 at 15:11, Mark Nelson wrote: > Hi All, > > Recently some folks showed interest in gath

[ceph-users] pool distribution quality report script

2015-03-04 Thread Mark Nelson
Hi All, Recently some folks showed interest in gathering pool distribution statistics and I remembered I wrote a script to do that a while back. It was broken due to a change in the ceph pg dump output format that was committed a while back, so I cleaned the script up, added detection of head