Re: [Puppet Users] puppet5 upgrade performance issues

2018-01-28 Thread Chris Smith
Hey, Thanks for the follow up. Environment caching helped a lot, compile times are down to 5-10 seconds (from 10+ minutes). I haven't had time to test puppet-agent-5.3 or look at converting to hiera5 unfortunately. On 25/01/18 04:41, Matthaus Owens wrote: > Hey Chris, > Just wondering if you go

Re: [Puppet Users] puppet5 upgrade performance issues

2018-01-24 Thread Matthaus Owens
Hey Chris, Just wondering if you got any further in figuring this out. I'd be happy to try to help debug some more if you need as well. On Wed, Jan 10, 2018 at 10:39 PM, Chris Smith wrote: > On 11/01/18 09:42, Poil wrote: >> Hey, >> >> Are you sure that you have environment cache enabled on your

Re: [Puppet Users] puppet5 upgrade performance issues

2018-01-10 Thread Chris Smith
On 11/01/18 09:42, Poil wrote: > Hey, > > Are you sure that you have environment cache enabled on your Puppet5 > installation ? (because x10 is what we have here when we disable it) No, that's not enabled at the moment (it wasn't before either). I'm working on setting that up, I did a test run an

Re: [Puppet Users] puppet5 upgrade performance issues

2018-01-10 Thread Chris Smith
On 11/01/18 08:41, Matthaus Owens wrote: > Chris, > > Good to know that PuppetDB isn't the cause here. One thing worth doing > on your servers is moving forward to Puppet-agent 5.3.2. There was a > performance regression in Puppet 5 > https://tickets.puppetlabs.com/browse/PUP-8009 around > interna

Re: [Puppet Users] puppet5 upgrade performance issues

2018-01-10 Thread Poil
Hey, Are you sure that you have environment cache enabled on your Puppet5 installation ? (because x10 is what we have here when we disable it) ref. https://www.example42.com/2017/03/27/environment_caching/ Best regards, Le 09/01/2018 à 04:31, chris smith a écrit : Hi there, I recently did

Re: [Puppet Users] puppet5 upgrade performance issues

2018-01-10 Thread Matthaus Owens
Chris, Good to know that PuppetDB isn't the cause here. One thing worth doing on your servers is moving forward to Puppet-agent 5.3.2. There was a performance regression in Puppet 5 https://tickets.puppetlabs.com/browse/PUP-8009 around internationalization and modules (something like 30% in some c

Re: [Puppet Users] puppet5 upgrade performance issues

2018-01-09 Thread Chris Smith
Hi, Thanks for your help. On 10/01/18 06:36, Matthaus Owens wrote: > Chris, > To better help you, it would be great to know a few more things about > your installation. First question: are you running puppetserver 5.0.0 > or something later in the 5.x series (and is it the same on all > servers)?

Re: [Puppet Users] puppet5 upgrade performance issues

2018-01-09 Thread Matthaus Owens
Chris, Hiera 3 + hiera-eyaml may also be contributing to the slowness. Here is one ticket (related to SERVER-1922) that indicated moving to hiera 5 improved compile times substantially: https://tickets.puppetlabs.com/browse/SERVER-1919 -Haus On Tue, Jan 9, 2018 at 11:36 AM, Matthaus Owens wrote:

Re: [Puppet Users] puppet5 upgrade performance issues

2018-01-09 Thread Matthaus Owens
Chris, To better help you, it would be great to know a few more things about your installation. First question: are you running puppetserver 5.0.0 or something later in the 5.x series (and is it the same on all servers)? Second, what version of the puppet-agent are on those servers? puppetserver 5.

[Puppet Users] puppet5 upgrade performance issues

2018-01-08 Thread chris smith
Hi there, I recently did an upgrade from puppetserver 2.7.2 to puppetserver 5.0 and performance has bottomed out pretty terribly. Agents and puppetdb also got updated. Compiling the catalog on the server used to take 10-20 seconds, now they are taking 90-150 seconds and agent runs are taking 30