Re: [Puppet Users] Re: Puppetmaster can't keep up with our 1400 nodes.

2014-11-07 Thread Wil Cooley
On Nov 4, 2014 7:32 AM, Georgi Todorov ter...@gmail.com wrote: I agree, there is something odd about File retrieval. We are creating a total of 10 autofs maps, however when I run trace, it looks like every separate entry creates a concat::fragment (puppetlabs-concat) which is later combined into

Re: [Puppet Users] Re: Puppetmaster can't keep up with our 1400 nodes.

2014-11-05 Thread jcbollinger
On Tuesday, November 4, 2014 9:32:32 AM UTC-6, Georgi Todorov wrote: On Tuesday, November 4, 2014 9:50:15 AM UTC-5, jcbollinger wrote: By far the biggest difference is is File retrieval time. This will be for File resources where you specify content via a 'source' parameter rather than

Re: [Puppet Users] Re: Puppetmaster can't keep up with our 1400 nodes.

2014-11-05 Thread Georgi Todorov
On Wednesday, November 5, 2014 9:47:02 AM UTC-5, jcbollinger wrote: On Tuesday, November 4, 2014 9:32:32 AM UTC-6, Georgi Todorov wrote: On Tuesday, November 4, 2014 9:50:15 AM UTC-5, jcbollinger wrote: By far the biggest difference is is File retrieval time. This will be for File

Re: [Puppet Users] Re: Puppetmaster can't keep up with our 1400 nodes.

2014-11-04 Thread jcbollinger
On Monday, November 3, 2014 10:39:14 AM UTC-6, Georgi Todorov wrote: On Friday, October 31, 2014 9:50:41 AM UTC-4, Georgi Todorov wrote: Actually, sometime last night something happened and puppet stopped processing requests altogether. Stopping and starting httpd fixed this, but this

Re: [Puppet Users] Re: Puppetmaster can't keep up with our 1400 nodes.

2014-11-04 Thread Georgi Todorov
On Tuesday, November 4, 2014 9:50:15 AM UTC-5, jcbollinger wrote: By far the biggest difference is is File retrieval time. This will be for File resources where you specify content via a 'source' parameter rather than via a 'content' property. The agent must make a separate request to

Re: [Puppet Users] Re: Puppetmaster can't keep up with our 1400 nodes.

2014-11-03 Thread Georgi Todorov
On Friday, October 31, 2014 9:50:41 AM UTC-4, Georgi Todorov wrote: Actually, sometime last night something happened and puppet stopped processing requests altogether. Stopping and starting httpd fixed this, but this could be just some bug in one of the new versions of software I upgraded

Re: [Puppet Users] Re: Puppetmaster can't keep up with our 1400 nodes.

2014-11-03 Thread Henrik Lindberg
On 2014-03-11 17:39, Georgi Todorov wrote: On Friday, October 31, 2014 9:50:41 AM UTC-4, Georgi Todorov wrote: Actually, sometime last night something happened and puppet stopped processing requests altogether. Stopping and starting httpd fixed this, but this could be just some

Re: [Puppet Users] Re: Puppetmaster can't keep up with our 1400 nodes.

2014-10-31 Thread Georgi Todorov
On Thursday, October 30, 2014 11:56:14 PM UTC-4, Garrett Honeycutt wrote: Hi Georgi, The catalog compilation time is how long it takes to compile the catalog *on the master*. You can find it on CentOS with `grep Compile /var/log/messages`. The amount of time it takes for your agent to

[Puppet Users] Re: Puppetmaster can't keep up with our 1400 nodes.

2014-10-30 Thread Georgi Todorov
Chris, I sleep very well :). Our master is hourly backed up (the entire vm) and all configs go though git. Redeploying/restoring the master should be fairly quick (I have not tried though). Also, the way we use puppet, if it is down, it is no harm really. Only needed to push changes, which we

Re: [Puppet Users] Re: Puppetmaster can't keep up with our 1400 nodes.

2014-10-30 Thread Garrett Honeycutt
On 10/30/14 4:32 PM, Georgi Todorov wrote: Chris, I sleep very well :). Our master is hourly backed up (the entire vm) and all configs go though git. Redeploying/restoring the master should be fairly quick (I have not tried though). Also, the way we use puppet, if it is down, it is no harm