[Puppet Users] Re: Considerations for puppet/cluster to manage 6000 hosts.

2013-11-15 Thread Christopher Pisano
Sorry to revive an old thread but i am currently trying to load balance two puppet masters behind an F5 and am running into issues. Can you share your configuration? I have a CA/Foreman server outside of the F5 and 2 Puppetmasters behind the F5. The VIP on the F5 has a generic DNS name with

[Puppet Users] Re: Considerations for puppet/cluster to manage 6000 hosts.

2011-01-17 Thread Matt
Not sure what his issue was but in my organization we had one puppet master with mod_passenger and puppet 2.6.3 running fine with 200 clients in a VM. We expanded to a 2 node cluster, with the original puppet master serving as the master for the secondaries. The secondaries have an F5 infront of

Re: [Puppet Users] Re: Considerations for puppet/cluster to manage 6000 hosts.

2011-01-17 Thread Eduardo S. Scarpellini
Matt, what type of service/health-check do you use in F5? What's URL (expected-string/HTTP-code) does the loadbalancer check to determine if puppet is alive? 2011/1/17 Matt mjbl...@gmail.com Not sure what his issue was but in my organization we had one puppet master with mod_passenger and

[Puppet Users] Re: Considerations for puppet/cluster to manage 6000 hosts.

2011-01-11 Thread Adrian Bridgett
It may also be worth looking at some form of improved scheduling in order to avoid a thundering herd of requests to your puppetmasters. One option that looks interesting (about to try it myself) is to use mcollective:

[Puppet Users] Re: Considerations for puppet/cluster to manage 6000 hosts.

2011-01-11 Thread donavan
On Jan 11, 1:05 am, Carles Amigó fr...@fr3nd.net wrote: What data is exactly discarded with thin storeconfigs? Effectively only facts and exported resources are stored for each node[1]. This is opposed to storing the complete set of resources (and other stuff?) for each node. For normal puppet

[Puppet Users] Re: Considerations for puppet/cluster to manage 6000 hosts.

2011-01-11 Thread DaveQB
We had trouble scaling with 400+ nodes. Puppet server is a VM on an ESX cluster with 3.5GB of ram and 1.5GB of swap but would regularly kick in OOM which would kill off most if not all of the 10 puppetmaster instances. We felt scheduling a restart of the puppetmasters a few times a day was not a

Re: [Puppet Users] Re: Considerations for puppet/cluster to manage 6000 hosts.

2011-01-11 Thread Nigel Kersten
On Tue, Jan 11, 2011 at 2:45 PM, DaveQB david.w...@drdstudios.com wrote: We had trouble scaling with 400+ nodes. Puppet server is a VM on an ESX cluster with 3.5GB of ram and 1.5GB of swap but would regularly kick in OOM which would kill off most if not all of the 10 puppetmaster instances.

[Puppet Users] Re: Considerations for puppet/cluster to manage 6000 hosts.

2011-01-11 Thread donavan
On Jan 11, 2:45 pm, DaveQB david.w...@drdstudios.com wrote: We had trouble scaling with 400+ nodes. Puppet server is a VM on an ESX cluster with 3.5GB of ram and 1.5GB of swap but would regularly kick in OOM which would kill off most if not all of the 10 puppetmaster instances. This is very

[Puppet Users] Re: Considerations for puppet/cluster to manage 6000 hosts.

2011-01-10 Thread donavan
On Jan 8, 1:02 pm, trey85stang trey85st...@gmail.com wrote: I'm trying to get an idea of what kind of backend setup I would need to run puppet to manage roughly 6000 hosts. No one else has asked, but what's the geographic/network distribution look like? I see puppet by iteself is limited to

Re: [Puppet Users] Re: Considerations for puppet/cluster to manage 6000 hosts.

2011-01-09 Thread Peter Meier
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 You'll need one or more mysql servers if you use storedconfigs. Storedconfigs can be useful, but will drastically increase the server CPU usage and will require a mysql backend. You can always turn it on later. One or more *SQL* servers: we

Re: [Puppet Users] Re: Considerations for puppet/cluster to manage 6000 hosts.

2011-01-09 Thread Nigel Kersten
On Sat, Jan 8, 2011 at 7:50 PM, Daniel Pittman dan...@rimspace.net wrote: On Sat, Jan 8, 2011 at 14:18, Patrick kc7...@gmail.com wrote: You'll need one or more mysql servers if you use storedconfigs.   Storedconfigs can be useful, but will drastically increase the server CPU usage and will

[Puppet Users] Re: Considerations for puppet/cluster to manage 6000 hosts.

2011-01-08 Thread trey85stang
Thanks for the reply, is there any documentation available on this type of setup? Where would the sql servers come into play? On Jan 8, 4:06 pm, Eduardo S. Scarpellini scarpell...@gmail.com wrote: My suggestions for big scenarios is: mod_passenger/apache22 (+ ruby-enterprise), subversion (or

Re: [Puppet Users] Re: Considerations for puppet/cluster to manage 6000 hosts.

2011-01-08 Thread Patrick
You'll need one or more mysql servers if you use storedconfigs. Storedconfigs can be useful, but will drastically increase the server CPU usage and will require a mysql backend. You can always turn it on later. There are two (working) ways to setup SSL which is used for authentication and

[Puppet Users] Re: Considerations for puppet/cluster to manage 6000 hosts.

2011-01-08 Thread trey85stang
Thanks for all the replies, looks like a have a lot more reading to do. Appreciate all the info! Thanks On Jan 8, 4:18 pm, Patrick kc7...@gmail.com wrote: You'll need one or more mysql servers if you use storedconfigs.   Storedconfigs can be useful, but will drastically increase the server