Re,

Well, the big question is do you HAVE 10k resources, or do you have a bug in your manifest?

When you have ruled out obvious bugs in your manifest (like exporting stuff thrice), you can turn to tuning your setup:

  * I found significant savings in grouping common service checks into
    a single template.

  * The nagios_* types are "nice", but just deploying file(snippets) is
    just MUCH cheaper.


Regards, David

On 26.09.2013 17:20, Matthew Arguin wrote:
So my reasoning behind the initial question/post again is due largely to
being unfamiliar with puppetdb i would say.  We do export a lot of
resources in our puppet deployment due to the nagios checks.  In poking
around on the groups, i came across this post:
https://groups.google.com/forum/#!topic/puppet-users/z1kjqwko1iA

i was especially interested in the comment posted by windowsrefund at
the bottom and trying to understand that because it seems like he is
saying that i could reduce the amount of duplication of exported
resources, but i am not entirely sure.

Basic questions:  Is it "bad" to have resource duplication?  Is it
"good" to have catalog duplication?  Should i just forget about the
20000 default on the query param or should i be aiming to tune my puppet
deployment to work towards that?  (currently set to 50000 to stop the
issue).

if i did not mention previously, heap currently set to 1G and looking at
the spark line, i seem to be maxing out right now at about 500MB.


On Thu, Sep 26, 2013 at 3:33 AM, David Schmitt <da...@dasz.at
<mailto:da...@dasz.at>> wrote:

    On 26.09.2013 05 <tel:26.09.2013%2005>:17, Christopher Wood wrote:

        On Wed, Sep 25, 2013 at 02:25:50PM +0100, Ken Barber wrote:

        (SNIP)

            http://puppetdb1.vm:8080/__dashboard/index.html
            <http://puppetdb1.vm:8080/dashboard/index.html>. Since
            Puppet doesn't
            put a limit on # of resources per node, its hard to say if
            your case
            is a problem somewhere. It does however sound exceptional
            but not
            unlikely (I've seen some nodes with 10k resources a-piece for
            example).


        Now I'm curious about

        who these people are


    Me, for example.


        why they need 10,000 resources per host


    Such numbers are easy to reach when every service exports a nagios
    check into a central server.


        how they keep track of everything


    High modularity. See below.


        how long an agent run takes


    Ages. The biggest node I know takes around 44 minutes to run.


        and how much cpu/ram an agent run takes


    Too much.


        and how they troubleshoot the massive debug output


    Since these 10k+ resources are 99% the same, there is not much to
    troubleshoot.


    Regards, David


    --
    You received this message because you are subscribed to a topic in
    the Google Groups "Puppet Users" group.
    To unsubscribe from this topic, visit
    https://groups.google.com/d/__topic/puppet-users/__D1KyxpUB4UU/unsubscribe
    <https://groups.google.com/d/topic/puppet-users/D1KyxpUB4UU/unsubscribe>.
    To unsubscribe from this group and all its topics, send an email to
    puppet-users+unsubscribe@__googlegroups.com
    <mailto:puppet-users%2bunsubscr...@googlegroups.com>.
    To post to this group, send email to puppet-users@googlegroups.com
    <mailto:puppet-users@googlegroups.com>.
    Visit this group at http://groups.google.com/__group/puppet-users
    <http://groups.google.com/group/puppet-users>.
    For more options, visit https://groups.google.com/__groups/opt_out
    <https://groups.google.com/groups/opt_out>.


--
You received this message because you are subscribed to the Google
Groups "Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to puppet-users+unsubscr...@googlegroups.com.
To post to this group, send email to puppet-users@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-users.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "Puppet 
Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To post to this group, send email to puppet-users@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-users.
For more options, visit https://groups.google.com/groups/opt_out.

Reply via email to