Re: [Puppet Users] Benchmark puppetDB

[shell heriyanto]

Hello Chris,

Thanks for your reply, i already solved this by use my production modules.
But yes, its take some time to build half my of production enviroment.
Thank for yours great work.

Regards,
Heriyanto

On Thu, Oct 25, 2012 at 12:38 AM, Chris Price  wrote:

> Hello Heriyanto,
>
> Were you able to come up with something to solve your problem?  We don't
> currently have any sort of sample catalog that could be used to easily
> benchmark the performance difference in your environment, though your
> e-mail has prompted some internal discussion about how we could conceivably
> provide something like that in the future.
>
> I suspect that if you simply time any agent run in your environment (for
> an agent with a non-trivial number of resources) against legacy
> storedconfigs, and then time it again with PuppetDB, you should notice some
> difference (because legacy storeconfigs must synchronously insert all of
> the catalog data into the database before the run completes).  You could
> also run your master with the "--debug" flag, which might provide you with
> some timing info for the various phases of the process.
>
> However, the biggest benefits come when you have a master that is under
> some load from concurrent agent requests.  That might be a bit more tricky
> to simulate in your own environment if the blog posts and other data we've
> posted isn't sufficient, but we would be happy to try to help if you have
> questions!
>
> Thanks
> Chris
>
>
> On Wednesday, October 17, 2012 5:45:07 AM UTC-7, Heriyanto wrote:
>
>> Hi Nan,
>>
>> Thank for your reply, yes that what im talking about, i can't prove just
>> with link to puppet blog,
>> yes you right catalog compile should give our output, do you have some
>> example of one
>> with large number of resources for my testing?
>>
>> Thank for your help
>> Regards,
>>
>> On Tue, Oct 16, 2012 at 1:12 AM, Nan Liu  wrote:
>>
>>> On Mon, Oct 15, 2012 at 1:41 AM, shell heriyanto
>>>  wrote:
>>> > I know puppetDB its more faster than storeconfigs, but to replace
>>> > storeconfigs with puppetDB into production server
>>> > Its need more explanation than some link from puppetlabs, need prove
>>> to my
>>> > bos and team.
>>> > For testing i just have 1 puppetmaster and 1 and 2 puppet agent, how i
>>> can
>>> > look different performance?
>>> > Its that any idea / or complex puppet stanza to benchmark / compare
>>> this
>>> > with storeconfigs?
>>>
>>> A catalog compile should show the difference in speed (especially one
>>> with large number of resources). This is discussed in the Puppet DB
>>> blog post. Also Deepak has great talk at Puppet Conf discussing why
>>> PuppetDB is async (which isn't something quite as easy to benchmark
>>> with just 2 agents):
>>>
>>> http://youtu.be/xw83cRofkpM
>>>
>>> HTH,
>>>
>>> Nan
>>>
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "Puppet Users" group.
>>> To post to this group, send email to puppet...@googlegroups.com.
>>> To unsubscribe from this group, send email to puppet-users...@**
>>> googlegroups.com.
>>>
>>> For more options, visit this group at http://groups.google.com/**
>>> group/puppet-users?hl=en
>>> .
>>>
>>>
>>  --
> You received this message because you are subscribed to the Google Groups
> "Puppet Users" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/puppet-users/-/vTscH5wWHWEJ.
>
> To post to this group, send email to puppet-users@googlegroups.com.
> To unsubscribe from this group, send email to
> puppet-users+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/puppet-users?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Users" group.
To post to this group, send email to puppet-users@googlegroups.com.
To unsubscribe from this group, send email to 
puppet-users+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/puppet-users?hl=en.

Re: [Puppet Users] Benchmark puppetDB

[Chris Price]

Hello Heriyanto,

Were you able to come up with something to solve your problem?  We don't 
currently have any sort of sample catalog that could be used to easily 
benchmark the performance difference in your environment, though your 
e-mail has prompted some internal discussion about how we could conceivably 
provide something like that in the future.

I suspect that if you simply time any agent run in your environment (for an 
agent with a non-trivial number of resources) against legacy storedconfigs, 
and then time it again with PuppetDB, you should notice some difference 
(because legacy storeconfigs must synchronously insert all of the catalog 
data into the database before the run completes).  You could also run your 
master with the "--debug" flag, which might provide you with some timing 
info for the various phases of the process.

However, the biggest benefits come when you have a master that is under 
some load from concurrent agent requests.  That might be a bit more tricky 
to simulate in your own environment if the blog posts and other data we've 
posted isn't sufficient, but we would be happy to try to help if you have 
questions!

Thanks
Chris

On Wednesday, October 17, 2012 5:45:07 AM UTC-7, Heriyanto wrote:
>
> Hi Nan,
>
> Thank for your reply, yes that what im talking about, i can't prove just 
> with link to puppet blog,
> yes you right catalog compile should give our output, do you have some 
> example of one
> with large number of resources for my testing?
>
> Thank for your help
> Regards,
>
> On Tue, Oct 16, 2012 at 1:12 AM, Nan Liu 
> > wrote:
>
>> On Mon, Oct 15, 2012 at 1:41 AM, shell heriyanto
>> > wrote:
>> > I know puppetDB its more faster than storeconfigs, but to replace
>> > storeconfigs with puppetDB into production server
>> > Its need more explanation than some link from puppetlabs, need prove to 
>> my
>> > bos and team.
>> > For testing i just have 1 puppetmaster and 1 and 2 puppet agent, how i 
>> can
>> > look different performance?
>> > Its that any idea / or complex puppet stanza to benchmark / compare this
>> > with storeconfigs?
>>
>> A catalog compile should show the difference in speed (especially one
>> with large number of resources). This is discussed in the Puppet DB
>> blog post. Also Deepak has great talk at Puppet Conf discussing why
>> PuppetDB is async (which isn't something quite as easy to benchmark
>> with just 2 agents):
>>
>> http://youtu.be/xw83cRofkpM
>>
>> HTH,
>>
>> Nan
>>
>> --
>> You received this message because you are subscribed to the Google Groups 
>> "Puppet Users" group.
>> To post to this group, send email to puppet...@googlegroups.com
>> .
>> To unsubscribe from this group, send email to 
>> puppet-users...@googlegroups.com .
>> For more options, visit this group at 
>> http://groups.google.com/group/puppet-users?hl=en.
>>
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Users" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/puppet-users/-/vTscH5wWHWEJ.
To post to this group, send email to puppet-users@googlegroups.com.
To unsubscribe from this group, send email to 
puppet-users+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/puppet-users?hl=en.

Re: [Puppet Users] Benchmark puppetDB

[shell heriyanto]

Hi Nan,

Thank for your reply, yes that what im talking about, i can't prove just
with link to puppet blog,
yes you right catalog compile should give our output, do you have some
example of one
with large number of resources for my testing?

Thank for your help
Regards,

On Tue, Oct 16, 2012 at 1:12 AM, Nan Liu  wrote:

> On Mon, Oct 15, 2012 at 1:41 AM, shell heriyanto
>  wrote:
> > I know puppetDB its more faster than storeconfigs, but to replace
> > storeconfigs with puppetDB into production server
> > Its need more explanation than some link from puppetlabs, need prove to
> my
> > bos and team.
> > For testing i just have 1 puppetmaster and 1 and 2 puppet agent, how i
> can
> > look different performance?
> > Its that any idea / or complex puppet stanza to benchmark / compare this
> > with storeconfigs?
>
> A catalog compile should show the difference in speed (especially one
> with large number of resources). This is discussed in the Puppet DB
> blog post. Also Deepak has great talk at Puppet Conf discussing why
> PuppetDB is async (which isn't something quite as easy to benchmark
> with just 2 agents):
>
> http://youtu.be/xw83cRofkpM
>
> HTH,
>
> Nan
>
> --
> You received this message because you are subscribed to the Google Groups
> "Puppet Users" group.
> To post to this group, send email to puppet-users@googlegroups.com.
> To unsubscribe from this group, send email to
> puppet-users+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/puppet-users?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Users" group.
To post to this group, send email to puppet-users@googlegroups.com.
To unsubscribe from this group, send email to 
puppet-users+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/puppet-users?hl=en.

Re: [Puppet Users] Benchmark puppetDB

[Nan Liu]

On Mon, Oct 15, 2012 at 1:41 AM, shell heriyanto
 wrote:
> I know puppetDB its more faster than storeconfigs, but to replace
> storeconfigs with puppetDB into production server
> Its need more explanation than some link from puppetlabs, need prove to my
> bos and team.
> For testing i just have 1 puppetmaster and 1 and 2 puppet agent, how i can
> look different performance?
> Its that any idea / or complex puppet stanza to benchmark / compare this
> with storeconfigs?

A catalog compile should show the difference in speed (especially one
with large number of resources). This is discussed in the Puppet DB
blog post. Also Deepak has great talk at Puppet Conf discussing why
PuppetDB is async (which isn't something quite as easy to benchmark
with just 2 agents):

http://youtu.be/xw83cRofkpM

HTH,

Nan

-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Users" group.
To post to this group, send email to puppet-users@googlegroups.com.
To unsubscribe from this group, send email to 
puppet-users+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/puppet-users?hl=en.

[Puppet Users] Benchmark puppetDB

[shell heriyanto]

Dear All,

I know puppetDB its more faster than storeconfigs, but to replace
storeconfigs with puppetDB into production server
Its need more explanation than some link from puppetlabs, need prove to my
bos and team.
For testing i just have 1 puppetmaster and 1 and 2 puppet agent, how i can
look different performance?
Its that any idea / or complex puppet stanza to benchmark / compare this
with storeconfigs?

Regards,
Thanks

-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Users" group.
To post to this group, send email to puppet-users@googlegroups.com.
To unsubscribe from this group, send email to 
puppet-users+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/puppet-users?hl=en.