On Tuesday, November 4, 2014 9:32:32 AM UTC-6, Georgi Todorov wrote: > > On Tuesday, November 4, 2014 9:50:15 AM UTC-5, jcbollinger wrote: >> >> By far the biggest difference is is File retrieval time. This will be >> for File resources where you specify content via a 'source' parameter >> rather than via a 'content' property. The agent must make a separate >> request to the master for each such file, and those are collectively taking >> a long time. Most likely they are backing up behind a bottleneck, so that >> much of the time consumed per node is actually spent waiting for service. >> > > I agree, there is something odd about File retrieval. We are creating a > total of 10 autofs maps, however when I run trace, it looks like every > separate entry creates a concat::fragment (puppetlabs-concat) which is > later combined into a single file. I'm not too familliar with what > concat::fragment does, but a quick scan of the code shows a lot of "source" > references. >
The Concat module provides a mechanism for managing a single file as a collection of separately-managed pieces, or 'fragments'. This has a number of advantages, mostly deriving from the ability to spread management of a single target file across multiple manifests, modules, or even separate nodes. As a practical matter, though, the implementation manages each fragment as a separate File, and combines them on the client. Those fragment files, one per Concat::Fragment resource, can use either 'content' or 'source', as specified for that fragment. I find it a bit odd that an autofs module would choose the 'source' option (with a 'puppet://*' URL as its value), but if it's indeed doing so then perhaps that is generating large numbers of tiny, 'source'd files. > We might have to just go to template files, instead of using the autofs > module. That might take care of all our issues. > > It might. Or you might find an alternative autofs module that operates differently. Or perhaps you could just use your current autofs module in a different way. John -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-users/6c4f5ef7-b00b-4dc5-b66d-a00c11189e42%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
