+1 on using a VCS system like GIT. Puppet is not the tool for doing this
kind of operation.
The vcsrepo puppet module can be used to checkout / update a repo of
files, and as jcbollinger said, that will scale well with changed files
individually versus re-deploy or rsync of all files.
https://forge.puppetlabs.com/puppetlabs/vcsrepo
On 2014-11-18 06:55, jcbollinger wrote:
On Monday, November 17, 2014 12:32:44 PM UTC-6, Seokhee Kim wrote:
Hi,
We have some special case to use Puppet which need to sync many and
many files but just few files are updated ( delete, created or
updated ).
Is there any way to sync just for changed files? now I am syncing
whole dir with purge option.
And I realized it's getting slower and slower based on number of
files.
So it looks like syncing changed list would be good idea.
The cost of such an operation must scale with the number of files,
unless you know in advance of each run, through some out-of-band
mechanism, what updates need to be performed. If you don't know that
then you have no alternative but to touch or at least examine every
one, either to determine whether it needs to be updated or to blindly
overwrite it. You can make that *cheaper* by various means, such as
changing the Files' 'checksum' parameter or managing the files via
rsync instead, but such options still scale the same way.
There is in fact a way to scale with the number of changes instead of
with the number of files, however: manage the files via a
version-control system (git, svn, mercurial, etc.) instead of directly
via Puppet. This has overhead in the form of disk space, of course,
and Puppet will not be able to report as precisely on changes
performed. Also you will not be able to have Puppet relationships with
individual files from the collection, because they are not represented
to Puppet as individual resources.
John
--
You received this message because you are subscribed to the Google Groups "Puppet
Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/puppet-users/36570a8e81889db502bb94016c06eab1%40mass-distortion.net.
For more options, visit https://groups.google.com/d/optout.
