Re: [Puppet Users] Puppet Compiled catalog very slow after upgrade puppetserver from puppet5 to puppet6

2020-09-18 Thread Yan Xiaofei
Hello Justin,

Thanks very much,
After set 1.25g heap size per instance and add codecache the performance is
better than before.

Regards
Xiaofei


On Fri, Sep 18, 2020 at 2:05 AM Justin Stoller  wrote:

> This is a draft of a new 6.x tuning guide we're working on, it may be of
> some help to you
> https://tickets.puppetlabs.com/browse/SERVER-2771
>
> The big things are a need for increased codecache and a very negative
> effect of low max-requests-per-instance values.
>
> hth,
> Justin
>
> On Thu, Sep 17, 2020 at 7:20 AM Yan Xiaofei  wrote:
>
>>  Hello
>>
>> I upgrade one of our puppetserver from puppetserver-5.3.1- to
>> puppetserver-6.13.0. The puppet server became very busy than before.
>> The puppet compiled catalog time is about 10 times than before.
>>
>> Here is one of tGhe client report:
>>
>> catalog_application380.6643
>> transaction_evaluation380.1565
>> config_retrieval11.5068
>> package8.7797
>> augeas6.1567
>> file4.1379
>> node_retrieval2.1395
>> fact_generation1.5989
>> plugin_sync1.1549
>> service0.6611
>> convert_catalog0.6149
>> exec0.1104
>> cron0.0581
>> sshd_config0.038
>> kernel_parameter0.0154
>> yumrepo0.0066
>> user0.0037
>> anchor0.0019
>> group0.0015
>> Total398.0497
>>
>> It take about 5 times than before.
>>
>> Here is one of client report, it take only 72 seconds to finish the
>> configuration:
>> catalog_application55.3449
>> transaction_evaluation54.9467
>> user12.4695
>> config_retrieval11.4419
>> package8.1218
>> augeas6.0239
>> service3.3816
>> file2.6859
>> fact_generation1.7699
>> convert_catalog1.707
>> plugin_sync0.7643
>> node_retrieval0.6629
>> exec0.1127
>> cron0.0607
>> sshd_config0.0397
>> group0.0277
>> kernel_parameter0.0174
>> yumrepo0.0055
>> anchor0.0017
>> Total72.3976
>>
>> How to tuning the performance of new version puppetserver.
>>
>> Best Regards
>> Xiaofei
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Puppet Users" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to puppet-users+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/puppet-users/CAEneikT0wwfJ8e06a%3Dqryd5MBEe2X4%2B-wgdf_VXCh0QLH9kmSw%40mail.gmail.com
>> <https://groups.google.com/d/msgid/puppet-users/CAEneikT0wwfJ8e06a%3Dqryd5MBEe2X4%2B-wgdf_VXCh0QLH9kmSw%40mail.gmail.com?utm_medium=email&utm_source=footer>
>> .
>>
> --
> You received this message because you are subscribed to the Google Groups
> "Puppet Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to puppet-users+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/puppet-users/CA%2B%3DBEqVNp_n87f8ZQxC6JqVKBhZmciTsj8tOvqhPMc6zWVMH0Q%40mail.gmail.com
> <https://groups.google.com/d/msgid/puppet-users/CA%2B%3DBEqVNp_n87f8ZQxC6JqVKBhZmciTsj8tOvqhPMc6zWVMH0Q%40mail.gmail.com?utm_medium=email&utm_source=footer>
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/CAEneikQ%3D1s-Ps%3DRkz%3D8uuqLy88vOOt-c49Hh-STCLLGeoAsBCg%40mail.gmail.com.


[Puppet Users] Puppet Compiled catalog very slow after upgrade puppetserver from puppet5 to puppet6

2020-09-17 Thread Yan Xiaofei
 Hello

I upgrade one of our puppetserver from puppetserver-5.3.1- to
puppetserver-6.13.0. The puppet server became very busy than before.
The puppet compiled catalog time is about 10 times than before.

Here is one of tGhe client report:

catalog_application380.6643
transaction_evaluation380.1565
config_retrieval11.5068
package8.7797
augeas6.1567
file4.1379
node_retrieval2.1395
fact_generation1.5989
plugin_sync1.1549
service0.6611
convert_catalog0.6149
exec0.1104
cron0.0581
sshd_config0.038
kernel_parameter0.0154
yumrepo0.0066
user0.0037
anchor0.0019
group0.0015
Total398.0497

It take about 5 times than before.

Here is one of client report, it take only 72 seconds to finish the
configuration:
catalog_application55.3449
transaction_evaluation54.9467
user12.4695
config_retrieval11.4419
package8.1218
augeas6.0239
service3.3816
file2.6859
fact_generation1.7699
convert_catalog1.707
plugin_sync0.7643
node_retrieval0.6629
exec0.1127
cron0.0607
sshd_config0.0397
group0.0277
kernel_parameter0.0174
yumrepo0.0055
anchor0.0017
Total72.3976

How to tuning the performance of new version puppetserver.

Best Regards
Xiaofei

-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/CAEneikT0wwfJ8e06a%3Dqryd5MBEe2X4%2B-wgdf_VXCh0QLH9kmSw%40mail.gmail.com.


[Puppet Users] How to make puppetlabs yum repository mirror

2018-01-18 Thread Yan Xiaofei

Hello

I used to rsync from rsync://yum.puppetlabs.com/. But it did not works 
any more.

How can I make local mirror from yum.puppetlabs.com.

Thanks very much!
Xiaofei

--
You received this message because you are subscribed to the Google Groups "Puppet 
Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/512d6e9a-167b-11a5-1049-a94db04aa0c0%40gmail.com.
For more options, visit https://groups.google.com/d/optout.


[Puppet Users] Puppet agent did not running after puppet agent reload

2017-09-07 Thread Yan Xiaofei

Dear puppet experts,

My puppet agent version is 3.8.1. Some of the agent report error message :
puppet-agent[15104]: Shutdown/restart in progress (:restart_requested); 
skipping run


This was because puppet reload config file during puppet agent running.
Here is the manifests:

  augeas{"splay" :
   context => "/files/etc/puppet/puppet.conf/agent/",
   changes => "set splay true",
   notify  => Exec['refreshpuppet']
  }

  augeas{"splaylimit" :
   context => "/files/etc/puppet/puppet.conf/agent/",
   changes => "set splaylimit $puppetinterval",
   notify  => Exec['refreshpuppet']
  }

  exec {'refreshpuppet':
    command  => "/etc/init.d/puppet reload",
    refreshonly  => true
  }

If I install a new node. This problem happened about 50%.  Some of the 
puppet agents  will process puppet reload after puppet run, These nodes 
are ok after installation. And some of the agents  will process puppet 
reload during puppet run, These nodes will report error message 
"Shutdown/restart in progress (:restart_requested); skipping run".


Regards
Xiaofei


--
You received this message because you are subscribed to the Google Groups "Puppet 
Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/0611996f-2da0-6b83-0216-f6272aa1d7da%40gmail.com.
For more options, visit https://groups.google.com/d/optout.


[Puppet Users] Error: Could not evaluate: invalid comparator for command get

2013-10-16 Thread Yan Xiaofei
Hello,

I use saz/ssh module to config ssh server.
Here is part of my manifese file:
ssh::server::configline{ 'AllowGroups':
ensure => 'present',
value => $allowgroups
}
ssh::server::configline{ 'AllowUsers':
ensure => 'absent',
}


But it report error after perform this change.
Here is the error message:

Info: Applying configuration version '1381979421'
Error:
/Stage[main]/Localaccounts::Sshconfig/Ssh::Server::Configline[AllowUsers]/Augeas[sshd_config_AllowUsers]:
Could not evaluate: Save failed with return code false, see debug

Error:
/Stage[main]/Localaccounts::Sshconfig/Ssh::Server::Configline[AllowGroups]/Augeas[sshd_config_AllowGroups]:
Could not evaluate: invalid comparator for command get
Notice: /Stage[main]/Ssh::Server::Service/Service[sshd]: Dependency
Augeas[sshd_config_AllowUsers] has failures: true
Notice: /Stage[main]/Ssh::Server::Service/Service[sshd]: Dependency
Augeas[sshd_config_AllowGroups] has failures: true
Warning: /Stage[main]/Ssh::Server::Service/Service[sshd]: Skipping
because of failed dependencies

Best Regards
Xiaofei

-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To post to this group, send email to puppet-users@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-users.
For more options, visit https://groups.google.com/groups/opt_out.


Re: [Puppet Users] Re: Warning: appears to have a negative number of dependencies

2013-10-14 Thread Yan Xiaofei
Hello

I resolved the problem.
I define same packages in deferent modules, and some dependences to
these packages.

Delete multiple package define, the warning message was gone.

Cheers
Xiaofei

于 2013/10/14 14:12, Rahul Khengare wrote:
> Hi Yan,
> Can you provide details about your manifests. May be manifests helps
> us to find the solution to problem.
>
> Thanks and Regards,
> Rahul Khengare
> NTT DATA OSS Center, Pune, India.
>
>
> On Saturday, October 12, 2013 6:22:00 AM UTC+5:30, Yan Xiaofei wrote:
>
> Hello
>
> After add some packagelist to puppet class.
> I get lots of warning message "appears to have a negative number of
> dependencies".
> My puppet master and agent version are 3.3.1.
> Here is the log out:
>
> [root@gpu022 ~]# puppet agent --test
> Info: Retrieving plugin
> Info: Loading facts in /var/lib/puppet/lib/facter/puppet_vardir.rb
> Info: Loading facts in /var/lib/puppet/lib/facter/puppi_projects.rb
> Info: Loading facts in /var/lib/puppet/lib/facter/pe_version.rb
> Info: Loading facts in /var/lib/puppet/lib/facter/last_run.rb
> Info: Loading facts in /var/lib/puppet/lib/facter/concat_basedir.rb
> Info: Loading facts in /var/lib/puppet/lib/facter/root_home.rb
> Info: Loading facts in /var/lib/puppet/lib/facter/facter_dot_d.rb
> Info: Caching catalog for gpu022.ihep.ac.cn
> <http://gpu022.ihep.ac.cn>
> Info: Applying configuration version '1381473104'
> Warning: /Stage[main]/Afs::Client/Service[afs]: appears to have a
> negative number of dependen
> Warning: Class[Afs::Client]: appears to have a negative number of
> dependencies
> Warning: Class[Afs::Client]: appears to have a negative number of
> dependencies
> Warning: /Stage[main]/Afs::Client/File[ThisCell]: appears to have a
> negative number of depend
> Warning: /Stage[main]/Afs::Client/File[CellServDB]: appears to have a
> negative number of depe
> Warning: Class[Afs::Client]: appears to have a negative number of
> dependencies
> Warning: Class[Afs::Client]: appears to have a negative number of
> dependencies
> Warning: Stage[main]: appears to have a negative number of
> dependencies
> Warning: Stage[main]: appears to have a negative number of
> dependencies
> Warning: Stage[main]: appears to have a negative number of
> dependencies
> Warning: Stage[main]: appears to have a negative number of
> dependencies
> Warning: /root/wn58packages.lst: appears to have a negative number of
> dependencies
> Warning: Class[Wn58packages]: appears to have a negative number of
> dependencies
> Warning: Stage[main]: appears to have a negative number of
> dependencies
> Notice: Finished catalog run in 150.52 seconds
>
>
> -- 
> You received this message because you are subscribed to the Google
> Groups "Puppet Users" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to puppet-users+unsubscr...@googlegroups.com.
> To post to this group, send email to puppet-users@googlegroups.com.
> Visit this group at http://groups.google.com/group/puppet-users.
> For more options, visit https://groups.google.com/groups/opt_out.

-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To post to this group, send email to puppet-users@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-users.
For more options, visit https://groups.google.com/groups/opt_out.


[Puppet Users] Warning: appears to have a negative number of dependencies

2013-10-11 Thread Yan Xiaofei
Hello

After add some packagelist to puppet class.
I get lots of warning message "appears to have a negative number of
dependencies".
My puppet master and agent version are 3.3.1.
Here is the log out:

[root@gpu022 ~]# puppet agent --test
Info: Retrieving plugin
Info: Loading facts in /var/lib/puppet/lib/facter/puppet_vardir.rb
Info: Loading facts in /var/lib/puppet/lib/facter/puppi_projects.rb
Info: Loading facts in /var/lib/puppet/lib/facter/pe_version.rb
Info: Loading facts in /var/lib/puppet/lib/facter/last_run.rb
Info: Loading facts in /var/lib/puppet/lib/facter/concat_basedir.rb
Info: Loading facts in /var/lib/puppet/lib/facter/root_home.rb
Info: Loading facts in /var/lib/puppet/lib/facter/facter_dot_d.rb
Info: Caching catalog for gpu022.ihep.ac.cn
Info: Applying configuration version '1381473104'
Warning: /Stage[main]/Afs::Client/Service[afs]: appears to have a
negative number of dependen
Warning: Class[Afs::Client]: appears to have a negative number of
dependencies
Warning: Class[Afs::Client]: appears to have a negative number of
dependencies
Warning: /Stage[main]/Afs::Client/File[ThisCell]: appears to have a
negative number of depend
Warning: /Stage[main]/Afs::Client/File[CellServDB]: appears to have a
negative number of depe
Warning: Class[Afs::Client]: appears to have a negative number of
dependencies
Warning: Class[Afs::Client]: appears to have a negative number of
dependencies
Warning: Stage[main]: appears to have a negative number of dependencies
Warning: Stage[main]: appears to have a negative number of dependencies
Warning: Stage[main]: appears to have a negative number of dependencies
Warning: Stage[main]: appears to have a negative number of dependencies
Warning: /root/wn58packages.lst: appears to have a negative number of
dependencies
Warning: Class[Wn58packages]: appears to have a negative number of
dependencies
Warning: Stage[main]: appears to have a negative number of dependencies
Notice: Finished catalog run in 150.52 seconds


-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To post to this group, send email to puppet-users@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-users.
For more options, visit https://groups.google.com/groups/opt_out.


Re: [Puppet Users] Re: How to specify kernel version from puppet and downgrade pkg version.

2013-09-16 Thread Yan Xiaofei
Hello John

Thanks very much! I am a new user of puppet.

If I have lot of machines that install different version of kernel. I
want them install the same version.
Do I need specify delete all other version of kernel?


Another question : I didn't find where to set the arch of package from
resource type.

Best regards
Xiaofei

于 2013/9/16 22:31, jcbollinger wrote:
>
>
> On Monday, September 16, 2013 1:57:19 AM UTC-5, Yan Xiaofei wrote:
>
> Hello
>
> I have some kernel moduls rpms related to specific kernel version.
> Is there a method to control kernel versions by puppet?
>
>
>
> You can use Puppet to install and remove kernel packages. You can
> control what version of a given package must be installed. You can use
> facts to determine which kernel version is currently running -- there
> are built-in facts for this.
>
>
> Another question is :
> Some time we need upgrade pkg version and downgrade pkg version,
> is possible by puppet?
>
>
>
> You can specify specific package versions that are supposed to be
> installed, and Puppet will attempt to achieve it. As with most things
> related to packages, this works best when the underlying package
> manager relies on a package repository somewhere, as many do. You can
> also ask that Puppet ensure the latest available version of a given
> package is installed. Refer to the docs for the Package resource type:
> http://docs.puppetlabs.com/references/3.stable/type.html#package
>
>
> John
>
> -- 
> You received this message because you are subscribed to the Google
> Groups "Puppet Users" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to puppet-users+unsubscr...@googlegroups.com.
> To post to this group, send email to puppet-users@googlegroups.com.
> Visit this group at http://groups.google.com/group/puppet-users.
> For more options, visit https://groups.google.com/groups/opt_out.

-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To post to this group, send email to puppet-users@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-users.
For more options, visit https://groups.google.com/groups/opt_out.


[Puppet Users] How to specify kernel version from puppet and downgrade pkg version.

2013-09-16 Thread Yan Xiaofei
Hello

I have some kernel moduls rpms related to specific kernel version.
Is there a method to control kernel versions by puppet?

Another question is :
Some time we need upgrade pkg version and downgrade pkg version, 
is possible by puppet?

Regards
Xiaofei

-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To post to this group, send email to puppet-users@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-users.
For more options, visit https://groups.google.com/groups/opt_out.