Forum: CFEngine Help
Subject: How long do your clients perform network transfers?
Author: [email protected]
Link to topic: https://cfengine.com/forum/read.php?3,22986,22986#msg-22986
I was thinking of switching my network transfer method from using digest to MD5
comparison. Here’s a test of how long its taking for me to perform a sync from
my master policy server. I have 465 files under /var/cfengine/inputs that
contain various policies, scripts, and system configurations.
# find /var/cfengine/inputs -print | wc -l
465
From my update.cf...
body copy_from remote_copy(sourcedir,sourceserver)
{
source => "$(sourcedir)";
servers => { "$(sourceserver)" };
copy_backup => "true";
purge => "true";
trustkey => "true";
compare => "digest";
encrypt => "true";
verify => "true";
}
Compare = MD5 digest:
# time /var/cfengine/bin/cf-agent -I -K -f failsafe.cf
real 0m27.082s
user 0m0.363s
sys 0m0.167s
Compare = File mtime:
# time /var/cfengine/bin/cf-agent -I -K -f failsafe.cf
real 0m26.462s
user 0m0.284s
sys 0m0.145s
File mtime with verify = false:
# time /var/cfengine/bin/cf-agent -I -K -f failsafe.cf
real 0m26.470s
user 0m0.282s
sys 0m0.142s
So, I’m really not seeing any sort of performance change whatsoever. In
reality, cf-agent and cf-serverd are spending 99% of the time sleeping. I see
this on “busy” master policy servers. Is this due to locking on BerkeleyDB’s
cf_lock.db? Would moving to TokyoCabinet in 3.2 really accelerate my
performance here on network transfers? Anyone else have similar results?
Kind of hard to see from below, but the cf-serverd threads below are in the SLP
column = sleep.
Thanks
Mike
$ prstat -Lm
PID USERNAME USR SYS TRP TFL DFL LCK SLP LAT VCX ICX SCL SIG PROCESS/LWPID
17592 root 41 2.5 0.0 0.0 0.0 0.0 56 0.2 3K 117 .1M 0 nscd/339
17592 root 28 1.9 0.0 0.0 0.0 0.0 70 0.2 2K 118 68K 0 nscd/67
5519 root 23 2.4 0.0 0.0 0.0 0.0 74 0.1 5K 83 68K 0 cf-agent/1
19438 root 11 0.1 0.0 0.0 0.0 0.0 89 0.0 116 29 1K 0 cf-serverd/19965
19438 root 2.4 0.4 0.0 0.0 0.0 0.0 97 0.0 90 10 2K 0 cf-serverd/19964
19438 root 2.2 0.3 0.0 0.0 0.0 0.0 97 0.0 81 7 2K 0 cf-serverd/19963
19438 root 1.2 0.3 0.0 0.0 0.0 0.0 99 0.0 85 13 2K 0 cf-serverd/19962
19438 root 1.1 0.3 0.0 0.0 0.0 0.0 99 0.0 72 4 2K 0 cf-serverd/19961
4947 root 1.1 0.2 0.0 0.0 0.0 0.0 99 0.0 198 2 1K 0 cf-agent/1
5153 splunk 1.0 0.1 0.0 0.0 0.0 0.0 99 0.0 9 3 601 0 splunkd/36
19438 root 0.8 0.2 0.0 0.0 0.0 0.0 99 0.0 82 6 1K 0 cf-serverd/19945
19438 root 0.7 0.2 0.0 0.0 0.0 0.0 99 0.0 88 2 1K 0 cf-serverd/19938
19438 root 0.7 0.2 0.0 0.0 0.0 0.0 99 0.0 139 1 1K 0 cf-serverd/19946
19438 root 0.7 0.2 0.0 0.0 0.0 0.0 99 0.0 80 2 1K 0 cf-serverd/19939
19438 root 0.6 0.2 0.0 0.0 0.0 0.0 99 0.0 77 0 1K 0 cf-serverd/19943
19438 root 0.6 0.1 0.0 0.0 0.0 0.0 99 0.0 94 9 1K 0 cf-serverd/19928
19438 root 0.6 0.1 0.0 0.0 0.0 0.0 99 0.0 86 2 1K 0 cf-serverd/19935
19438 root 0.6 0.1 0.0 0.0 0.0 0.0 99 0.0 90 1 1K 0 cf-serverd/19948
19438 root 0.5 0.1 0.0 0.0 0.0 0.0 99 0.0 81 0 1K 0 cf-serverd/19944
19438 root 0.5 0.1 0.0 0.0 0.0 0.0 99 0.0 79 2 1K 0 cf-serverd/19947
19438 root 0.5 0.1 0.0 0.0 0.0 0.0 99 0.0 75 1 1K 0 cf-serverd/19934
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 94 0 921 0 cf-serverd/19952
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 92 4 870 0 cf-serverd/19941
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 84 0 865 0 cf-serverd/19958
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 81 0 824 0 cf-serverd/19930
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 89 1 891 0 cf-serverd/19949
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 85 1 864 0 cf-serverd/19957
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 89 0 896 0 cf-serverd/19954
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 89 2 919 0 cf-serverd/19951
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 88 0 821 0 cf-serverd/19940
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 83 1 833 0 cf-serverd/19959
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 81 2 860 0 cf-serverd/19956
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 96 0 875 0 cf-serverd/19955
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 75 0 817 0 cf-serverd/19924
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 81 0 845 0 cf-serverd/19942
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 93 0 889 0 cf-serverd/19932
19438 root 0.3 0.1 0.0 0.0 0.0 0.0 100 0.0 77 0 835 0 cf-serverd/19926
Total: 72 processes, 304 lwps, load averages: 0.67, 0.46, 0.37
_______________________________________________
Help-cfengine mailing list
[email protected]
https://cfengine.org/mailman/listinfo/help-cfengine
