[collectd] Collectd can't collect data when mysql is restarted
Hi, When I restarted the mysql, it seems that collectd can't collectd data from mysql. Is it a collectd bug? B.R. Benjamin Wang ___ collectd mailing list collectd@verplant.org http://mailman.verplant.org/listinfo/collectd
[collectd] Mysql plugin works very strange
Hi, When I setup collectd and mysql, there are 5 rrd files generated for mysql_commands as following: mysql_commands-admin_commands.rrd mysql_commands-select.rrd mysql_commands-show_databases.rrd mysql_commands-show_master_status.rrd mysql_commands-show_status.rrd Then I reboot the machine, two strange things happen: 1. mysql_commands-show_master_status.rrd will not be updated 2. There are 3 more rrd files generated(mysql_commands-change_db.rrd, mysql_commands-show_fields.rrd, mysql_commands-show_tables.rrd) Next is the latest ls result: [root@crdc-c210-141 mysql-example]# ls -al total 156 drwxr-xr-x. 2 root root 4096 Mar 21 14:03 . drwxr-xr-x. 13 root root 4096 Mar 14 14:40 .. -rw-r--r--. 1 root root 5320 Mar 21 22:37 mysql_commands-admin_commands.rrd -rw-r--r--. 1 root root 5320 Mar 21 16:34 mysql_commands-change_db.rrd -rw-r--r--. 1 root root 5320 Mar 21 22:37 mysql_commands-select.rrd -rw-r--r--. 1 root root 5320 Mar 21 22:37 mysql_commands-show_databases.rrd -rw-r--r--. 1 root root 5320 Mar 21 16:34 mysql_commands-show_fields.rrd -rw-r--r--. 1 root root 5320 Mar 21 16:34 mysql_commands-show_master_status.rrd -rw-r--r--. 1 root root 5320 Mar 21 22:37 mysql_commands-show_status.rrd -rw-r--r--. 1 root root 5320 Mar 21 16:34 mysql_commands-show_tables.rrd B.R. Benjamin Wang ___ collectd mailing list collectd@verplant.org http://mailman.verplant.org/listinfo/collectd
[collectd] Is there any cache recovering mechanism similar to redo log?
Hi, Collectd website mentions that rrdtool is using cache to avoid the IO hell. Is there any chache recovering mechanism similar to redo log? When the collectd is down, will the cache data be lost or recovered from some place? B.R. Benjamin Wang ___ collectd mailing list collectd@verplant.org http://mailman.verplant.org/listinfo/collectd
[collectd] What about the scalability for collectd network plugin?
Hi, Now we want to manage 100K virtual machines which run collectd. If we just setup a collectd server which enables collectd network plugin to receive the udp packet from the devices and generate all the RRD files. Then our system will parse these RRD files. I have no experience data about the collectd performance. Is there any potential bottleneck for this scenario? Do you have any experienced data about the collectd performance? B.R. Benjamin Wang ___ collectd mailing list collectd@verplant.org http://mailman.verplant.org/listinfo/collectd
[collectd] rrdcached+collectd
Hi, I try to setup rrdcached and collectd in one VM(Redhat 6.2). rrdcached also listens on the network port for remote query. rrdtool: 1.4.7 collectd: 5.2.0 The collectd.conf is as following: LoadPlugin rrdcached LoadPlugin rrdtool Plugin rrdcached DaemonAddress unix:/tmp/rrdcached.sock DataDir /root/tools/rrdcached CreateFiles true /Plugin Plugin rrdtool DataDir /opt/collectd/var/lib/collectd /Plugin The rrdcached start script is as following: rrdcached -F -b /root/tools/rrdcached -j /root/tools/rrdcached/cached -p /root/tools/rrdcached/rrdcached.pid -l unix:/tmp/rrdcached.sock -l 10.74.125.141 But the collectd log always show the error: [2013-03-04 21:24:56] rrdcached plugin: rrdc_update (/root/tools/rrdcached/10.74.125.141/memory/memory-used.rrd, [1362403496:4414574592.00], 1) failed with status -1. [2013-03-04 21:24:56] rrdcached plugin: rrdc_update (/root/tools/rrdcached/10.74.125.141/memory/memory-buffered.rrd, [1362403496:363573248.00], 1) failed with status -1. [2013-03-04 21:24:56] rrdcached plugin: rrdc_update (/root/tools/rrdcached/10.74.125.141/memory/memory-cached.rrd, [1362403496:1231032320.00], 1) failed with status -1. I have gone through the old threads and have tried chmod 777 /root/tools/rrdcached. But it doesn't work. What is the problem? B.R. Benjamin Wang ___ collectd mailing list collectd@verplant.org http://mailman.verplant.org/listinfo/collectd
Re: [collectd] rrdcached+collectd
Hi, It still doesn’t work. When I debug rrdcached, it seems that rrdcached does not receive any packet. Then I try to deploy the rrdcached in another machine, When rrdc_connect within rrdcached plugin is executed, I can monitor the connection is setup. But when rrdc_update is executed, no packet can be found in wireshard. BTW: Both collectd and rrdcached are running by root user. B.R. Benjamin Wang From: Cyril Feraudet [mailto:colle...@feraudet.com] Sent: 2013年3月4日 21:46 To: Benjamin Wang (gendwang) Cc: collectd@verplant.org; jma...@anti.net; jma...@autidot.net; Yang Zhou (yangzho) Subject: Re: [collectd] rrdcached+collectd You don't need both rrdtool and rrdcached plugin. Cyril http://perfwatcher.org/ On 4 mars 2013, at 14:38, Benjamin Wang (gendwang) gendw...@cisco.commailto:gendw...@cisco.com wrote: Hi, I try to setup rrdcached and collectd in one VM(Redhat 6.2). rrdcached also listens on the network port for remote query. rrdtool: 1.4.7 collectd: 5.2.0 The collectd.conf is as following: LoadPlugin rrdcached LoadPlugin rrdtool Plugin rrdcached DaemonAddress unix:/tmp/rrdcached.sock DataDir /root/tools/rrdcached CreateFiles true /Plugin Plugin rrdtool DataDir /opt/collectd/var/lib/collectd /Plugin The rrdcached start script is as following: rrdcached -F -b /root/tools/rrdcached -j /root/tools/rrdcached/cached -p /root/tools/rrdcached/rrdcached.pid -l unix:/tmp/rrdcached.sock -l 10.74.125.141 But the collectd log always show the error: [2013-03-04 21:24:56] rrdcached plugin: rrdc_update (/root/tools/rrdcached/10.74.125.141/memory/memory-used.rrd, [1362403496:4414574592.00], 1) failed with status -1. [2013-03-04 21:24:56] rrdcached plugin: rrdc_update (/root/tools/rrdcached/10.74.125.141/memory/memory-buffered.rrd, [1362403496:363573248.00], 1) failed with status -1. [2013-03-04 21:24:56] rrdcached plugin: rrdc_update (/root/tools/rrdcached/10.74.125.141/memory/memory-cached.rrd, [1362403496:1231032320.00], 1) failed with status -1. I have gone through the old threads and have tried “chmod 777 /root/tools/rrdcached”. But it doesn’t work. What is the problem? B.R. Benjamin Wang ___ collectd mailing list collectd@verplant.orgmailto:collectd@verplant.org http://mailman.verplant.org/listinfo/collectd ___ collectd mailing list collectd@verplant.org http://mailman.verplant.org/listinfo/collectd
Re: [collectd] rrdcached+collectd
Hi, This should be a code fault. When rrdcached plugin is started, rrdcached plugin will create the rrd files with the current value. But after the rrd files are created, rrdcached plugin will update the same value to rrdcached. The rrdcached will return error. When I update the code as following, it works well: rc_write method in rrdcached.c if (config_create_files) { struct stat statbuf; status = stat (filename, statbuf); if (status != 0) { if (errno != ENOENT) { char errbuf[1024]; ERROR (rrdcached plugin: stat (%s) failed: %s, filename, sstrerror (errno, errbuf, sizeof (errbuf))); return (-1); } status = cu_rrd_create_file (filename, ds, vl, rrdcreate_config); if (status != 0) { ERROR (rrdcached plugin: cu_rrd_create_file (%s) failed., filename); return (-1); } + return (0); } } The above code will skip the first update when the file is created. What about your comments? B.R. Benjamin Wang From: Cyril Feraudet [mailto:colle...@feraudet.com] Sent: 2013年3月4日 21:46 To: Benjamin Wang (gendwang) Cc: collectd@verplant.org; jma...@anti.net; jma...@autidot.net; Yang Zhou (yangzho) Subject: Re: [collectd] rrdcached+collectd You don't need both rrdtool and rrdcached plugin. Cyril http://perfwatcher.org/ On 4 mars 2013, at 14:38, Benjamin Wang (gendwang) gendw...@cisco.commailto:gendw...@cisco.com wrote: Hi, I try to setup rrdcached and collectd in one VM(Redhat 6.2). rrdcached also listens on the network port for remote query. rrdtool: 1.4.7 collectd: 5.2.0 The collectd.conf is as following: LoadPlugin rrdcached LoadPlugin rrdtool Plugin rrdcached DaemonAddress unix:/tmp/rrdcached.sock DataDir /root/tools/rrdcached CreateFiles true /Plugin Plugin rrdtool DataDir /opt/collectd/var/lib/collectd /Plugin The rrdcached start script is as following: rrdcached -F -b /root/tools/rrdcached -j /root/tools/rrdcached/cached -p /root/tools/rrdcached/rrdcached.pid -l unix:/tmp/rrdcached.sock -l 10.74.125.141 But the collectd log always show the error: [2013-03-04 21:24:56] rrdcached plugin: rrdc_update (/root/tools/rrdcached/10.74.125.141/memory/memory-used.rrd, [1362403496:4414574592.00], 1) failed with status -1. [2013-03-04 21:24:56] rrdcached plugin: rrdc_update (/root/tools/rrdcached/10.74.125.141/memory/memory-buffered.rrd, [1362403496:363573248.00], 1) failed with status -1. [2013-03-04 21:24:56] rrdcached plugin: rrdc_update (/root/tools/rrdcached/10.74.125.141/memory/memory-cached.rrd, [1362403496:1231032320.00], 1) failed with status -1. I have gone through the old threads and have tried “chmod 777 /root/tools/rrdcached”. But it doesn’t work. What is the problem? B.R. Benjamin Wang ___ collectd mailing list collectd@verplant.orgmailto:collectd@verplant.org http://mailman.verplant.org/listinfo/collectd ___ collectd mailing list collectd@verplant.org http://mailman.verplant.org/listinfo/collectd
[collectd] Why not release sending_sockets in network plugin?
Hi, When network_shutdown method in network.c is called, listen_sockets will be released as following: sockent_destroy (listen_sockets); But why not release sending_sockets? B.R. Benjamin Wang ___ collectd mailing list collectd@verplant.org http://mailman.verplant.org/listinfo/collectd
[collectd] How to compile the source to get the auto-start script in /etc/init.d
Hi, I am the new user of collectd. I am not sure whether this is a correct mail list. If this is not a correct mail list, please correct me. Currently I can start collect by the following command: ./collectdmon -c /opt/collectd/sbin/collectd It seems that collectmon is the safeguard process which is similar to mysqld_safe implementation. But for mysql there is a smooth stop procedure. How to smoothly stop collectd? How to generate the autostart script under /etc/init.d? Then if the system is rebooted, the process can be restarted automatically? B.R. Benjamin Wang ___ collectd mailing list collectd@verplant.org http://mailman.verplant.org/listinfo/collectd