[rrd-users] Re: RRD-Performance Issue - Need Help

2006-06-21 Thread Martin Sperl
Hi! We are currently updating 15000 rrd-files every 5 minutes, and we have not found any problems, except for required IO/memory usage. But this also may have to do with that our scripts that fetch the data are written in perl and do not fork awk/rrdtool/... processes but do everything with per

[rrd-users] Re: RRD-Performance Issue - Need Help

2006-06-21 Thread Fabien Wernli
On Tue, Jun 20, 2006 at 12:38:20PM +0200, Alex van den Bogaerdt wrote: > > | awk '/whatever/{print $2}' in.txt > > How is this different from my: > > > and remove grep as well: > > > > >>> < in.txt awk '/whatever/{print $2}' > > Thank you very much for your contribution! For the record I:

[rrd-users] Re: RRD-Performance Issue - Need Help

2006-06-21 Thread Darryl Lewis
Here are some suggestions; Depends on how complicated you shell/awk scripts are. Calling individual shell scripts are slower than having parameters read into a loop to go thru each server. i.e. while read servername do [snmp walk $servername] [update rrd $servername] [rrd graph $servername

[rrd-users] Re: RRD-Performance Issue - Need Help

2006-06-20 Thread Fabien Wernli
On Tue, Jun 20, 2006 at 11:57:59AM +0200, Simone Felici wrote: > The snmpwalk is fast, but the cicle with all grep, awk, rrdtool update needs > minimum 7 minutes on first router and 20 minutes on second router!! I divided the serverload by at least 20 by using perl and RRDs instead of shell/awk/se

[rrd-users] Re: RRD-Performance Issue - Need Help

2006-06-20 Thread Alex van den Bogaerdt
On Tue, Jun 20, 2006 at 12:28:26PM +0200, Fabien Wernli wrote: > On Tue, Jun 20, 2006 at 12:23:28PM +0200, Alex van den Bogaerdt wrote: > > >>> < in.txt grep whatever | awk '{print $2}' > > hmmm make it > > | awk '/whatever/{print $2}' in.txt How is this different from my: > and remove

[rrd-users] Re: RRD-Performance Issue - Need Help

2006-06-20 Thread Fabien Wernli
On Tue, Jun 20, 2006 at 12:23:28PM +0200, Alex van den Bogaerdt wrote: > >>> < in.txt grep whatever | awk '{print $2}' hmmm make it | awk '/whatever/{print $2}' in.txt to save another cycle or use perl :o) -- Unsubscribe mailto:[EMAIL PROTECTED] Helpmailto:[EMAIL PROTECTED] Archiv

[rrd-users] Re: RRD-Performance Issue - Need Help

2006-06-20 Thread Alex van den Bogaerdt
On Tue, Jun 20, 2006 at 11:57:59AM +0200, Simone Felici wrote: > 6. determinate InCounter32 (cat in.txt | grep line | awk blablabla) > 7. determinate OutCounter32 (cat out.txt | grep line | awk blablabla) Ever heard of the useless use of cat award ? You could probably save some cycles by changi