Hi Paolo,
On Wed, 20 Jun 2012, Paolo Lucente wrote:
I'm thinking to the possibility that given the aggregation method the
SQL cache configured by default is not sufficient to keep all the
aggregates over the time period - although the time period is very
short. Can you as matter of test add the following line to your config
and see if it makes any difference?
sql_cache_entries: 999991
About plugin_buffer_size and plugin_pipe_size, CONFIG-KEYS gives
some guidelines. I suggest to start from those and take it from
there (no error message is OK; still error message then move up
by one order of magnitude; etc.). So try starting from:
plugin_pipe_size: 10240000
plugin_buffer_size: 10240
OK, testing now. Would it be possible for pmacctd to log a warning if it
exceeds any of these thresholds, to help with tuning without wasting
memory?
I'm still getting some duplicate values, although fewer, and I noticed
something interesting:
Jun 26 04:00:01 fen-fw2 pmacctd[11470]: ERROR ( long/mysql ): Duplicate
entry '10.0.156.34-10.9.0.6-443-34555-tcp-2012-06-26 02:00:00' for key 1
Jun 26 04:00:01 fen-fw2 pmacctd[11470]: ERROR ( long/mysql ): Duplicate
entry '109.74.198.131-10.0.156.210-56505-8140-tcp-2012-06-26 02:00:00' for
key 1
Jun 26 04:00:01 fen-fw2 pmacctd[11470]: ERROR ( long/mysql ): Duplicate
entry '10.0.156.210-109.74.198.131-8140-56505-tcp-2012-06-26 02:00:00' for
key 1
Jun 26 04:00:01 fen-fw2 pmacctd[11470]: ERROR ( long/mysql ): Duplicate
entry '178.79.174.118-10.0.156.210-58250-8140-tcp-2012-06-26 02:00:00' for
key 1
These log entries were created at 4am, and the "long" configuration
aggregates over one hour, so at 4am it should have been writing database
records for 3am-4am, with a timestamp of 3am. But the timestamp was 2am.
Is it possible that it either failed to remove some records from the
cache, or calculated the timestamp of the database records incorrectly?
Cheers, Chris.
--
Aptivate | http://www.aptivate.org | Phone: +44 1223 967 838
Future Business, Cam City FC, Milton Rd, Cambridge, CB4 1UY, UK
Aptivate is a not-for-profit company registered in England and Wales
with company number 04980791.
_______________________________________________
pmacct-discussion mailing list
http://www.pmacct.net/#mailinglists
