Emanuele

Here is the information, I  can monitor the memory usage with zabbix and a 
custom template 
(https://github.com/thecamels/zabbix/blob/master/templates/Template%20Specific%20Process%20Memory%20Usage.xml)

If you want to do tests, please contact me off the list and I can give you ssh 
access.


==32365==    by 0x9339341: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x93394E5: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x933E0B4: g_type_register_fundamental (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x93230CB: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x9318645: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365==    by 0x400ECD2: call_init (dl-init.c:36)
==32365==    by 0x400ECD2: _dl_init (dl-init.c:126)
==32365==    by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365==    by 0x2: ???
==32365==    by 0xFFF000906: ???
==32365== 
==32365== 130 bytes in 1 blocks are possibly lost in loss record 253 of 302
==32365==    at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365==    by 0x95AF821: g_malloc0 (in 
/lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365==    by 0x933A129: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x93185E2: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365==    by 0x400ECD2: call_init (dl-init.c:36)
==32365==    by 0x400ECD2: _dl_init (dl-init.c:126)
==32365==    by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365==    by 0x2: ???
==32365==    by 0xFFF000906: ???
==32365==    by 0xFFF00090D: ???
==32365==    by 0xFFF000925: ???
==32365== 
==32365== 132 bytes in 1 blocks are possibly lost in loss record 254 of 302
==32365==    at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365==    by 0x95AF821: g_malloc0 (in 
/lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365==    by 0x9339FBF: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x933E112: g_type_register_fundamental (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x931E5BB: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x9318636: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365==    by 0x400ECD2: call_init (dl-init.c:36)
==32365==    by 0x400ECD2: _dl_init (dl-init.c:126)
==32365==    by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365==    by 0x2: ???
==32365==    by 0xFFF000906: ???
==32365==    by 0xFFF00090D: ???
==32365== 
==32365== 132 bytes in 1 blocks are possibly lost in loss record 255 of 302
==32365==    at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365==    by 0x95AF821: g_malloc0 (in 
/lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365==    by 0x9339FBF: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x933E112: g_type_register_fundamental (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x931E621: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x9318636: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365==    by 0x400ECD2: call_init (dl-init.c:36)
==32365==    by 0x400ECD2: _dl_init (dl-init.c:126)
==32365==    by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365==    by 0x2: ???
==32365==    by 0xFFF000906: ???
==32365==    by 0xFFF00090D: ???
==32365== 
==32365== 148 bytes in 1 blocks are possibly lost in loss record 257 of 302
==32365==    at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365==    by 0x95AF821: g_malloc0 (in 
/lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365==    by 0x9339D93: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x933E112: g_type_register_fundamental (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x9328034: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x9318640: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365==    by 0x400ECD2: call_init (dl-init.c:36)
==32365==    by 0x400ECD2: _dl_init (dl-init.c:126)
==32365==    by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365==    by 0x2: ???
==32365==    by 0xFFF000906: ???
==32365==    by 0xFFF00090D: ???
==32365== 
==32365== 148 bytes in 1 blocks are possibly lost in loss record 258 of 302
==32365==    at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365==    by 0x95AF821: g_malloc0 (in 
/lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365==    by 0x9339D93: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x933E112: g_type_register_fundamental (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x93230CB: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x9318645: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365==    by 0x400ECD2: call_init (dl-init.c:36)
==32365==    by 0x400ECD2: _dl_init (dl-init.c:126)
==32365==    by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365==    by 0x2: ???
==32365==    by 0xFFF000906: ???
==32365==    by 0xFFF00090D: ???
==32365== 
==32365== 155 (48 direct, 107 indirect) bytes in 1 blocks are definitely lost 
in loss record 259 of 302
==32365==    at 0x4C29180: operator new(unsigned long) (vg_replace_malloc.c:324)
==32365==    by 0x4A2B7D: Ntop::registerNagios() (Ntop.cpp:281)
==32365==    by 0x482E17: main (main.cpp:128)
==32365== 
==32365== 160 bytes in 1 blocks are possibly lost in loss record 260 of 302
==32365==    at 0x4C28C20: malloc (vg_replace_malloc.c:296)
==32365==    by 0x5A51CD9: my_malloc (in /usr/lib/libmysqlclient.so.18.0.0)
==32365==    by 0x5A4D059: ??? (in /usr/lib/libmysqlclient.so.18.0.0)
==32365==    by 0x5A1FEED: ??? (in /usr/lib/libmysqlclient.so.18.0.0)
==32365==    by 0x5A0DD0B: mysql_server_init (in 
/usr/lib/libmysqlclient.so.18.0.0)
==32365==    by 0x5A147B6: mysql_init (in /usr/lib/libmysqlclient.so.18.0.0)
==32365==    by 0x497C54: MySQLDB::connectToDB(st_mysql*, bool) 
(MySQLDB.cpp:685)
==32365==    by 0x497001: MySQLDB::MySQLDB(NetworkInterface*) (MySQLDB.cpp:479)
==32365==    by 0x4BEFD3: BatchedMySQLDB::BatchedMySQLDB(NetworkInterface*) 
(BatchedMySQLDB.cpp:26)
==32365==    by 0x44CB51: NetworkInterface::NetworkInterface(char const*, char 
const*) (NetworkInterface.cpp:167)
==32365==    by 0x49C848: ParserInterface::ParserInterface(char const*, char 
const*) (ParserInterface.cpp:27)
==32365==    by 0x4B84EC: CollectorInterface::CollectorInterface(char const*) 
(CollectorInterface.cpp:26)
==32365== 
==32365== 184 bytes in 1 blocks are possibly lost in loss record 263 of 302
==32365==    at 0x4C2AF2E: realloc (vg_replace_malloc.c:692)
==32365==    by 0x95AF88D: g_realloc (in 
/lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365==    by 0x93392E9: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x933E2CC: g_type_register_static (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x9329BD9: g_param_type_register_static (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x932B838: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x931864A: ??? (in 
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365==    by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365==    by 0x400ECD2: call_init (dl-init.c:36)
==32365==    by 0x400ECD2: _dl_init (dl-init.c:126)
==32365==    by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365==    by 0x2: ???
==32365==    by 0xFFF000906: ???
==32365== 
==32365== 200 bytes in 1 blocks are definitely lost in loss record 266 of 302
==32365==    at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365==    by 0x5A5368E: ??? (in /usr/lib/libmysqlclient.so.18.0.0)
==32365==    by 0x5A0DCF4: mysql_server_init (in 
/usr/lib/libmysqlclient.so.18.0.0)
==32365==    by 0x5A147B6: mysql_init (in /usr/lib/libmysqlclient.so.18.0.0)
==32365==    by 0x497C54: MySQLDB::connectToDB(st_mysql*, bool) 
(MySQLDB.cpp:685)
==32365==    by 0x4BF694: BatchedMySQLDB::queryLoop() (BatchedMySQLDB.cpp:244)
==32365==    by 0x494EA8: queryLoop(void*) (MySQLDB.cpp:27)
==32365==    by 0x5F9A063: start_thread (pthread_create.c:309)
==32365==    by 0x845062C: clone (clone.S:111)
==32365== 
==32365== 255 bytes in 6 blocks are definitely lost in loss record 268 of 302
==32365==    at 0x4C28C20: malloc (vg_replace_malloc.c:296)
==32365==    by 0x48A548: Prefs::setOption(int, char*) (Prefs.cpp:541)
==32365==    by 0x48CF2E: Prefs::loadFromFile(char const*) (Prefs.cpp:1192)
==32365==    by 0x482D66: main (main.cpp:109)
==32365== 
==32365== 256 bytes in 1 blocks are possibly lost in loss record 271 of 302
==32365==    at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365==    by 0x55E4C0: array_list_new (arraylist.c:36)
==32365==    by 0x55B76C: json_object_new_array (json_object.c:849)
==32365==    by 0x430021: Flow::flow2json() (Flow.cpp:1901)
==32365==    by 0x42F2D0: Flow::serialize(bool) (Flow.cpp:1738)
==32365==    by 0x44F1EA: NetworkInterface::dumpDBFlow(long, Flow*) 
(NetworkInterface.cpp:711)
==32365==    by 0x42B2B0: Flow::dumpFlow(bool) (Flow.cpp:873)
==32365==    by 0x42C814: Flow::update_hosts_stats(timeval*) (Flow.cpp:1176)
==32365==    by 0x455293: flow_update_hosts_stats(GenericHashEntry*, void*) 
(NetworkInterface.cpp:2371)
==32365==    by 0x416DF4: GenericHash::walk(bool (*)(GenericHashEntry*, void*), 
void*) (GenericHash.cpp:155)
==32365==    by 0x4553ED: NetworkInterface::periodicStatsUpdate() 
(NetworkInterface.cpp:2434)
==32365==    by 0x45BDE1: NetworkInterface::runHousekeepingTasks() 
(NetworkInterface.cpp:4443)
==32365== 
==32365== 336 bytes in 1 blocks are possibly lost in loss record 273 of 302
==32365==    at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365==    by 0x40111C1: allocate_dtv (dl-tls.c:296)
==32365==    by 0x40118CD: _dl_allocate_tls (dl-tls.c:460)
==32365==    by 0x5F9ABE7: allocate_stack (allocatestack.c:589)
==32365==    by 0x5F9ABE7: pthread_create@@GLIBC_2.2.5 (pthread_create.c:495)
==32365==    by 0x4970EC: MySQLDB::startDBLoop() (MySQLDB.cpp:491)
==32365==    by 0x4A7784: NetworkInterface::startDBLoop() (in /usr/bin/ntopng)
==32365==    by 0x4A6E99: Ntop::registerInterface(NetworkInterface*) 
(Ntop.cpp:1566)
==32365==    by 0x4831CD: main (main.cpp:227)
==32365== 
==32365== 2,515 (40 direct, 2,475 indirect) bytes in 1 blocks are definitely 
lost in loss record 294 of 302
==32365==    at 0x4C28C20: malloc (vg_replace_malloc.c:296)
==32365==    by 0x4E450A5: ??? (in /usr/lib/x86_64-linux-gnu/libpcap.so.1.6.2)
==32365==    by 0x4E455AE: ??? (in /usr/lib/x86_64-linux-gnu/libpcap.so.1.6.2)
==32365==    by 0x4E434C6: ??? (in /usr/lib/x86_64-linux-gnu/libpcap.so.1.6.2)
==32365==    by 0x4E43852: pcap_findalldevs (in 
/usr/lib/x86_64-linux-gnu/libpcap.so.1.6.2)
==32365==    by 0x4AF289: Utils::getInterfaceDescription(char*, char*, int) 
(Utils.cpp:2212)
==32365==    by 0x44C47C: NetworkInterface::NetworkInterface(char const*, char 
const*) (NetworkInterface.cpp:103)
==32365==    by 0x49C848: ParserInterface::ParserInterface(char const*, char 
const*) (ParserInterface.cpp:27)
==32365==    by 0x4B84EC: CollectorInterface::CollectorInterface(char const*) 
(CollectorInterface.cpp:26)
==32365==    by 0x482FDD: main (main.cpp:165)
==32365== 
==32365== 14,528 (3,024 direct, 11,504 indirect) bytes in 42 blocks are 
definitely lost in loss record 298 of 302
==32365==    at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365==    by 0x55AAD1: json_object_new (json_object.c:186)
==32365==    by 0x55B74A: json_object_new_array (json_object.c:845)
==32365==    by 0x430021: Flow::flow2json() (Flow.cpp:1901)
==32365==    by 0x42F2D0: Flow::serialize(bool) (Flow.cpp:1738)
==32365==    by 0x44F1EA: NetworkInterface::dumpDBFlow(long, Flow*) 
(NetworkInterface.cpp:711)
==32365==    by 0x42B2B0: Flow::dumpFlow(bool) (Flow.cpp:873)
==32365==    by 0x42C814: Flow::update_hosts_stats(timeval*) (Flow.cpp:1176)
==32365==    by 0x455293: flow_update_hosts_stats(GenericHashEntry*, void*) 
(NetworkInterface.cpp:2371)
==32365==    by 0x416DF4: GenericHash::walk(bool (*)(GenericHashEntry*, void*), 
void*) (GenericHash.cpp:155)
==32365==    by 0x4553ED: NetworkInterface::periodicStatsUpdate() 
(NetworkInterface.cpp:2434)
==32365==    by 0x45BDE1: NetworkInterface::runHousekeepingTasks() 
(NetworkInterface.cpp:4443)
==32365== 
==32365== LEAK SUMMARY:
==32365==    definitely lost: 3,672 bytes in 55 blocks
==32365==    indirectly lost: 14,086 bytes in 188 blocks
==32365==      possibly lost: 5,549 bytes in 88 blocks
==32365==    still reachable: 224,012 bytes in 827 blocks
==32365==         suppressed: 0 bytes in 0 blocks
==32365== Reachable blocks (those to which a pointer was found) are not shown.
==32365== To see them, rerun with: --leak-check=full --show-leak-kinds=all
==32365== 
==32365== For counts of detected and suppressed errors, rerun with: -v
==32365== Use --track-origins=yes to see where uninitialised values come from
==32365== ERROR SUMMARY: 415821 errors from 124 contexts (suppressed: 0 from 0)
==32365== could not unlink /tmp/vgdb-pipe-from-vgdb-to-32365-by-root-on-???
==32365== could not unlink /tmp/vgdb-pipe-to-vgdb-from-32365-by-root-on-???
==32365== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-32365-by-root-on-???

Regards
Roberto

Sobre 24-08-2017 15:38:37, Emanuele Faranda <[email protected]> escribió:
_______________________________________________ Ntop mailing list 
[email protected] http://listgateway.unipi.it/mailman/listinfo/ntop
Hi Roberto,

Can you monitor the ntopng memory usage over some hours to see if that is the 
process which consumes memory?

I've just committed a fix for a memory leak on the Mac.cpp but it cannot affect 
you since you are receiving flows from nProbe. It will be very helpful if you 
could run ntopng with valgrind and send me the valgrind log (just the last 200 
lines of log or so). Please execute
sudo valgrind --leak-check=full ntopng /etc/ntopng.conf

Regards,
Emanuele

On Thu, Aug 24, 2017 at 6:40 PM, Roberto Alvarado <[email protected]> wrote:

Hi,

The problem is after some time, here is the log from the start of ntopng to the 
die of the process:

23/Aug/2017 11:20:05 [Ntop.cpp:1437] Setting local networks to [REMOVED]
23/Aug/2017 11:20:05 [Redis.cpp:109] Successfully connected to redis 
127.0.0.1:6379@0
23/Aug/2017 11:20:05 [NtopPro.cpp:183] [LICENSE] Reading license from 
/etc/ntopng.license
23/Aug/2017 11:20:05 [NtopPro.cpp:118] [LICENSE] /etc/ntopng.license: unable to 
validate Enterprise license [License mismatch error]
23/Aug/2017 11:20:05 [NtopPro.cpp:121] [LICENSE] /etc/ntopng.license: found 
valid Professional license
23/Aug/2017 11:20:06 [MySQLDB.cpp:680] Attempting to connect to MySQL for 
interface tcp://127.0.0.1:5556...
23/Aug/2017 11:20:06 [MySQLDB.cpp:720] Successfully connected to MySQL 
[localhost:ntop] for interface tcp://127.0.0.1:5556
23/Aug/2017 11:20:06 [Ntop.cpp:1563] Registered interface tcp://127.0.0.1:5556 
[id: 0]
23/Aug/2017 11:20:06 [main.cpp:252] PID stored in file /var/tmp/ntopng.pid
23/Aug/2017 11:20:06 [HTTPserver.cpp:797] Please read 
https://github.com/ntop/ntopng/blob/dev/doc/README.SSL if you want to enable 
SSL.
23/Aug/2017 11:20:06 [Utils.cpp:427] User changed to nobody
23/Aug/2017 11:20:06 [HTTPserver.cpp:851] Web server dirs 
[/usr/share/ntopng/httpdocs][/usr/share/ntopng/scripts]
23/Aug/2017 11:20:06 [HTTPserver.cpp:854] HTTP server listening on port(s) 3000
23/Aug/2017 11:20:06 [MySQLDB.cpp:667] Disconnected from MySQL for interface 
tcp://127.0.0.1:5556...
23/Aug/2017 11:20:06 [MySQLDB.cpp:680] Attempting to connect to MySQL for 
interface tcp://127.0.0.1:5556...
23/Aug/2017 11:20:06 [MySQLDB.cpp:720] Successfully connected to MySQL 
[localhost:ntop] for interface tcp://127.0.0.1:5556
23/Aug/2017 11:20:06 [main.cpp:320] Working directory: /data/ntopng
23/Aug/2017 11:20:06 [main.cpp:322] Scripts/HTML pages directory: 
/usr/share/ntopng
23/Aug/2017 11:20:06 [Ntop.cpp:340] Welcome to ntopng x86_64 v.3.1.170821 - (C) 
1998-17 ntop.org
23/Aug/2017 11:20:06 [Ntop.cpp:345] Built on Debian GNU/Linux 8.2 (jessie)
23/Aug/2017 11:20:06 [NtopPro.cpp:383] [LICENSE] System Id:     [REMOVED]
23/Aug/2017 11:20:06 [NtopPro.cpp:384] [LICENSE] Edition:       Professional
23/Aug/2017 11:20:06 [NtopPro.cpp:385] [LICENSE] License Type:  Permanent 
License
23/Aug/2017 11:20:06 [NtopPro.cpp:388] [LICENSE] License:       [REMOVED]
23/Aug/2017 11:20:06 [NtopPro.cpp:398] [LICENSE] Maintenance:   Until Thu Mar 
22 12:28:01 2018 [211 days left]
23/Aug/2017 11:20:06 [PeriodicActivities.cpp:50] Started periodic activities 
loop...
23/Aug/2017 11:20:06 [NetworkInterface.cpp:2241] Started packet polling on 
interface tcp://127.0.0.1:5556 [id: 0]...
23/Aug/2017 11:20:07 [MySQLDB.cpp:680] Attempting to connect to MySQL for 
interface tcp://127.0.0.1:5556...
23/Aug/2017 11:20:07 [CollectorInterface.cpp:116] Collecting flows on 
tcp://127.0.0.1:5556
23/Aug/2017 11:20:08 [NetworkInterface.cpp:1202] WARNING: A flow has been seen 
from multiple exprters or from multiple IN/OUT interfaces. Check exporters 
configuration.
23/Aug/2017 12:07:26 [MySQLDB.cpp:720] Successfully connected to MySQL 
[localhost:ntop] for interface tcp://127.0.0.1:5556
23/Aug/2017 17:57:02 [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
23/Aug/2017 17:58:01 [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]


My config file:

root@mhost:/var/log/ntopng# cat /etc/ntopng/ntopng.conf 
-G=/var/tmp/ntopng.pid
-i="tcp://127.0.0.1:5556"
-d="/data/ntopng"
-w="3000"
#-v=5
--max-num-hosts=300000
--local-networks=[REMOVED]
--dump-flows="mysql;localhost;ntop;[REMOVED]"
root@mhost:/var/log/ntopng# 

A screenshoot of my dashboard:

https://i.dmtinc.cl/i/2017/08/24/CapturaNTOPNG428fd.png

More info from syslog:

Aug 22 22:20:00 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
Aug 22 22:21:01 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
Aug 22 22:22:00 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
Aug 22 22:23:01 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
Aug 22 22:24:00 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
Aug 22 22:24:09 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:10 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/housekeeping.lua][not enough memory]
Aug 22 22:24:10 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:11 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:12 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:13 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/housekeeping.lua][not enough memory]
Aug 22 22:24:13 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:14 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:15 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:16 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/housekeeping.lua][not enough memory]
Aug 22 22:24:16 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:17 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:18 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:19 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/housekeeping.lua][not enough memory]
Aug 22 22:24:19 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186:
 not enough memory]
Aug 22 22:24:20 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186:
 not enough memory]
Aug 22 22:24:21 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186:
 not enough memory]
Aug 22 22:24:22 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/housekeeping.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186:
 not enough memory]
Aug 22 22:24:22 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186:
 not enough memory]
Aug 22 22:24:23 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186:
 not enough memory]
Aug 22 22:24:24 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][error loading module 
'lua_utils' from file 
'/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not enough memory]
Aug 22 22:24:25 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/housekeeping.lua][error loading module 
'lua_utils' from file 
'/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not enough memory]
Aug 22 22:24:25 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][error loading module 
'lua_utils' from file 
'/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not enough memory]
Aug 22 22:24:26 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][error loading module 
'lua_utils' from file 
'/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not enough memory]
Aug 22 22:24:27 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][error loading module 
'lua_utils' from file 
'/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not enough memory]
Aug 22 22:24:28 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/housekeeping.lua][error loading module 
'lua_utils' from file 
'/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not enough memory]
Aug 22 22:24:28 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/second.lua][error loading module 
'lua_utils' from file 
'/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not enough memory]
Aug 23 11:20:02 mhost logger: ntopng stop
Aug 23 11:20:05 mhost logger: ntopng start
Aug 23 11:20:08 mhost ntopng: [NetworkInterface.cpp:1202] WARNING: A flow has 
been seen from multiple exprters or from multiple IN/OUT interfaces. Check 
exporters configuration.
Aug 23 17:57:02 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
Aug 23 17:58:01 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory


Additional preferences:

{
  "ntopng.prefs.housekeeping_frequency": 5,
  "ntopng.prefs.local_host_cache_duration": 3600,
  "ntopng.prefs.local_host_max_idle": 300,
  "ntopng.prefs.non_local_host_max_idle": 60,
  "ntopng.prefs.flow_max_idle": 60,
  "ntopng.prefs.active_local_host_cache_interval": 3600,
  "ntopng.prefs.intf_rrd_raw_days": 1,
  "ntopng.prefs.intf_rrd_1min_days": 30,
  "ntopng.prefs.intf_rrd_1h_days": 100,
  "ntopng.prefs.intf_rrd_1d_days": 365,
  "ntopng.prefs.other_rrd_raw_days": 1,
  "ntopng.prefs.other_rrd_1min_days": 30,
  "ntopng.prefs.other_rrd_1h_days": 100,
  "ntopng.prefs.other_rrd_1d_days": 365,
  "ntopng.prefs.host_top_sites_creation": false,
  "ntopng.prefs.is_local_host_cache_enabled": true,
  "ntopng.prefs.is_active_local_host_cache_enabled": true,
  "ntopng.prefs.tiny_flows_export_enabled": true,
  "ntopng.prefs.max_num_alerts_per_entity": 1024,
  "ntopng.prefs.max_num_flow_alerts": 16384,
  "ntopng.prefs.flow_device_port_rrd_creation": false,
  "ntopng.prefs.disable_alerts_generation": true,
  "ntopng.prefs.probing_alerts": false,
  "ntopng.prefs.ssl_alerts": false,
  "ntopng.prefs.alerts_syslog": true,
  "ntopng.prefs.alerts.slack_notifications_enabled": false,
  "ntopng.prefs.alerts.dump_alerts_when_iface_is_alerted": false,
  "ntopng.prefs.max_num_packets_per_tiny_flow": 3,
  "ntopng.prefs.max_num_bytes_per_tiny_flow": 64,
  "ntopng.prefs.safe_search_dns": 2078163920,
  "ntopng.prefs.global_dns": 4294967295,
  "ntopng.prefs.secondary_dns": 4294967295,
  "ntopng.prefs.enable_captive_portal": false,
  "ntopng.prefs.redirection_url": "http:\/\/www.ntop.org",
  "ntopng.prefs.max_ui_strlen": 24,
  "ntopng.prefs.host_mask": 0,
  "ntopng.prefs.ldap.bind_dn": "",
  "ntopng.prefs.ldap.bind_pwd": "",
  "ntopng.prefs.ldap.search_path": "",
  "ntopng.prefs.ldap.user_group": "",
  "ntopng.prefs.ldap.admin_group": "",
  "ntopng.prefs.alerts.mysql_check_open_files_limit": "1",
  "ntopng.prefs.nagios_nsca_host": "localhost",
  "ntopng.prefs.nagios_nsca_port": "5667",
  "ntopng.prefs.nagios_send_nsca_executable": 
"\/usr\/local\/nagios\/bin\/send_nsca",
  "ntopng.prefs.nagios_send_nsca_config": 
"\/usr\/local\/nagios\/etc\/send_nsca.cfg",
  "ntopng.prefs.nagios_host_name": "ntopng-host",
  "ntopng.prefs.nagios_service_name": "NtopngAlert",
  "ntopng.prefs.default_snmp_community": "public",
  "ntopng.prefs.google_apis_browser_key": "",
  "ntopng.prefs.show_advanced_prefs": "true",
  "ntopng.prefs.host_blacklist": "0"
}

Regards!

Roberto
Sobre 23-08-2017 4:14:34, Emanuele Faranda <[email protected]> escribió:
_______________________________________________ Ntop mailing list 
[email protected] http://listgateway.unipi.it/mailman/listinfo/ntop
Hi Roberto,

What is the content of your ntopng.conf file? Does the problem occur 
immediately or after some time? Can you post a screenshot of your ntopng 
dashboard?

Emanuele

On Wed, Aug 23, 2017 at 1:46 AM, Roberto Alvarado <[email protected]> wrote:

Hi Folks, My ntopng is crashing every time when the housekeeping is executed, 
the message of the log is explicit “no enough memory”, but this problems comes 
out after upgrade my install to the latest devel version, do you have any clue 
about this, of how much memory is needed? 21/Aug/2017 20:14:22 [Lua.cpp:6214] 
WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][not 
enough memory] 21/Aug/2017 20:14:22 [Lua.cpp:6214] WARNING: Script failure 
[/usr/share/ntopng/scripts/callbacks/housekeeping.lua][not enough memory] 
root@mhost:/var/log/ntopng# free -m total used free shared buffers cached Mem: 
32163 30833 1329 428 575 25141 -/+ buffers/cache: 5116 27046 Swap: 18530 399 
18131 root@mhost:/var/log/ntopng# root@mhost:/var/log/ntopng# ps aux --sort 
-rss USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND nobody 26971 28.1 
5.8 3375504 1942968 ? Sl 16:12 76:01 ntopng /etc/ntopng/ntopng.conf mysql 19755 
15.0 1.7 1809120 588236 ? Ssl Aug17 1173:54 /usr/sbin/mysqld root 838 0.0 0.1 
90724 51236 ? Ss Feb17 14:29 /lib/systemd/systemd-journald 
root@mhost:/var/log/ntopng# ntopng -V v.3.1.170821 [Enterprise/Professional 
build] GIT rev: dev:d13a4a219d885e47a46b008c61fb5e24b49b4514:20170821 Pro rev: 
r1130 Built on: Debian GNU/Linux 8.2 (jessie) System Id: Edition: Professional 
License Type: Permanent Maintenance: Until Thu Mar 22 12:28:01 2018 [211 days 
left] License: root@mhost:/var/log/ntopng# Thanks Regards Roberto 
_______________________________________________ Ntop mailing list 
[email protected] [mailto:[email protected]] 
http://listgateway.unipi.it/mailman/listinfo/ntop 
[http://listgateway.unipi.it/mailman/listinfo/ntop]
_______________________________________________
Ntop mailing list
[email protected]
http://listgateway.unipi.it/mailman/listinfo/ntop

Reply via email to