Doesn't matter .. the sad reality is that there is no fix. IF you trip the
syslog problem, you're toast. Read the whole thread and search in the back
traffic (and ntop-dev for the cvs commit messages), e.g.:
revision 1.3
date: 2005-01-28 15:56:39 +0000; author: burton; state: Exp; lines: +2 -0
"Fix" for the 'RedHat 8 hangs' problem.
In my testing for this problem, I have seen all of ntop's threads hanging
in the syslog() routines.
This "fix" adds a mutex around the calls. It fixes the problem for me, at
a cost of some slight single threading. Since the problem shows up most
often at startup when a bunch of threads are issuing their initial messages,
that's not a big hit. Still, I can't PROVE it's the fix, so it's
conditional on a -D defined item (configureextra/LINUXredhat8.0:
CPPFLAGS="${CPPFLAGS} -DFORPRENPTL"
)
Here's where it gets odd...
If you skulk around the web, you'll see a lot of threads that talk about
random
hangs in syslog() routines, across lots of different open source projects.
It appears that syslog() routines aren't thread safe... and the usual
'answer'
is to create some sort of thread-safe wrapper. That's what I've done here.
Yet, strangely, I've never seen this w/ ntop before 3.1.
If this is really the problem, then other pre-NPTL Linuxes could also have
the same hang. If so, we will need to adjust their configureextra/LINUXxxxx
routines like the change this fix makes in configureextra/LINUX/redhat8.0!
-----Burton (ref 541)
But, as subsequent testing has found, the fix in the configureextra files
helps - sometimes, but not enough if the machine is too fast or too parallel
- the problem is internal to glibc and the mutex can only go so far.
Still, give it a try - copy the line from the redhat into the slackware
file.
There's no way to work around this - ghu knows I've tried. I've tried
three other solutions, even crafting a test program just for the thread
lockup and no joy. The real fix is supposed to be in the newest glibc, but
I wouldn't recommend using the cvs version of THAT on any machine.
So until that's out and widely spread, there's nothing we can do.
-----Burton
FWIW, in the future, make sure large log extracts preserve the line breaks -
I hate trying to puzzle out run-on logs and so I usually just ignore any
such message.
-----Original Message-----
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf
Of Dan Bellis
Sent: Thursday, August 04, 2005 12:26 AM
To: [email protected]
Subject: Re: [Ntop-dev] NTOP SMP problem with Slackware 10.1
Sorry, just realized my paste was from the ST window, not the MT windows.
Thu Aug 4 01:03:25 2005 Initializing gdbm databases Thu Aug 4 01:03:25
2005 ntop v.3.1 MT (SSL) Thu Aug 4 01:03:25 2005 Configured on Aug 1
2005 10:46:55, built on Aug 1
2005 10:47:25.
Thu Aug 4 01:03:25 2005 Copyright 1998-2004 by Luca Deri <[EMAIL PROTECTED]>
Thu Aug 4 01:03:25 2005 Get the freshest ntop from http://www.ntop.org/
Thu Aug 4 01:03:25 2005 Initializing ntop Thu Aug 4 01:03:25 2005
**WARNING** Truncated network size (device eth2) to
1024 hosts (real netmask 255.255.192.0)
Thu Aug 4 01:03:25 2005 Checking eth2 for additional devices Thu Aug 4
01:03:25 2005 Resetting traffic statistics for device eth2 Thu Aug 4
01:03:25 2005 DLT: Device 0 [eth2] is 1, mtu 1514, header 14 Thu Aug 4
01:03:25 2005 Initializing gdbm databases Thu Aug 4 01:03:25 2005 VENDOR:
Loading MAC address table.
Thu Aug 4 01:03:25 2005 VENDOR: Checking for MAC address table file Thu
Aug 4 01:03:25 2005 VENDOR: Loading newer file
'/usr/local/etc/ntop/specialMAC.txt.gz'
Thu Aug 4 01:03:25 2005 VENDOR: ...found 61 lines Thu Aug 4 01:03:25 2005
VENDOR: ...loaded 59 records Thu Aug 4 01:03:25 2005 VENDOR: Checking for
MAC address table file Thu Aug 4 01:03:25 2005 VENDOR: Loading newer file
'/usr/local/etc/ntop/oui.txt.gz'
Thu Aug 4 01:03:26 2005 VENDOR: ...found 48541 lines Thu Aug 4 01:03:26
2005 VENDOR: ...loaded 7853 records Thu Aug 4 01:03:26 2005 Fingeprint:
Loading signature file.
Thu Aug 4 01:03:26 2005 Fingeprint: ...loaded 1697 records Thu Aug 4
01:03:26 2005 ASN: Checking for Autonomous System Number table file Thu Aug
4 01:03:26 2005 **WARNING** ASN: Unable to open file 'AS-list.txt'
Thu Aug 4 01:03:26 2005 I18N: This instance of ntop does not support
multiple languages Thu Aug 4 01:03:26 2005 IP2CC: Checking for IP address
<-> Country Code mapping file Thu Aug 4 01:03:26 2005 IP2CC: Loading file
'/usr/local/etc/ntop/p2c.opt.table.gz'
Thu Aug 4 01:03:26 2005 IP2CC: ...found 52395 lines Thu Aug 4 01:03:26
2005 GDVERCHK: Guessing at libgd version Thu Aug 4 01:03:26 2005
GDVERCHK: ... as 2.0.21+ Thu Aug 4 01:03:26 2005 Initializing external
applications Thu Aug 4 01:03:26 2005 THREADMGMT: Packet processor thread
running...
Thu Aug 4 01:03:26 2005 THREADMGMT: Started thread (16386) for network
packet analyser Thu Aug 4 01:03:26 2005 THREADMGMT: Fingerprint scan
thread running...
Thu Aug 4 01:03:26 2005 THREADMGMT: Started thread (32771) for
fingerprinting Thu Aug 4 01:03:26 2005 THREADMGMT: Idle host scan thread
running...
Thu Aug 4 01:03:26 2005 THREADMGMT: Started thread (49156) for idle hosts
detection Thu Aug 4 01:03:26 2005 THREADMGMT: Address resolution thread
running...
Thu Aug 4 01:03:26 2005 THREADMGMT: Started thread (65541) for DNS address
resolution Thu Aug 4 01:03:26 2005 Calling plugin start functions (if any)
Thu Aug 4 01:03:26 2005 SSL is present but https is disabled: use -W
<https
port> for enabling it
Thu Aug 4 01:03:26 2005 CHKVER:
**********************PRIVACY**NOTICE**********************
Thu Aug 4 01:03:26 2005 INITWEB: Initializing web server Thu Aug 4
01:03:26 2005 CHKVER: * ntop instances may record individually
identifiable *
Thu Aug 4 01:03:26 2005 CHKVER: * information on a remote system as part
of
the version *
Thu Aug 4 01:03:26 2005 CHKVER: * check.
*
Thu Aug 4 01:03:26 2005 CHKVER: *
*
Thu Aug 4 01:03:26 2005 CHKVER: * You may request - via the
--skip-version-check option *
Thu Aug 4 01:03:26 2005 CHKVER: * that this check be skipped and that no
individually *
Thu Aug 4 01:03:26 2005 CHKVER: * identifiable information be recorded.
*
Thu Aug 4 01:03:26 2005 CHKVER: *
*
Thu Aug 4 01:03:26 2005 CHKVER: * In general, we ask you to permit this
check because it * Thu Aug 4 01:03:26 2005 CHKVER: * benefits both the
users and developers of
ntop. *
Thu Aug 4 01:03:26 2005 CHKVER: *
*
Thu Aug 4 01:03:26 2005 CHKVER: * Review the man ntop page for more
information. *
Thu Aug 4 01:03:26 2005 CHKVER: *
*
Thu Aug 4 01:03:26 2005 CHKVER:
**********************PRIVACY**NOTICE**********************
Thu Aug 4 01:03:26 2005 CHKVER: Checking current ntop version at
version.ntop.org/version.xml Thu Aug 4 01:03:26 2005 INITWEB: Initializing
tcp/ip socket connections for web server Thu Aug 4 01:03:26 2005 INITWEB:
Initialized socket, port 3000, address
(any)
Thu Aug 4 01:03:26 2005 INITWEB: Waiting for HTTP connections on port 3000
Thu Aug 4 01:03:26 2005 INITWEB: Starting web server Thu Aug 4 01:03:26
2005 THREADMGMT: Started thread (98311) for web server Thu Aug 4 01:03:26
2005 THREADMGMT: web connections thread (5842) started...
Thu Aug 4 01:03:26 2005 Listening on [eth2] Thu Aug 4 01:03:26 2005
Loading Plugins Thu Aug 4 01:03:26 2005 Note: SIGPIPE handler set (ignore)
Thu Aug 4 01:03:26 2005 Searching for plugins in
/usr/local/lib/ntop/plugins Thu Aug 4 01:03:26 2005 WEB: ntop's web server
is now processing requests Thu Aug 4 01:03:26 2005 ICMP: Welcome to
icmpWatchPlugin. (C) 1999-2004 by Luca Deri Thu Aug 4 01:03:26 2005
LASTSEEN: Welcome to LastSeenWatchPlugin. (C) 1999 by Andrea Marangoni Thu
Aug 4 01:03:26 2005 NETFLOW: Welcome to NetFlow.(C) 2002-04 by Luca Deri
Thu Aug 4 01:03:26 2005 PDA: Welcome to PDAPlugin. (C) 2001-2004 by L.Deri
and W.Brock Thu Aug 4 01:03:26 2005 RRD: Welcome to rrdPlugin. (C) 2002-04
by Luca Deri.
Thu Aug 4 01:03:26 2005 SNMP: Welcome to snmpPlugin. (C) 2004 by F.Fusco
and G.Giardina Thu Aug 4 01:03:26 2005 SFLOW: Welcome to sFlow.(C) 2002-04
by Luca Deri Thu Aug 4 01:03:26 2005 XML: Welcome to xmldump plugin. (C)
2003-2004 by Burton Strauss Thu Aug 4 01:03:26 2005 Calling plugin start
functions (if any) Thu Aug 4 01:03:26 2005 RRD: Welcome to the RRD plugin
Thu Aug 4 01:03:26 2005 RRD: Mask for new directories is 0700 Thu Aug 4
01:03:26 2005 RRD: Mask for new files is 0066 Thu Aug 4 01:03:26 2005
THREADMGMT: rrd thread (0) started Thu Aug 4 01:03:26 2005 RRD: Started
thread (114696) for data collection.
Thu Aug 4 01:03:26 2005 Now running as requested user 'ntop' (1001:105)
Thu Aug 4 01:03:26 2005 INIT: Created pid file (/home/ntop/ntop.pid) Thu
Aug 4 01:03:26 2005 Note: Reporting device initally set to 0 [eth2]
(merged)
Here it is with trace level 5
Thu Aug 4 01:21:22 2005 [MSGID8469382] Initializing gdbm databases Thu Aug
4 01:21:22 2005 [MSGID0234024] Opening database '/home/ntop/prefsCache.db'
Thu Aug 4 01:21:22 2005 [MSGID0234024] Opening database
'/home/ntop/ntop_pw.db'
Thu Aug 4 01:21:22 2005 [MSGID0364088] NOTE: Calling getopt_long to process
parameters Thu Aug 4 01:21:22 2005 [MSGID0540387] ntop v.3.1 MT (SSL) Thu
Aug 4 01:21:22 2005 [MSGID8997049] Configured on Aug 1 2005 10:46:55,
built on Aug 1 2005 10:47:25.
Thu Aug 4 01:21:22 2005 [MSGID0836771] Copyright 1998-2004 by Luca Deri
<[EMAIL PROTECTED]> Thu Aug 4 01:21:22 2005 [MSGID0260707] Get the freshest
ntop from http://www.ntop.org/ Thu Aug 4 01:21:22 2005 [MSGID0230749]
Initializing ntop Thu Aug 4 01:21:22 2005 [MSGID9325128] Initializing IP
services Thu Aug 4 01:21:22 2005 [MSGID8679944] Initializing network
devices Thu Aug 4 01:21:22 2005 [MSGID9397416] Found interface [index=0]
'eth2'
Thu Aug 4 01:21:22 2005 [MSGID9397416] Found interface [index=1] 'any'
Thu Aug 4 01:21:22 2005 [MSGID9397416] Found interface [index=2] 'lo'
Thu Aug 4 01:21:22 2005 [MSGID8743464] Checking requested device 'eth2'
Thu Aug 4 01:21:22 2005 [MSGID0059920] Adding network device eth2 Thu Aug
4 01:21:22 2005 [MSGID0214692] **WARNING** Truncated network size (device
eth2) to 1024 hosts (real netmask 255.255.192.0) Thu Aug 4 01:21:22 2005
[MSGID8888622] MEMORY: ipTrafficMatrix base (no
TrafficEntry) for interface 'eth2' is 4.05MB Thu Aug 4 01:21:22 2005
[MSGID8899592] Checking eth2 for additional devices Thu Aug 4 01:21:22 2005
[MSGID0070928] Checking eth2:0 Thu Aug 4 01:21:22 2005 [MSGID0070928]
Checking eth2:1 Thu Aug 4 01:21:22 2005 [MSGID0070928] Checking eth2:2 Thu
Aug 4 01:21:22 2005 [MSGID0070928] Checking eth2:3 Thu Aug 4 01:21:22 2005
[MSGID0070928] Checking eth2:4 Thu Aug 4 01:21:22 2005 [MSGID0070928]
Checking eth2:5 Thu Aug 4 01:21:22 2005 [MSGID0070928] Checking eth2:6 Thu
Aug 4 01:21:22 2005 [MSGID0070928] Checking eth2:7 Thu Aug 4 01:21:22 2005
[MSGID0991760] Resetting traffic statistics for device eth2 Thu Aug 4
01:21:22 2005 [MSGID8467178] DLT: Device 0 [eth2] is 1, mtu 1514, header 14
Thu Aug 4 01:21:22 2005 [MSGID8469382] Initializing gdbm databases Thu Aug
4 01:21:22 2005 [MSGID0234024] Creating database
'/home/ntop/addressQueue.db'
Thu Aug 4 01:21:22 2005 [MSGID0234024] Opening database
'/home/ntop/dnsCache.db'
Thu Aug 4 01:21:22 2005 [MSGID0234024] Opening database
'/home/ntop/macPrefix.db'
Thu Aug 4 01:21:22 2005 [MSGID0234024] Opening database
'/home/ntop/fingerprint.db'
Thu Aug 4 01:21:22 2005 [MSGID0737709] VENDOR: Loading MAC address table.
Thu Aug 4 01:21:22 2005 [MSGID8761126] VENDOR: Checking for MAC address
table file Thu Aug 4 01:21:22 2005 [MSGID0492078] VENDOR: Checking
'./specialMAC.txt.gz'
Thu Aug 4 01:21:22 2005 [MSGID0492078] VENDOR: Checking './specialMAC.txt'
Thu Aug 4 01:21:22 2005 [MSGID0492078] VENDOR: Checking
'/usr/local/etc/ntop/specialMAC.txt.gz'
Thu Aug 4 01:21:22 2005 [MSGID0196348] VENDOR: ...Found Thu Aug 4 01:21:22
2005 [MSGID0638310] VENDOR: Database created Thu Aug 4
01:03:26 2005, last modified Thu Aug 4 01:03:26 2005 Thu Aug 4 01:21:22
2005 [MSGID0507238] VENDOR: Input file created/last modified Thu Aug 4
01:02:54 2005 Thu Aug 4 01:21:22 2005 [MSGID8773408] VENDOR: File
'/usr/local/etc/ntop/specialMAC.txt.gz' does not need to be reloaded Thu Aug
4 01:21:22 2005 [MSGID9209279] VENDOR: ntop continues ok Thu Aug 4 01:21:22
2005 [MSGID8761126] VENDOR: Checking for MAC address table file Thu Aug 4
01:21:22 2005 [MSGID0492078] VENDOR: Checking './oui.txt.gz'
Thu Aug 4 01:21:22 2005 [MSGID0492078] VENDOR: Checking './oui.txt'
Thu Aug 4 01:21:22 2005 [MSGID0492078] VENDOR: Checking
'/usr/local/etc/ntop/oui.txt.gz'
Thu Aug 4 01:21:22 2005 [MSGID0196348] VENDOR: ...Found Thu Aug 4 01:21:22
2005 [MSGID0638310] VENDOR: Database created Thu Aug 4
01:03:26 2005, last modified Thu Aug 4 01:03:26 2005 Thu Aug 4 01:21:22
2005 [MSGID0507238] VENDOR: Input file created/last modified Thu Aug 4
01:02:54 2005 Thu Aug 4 01:21:22 2005 [MSGID8773408] VENDOR: File
'/usr/local/etc/ntop/oui.txt.gz' does not need to be reloaded Thu Aug 4
01:21:22 2005 [MSGID9209279] VENDOR: ntop continues ok Thu Aug 4 01:21:22
2005 [MSGID0697341] Fingeprint: Loading signature file.
Thu Aug 4 01:21:22 2005 [MSGID8593979] Fingeprint: ...loaded 1697 records
Thu Aug 4 01:21:22 2005 [MSGID8761126] ASN: Checking for Autonomous System
Number table file Thu Aug 4 01:21:22 2005 [MSGID0492078] ASN: Checking
'./AS-list.txt.gz'
Thu Aug 4 01:21:22 2005 [MSGID0492078] ASN: Checking './AS-list.txt'
Thu Aug 4 01:21:22 2005 [MSGID0492078] ASN: Checking
'/usr/local/etc/ntop/AS-list.txt.gz'
Thu Aug 4 01:21:22 2005 [MSGID0492078] ASN: Checking
'/usr/local/etc/ntop/AS-list.txt'
Thu Aug 4 01:21:22 2005 [MSGID0492078] ASN: Checking '/etc/AS-list.txt.gz'
Thu Aug 4 01:21:22 2005 [MSGID0492078] ASN: Checking '/etc/AS-list.txt'
Thu Aug 4 01:21:22 2005 [MSGID0026798] **WARNING** ASN: Unable to open file
'AS-list.txt'
Thu Aug 4 01:21:22 2005 [MSGID9197786] ASN: ntop continues ok, but without
ASN information.
Thu Aug 4 01:21:22 2005 [MSGID0843586] I18N: This instance of ntop does not
support multiple languages Thu Aug 4 01:21:22 2005 [MSGID8761126] IP2CC:
Checking for IP address <-> Country Code mapping file Thu Aug 4 01:21:22
2005 [MSGID0492078] IP2CC: Checking './p2c.opt.table.gz'
Thu Aug 4 01:21:22 2005 [MSGID0492078] IP2CC: Checking './p2c.opt.table'
Thu Aug 4 01:21:22 2005 [MSGID0492078] IP2CC: Checking
'/usr/local/etc/ntop/p2c.opt.table.gz'
Thu Aug 4 01:21:22 2005 [MSGID0196348] IP2CC: ...Found Thu Aug 4 01:21:22
2005 [MSGID0647342] IP2CC: Loading file
'/usr/local/etc/ntop/p2c.opt.table.gz'
Thu Aug 4 01:21:22 2005 [MSGID9325976] IP2CC: .... 10000 records read Thu
Aug 4 01:21:22 2005 [MSGID9325976] IP2CC: .... 20000 records read Thu Aug
4 01:21:22 2005 [MSGID9325976] IP2CC: .... 30000 records read Thu Aug 4
01:21:22 2005 [MSGID9325976] IP2CC: .... 40000 records read Thu Aug 4
01:21:22 2005 [MSGID9325976] IP2CC: .... 50000 records read Thu Aug 4
01:21:22 2005 [MSGID0788390] IP2CC: Closing file Thu Aug 4 01:21:22 2005
[MSGID0773926] IP2CC: ...found 52395 lines Thu Aug 4 01:21:22 2005
[MSGID9038886] GDVERCHK: Guessing at libgd version Thu Aug 4 01:21:22 2005
[MSGID8913392] GDVERCHK: ... as 2.0.21+ Thu Aug 4 01:21:22 2005
[MSGID9111172] Initializing external applications Thu Aug 4 01:21:22 2005
[MSGID8783078] THREADMGMT: Packet processor thread running...
Thu Aug 4 01:21:22 2005 [MSGID0121542] THREADMGMT: Started thread (16386)
for network packet analyser Thu Aug 4 01:21:22 2005 [MSGID0393976]
THREADMGMT: Fingerprint scan thread running...
Thu Aug 4 01:21:22 2005 [MSGID0783756] THREADMGMT: Started thread (32771)
for fingerprinting Thu Aug 4 01:21:22 2005 [MSGID0393976] THREADMGMT: Idle
host scan thread running...
Thu Aug 4 01:21:22 2005 [MSGID0051670] THREADMGMT: Started thread (49156)
for idle hosts detection Thu Aug 4 01:21:22 2005 [MSGID8779240] THREADMGMT:
Address resolution thread running...
Thu Aug 4 01:21:22 2005 [MSGID0983766] THREADMGMT: Started thread (65541)
for DNS address resolution Thu Aug 4 01:21:22 2005 [MSGID0393042] Starting
Plugins Thu Aug 4 01:21:22 2005 [MSGID8824418] Calling plugin start
functions (if
any)
Thu Aug 4 01:21:22 2005 [MSGID8433108] Plugins started... continuing with
initialization Thu Aug 4 01:21:22 2005 [MSGID8764367] SSL is present but
https is disabled:
use -W <https port> for enabling it
Thu Aug 4 01:21:22 2005 [MSGID8795054] CHKVER: Checking current ntop
version at version.ntop.org/version.xml Thu Aug 4 01:21:22 2005
[MSGID9360773] INITWEB: Initializing web server Thu Aug 4 01:21:22 2005
[MSGID8922501] INITWEB: Initializing tcp/ip socket connections for web
server Thu Aug 4 01:21:22 2005 [MSGID0349927] Initializing socket, port
3000, address (any) Thu Aug 4 01:21:22 2005 [MSGID0218735] INITWEB: Created
a new socket (14) Thu Aug 4 01:21:22 2005 [MSGID0349927] INITWEB:
Initialized socket, port 3000, address (any) Thu Aug 4 01:21:22 2005
[MSGID0818081] INITWEB: Waiting for HTTP connections on port 3000 Thu Aug 4
01:21:22 2005 [MSGID0841093] INITWEB: Starting web server Thu Aug 4
01:21:22 2005 [MSGID8791429] THREADMGMT: Started thread (98311) for web
server Thu Aug 4 01:21:22 2005 [MSGID0687353] THREADMGMT: web connections
thread
(5862) started...
Thu Aug 4 01:21:22 2005 [MSGID8437197] INITWEB: Server started...
continuing with initialization Thu Aug 4 01:21:22 2005 [MSGID0316203] Note:
SIGPIPE handler set (ignore) Thu Aug 4 01:21:22 2005 [MSGID0153071]
Listening on [eth2] Thu Aug 4 01:21:22 2005 [MSGID0986275] WEB: ntop's web
server is now processing requests Thu Aug 4 01:21:22 2005 [MSGID0697671]
Loading Plugins Thu Aug 4 01:21:22 2005 [MSGID9428286] Searching for
plugins in /usr/local/lib/ntop/plugins Thu Aug 4 01:21:22 2005
[MSGID8837990] Loading plugin '/usr/local/lib/ntop/plugins/icmpPlugin.so'
Thu Aug 4 01:21:22 2005 [MSGID0270005] ICMP: Welcome to icmpWatchPlugin.
(C)
1999-2004 by Luca Deri
Thu Aug 4 01:21:22 2005 [MSGID8837990] Loading plugin
'/usr/local/lib/ntop/plugins/lastSeenPlugin.so'
Thu Aug 4 01:21:22 2005 [MSGID9404515] LASTSEEN: Welcome to
LastSeenWatchPlugin. (C) 1999 by Andrea Marangoni Thu Aug 4 01:21:22 2005
[MSGID0632846] Compiling filter 'ip or (vlan and ip)'
on interface eth2
Thu Aug 4 01:21:22 2005 [MSGID8837990] Loading plugin
'/usr/local/lib/ntop/plugins/netflowPlugin.so'
Thu Aug 4 01:21:22 2005 [MSGID0205751] NETFLOW: Welcome to NetFlow.(C)
2002-04 by Luca Deri
Thu Aug 4 01:21:22 2005 [MSGID8837990] Loading plugin
'/usr/local/lib/ntop/plugins/pdaPlugin.so'
Thu Aug 4 01:21:22 2005 [MSGID0316102] PDA: Welcome to PDAPlugin. (C)
2001-2004 by L.Deri and W.Brock
Thu Aug 4 01:21:22 2005 [MSGID8837990] Loading plugin
'/usr/local/lib/ntop/plugins/rrdPlugin.so'
Thu Aug 4 01:21:22 2005 [MSGID0392522] RRD: Welcome to rrdPlugin. (C)
2002-04 by Luca Deri.
Thu Aug 4 01:21:22 2005 [MSGID8837990] Loading plugin
'/usr/local/lib/ntop/plugins/snmpPlugin.so'
Thu Aug 4 01:21:22 2005 [MSGID0045440] SNMP: Welcome to snmpPlugin. (C)
2004 by F.Fusco and G.Giardina Thu Aug 4 01:21:22 2005 [MSGID8837990]
Loading plugin '/usr/local/lib/ntop/plugins/sflowPlugin.so'
Thu Aug 4 01:21:22 2005 [MSGID0207032] SFLOW: Welcome to sFlow.(C) 2002-04
by Luca Deri Thu Aug 4 01:21:22 2005 [MSGID0632846] Compiling filter 'udp
and (port 6343 or port 7343)' on interface eth2 Thu Aug 4 01:21:22 2005
[MSGID8837990] Loading plugin '/usr/local/lib/ntop/plugins/xmldumpPlugin.so'
Thu Aug 4 01:21:22 2005 [MSGID0612831] XML: Welcome to xmldump plugin. (C)
2003-2004 by Burton Strauss
Thu Aug 4 01:21:22 2005 [MSGID0394567] Starting Plugins Thu Aug 4 01:21:22
2005 [MSGID8824418] Calling plugin start functions (if
any)
Thu Aug 4 01:21:22 2005 [MSGID0067366] Starting 'xmldump plugin'
Thu Aug 4 01:21:22 2005 [MSGID0067366] Starting 'sFlow'
Thu Aug 4 01:21:22 2005 [MSGID0067366] Starting 'snmpPlugin'
Thu Aug 4 01:21:22 2005 [MSGID0067366] Starting 'rrdPlugin'
Thu Aug 4 01:21:22 2005 [MSGID0529826] RRD: Welcome to the RRD plugin Thu
Aug 4 01:21:22 2005 [MSGID0974000] RRD: Mask for new directories is 0700
Thu Aug 4 01:21:22 2005 [MSGID9274544] RRD: Mask for new files is 0066 Thu
Aug 4 01:21:22 2005 [MSGID0704862] RRD: Started thread (114696) for data
collection.
Thu Aug 4 01:21:22 2005 [MSGID8606478] THREADMGMT: rrd thread (0) started
Thu Aug 4 01:21:22 2005 [MSGID0067366] Starting 'PDAPlugin'
Thu Aug 4 01:21:22 2005 [MSGID0067366] Starting 'NetFlow'
Thu Aug 4 01:21:22 2005 [MSGID0067366] Starting 'LastSeenWatchPlugin'
Thu Aug 4 01:21:22 2005 [MSGID0067366] Starting 'icmpWatchPlugin'
Thu Aug 4 01:21:22 2005 [MSGID8434633] Plugins started... continuing with
initialization Thu Aug 4 01:21:22 2005 [MSGID0945310] Now running as
requested user 'ntop' (1001:105) Thu Aug 4 01:21:22 2005 [MSGID9410826]
INIT: Created pid file
(/home/ntop/ntop.pid)
Thu Aug 4 01:21:22 2005 [MSGID0072991] Device 0. eth2
(active)
Thu Aug 4 01:21:22 2005 [MSGID0233949] INITWEB: Merging interfaces,
reporting device forced to 0 Thu Aug 4 01:21:22 2005 [MSGID0544335] Note:
Reporting device initally set to 0 [eth2] (merged) Thu Aug 4 01:21:22 2005
[MSGID0178587] MEMORY: Base memory load is 8.41MB
(3799740+5017600)
Thu Aug 4 01:21:22 2005 [MSGID0891141] MEMORY: Base interface structure (no
hashes loaded) is 0.28MB each
Thu Aug 4 01:21:22 2005 [MSGID1016507] MEMORY: or 0.28MB for 1
interfaces
Thu Aug 4 01:21:22 2005 [MSGID8599457] MEMORY: ipTraffixMatrix structure
(no TrafficEntry loaded) is 4.00MB
FYI
telnet localhost 3000
Trying 127.0.0.1...
Connected to localhost.
Escape character is '^]'.
And that's all she wrote...
On Thursday 04 August 2005 01:15 am, Dan Bellis wrote:
> Hi,
> For the last few weeks I've been trying to get ntop 3.1 to work with
> a SMP kernel on slackware 10.1. The hardware is a Dell 1850, dual
> Xeon processors. It works fine if the kernel is compiled without SMP
support.
> Tested kernels are 2.4.29, 2.4.31, 2.6.12.3. The symptom I'm having
> is not being able to make a successful connection to the system on port
3000. The
> connection is accepted, but hangs. I believe this is related to the
> multithreading, and the strace indicates that it is hanging waiting to
> make a call to syslog.
>
> First a bit of backgroung.....
>
> Running it with the following command:
>
> ntop -u ntop -w 3000 -a /usr/local/lib/ntop/access.log -P /home/ntop
> -i
> eth2 -O /home/ntop
>
> Yields the following results:
>
> Wed Aug 3 23:29:53 2005 Initializing gdbm databases Wed Aug 3
> 23:29:53 2005 ntop v.3.1 ST (SSL) Wed Aug 3 23:29:53 2005
> Configured on Jul 29 2005 8:58:46, built on Jul
> 29 2005 09:24:54.
> Wed Aug 3 23:29:53 2005 Copyright 1998-2004 by Luca Deri
> <[EMAIL PROTECTED]> Wed Aug 3 23:29:53 2005 Get the freshest ntop from
> http://www.ntop.org/ Wed Aug 3 23:29:53 2005 Initializing ntop Wed
> Aug 3 23:29:53 2005 Checking eth2 for additional devices Wed Aug 3
> 23:29:53 2005 Resetting traffic statistics for device eth2 Wed Aug 3
> 23:29:53 2005 DLT: Device 0 [eth2] is 1, mtu 1514, header 14 Wed Aug
> 3 23:29:53 2005 Initializing gdbm databases Wed Aug 3 23:29:53 2005
> VENDOR: Loading MAC address table.
> Wed Aug 3 23:29:53 2005 VENDOR: Checking for MAC address table file
> Wed Aug 3 23:29:53 2005 VENDOR: File './specialMAC.txt.gz' does not
> need to be reloaded Wed Aug 3 23:29:53 2005 VENDOR: ntop continues
> ok Wed Aug 3 23:29:53 2005 VENDOR: Checking for MAC address table
> file Wed Aug 3 23:29:53 2005 VENDOR: File './oui.txt.gz' does not
> need to be reloaded Wed Aug 3 23:29:53 2005 VENDOR: ntop continues
> ok Wed Aug 3 23:29:53 2005 Fingeprint: Loading signature file.
> Wed Aug 3 23:29:53 2005 Fingeprint: ...loaded 1697 records Wed Aug
> 3 23:29:53 2005 ASN: Checking for Autonomous System Number table file
> Wed Aug 3 23:29:53 2005 ASN: Loading file './AS-list.txt.gz'
> Wed Aug 3 23:29:54 2005 ASN: ...found 111435 lines Wed Aug 3
> 23:29:54 2005 ASN: ....Used 3780 KB of memory (12 per entry) Wed Aug
> 3 23:29:54 2005 I18N: This instance of ntop does not support multiple
> languages Wed Aug 3 23:29:54 2005 IP2CC: Checking for IP address <->
> Country Code mapping file Wed Aug 3 23:29:54 2005 IP2CC: Loading
> file './p2c.opt.table.gz'
> Wed Aug 3 23:29:54 2005 IP2CC: ...found 52395 lines Wed Aug 3
> 23:29:54 2005 GDVERCHK: Guessing at libgd version Wed Aug 3 23:29:54
> 2005 GDVERCHK: ... as 2.0.21+ Wed Aug 3 23:29:54 2005 Initializing
> external applications Wed Aug 3 23:29:54 2005 Calling plugin start
> functions (if any) Wed Aug 3 23:29:54 2005 CHKVER:
> **********************PRIVACY**NOTICE**********************
> Wed Aug 3 23:29:54 2005 CHKVER: * ntop instances may record individually
> identifiable *
> Wed Aug 3 23:29:54 2005 CHKVER: * information on a remote system as part
> of the version *
> Wed Aug 3 23:29:54 2005 CHKVER: * check.
> *
> Wed Aug 3 23:29:54 2005 CHKVER: *
> *
> Wed Aug 3 23:29:54 2005 CHKVER: * You may request - via the
> --skip-version-check option *
> Wed Aug 3 23:29:54 2005 CHKVER: * that this check be skipped and that no
> individually *
> Wed Aug 3 23:29:54 2005 CHKVER: * identifiable information be recorded.
> *
> Wed Aug 3 23:29:54 2005 CHKVER: *
> *
> Wed Aug 3 23:29:54 2005 CHKVER: * In general, we ask you to permit
> this check because it * Wed Aug 3 23:29:54 2005 CHKVER: * benefits
> both the users and developers
> of ntop. *
> Wed Aug 3 23:29:54 2005 CHKVER: *
> *
> Wed Aug 3 23:29:54 2005 CHKVER: * Review the man ntop page for more
> information. *
> Wed Aug 3 23:29:54 2005 CHKVER: *
> *
> Wed Aug 3 23:29:54 2005 CHKVER:
> **********************PRIVACY**NOTICE**********************
> Wed Aug 3 23:29:54 2005 CHKVER: Checking current ntop version at
> version.ntop.org/version.xml Wed Aug 3 23:29:59 2005 CHKVER: Version
> file is from 'version.ntop.org'
> Wed Aug 3 23:29:59 2005 CHKVER: as of date is '2004-12-01T17:00:00'
> Wed Aug 3 23:29:59 2005 CHKVER: This version of ntop is the CURRENT
> stable version Wed Aug 3 23:29:59 2005 SSL is present but https is
> disabled: use -W <https port> for enabling it Wed Aug 3 23:29:59 2005
> INITWEB: Initializing web server Wed Aug 3 23:29:59 2005 INITWEB:
> Initializing tcp/ip socket connections for web server Wed Aug 3
> 23:29:59 2005 INITWEB: Initialized socket, port 3000, address
> (any)
> Wed Aug 3 23:29:59 2005 INITWEB: Waiting for HTTP connections on
> port 3000 Wed Aug 3 23:29:59 2005 Listening on [eth2] Wed Aug 3
> 23:29:59 2005 Loading Plugins Wed Aug 3 23:29:59 2005 Searching for
> plugins in ./plugins Wed Aug 3 23:29:59 2005 ICMP: Welcome to
> icmpWatchPlugin. (C) 1999-2004 by Luca Deri Wed Aug 3 23:29:59 2005
> LASTSEEN: Welcome to LastSeenWatchPlugin. (C)
> 1999 by Andrea Marangoni
> Wed Aug 3 23:29:59 2005 NETFLOW: Welcome to NetFlow.(C) 2002-04 by
> Luca Deri Wed Aug 3 23:29:59 2005 PDA: Welcome to PDAPlugin. (C)
> 2001-2004 by L.Deri and W.Brock Wed Aug 3 23:29:59 2005 RRD: Welcome
> to rrdPlugin. (C) 2002-04 by Luca Deri. Wed Aug 3 23:29:59 2005
> SNMP: Welcome to snmpPlugin. (C) 2004 by F.Fusco and G.Giardina Wed
> Aug 3 23:29:59 2005 **WARNING** Unable to load plugin
> './plugins/sflowPlugin.so'
> Wed Aug 3 23:29:59 2005 **WARNING** Message is
'./plugins/sflowPlugin.so:
> undefined symbol: queuePacket'
> Wed Aug 3 23:29:59 2005 XML: Welcome to xmldump plugin. (C)
> 2003-2004 by Burton Strauss Wed Aug 3 23:29:59 2005 Calling plugin
> start functions (if any) Wed Aug 3 23:29:59 2005 RRD: Welcome to the
> RRD plugin Wed Aug 3 23:29:59 2005 RRD: Mask for new directories is
> 0700 Wed Aug 3 23:29:59 2005 RRD: Mask for new files is 0066 Wed Aug
> 3 23:29:59 2005 Now running as requested user 'ntop' (1001:105) Wed
> Aug 3 23:29:59 2005 INIT: Created pid file (/home/ntop/ntop.pid) Wed
> Aug 3 23:29:59 2005 Note: Reporting device initally set to 0 [eth2]
> (merged)
>
> At this point it just hangs. At first I thought it was related to the
> network card (intel 1000), so I tried on a Dell 6650 that has Broadcom
> ethernet interfaces with the same results.
>
> After more experimentation, I realized the non-SMP kernel worked fine.
> Armed with that information I searched the archives again, and came up
> with this post....
>
> http://www.mail-archive.com/ntop-dev%40unipi.it/msg04267.html
>
> An strace confirms that the problem seems to be syslog being blocked
> from another thread already writing to syslog. Strace available on
request.
>
> I downloaded the newest CVS version (3.1.50), compiled with the
> -DFORPRENPTL added to the configureextra/LINUXslackware file, did a
> ./configure;make;make install, and still have the same results.
>
> I upgraded glibc to 2.3.5 from slackware-current with the following
> packages:
>
> glibc-2.3.5-i486-4.tgz
> glibc-i18n-2.3.5-noarch-4.tgz
> glibc-profile-2.3.5-i486-4.tgz
> glibc-solibs-2.3.5-i486-4.tgz
> glibc-zoneinfo-2.3.5-noarch-4.tgz
>
> I recompiled ntop, changing the top level Makefile to use NPTL (
> -I/usr/include/nptl -L/usr/lib/nptl). I also recompiled libpcap with
> the same flags.
>
> No success.
>
> I am considering recompiling syslog, but am looking for some guidance
> (patches) to make that work with NPTL if that's possible.
>
> I'm fairly sure I'm going down the right path, but not totally convinced.
> The strange thing is that if I run it as root (-u root) then all is
> well, even with the SMP kernel. That tends to make me think it's a
> permission issue (possibly of the interface?) but doesn't explain the
> strace problem with syslog.
>
> Other things I've tried....
>
> ./configure --disable-mt
>
> This works with:
>
> ntop -u ntop -w 3000 -a /usr/local/lib/ntop/access.log -P /home/ntop
> -i
> eth2 -O /home/ntop
>
> for a short time, then ntop crashes.
>
> These don't work (mt enabled):
>
> ntop -L -d -u ntop -w 3000 -a /usr/local/lib/ntop/access.log -P
> /home/ntop -i eth2 -O /home/ntop t 0
>
> ntop -d -u ntop -w 3000 -a /usr/local/lib/ntop/access.log -P
> /home/ntop -i
> eth2 -O /home/ntop
>
> Any help anyone could offer would be greatly appreciated.
--
---dan
_______________________________________________
Ntop-dev mailing list
[email protected]
http://listgateway.unipi.it/mailman/listinfo/ntop-dev
_______________________________________________
Ntop-dev mailing list
[email protected]
http://listgateway.unipi.it/mailman/listinfo/ntop-dev
