Luca,

here is the complete log of start and stuck...

you can see after th first data displayed the output stop (and the same happen to the other side of the zmq comunication, ntopng stop to read data fromr this probe).

i also add the lspci.

Please note i had tested to compile with and without PF_RING and i also test tcpdump coming with PF_RING, if the pf_ring.ko is removed it work fine, but with pf_rng.ko installed (insmod ...) tcpdump stop to receceive data out than broadcast.


me@te:~$
me@te:~$ sudo /usr/local/bin/nprobe -b2 -i eth2 -Q 1 -u 1 --lifetime-timeout 600 --idle-timeout 60 --queue-timeout 60 -g /var/tmp/nprobe.pid --ndpi-proto-ports /tmp/protos.txt -T "%IN_SRC_MAC %OUT_DST_MAC %IPV4_SRC_ADDR %IPV4_DST_ADDR %IN_PKTS %IN_BYTES %OUT_PKTS %OUT_BYTES %PROTOCOL %L4_SRC_PORT %L4_DST_PORT %FIRST_SWITCHED %LAST_SWITCHED\ %TCP_FLAGS %SRC_TOS %L7_PROTO %L7_PROTO_NAME %IPV4_SRC_MASK %IPV4_DST_MASK %FLOWS %FRAGMENTS" --zmq tcp://*:5556 --mysql=localhost:nprobe:l:nprobe:nprobe
15/Jan/2014 12:06:10 [plugin.c:161] No plugins found in ./plugins
15/Jan/2014 12:06:10 [plugin.c:168] Loading plugins [.so] from /usr/local/lib/nprobe/plugins 15/Jan/2014 12:06:10 [nprobe.c:3620] Succesfully created zmq endpoint tcp://*:5556 15/Jan/2014 12:06:10 [nprobe.c:3835] Welcome to nprobe v.6.15.140114 ($Revision: 3745 $) for x86_64-unknown-linux-gnu
15/Jan/2014 12:06:10 [nprobe.c:3863] Tracing enabled
15/Jan/2014 12:06:10 [nprobe.c:3901] WARNING: -n parameter is missing. 127.0.0.1:2055 will be used. 15/Jan/2014 12:06:10 [nprobe.c:2530] Exporting flows towards 127.0.0.1:2055 using UDP 15/Jan/2014 12:06:10 [bgpPlugin.c:380] BGP plugin is disabled (--bgp-port has not been specified)
15/Jan/2014 12:06:10 [dbPlugin.c:78] Initializing DB plugin
15/Jan/2014 12:06:10 [dbPlugin.c:136] Attempting to connect to database as [host: localhost][dbname: nprobe][table prefix: l][user: nprobe][pwd: xxxxxx]
15/Jan/2014 12:06:10 [database.c:92] MySQL initialized
15/Jan/2014 12:06:10 [database.c:112] Successfully connected to MySQL [host:dbname:user:passwd]=[localhost@0:nprobe:nprobe:xxxxxx]
15/Jan/2014 12:06:10 [plugin.c:225] 2 plugin(s) loaded [2 delete][1 packet].
15/Jan/2014 12:06:10 [nprobe.c:5710] Welcome to nprobe v.6.15.140114 for x86_64-unknown-linux-gnu
15/Jan/2014 12:06:10 [nprobe.c:4948] Compiling flow templates...
15/Jan/2014 12:06:10 [nprobe.c:4984] Using NetFlow Packet Payload Len: 1472
15/Jan/2014 12:06:10 [plugin.c:745] Scanning plugin BGP Update Listener
15/Jan/2014 12:06:10 [plugin.c:745] Scanning plugin MySQL DB
15/Jan/2014 12:06:10 [plugin.c:872] 0 plugin(s) enabled
15/Jan/2014 12:06:10 [nprobe.c:5285] Scanning flow template...
15/Jan/2014 12:06:10 [nprobe.c:5295] Template [id=257]
15/Jan/2014 12:06:10 [nprobe.c:5301] Found IN_BYTES [num 1][id 1][4 bytes][total 4 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found IN_PKTS [num 2][id 2][4 bytes][total 8 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found FLOWS [num 3][id 3][4 bytes][total 12 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found PROTOCOL [num 4][id 4][1 bytes][total 13 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found SRC_TOS [num 5][id 5][1 bytes][total 14 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found TCP_FLAGS [num 6][id 6][1 bytes][total 15 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found L4_SRC_PORT [num 7][id 7][2 bytes][total 17 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found IPV4_SRC_ADDR [num 8][id 8][4 bytes][total 21 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found IPV4_SRC_MASK [num 9][id 9][1 bytes][total 22 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found L4_DST_PORT [num 10][id 11][2 bytes][total 24 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found IPV4_DST_ADDR [num 11][id 12][4 bytes][total 28 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found IPV4_DST_MASK [num 12][id 13][1 bytes][total 29 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found LAST_SWITCHED [num 13][id 21][4 bytes][total 33 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found FIRST_SWITCHED [num 14][id 22][4 bytes][total 37 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found OUT_BYTES [num 15][id 23][4 bytes][total 41 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found OUT_PKTS [num 16][id 24][4 bytes][total 45 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found IN_SRC_MAC [num 17][id 56][6 bytes][total 51 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found OUT_DST_MAC [num 18][id 80][6 bytes][total 57 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found FRAGMENTS [num 19][id 80][2 bytes][total 59 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found L7_PROTO [num 20][id 118][2 bytes][total 61 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found L7_PROTO_NAME [num 21][id 119][16 bytes][total 77 bytes]
15/Jan/2014 12:06:10 [nprobe.c:5295] Template [id=258]
15/Jan/2014 12:06:10 [nprobe.c:5301] Found IN_BYTES [num 1][id 1][4 bytes][total 4 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found IN_PKTS [num 2][id 2][4 bytes][total 8 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found FLOWS [num 3][id 3][4 bytes][total 12 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found PROTOCOL [num 4][id 4][1 bytes][total 13 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found SRC_TOS [num 5][id 5][1 bytes][total 14 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found TCP_FLAGS [num 6][id 6][1 bytes][total 15 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found L4_SRC_PORT [num 7][id 7][2 bytes][total 17 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found L4_DST_PORT [num 8][id 11][2 bytes][total 19 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found LAST_SWITCHED [num 9][id 21][4 bytes][total 23 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found FIRST_SWITCHED [num 10][id 22][4 bytes][total 27 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found OUT_BYTES [num 11][id 23][4 bytes][total 31 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found OUT_PKTS [num 12][id 24][4 bytes][total 35 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found IPV6_SRC_ADDR [num 13][id 27][16 bytes][total 51 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found IPV6_DST_ADDR [num 14][id 28][16 bytes][total 67 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found IPV6_SRC_MASK [num 15][id 29][1 bytes][total 68 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found IPV6_DST_MASK [num 16][id 30][1 bytes][total 69 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found IN_SRC_MAC [num 17][id 56][6 bytes][total 75 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found OUT_DST_MAC [num 18][id 80][6 bytes][total 81 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found FRAGMENTS [num 19][id 80][2 bytes][total 83 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found L7_PROTO [num 20][id 118][2 bytes][total 85 bytes] 15/Jan/2014 12:06:10 [nprobe.c:5301] Found L7_PROTO_NAME [num 21][id 119][16 bytes][total 101 bytes]
15/Jan/2014 12:06:10 [database.c:217] Creating database schema...
15/Jan/2014 12:06:10 [database.c:219] Scanning templates
15/Jan/2014 12:06:11 [nprobe.c:5325] Scanning option template...
15/Jan/2014 12:06:11 [nprobe.c:5331] Found TOTAL_FLOWS_EXP [id 42][4 bytes][total 4 bytes] 15/Jan/2014 12:06:11 [nprobe.c:5331] Found TOTAL_PKTS_EXP [id 41][4 bytes][total 8 bytes]
15/Jan/2014 12:06:11 [nprobe.c:5359] Each flow is 101 bytes long
15/Jan/2014 12:06:11 [nprobe.c:5360] The # packets per flow has been set to 13
15/Jan/2014 12:06:11 [nprobe.c:4356] Using packet capture length 1600
15/Jan/2014 12:06:11 [nprobe.c:5890] The flows hash has 131072 buckets
15/Jan/2014 12:06:11 [nprobe.c:5892] Flows older than 600 seconds will be exported 15/Jan/2014 12:06:11 [nprobe.c:5895] Flows inactive for at least 60 seconds will be exported 15/Jan/2014 12:06:11 [nprobe.c:5898] Expired flows will not be queued for more than 60 seconds 15/Jan/2014 12:06:11 [nprobe.c:5905] Exported flows with engineType 0 and engineId 162
15/Jan/2014 12:06:11 [nprobe.c:5927] TCP TOS will be ignored and set to 0.
15/Jan/2014 12:06:11 [nprobe.c:5932] Flows ASs will not be computed (missing GeoIP support) 15/Jan/2014 12:06:11 [nprobe.c:5945] After 1 flow packets are sent, we'll delay at least 1 ms 15/Jan/2014 12:06:11 [nprobe.c:5965] Flows will be emitted in NetFlow 9 format
15/Jan/2014 12:06:11 [nprobe.c:5995] Flow input interface index is set to 1
15/Jan/2014 12:06:11 [nprobe.c:6001] Flow output interface index is set to 1
15/Jan/2014 12:06:11 [nprobe.c:6017] Capturing packets from interface eth2 [snaplen: 1600 bytes]
15/Jan/2014 12:06:11 [util.c:2692] nProbe changed user to 'nobody'
15/Jan/2014 12:06:11 [plugin.c:708] Disabling plugin BGP Update Listener (no template is using it) 15/Jan/2014 12:06:11 [plugin.c:708] Disabling plugin MySQL DB (no template is using it) 15/Jan/2014 12:06:11 [nprobe.c:5472] Loading nDPI custom protocol ports from /tmp/protos.txt [NDPI] addDefaultPort(): found duplicate for port 1720: overwriting it with new value [NDPI] addDefaultPort(): found duplicate for port 3001: overwriting it with new value [NDPI] addDefaultPort(): found duplicate for port 44046: overwriting it with new value
15/Jan/2014 12:06:11 [nprobe.c:6122] Starting 1 packet fetch thread(s)
15/Jan/2014 12:06:11 [engine.c:2967] Starting bucket dequeue thread
15/Jan/2014 12:06:11 [nprobe.c:4717] Fetch packets thread started [thread 0]
15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:20841 -> 10.246.128.166:56001 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 0][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=44707] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:28216 -> 10.246.128.25:5061 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 48][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=1001] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.246.128.25:5061 -> 10.19.1.205:46988 [50:57:A8:09:4C:00 -> 00:10:DB:FF:A0:80][vlan 0][tos 0][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=19773] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:20847 -> 10.246.128.166:56001 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 0][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=44713] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:45572 -> 10.249.37.50:443 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 48][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=56004] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:56075 -> 10.246.128.165:56001 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 0][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=79940] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:45512 -> 10.249.37.25:443 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 0][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=55919] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:37871 -> 10.246.128.165:56001 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 48][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=61736] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [icmp] 10.246.130.10:0 -> 10.19.128.35:0 [50:57:A8:09:4C:00 -> 00:10:DB:FF:A0:80][vlan 0][tos 0][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=558] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.246.130.10:3329 -> 10.19.128.35:445 [50:57:A8:09:4C:00 -> 00:10:DB:FF:A0:80][vlan 0][tos 0][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=4337] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:45350 -> 10.246.128.161:56001 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 0][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=69211] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:45578 -> 10.249.37.25:443 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 0][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=55985] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:45585 -> 10.249.37.50:443 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 48][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=56017] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:45500 -> 10.249.37.25:443 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 0][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=55907] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:45511 -> 10.249.37.25:443 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 0][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=55918] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:45588 -> 10.246.132.16:443 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 0][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=14770] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.246.130.10:3332 -> 10.19.128.8:80 [50:57:A8:09:4C:00 -> 00:10:DB:FF:A0:80][vlan 0][tos 0][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=3948] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:45217 -> 10.246.128.84:56006 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 48][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=69006] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:2057 -> 10.246.128.162:56001 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 48][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=25919] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:61293 -> 10.246.128.84:56006 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 48][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=85082] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:44124 -> 10.246.128.167:56001 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 48][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=67991] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:38713 -> 10.196.8.171:3200 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 48][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=110135] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:61646 -> 10.196.6.56:3202 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 48][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=1371] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.19.1.205:45584 -> 10.246.132.16:443 [00:10:DB:FF:A0:80 -> 50:57:A8:09:4C:00][vlan 0][tos 48][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=14766] 15/Jan/2014 12:06:11 [engine.c:2190] New Flow: [tcp] 10.246.128.165:56001 -> 10.19.1.205:37873 [50:57:A8:09:4C:00 -> 00:10:DB:FF:A0:80][vlan 0][tos 0][ifIdx: 65535 -> 65535][subflowId: 0/0x0000][idx=61738]







^Z
[1]+ Stopped sudo /usr/local/bin/nprobe -b2 -i eth2 -Q 1 -u 1 --lifetime-timeout 600 --idle-timeout 60 --queue-timeout 60 -g /var/tmp/nprobe.pid --ndpi-proto-ports /tmp/protos.txt -T "%IN_SRC_MAC %OUT_DST_MAC %IPV4_SRC_ADDR %IPV4_DST_ADDR %IN_PKTS %IN_BYTES %OUT_PKTS %OUT_BYTES %PROTOCOL %L4_SRC_PORT %L4_DST_PORT %FIRST_SWITCHED %LAST_SWITCHED %TCP_FLAGS %SRC_TOS %L7_PROTO %L7_PROTO_NAME %IPV4_SRC_MASK %IPV4_DST_MASK %FLOWS %FRAGMENTS" --zmq tcp://*:5556 --mysql=localhost:nprobe:l:nprobe:nprobe
me@te:~$ bg 1
[1]+ sudo /usr/local/bin/nprobe -b2 -i eth2 -Q 1 -u 1 --lifetime-timeout 600 --idle-timeout 60 --queue-timeout 60 -g /var/tmp/nprobe.pid --ndpi-proto-ports /tmp/protos.txt -T "%IN_SRC_MAC %OUT_DST_MAC %IPV4_SRC_ADDR %IPV4_DST_ADDR %IN_PKTS %IN_BYTES %OUT_PKTS %OUT_BYTES %PROTOCOL %L4_SRC_PORT %L4_DST_PORT %FIRST_SWITCHED %LAST_SWITCHED %TCP_FLAGS %SRC_TOS %L7_PROTO %L7_PROTO_NAME %IPV4_SRC_MASK %IPV4_DST_MASK %FLOWS %FRAGMENTS" --zmq tcp://*:5556 --mysql=localhost:nprobe:l:nprobe:nprobe &
me@te:~$
me@te:~$ ps ax
  PID TTY      STAT   TIME COMMAND
<snip>
9507 pts/3 S 0:00 sudo /usr/local/bin/nprobe -b2 -i eth2 -Q 1 -u 1 --lifetime-timeout 600 --idle-timeout 60 --queue-timeout 60 -g /var/tmp/nprobe.pid --ndpi-proto-ports /tmp/protos.txt -T 9508 pts/3 Sl 2:55 /usr/local/bin/nprobe -b2 -i eth2 -Q 1 -u 1 --lifetime-timeout 600 --idle-timeout 60 --queue-timeout 60 -g /var/tmp/nprobe.pid --ndpi-proto-ports /tmp/protos.txt -T %IN_S
me@te:~$
me@te:~$ date
Wed Jan 15 12:09:22 CET 2014
me@te:~$

lspci
00:00.0 Host bridge: Intel Corporation 5000P Chipset Memory Controller Hub (rev b1) 00:02.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x8 Port 2-3 (rev b1) 00:03.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x4 Port 3 (rev b1) 00:04.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x8 Port 4-5 (rev b1) 00:05.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x4 Port 5 (rev b1) 00:06.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x8 Port 6-7 (rev b1) 00:07.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x4 Port 7 (rev b1) 00:10.0 Host bridge: Intel Corporation 5000 Series Chipset FSB Registers (rev b1) 00:10.1 Host bridge: Intel Corporation 5000 Series Chipset FSB Registers (rev b1) 00:10.2 Host bridge: Intel Corporation 5000 Series Chipset FSB Registers (rev b1) 00:11.0 Host bridge: Intel Corporation 5000 Series Chipset Reserved Registers (rev b1) 00:13.0 Host bridge: Intel Corporation 5000 Series Chipset Reserved Registers (rev b1) 00:15.0 Host bridge: Intel Corporation 5000 Series Chipset FBD Registers (rev b1) 00:16.0 Host bridge: Intel Corporation 5000 Series Chipset FBD Registers (rev b1) 00:1c.0 PCI bridge: Intel Corporation 631xESB/632xESB/3100 Chipset PCI Express Root Port 1 (rev 09) 00:1c.1 PCI bridge: Intel Corporation 631xESB/632xESB/3100 Chipset PCI Express Root Port 2 (rev 09) 00:1d.0 USB controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #1 (rev 09) 00:1d.1 USB controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #2 (rev 09) 00:1d.2 USB controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #3 (rev 09) 00:1d.3 USB controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #4 (rev 09) 00:1d.7 USB controller: Intel Corporation 631xESB/632xESB/3100 Chipset EHCI USB2 Controller (rev 09)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev d9)
00:1f.0 ISA bridge: Intel Corporation 631xESB/632xESB/3100 Chipset LPC Interface Controller (rev 09) 00:1f.1 IDE interface: Intel Corporation 631xESB/632xESB IDE Controller (rev 09) 00:1f.3 SMBus: Intel Corporation 631xESB/632xESB/3100 Chipset SMBus Controller (rev 09) 01:00.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express Upstream Port (rev 01) 01:00.3 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express to PCI-X Bridge (rev 01) 02:00.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express Downstream Port E1 (rev 01) 02:01.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express Downstream Port E2 (rev 01)
03:00.0 RAID bus controller: Adaptec AAC-RAID (Rocket) (rev 02)
08:01.0 Ethernet controller: Intel Corporation 82546GB Gigabit Ethernet Controller (rev 03) 08:01.1 Ethernet controller: Intel Corporation 82546GB Gigabit Ethernet Controller (rev 03) 1a:00.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5721 Gigabit Ethernet PCI Express (rev 21) 1c:04.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] ES1000 (rev 02)



Il 15/01/2014 09:48, Luca Deri ha scritto:
Stefano
please provide some logs of the instance that is dropping traffic

Luca

On 14 Jan 2014, at 16:14, Stefano Bianchi <[email protected] <mailto:[email protected]>> wrote:

Hi there,

i'm facing a strange issue wih the nprobe & ntopng architecture.
i'm testing an environment where 2 nprobe systems (using the same nprobe distribution) feed one single ntopng system.

one of the 2 nprobe is working fine, i must start without the -G flag otherwire it stop to generate flowsin zmq & local db after some times. the second one is not working fine, it start to listend and generate flows, but after a while (10 or 15 seconds) it stop to generate anything and the statistics (-b 1) tell me i is dropping whole traffic. the big difference could be in the host machine (no one could be the same than the other) and the troughtput, the second one is listening at 80Mbit/s the other one (the working one mean) is listeing 7 to 14 Mbit/s of traffic.

can you help ?

/stefano


Il 20/12/2013 16:34, Yuri Francalacci ha scritto:
check with netstat if port 5556 is in "LISTEN" and if ntopng can connect to this host/port (firewall issue?)(if you are running apps on different machine).
Yuri
###############################################
Yuri Francalacci [email protected] <mailto:[email protected]><mailto:[email protected]> -http://www.ntop.org <http://www.ntop.org/><http://www.ntop.org/>
"Simplicity is the ultimate sophistication" - Leonardo da Vinci
###############################################

On Dec 20, 2013, at 10:21 AM, Stefano Bianchi wrote:

Yuri,

please also have a view to nprobe startup


20/Dec/2013 10:13:55 [plugin.c:161] No plugins found in ./plugins
20/Dec/2013 10:13:55 [plugin.c:168] Loading plugins [.so] from /usr/local/lib/nprobe/plugins 20/Dec/2013 10:13:55 [nprobe.c:3620] Succesfully created zmq endpoint tcp://10.10.10.10:5556 20/Dec/2013 10:13:55 [nprobe.c:3835] Welcome to nprobe v.6.15.131219 ($Revision: 3745 $) for x86_64-unknown-linux-gnu with native PF_RING acceleration 20/Dec/2013 10:13:55 [nprobe.c:3901] WARNING: -n parameter is missing. 127.0.0.1:2055 will be used.
20/Dec/2013 10:13:55 [dbPlugin.c:78] Initializing DB plugin
20/Dec/2013 10:13:55 [dbPlugin.c:136] Attempting to connect to database as [host: localhost][dbname: nprobe][table prefix: l][user: nprobe][pwd: xxxxxx]
20/Dec/2013 10:13:55 [database.c:92] MySQL initialized
20/Dec/2013 10:13:55 [database.c:112] Successfully connected to MySQL [host:dbname:user:passwd]=[localhost@0:nprobe:nprobe:xxxxxx] 20/Dec/2013 10:13:55 [nprobe.c:5710] Welcome to nprobe v.6.15.131219 for x86_64-unknown-linux-gnu 20/Dec/2013 10:13:55 [nprobe.c:4984] Using NetFlow Packet Payload Len: 1472
20/Dec/2013 10:13:55 [plugin.c:872] 0 plugin(s) enabled
20/Dec/2013 10:13:55 [database.c:217] Creating database schema...
20/Dec/2013 10:13:55 [nprobe.c:5359] Each flow is 187 bytes long
20/Dec/2013 10:13:55 [nprobe.c:5360] The # packets per flow has been set to 6 20/Dec/2013 10:13:55 [util.c:310] WARNING: Unable to load AS file /usr/local/nprobe/GeoIPASNum.dat. AS support disabled 20/Dec/2013 10:13:55 [util.c:319] WARNING: Unable to load AS IPv6 file /usr/local/nprobe/GeoIPASNumv6.dat. AS IPv6 support disabled
20/Dec/2013 10:13:55 [nprobe.c:4356] Using packet capture length 1600
20/Dec/2013 10:13:55 [pro/pf_ring.c:325] Using PF_RING in-kernel accelerated packet parsing 20/Dec/2013 10:13:55 [pro/pf_ring.c:329] Dumping traffic statistics on /proc/net/pf_ring/stats/17330-eth2.36
20/Dec/2013 10:13:55 [nprobe.c:5932] Flows ASs will not be computed

ciao


Il 20/12/2013 10:18, Stefano Bianchi ha scritto:
Yuri,

thank for replay but i alredy have the " around the param.
this is my startup script

NOMESONDA="PROBE1"
PIDFILE="/var/tmp/nprobe.pid"
ZMQ_SOCKET="tcp://*:5556"
SNIF_IFACE="eth2"
DB_HOST="localhost"
DB_SCHEMA="nprobe"
DB_TABPREFIX="l"
DB_USER="nprobe"
DB_PASSWORD="pass"
PROTOS="/tmp/protos.txt"
TEMPLATEFILE="/tmp/capture_template.txt"
FILTERINFILE="$NOMESONDA+captfilter.txt"
FILTERFILE="/tmp/captfilter.txt"
BINPATH="/usr/local/bin"

case "$1" in
start)
echo "Starting nprobe"
<snip>
  TEMPLATE=$(cat "$TEMPLATEFILE")
  FILTER=$(cat "$FILTERFILE")
  if [ ! -f /tmp/nprobe.norun ]; then

$BINPATH/nprobe -i $SNIF_IFACE -Q 1 -u 1 -G --lifetime-timeout 600 --idle-timeout 60 --queue-timeout 60\
  -g "$PIDFILE"  --ndpi-proto-ports $PROTOS \
  -T "$TEMPLATE" -f "$FILTER" \
--zmq "$ZMQ_SOCKET" "--mysql=$DB_HOST:$DB_SCHEMA:$DB_TABPREFIX:$DB_USER:$DB_PASSWORD" > /var/log/nprobe


But even i bind the zmq socket to real ip (ZMQ_SOCKET="tcp://10.10.10:5556") nothing change, the zmq_pool timeout each second without fetching data ( i added a log of zmq_poll timeout).

ciao

Il 19/12/2013 17:56, Yuri Francalacci ha scritto:
if you do not use " " in zmq address, the shell will expand the *.
Try enclosing the zmq address in " ".
Yuri
On 19/dic/2013, at 16:18, Stefano Bianchi <[email protected] <mailto:[email protected]><mailto:[email protected]>> wrote:

Hi,
i had just finish to set up a complete environment with a server is sniffing the traffic with nprobe (last version) and another one is trying to fetch the traffic from the originating machine.

i see zmq conversation set up but i fail to receive any traffic and ntopng interface loop on "No packet has been received yet on [email protected] <mailto:[email protected]>:5556.

Start options:
nprobe
/usr/local/bin/nprobe -i eth2 -Q 1 -u 1 -G --lifetime-timeout 600 --idle-timeout 60 --queue-timeout 60 -g /var/tmp/nprobe.pid --ndpi-proto-ports /tmp/protos.txt -T %IN_SRC_MAC %OUT_DST_MAC %IPV4_SRC_ADDR %IPV4_DST_ADDR %IN_PKTS %IN_BYTES %OUT_PKTS %OUT_BYTES %PROTOCOL %L4_SRC_PORT %L4_DST_PORT %FIRST_SWITCHED %LAST_SWITCHED %TCP_FLAGS %SRC_TOS %L7_PROTO %L7_PROTO_NAME %IPV4_SRC_MASK %IPV4_DST_MASK %FLOWS %FRAGMENTS %CLIENT_NW_DELAY_SEC %CLIENT_NW_DELAY_USEC %SERVER_NW_DELAY_SEC %SERVER_NW_DELAY_USEC %APPL_LATENCY_SEC %APPL_LATENCY_USEC %NUM_PKTS_UP_TO_128_BYTES %NUM_PKTS_128_TO_256_BYTES %NUM_PKTS_256_TO_512_BYTES %NUM_PKTS_512_TO_1024_BYTES %NUM_PKTS_1024_TO_1514_BYTES %NUM_PKTS_OVER_1514_BYTES %FLOW_PROTO_PORT %LONGEST_FLOW_PKT %SHORTEST_FLOW_PKT %RETRANSMITTED_IN_PKTS %RETRANSMITTED_OUT_PKTS %OOORDER_IN_PKTS %OOORDER_OUT_PKTS %IPV4_NEXT_HOP --zmqtcp://*:5556--mysql=localhost:nprobe:l:nprobe:pass

ntopng
./ntopng -itcp://10.10.10.10:5556

I had confirm about flow are captured by the nprobe as they are also stored in the local database, and i see the zmq session startup via tcpdump, but no no more data are exchanged after the first 5 or 6 pck.
how i can find why zmq is not working ?

thanks in advance

Stefano
_______________________________________________
Ntop-misc mailing list
[email protected] <mailto:[email protected]><mailto:[email protected]>
http://listgateway.unipi.it/mailman/listinfo/ntop-misc
###############################################
Yuri Francalacci [email protected] <mailto:[email protected]><mailto:[email protected]> -http://www.ntop.org <http://www.ntop.org/>
"Simplicity is the ultimate sophistication" - Leonardo da Vinci
###############################################










_______________________________________________
Ntop-misc mailing list
[email protected] <mailto:[email protected]>
http://listgateway.unipi.it/mailman/listinfo/ntop-misc


_______________________________________________
Ntop-misc mailing list
[email protected]
http://listgateway.unipi.it/mailman/listinfo/ntop-misc

Reply via email to