Hello Simone,
I'm also very interested in this issue, observing same behaviour as
Pelham. Do you mean we need a custom fields configuration file to make
this work? How will it be different from your attempts where "events
other than flow-delete often contain to few attributes to properly
update the flow"?
--
With Best Regards,
Marat Khalili
On 06/07/17 14:54, Simone Mainardi wrote:
Dear Pelham,
Thanks for sharing the pcap. Currently, in nProbe we deliberately
ignore ASA firewall events different from flow-delete. We have made
this choice as we have seen that events other than flow-delete often
contain to few attributes to properly update the flow. This is the
reason why other templates are silently ignored by nprobe.
If you want your nProbe to proxy all the templates received as-is, you
may want to have a look at:
http://www.ntop.org/nprobe/collecting-proprietary-flows-with-nprobe/
Simone
Regards,
Simone
On Thu, Jul 6, 2017 at 3:55 AM, Pelham Whitmore
<[email protected]
<mailto:[email protected]>> wrote:
Hey Simone,
Thanks for the reply. I have configured the timeout values you
mentioned in nprobe however it seemed to have no effect.
I have generated a .pcap file that includes templates, flow
create, update, and teardown events.
.pcap file can be downloaded from here:
https://files.aceinfo.net.au/index.php/s/bj0aFU3lpyUjqM4/download
<https://files.aceinfo.net.au/index.php/s/bj0aFU3lpyUjqM4/download>
One thing I did notcie from the packet capture is that flow update
events are being listed as "Firewall Event: Unknown (5)" .
I'm not sure if that is to be expected.
Regards,
Pelham Whitmore
-----Original Message-----
From: [email protected]
<mailto:[email protected]>
[mailto:[email protected]
<mailto:[email protected]>] On Behalf Of
[email protected]
<mailto:[email protected]>
Sent: 05 July 2017 8:00 PM
To: [email protected] <mailto:[email protected]>
Subject: Ntop Digest, Vol 158, Issue 1
Send Ntop mailing list submissions to
[email protected] <mailto:[email protected]>
To subscribe or unsubscribe via the World Wide Web, visit
http://listgateway.unipi.it/mailman/listinfo/ntop
<http://listgateway.unipi.it/mailman/listinfo/ntop>
or, via email, send a message with subject or body 'help' to
[email protected]
<mailto:[email protected]>
You can reach the person managing the list at
[email protected]
<mailto:[email protected]>
When replying, please edit your Subject line so it is more
specific than "Re: Contents of Ntop digest..."
Today's Topics:
1. Re: Netflow (NSEL) updates from Cisco ASA (Simone Mainardi)
2. Re: Netflow (NSEL) updates from Cisco ASA (Simone Mainardi)
----------------------------------------------------------------------
Message: 1
Date: Tue, 4 Jul 2017 14:25:19 +0200
From: Simone Mainardi <[email protected] <mailto:[email protected]>>
To: [email protected] <mailto:[email protected]>
Cc: "[email protected] <mailto:[email protected]>"
<[email protected] <mailto:[email protected]>>
Subject: Re: [Ntop] Netflow (NSEL) updates from Cisco ASA
Message-ID:
<cajcxkcdhiqcnpxrwnx3sos6mcszrkmnanacbuxcjz96iynz...@mail.gmail.com
<mailto:cajcxkcdhiqcnpxrwnx3sos6mcszrkmnanacbuxcjz96iynz...@mail.gmail.com>>
Content-Type: text/plain; charset="utf-8"
Pelham,
ASA flow-updates are received and processed by nprobe. However, I
am not sure they contain all the necessary information required to
properly update flow statistics. Can you please generate and send
a .pcap capture file of your ASA netflow (make sure it contains
both templates and data records for flow-updates and
flow-teardown) for our inspection?
By the way, nprobe gives you a couple of configurable timeout that
you can use to periodically export long-lived flows:
[--lifetime-timeout|-t] <timeout> | It specifies the maximum
(seconds)
flow
| lifetime [default=120]
[--idle-timeout|-d] <timeout> | It specifies the maximum
(seconds)
flow
| idle lifetime [default=30]
Regards,
Simone
On Wed, Jun 28, 2017 at 2:38 AM, Pelham Whitmore <
[email protected]
<mailto:[email protected]>> wrote:
> Hello,
>
>
>
> I have a Cisco ASA configured to send Netflow to an instance of
> nprobe, and then on to ntopng.
>
> The configuration is working, however I have noticed that nprobe is
> only emitting flows when it receives a flow-teardown event from the
> ASA. This is causing inaccurate bandwidth reporting for long-lived
> flows as the total byte count is being recorded as a single
spike once the flow is torn down.
>
>
>
> My understanding is that Cisco ASA netflow is very non-standard and
> that this behaviour used to be expected on older version of ASA.
> However, newer versions of ASA are capable of sending flow-update
> events using a refresh-interval for active flows. When I run tcpdump
> on my nprobe server I can see the flow-create and flow-update events
> being sent from the ASA, however nprobe does not seem to use these
> events, or act on them in any way. I have enabled verbose
logging, but
> can only see logs being generated for flow-teardown events, not
flow-create or flow-update.
>
>
>
> My question is, should I expect nprobe to use the flow-updates from
> Cisco ASA for long-lived active flows, or is it normal for it to
only
> process flow-teardown events?
>
>
>
> Nprobe (dev build v.8.1.170626) is running in collector mode
with the
> following settings:
>
>
>
> --zmq="tcp://*:5559"
>
> --collector-port=2055
>
> -i=none
>
> -n=none
>
>
>
>
>
>
>
> Regards,
>
> Pelham
>
>
>
>
>
> ------------------------------
>
> This electronic mail is solely for the use of the addressee and may
> contain information which is confidential or privileged. If you
> receive this electronic mail in error, please delete it from your
> system immediately and notify the sender by electronic mail. Any
> opinion expressed in this email is not represented as the opinion of
> Australian Communication Limited unless that is stated or
apparent from its terms.
> ------------------------------
>
>
> _______________________________________________
> Ntop mailing list
> [email protected] <mailto:[email protected]>
> http://listgateway.unipi.it/mailman/listinfo/ntop
<http://listgateway.unipi.it/mailman/listinfo/ntop>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://listgateway.unipi.it/pipermail/ntop/attachments/20170704/76008a4b/attachment-0002.htm
<http://listgateway.unipi.it/pipermail/ntop/attachments/20170704/76008a4b/attachment-0002.htm>>
------------------------------
Message: 2
Date: Tue, 4 Jul 2017 14:25:19 +0200
From: Simone Mainardi <[email protected] <mailto:[email protected]>>
To: [email protected] <mailto:[email protected]>
Cc: "[email protected] <mailto:[email protected]>"
<[email protected] <mailto:[email protected]>>
Subject: Re: [Ntop] Netflow (NSEL) updates from Cisco ASA
Message-ID:
<cajcxkcdhiqcnpxrwnx3sos6mcszrkmnanacbuxcjz96iynz...@mail.gmail.com
<mailto:cajcxkcdhiqcnpxrwnx3sos6mcszrkmnanacbuxcjz96iynz...@mail.gmail.com>>
Content-Type: text/plain; charset="utf-8"
Pelham,
ASA flow-updates are received and processed by nprobe. However, I
am not sure they contain all the necessary information required to
properly update flow statistics. Can you please generate and send
a .pcap capture file of your ASA netflow (make sure it contains
both templates and data records for flow-updates and
flow-teardown) for our inspection?
By the way, nprobe gives you a couple of configurable timeout that
you can use to periodically export long-lived flows:
[--lifetime-timeout|-t] <timeout> | It specifies the maximum
(seconds)
flow
| lifetime [default=120]
[--idle-timeout|-d] <timeout> | It specifies the maximum
(seconds)
flow
| idle lifetime [default=30]
Regards,
Simone
On Wed, Jun 28, 2017 at 2:38 AM, Pelham Whitmore <
[email protected]
<mailto:[email protected]>> wrote:
> Hello,
>
>
>
> I have a Cisco ASA configured to send Netflow to an instance of
> nprobe, and then on to ntopng.
>
> The configuration is working, however I have noticed that nprobe is
> only emitting flows when it receives a flow-teardown event from the
> ASA. This is causing inaccurate bandwidth reporting for long-lived
> flows as the total byte count is being recorded as a single
spike once the flow is torn down.
>
>
>
> My understanding is that Cisco ASA netflow is very non-standard and
> that this behaviour used to be expected on older version of ASA.
> However, newer versions of ASA are capable of sending flow-update
> events using a refresh-interval for active flows. When I run tcpdump
> on my nprobe server I can see the flow-create and flow-update events
> being sent from the ASA, however nprobe does not seem to use these
> events, or act on them in any way. I have enabled verbose
logging, but
> can only see logs being generated for flow-teardown events, not
flow-create or flow-update.
>
>
>
> My question is, should I expect nprobe to use the flow-updates from
> Cisco ASA for long-lived active flows, or is it normal for it to
only
> process flow-teardown events?
>
>
>
> Nprobe (dev build v.8.1.170626) is running in collector mode
with the
> following settings:
>
>
>
> --zmq="tcp://*:5559"
>
> --collector-port=2055
>
> -i=none
>
> -n=none
>
>
>
>
>
>
>
> Regards,
>
> Pelham
>
>
>
>
>
> ------------------------------
>
> This electronic mail is solely for the use of the addressee and may
> contain information which is confidential or privileged. If you
> receive this electronic mail in error, please delete it from your
> system immediately and notify the sender by electronic mail. Any
> opinion expressed in this email is not represented as the opinion of
> Australian Communication Limited unless that is stated or
apparent from its terms.
> ------------------------------
>
>
> _______________________________________________
> Ntop mailing list
> [email protected] <mailto:[email protected]>
> http://listgateway.unipi.it/mailman/listinfo/ntop
<http://listgateway.unipi.it/mailman/listinfo/ntop>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://listgateway.unipi.it/pipermail/ntop/attachments/20170704/76008a4b/attachment-0003.htm
<http://listgateway.unipi.it/pipermail/ntop/attachments/20170704/76008a4b/attachment-0003.htm>>
------------------------------
_______________________________________________
Ntop mailing list
[email protected] <mailto:[email protected]>
http://listgateway.unipi.it/mailman/listinfo/ntop
<http://listgateway.unipi.it/mailman/listinfo/ntop>
End of Ntop Digest, Vol 158, Issue 1
************************************
This electronic mail is solely for the use of the addressee and
may contain information which is confidential or privileged.
If you receive this electronic mail in error, please delete it
from your system immediately and notify the sender by electronic mail.
Any opinion expressed in this email is not represented as the
opinion of Australian Communication Exchange Limited unless that
is stated or
apparent from its terms.
_______________________________________________
Ntop mailing list
[email protected] <mailto:[email protected]>
http://listgateway.unipi.it/mailman/listinfo/ntop
<http://listgateway.unipi.it/mailman/listinfo/ntop>
_______________________________________________
Ntop mailing list
[email protected]
http://listgateway.unipi.it/mailman/listinfo/ntop
_______________________________________________
Ntop mailing list
[email protected]
http://listgateway.unipi.it/mailman/listinfo/ntop