Hi Wilfrid,
Your understanding is correct although replication and collection are
two separate pieces. You can have 1) a nfacctd replicator, that is
binary NetFlow to binary NetFlow, where you could fan-out and filter
pieces of your original export (to different collector, apps, etc.) and
2) a nfacctd collector that is parsing binary NetFlow and sending into
Kafka; this piece should be business as usual and encodings you can pick
are JSON or Apache Avro.
You can find examples and some introductory elaboration around the
replication (tee) plugin here:
https://github.com/pmacct/pmacct/blob/master/QUICKSTART#L2105-#L2167
Paolo
On 10/5/21 12:28, Grassot, Wilfrid wrote:
Hi Paolo,
I understand that we can configure tee to replicate filtered datagram
with pre-tag.map to a kafka broker.
I am novice to Kafka, but does it mean the data sent to Kafka is in json
format ? If not which other data format is it sent to Kafka ?
I am not sure either how would look like the configuration nfacct with
the tee plugin to replicate netflow packet to a kafka broker, would you
have an example ?
Many thanks .
Wilfrid
_______________________________________________
pmacct-discussion mailing list
http://www.pmacct.net/#mailinglists
_______________________________________________
pmacct-discussion mailing list
http://www.pmacct.net/#mailinglists
