[ 
https://issues.apache.org/jira/browse/NIFI-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16548151#comment-16548151
 ] 

ASF GitHub Bot commented on NIFI-5327:
--------------------------------------

Github user PrashanthVenkatesan commented on the issue:

    https://github.com/apache/nifi/pull/2820
  
    @ottobackwards  Thanks for your valuable review.
    I thought if user flow sends this json to some sink (say kafka), it would 
be good to have the raw_data with it. are you suggesting me to remove this ? .. 
 
    
    Providing template also for the above purpose, if the external system wants 
to parse the raw or understand the parsing configs, template would be 
necessary.  Also further ahead if we support other netflow related protocols 
that has concept of dynamic templates, it is worth sending templates via 
relationship.
    
    I understand your point adding raw to json looks like conflating, but i 
felt creating the another relationship would create separate content claim for 
each record that might degrade the throughput of processor.
    
    would like to know your view on my points..
    I will incorporate all the other review comments and soon push the commit.


> NetFlow Processors
> ------------------
>
>                 Key: NIFI-5327
>                 URL: https://issues.apache.org/jira/browse/NIFI-5327
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Core Framework
>    Affects Versions: 1.6.0
>            Reporter: Prashanth Venkatesan
>            Assignee: Prashanth Venkatesan
>            Priority: Major
>
> As network traffic data scopes for the big data use case, would like NiFi to 
> have processors to support parsing of those protocols.
> Netflow is a protocol introduced by Cisco that provides the ability to 
> collect IP network traffic as it enters or exits an interface and is 
> described in detail in here:
> [https://www.cisco.com/c/en/us/td/docs/net_mgmt/netflow_collection_engine/3-6/user/guide/format.html]
>  
> Currently, I have created the following processor:
> *ParseNetflowv5*:  Parses the ingress netflowv5 bytes and ingest as either 
> NiFi flowfile attributes or as a JSON content. This also sends 
> one-time-template.
>  
> Further ahead, we can add many processor specific to network protocols in 
> this nar bundle.
> I will create a pull request.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to