Alex Halldin created NIFI-2590:
----------------------------------

             Summary: Added the FlowFileAggregationController Processor
                 Key: NIFI-2590
                 URL: https://issues.apache.org/jira/browse/NIFI-2590
             Project: Apache NiFi
          Issue Type: New Feature
            Reporter: Alex Halldin


This processor is used to aggregate flowfiles and continuously feed them into 
another processor. This processor will keep track of the individual flow files, 
as well as an entire batch of flowfiles, and will throw away old flow files 
when a new batch is detected in an event driven fashion. The processor will 
also create and update a "startTime" attribute on all flowfiles that is 
controlled by the "Data Retrieval Time Delay" property.

An example of usage would be a query use case. The 
FlowFileAggregationController will aggregate a number of flowfiles representing 
query attributes, and will update the startTime's on each flowfile. As each 
flowfile is processed by the query processor and returned to the Aggregator, 
the Aggregator will update the startTime's once again with the end time of the 
previous query execution and will feed them back into the query processor. In 
other words, this processor will allows us to continually query using 
timestamps that are updated after each previous processing attempt.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to