Leng, Generally, Apache NiFi is data "flow" oriented, in the same sense of a water flow (along pipes, for example) that might emit a lot or a little (or none) at any one time, but overall the water continues to flow through, and there might not be a discrete concept of "finished".
In your case, when would you know that a processor is "finished processing all the inserts/updates"? Do you have an upstream processor that runs at a specified schedule, such that the downstream flow would only be processed every so often? If so, you could try the MonitorActivity processor [1] after your PutES5 processor, it would allow you to generate an event if an amount of time has passed with no output. If not, can you describe your NiFi flow in more detail? Although this seems more batch-oriented, NiFi does have some capabilities that could enable you to achieve what you're looking for. Regards, Matt [1] https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.MonitorActivity/index.html On Wed, Apr 12, 2017 at 9:16 PM, Leng Lim <leng....@brightsparklabs.com> wrote: > Hello, > > Is there any easy way to tell when the PutElasticsearch5 processor has > finished inserting or updating records in the database? What I'm looking for > is some way for the processor to signal that it has finished processing all > the insert or updates so I know the database is in the correct state before > I query or process further inserts/updates on it. > > From what I can see, the PutElasticsearch5 will only output a flow file for > each insert/update or failure it processes. It would be helpful if there > were some way to specify how many records are expected to inserted/updated > for a specific transaction and have the processor signal via routing a flow > file to some relationship or some other mechanism that it has finished > processing the expected amount of inserts/updates. > > Regards, > > Leng > > > > -- > View this message in context: > http://apache-nifi-developer-list.39713.n7.nabble.com/PutElasticsearch5-Processor-Finished-Processing-tp15457.html > Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
