Re: RE: [EXT] Re: Polling Processors impact on Latency

2017-11-08 Thread Chirag Dewan
t; Original Message >Subject: RE: [EXT] Re: Polling Processors impact on Latency >Local Time: November 7, 2017 7:29 AM >UTC Time: November 7, 2017 12:29 PM >From: pwi...@micron.com >To: users@nifi.apache.org <users@nifi.apache.org> > > >If you sched

RE: [EXT] Re: Polling Processors impact on Latency

2017-11-07 Thread Andy Christianson
ubject: RE: [EXT] Re: Polling Processors impact on Latency >Local Time: November 7, 2017 7:29 AM >UTC Time: November 7, 2017 12:29 PM >From: pwi...@micron.com >To: users@nifi.apache.org <users@nifi.apache.org> > > >If you schedule the processor to run every 0 sec (the

RE: [EXT] Re: Polling Processors impact on Latency

2017-11-07 Thread Peter Wicks (pwicks)
uration=10 millis Thanks, Peter From: Chirag Dewan [mailto:chirag.dewa...@yahoo.in] Sent: Tuesday, November 07, 2017 8:02 PM To: apere...@gmail.com; users@nifi.apache.org Subject: [EXT] Re: Polling Processors impact on Latency Thanks Andrew for the quick response. I am more concerned about the

Re: Polling Processors impact on Latency

2017-11-07 Thread Chirag Dewan
Thanks Andrew for the quick response. I am more concerned about the processors polling for flow files on the connection between the processors? Thanks, Chirag Sent from Yahoo Mail on Android On Tue, 7 Nov 2017 at 5:24 PM, Andrew Grande wrote: Yes, polling increases

Re: Polling Processors impact on Latency

2017-11-07 Thread Andrew Grande
Yes, polling increases latency in some cases. But no, NiFi is not just polling. It has all kinds of sources, and listening vs polling vs subscribing purely depends on the protocol of that given processor. Hope this helps, Andrew On Tue, Nov 7, 2017, 1:39 AM Chirag Dewan

Polling Processors impact on Latency

2017-11-06 Thread Chirag Dewan
Hi All, I am a layman to NiFi. I am exploring NiFi as a data flow engine to be integrated with my Flink processing engine. A brief history of our approach :  We are trying to build a Streaming Data processing engine. We started off with Flink as the sole core engine, which is responsible for