Re: [EXT] Sliding windows

2019-06-05 Thread Michal Klempa
d > >> the FlowFile is (using the timestamp attribute I mentioned). If the > >> FlowFile is older than x, drop it, else send it back to the MergeContent > >> processor. > >> > >> Using this process, it should be easy to get a 5 min rolling window (drop &

Re: [EXT] Sliding windows

2019-06-04 Thread Craig Knell
er than x, drop it, else send it back to the MergeContent >> processor. >> >> Using this process, it should be easy to get a 5 min rolling window (drop >> any FlowFile older than 5 min in RouteOnAttribute). >> >> I don't know that this perfectly answers what

Re: [EXT] Sliding windows

2019-06-04 Thread Joe Witt
sy to get a 5 min rolling window (drop > any FlowFile older than 5 min in RouteOnAttribute). > > I don't know that this perfectly answers what you asked, but does it give > you a good direction to investigate? > > Thanks, > Peter > > -Original Message- >

RE: [EXT] Sliding windows

2019-06-04 Thread Peter Wicks (pwicks)
ctly answers what you asked, but does it give you a good direction to investigate? Thanks, Peter -Original Message- From: Craig Knell Sent: Tuesday, June 4, 2019 1:32 AM To: dev@nifi.apache.org Subject: [EXT] Sliding windows Hi Folks We have a stream of data that I need to window t

Sliding windows

2019-06-04 Thread Craig Knell
Hi Folks We have a stream of data that I need to window to 5 minutes and the window is to slide every 3 minutes. Each minute is 1 mb, I therefore have to deliver 5mb per 3 minutes. What is the best way of achieving this in nifi? Best regards Craig