Re: Unit tests failing, losing stream contents

2016-08-15 Thread Ciar, David B.
function). Cheers, Max On Thu, Aug 11, 2016 at 5:47 PM, Ciar, David B. mailto:dcia...@ceh.ac.uk>> wrote: > Hi everyone, > > > I've been trying to write unit tests for my data stream bolts (map, flatMap, > apply etc.), however the results I've been getting are stran

Re: Unit tests failing, losing stream contents

2016-08-15 Thread Ciar, David B.
Max On Thu, Aug 11, 2016 at 5:47 PM, Ciar, David B. mailto:dcia...@ceh.ac.uk>> wrote: > Hi everyone, > > > I've been trying to write unit tests for my data stream bolts (map, flatMap, > apply etc.), however the results I've been getting are strange. The code

Unit tests failing, losing stream contents

2016-08-11 Thread Ciar, David B.
Hi everyone, I've been trying to write unit tests for my data stream bolts (map, flatMap, apply etc.), however the results I've been getting are strange. The code for testing is here (running with scalatest and sbt): https://gist.github.com/dbciar/7469adfea9e6442cdc9568aed07095ff It runs t

Window Functions with Incremental Aggregation

2016-08-01 Thread Ciar, David B.
Hello everyone, I'm trying to understand how I can use the Incremental Aggregation + Window Functions, as I've been unsuccessfully trying for a while now. The use-case is one where I have a stream of objects, I want to count the number of objects within a sliding window, and then within the w

Re: countWindow custom WindowFunction

2016-07-13 Thread Ciar, David B.
, www.vishnuviswanath.com<http://www.vishnuviswanath.com/> On Wed, Jul 13, 2016 at 7:07 AM, Ciar, David B. mailto:dcia...@ceh.ac.uk>> wrote: Hello everyone, I'm relatively new to using Apache Flink and Scala, and am just getting to grips with some of the basic function

countWindow custom WindowFunction

2016-07-13 Thread Ciar, David B.
Hello everyone, I'm relatively new to using Apache Flink and Scala, and am just getting to grips with some of the basic functionality both provide. I've hit a wall trying to implement a custom WindowFunction over a keyed countWindow however, and hoped someone may have a pointer. The full cod