Re: dynamic sliding window duration

2014-10-07 Thread Tobias Pfeiffer
Hi, On Wed, Oct 8, 2014 at 4:50 AM, Josh J wrote: > > I have a source which fluctuates in the frequency of streaming tuples. I > would like to process certain batch counts, rather than batch window > durations. Is it possible to either > > 1) define batch window sizes > Cf. http://apache-spark-u

dynamic sliding window duration

2014-10-07 Thread Josh J
Hi, I have a source which fluctuates in the frequency of streaming tuples. I would like to process certain batch counts, rather than batch window durations. Is it possible to either 1) define batch window sizes or 2) dynamically adjust the duration of the sliding window? Thanks, Josh