Re: window function outputs two different values

2017-01-10 Thread Yury Ruchin
Hi, Is there a strict requirement that elements must proceed along the processing pipeline exactly after being accounted by the reduce function? If not, you could derive two streams from the original one to be processed concurrently, something like this: val protoStream = kafka source -> keyBy

Re: window function outputs two different values

2017-01-10 Thread Aljoscha Krettek
Hi, I'm afraid this is not possible with the current model. A reduce function is only meant to combine two values and output the result of that. Side effects, such as emitting further data are not allowed right now. Cheers, Aljoscha On Mon, 9 Jan 2017 at 15:27 tao xiao

Re: window function outputs two different values

2017-01-09 Thread tao xiao
Hi team, any suggestions on below topic? I have a requirement that wants to output two different values from a time window reduce function. Here is basic workflow 1. fetch data from Kafka 2. flow the data to a event session window. kafka source -> keyBy -> session window -> reduce 3. inside the

window function outputs two different values

2017-01-07 Thread tao xiao
Hi team, I have a requirement that wants to output two different values from a time window reduce function. Here is basic workflow 1. fetch data from Kafka 2. flow the data to a event session window. kafka source -> keyBy -> session window -> reduce 3. inside the reduce function, count the