Re: Collect output of transformations on a custom source in real time

2016-05-26 Thread Stephan Ewen
Hi! I am not sure I understand the problem exactly, but one problem I see in your code is that you call "execute()" on and then "DataStreamUtils.collect( datastream);" The first call to "env.execute()" will start the program (source and filter) and the results will simply go nowhere. Then you cal

Collect output of transformations on a custom source in real time

2016-05-26 Thread Ahmed Nader
Hello, I have defined a custom source function for an infinite stream source, where in my overwritten run method I have a while true loop to keep listening for the input. I want to apply some transformations on the resulting datastream from my source and collect the output so far of these transform