Re: Unable to serialize exception running KafkaWindowedWordCountExample

2016-03-19 Thread Maximilian Michels
@Dan: You're right that the PipelineOptions shouldn't be cached like this. In this particular wrapper, it was not even necessary. @Jiankang: I've pushed a fix to the repository with a few improvements. Could you please try again? You will have to recompile. Thanks, Max On Thu, Mar 17, 2016 at 8:

Re: Unable to serialize exception running KafkaWindowedWordCountExample

2016-03-19 Thread Maximilian Michels
Hi Jiankang, Thanks for reporting again. I'm sorry that you ran into another problem. This example had been working but it has some small problems with the new code base we just migrated to. I've fixed and tested the example and would invite you to try again. Thanks, Max On Thu, Mar 17, 2016 at

Re: Unable to serialize exception running KafkaWindowedWordCountExample

2016-03-19 Thread Dan Halperin
+Max for the Flink Runner, and +Luke who wrote most of the initial code around PipelineOptions. The UnboundedFlinkSource is caching the `PipelineOptions` object, here: https://github.com/apache/incubator-beam/blob/071e4dd67021346b0cab2aafa0900ec7e34c4ef8/runners/flink/runner/src/main/java/org/apac

Unable to serialize exception running KafkaWindowedWordCountExample

2016-03-19 Thread 刘见康
Hi guys, Failed to run KafkaWindowedWordCountExample with Unable to serialize exception, the stack exception as below: 16/03/17 13:49:09 INFO flink.FlinkPipelineRunner: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 160 files. Enable logging at

Re: Unable to serialize exception running KafkaWindowedWordCountExample

2016-03-18 Thread 刘见康
@Max: Thanks for your quick fix, this serializable exception has been solved. However, it reported another one: 16/03/17 20:14:23 INFO flink.FlinkPipelineRunner: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 158 files. Enable logging at DEBUG lev