Hello Bill, This is a known limitation of the Flink Runner. There is a JIRA issue for that https://issues.apache.org/jira/browse/BEAM-127
A wrapper for Flink sinks will come soon and as Beam evolves, a more Beam-y solution will come as well. Kostas On Mar 18, 2016, at 5:23 PM, William McCarthy <[email protected]> wrote: Hi, I’m trying to write a proof-of-concept which takes messages from Kafka, transforms them using Beam on Flink, then pushes the results onto a different Kafka topic. I’ve used the KafkaWindowedWordCountExample as a starting point, and that’s doing the first part of what I want to do, but it outputs to text files as opposed to Kafka. FlinkKafkaProducer08 looks promising, but I can’t figure out how to plug it into the pipeline. I was thinking that it would be wrapped with an UnboundedFlinkSink, or some such, but that doesn’t seem to exist. Any advice or thoughts on what I’m trying to do? I’m running the latest incubator-beam (as of last night from Github), Flink 1.0.0 in cluster mode and Kafka 0.9.0.1, all on Google Compute Engine (Debian Jessie). Thanks, Bill McCarthy
