As I said in my previous e-mail, until recently DirectPipelineRunner
didn't support Unbounded.
It's now fixed, so if you take a latest nightly build, or build master,
it should work.
As workaround, you can also limit the number of message consumed from
Kafka (and so work with bounded).
Regards
JB
On 04/29/2016 07:12 PM, amir bahmanyari wrote:
Hi colleagues,
I am moving this conversation to this users mailing list as per Max’s
suggestion.
Thanks Max.
Hi JB,
Hope all is great.
Is there a resolution to the exception I sent last night pls?
When would the sample code to use KafkaIO be released?
I really appreciate your valuable time. Below is the exception for your
reference.
This is how it gets used in my code:
p.apply(KafkaIO.read().withBootstrapServers("kirk:9092").withTopics(topics));
Have a wonderful weekend.
Exception in thread "main" java.lang.IllegalStateException: no evaluator
registered for Read(UnboundedKafkaSource)
at
org.apache.beam.sdk.runners.DirectPipelineRunner$Evaluator.visitTransform(DirectPipelineRunner.java:898)
at
org.apache.beam.sdk.runners.TransformTreeNode.visit(TransformTreeNode.java:221)
at
org.apache.beam.sdk.runners.TransformTreeNode.visit(TransformTreeNode.java:217)
at
org.apache.beam.sdk.runners.TransformTreeNode.visit(TransformTreeNode.java:217)
at
org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:104)
at
org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:261)
at
org.apache.beam.sdk.runners.DirectPipelineRunner$Evaluator.run(DirectPipelineRunner.java:860)
at
org.apache.beam.sdk.runners.DirectPipelineRunner.run(DirectPipelineRunner.java:572)
at
org.apache.beam.sdk.runners.DirectPipelineRunner.run(DirectPipelineRunner.java:106)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:182)
at
benchmark.flinkspark.flink.ReadFromKafka2.main(ReadFromKafka2.java:286)
Kind Regards,
Amir
--
Jean-Baptiste Onofré
[email protected]
http://blog.nanthrax.net
Talend - http://www.talend.com
