Hi there, I check my build.gradle file, I use 'org.apache.flink:flink-connector-kafka-0.9_2.10:1.0.0’, but I found that this lib is based on kaka-clients 0.9.0.1.
I want to use Flink streaming to consume Kafka’s events in realtime, but I’m confused by Flink’s libs with different versions. Which flink-connector-kafka is comparable with kafka 0.9.0.0 ? My environment is Kafka: 0.9.0.0, Flink: 1.0.0, Language: java part of my build.grade： 'org.apache.kafka:kafka_2.10:0.9.0.0', 'org.apache.kafka:kafka-clients:0.9.0.0', 'org.apache.flink:flink-java:1.0.0', 'org.apache.flink:flink-streaming-java_2.10:1.0.0', 'org.apache.flink:flink-connector-kafka-0.9_2.10:1.0.0', 'org.apache.flink:flink-connector-kafka-base_2.10:1.0.0 Any advice ? Thanks. > On Mar 30, 2016, at 10:35 PM, Stephan Ewen <se...@apache.org> wrote: > > Hi! > > A "NoSuchMethodError" usually means that you compile and run against > different versions. > > Make sure the version you reference in the IDE and the version on the cluster > are the same. > > Greetings, > Stephan > > > > On Wed, Mar 30, 2016 at 9:42 AM, Balaji Rajagopalan > <balaji.rajagopa...@olacabs.com <mailto:balaji.rajagopa...@olacabs.com>> > wrote: > I have tested kafka 0.8.0.2 with flink 1.0.0 and it works for me. Can't talk > about kafka 0.9.0.1. > > On Wed, Mar 30, 2016 at 12:51 PM, Zhun Shen <shenzhunal...@gmail.com > <mailto:shenzhunal...@gmail.com>> wrote: > Hi there, > > flink version: 1.0.0 > kafka version: 0.9.0.0 > env: local > > I run the script below: > ./bin/flink run -c com.test.flink.FlinkTest test.jar --topic nginx-logs > --bootstrap.servers localhost:9092 --zookeeper.connect localhost:2181 > --group.id <http://group.id/> myGroup --partition.assignment.strategy round > robin > > But I got the error: > ava.lang.NoSuchMethodError: > org.apache.kafka.clients.consumer.KafkaConsumer.partitionsFor(Ljava/lang/String;)Ljava/util/List; > at > org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer09.<init>(FlinkKafkaConsumer09.java:194) > at > org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer09.<init>(FlinkKafkaConsumer09.java:164) > at > org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer09.<init>(FlinkKafkaConsumer09.java:131) > > > The code as below: > DataStream<String> messageStream = env.addSource(new > FlinkKafkaConsumer09<>("nginx-logs", new > SimpleStringSchema(),parameterTool.getProperties())); > messageStream.rebalance().map(new MapFunction<String, String>() { > > @Override > public String map(String value) throws Exception { > return "Kafka and Flink says: " + value; > } > }).print(); > > > I check the error with google, but it shows that it is a method of kafka > 0.9.01. Any idea? Thanks. > > >
