spark-streaming-kafka-0-10 has a transitive dependency on the kafka library, you shouldn't need to include kafka explicitly.
What's your actual list of dependencies? On Tue, Jan 31, 2017 at 3:49 PM, Marco Mistroni <mmistr...@gmail.com> wrote: > HI all > i am trying to run a sample spark code which reads streaming data from > Kafka > I Have followed instructions here > > https://spark.apache.org/docs/latest/streaming-kafka-0-10-integration.html > > > Here's my setup > Spark: 2.0.1 > Kafka:0.10.1.1 > Scala Version: 2.11 > > > > Libraries used > - spark-streaming-kafka-0.10_2.11-2.0.1 > - kafka-_2.11-0.10.0.1.jar > > These are my imports > > import org.apache.spark.streaming.kafka010.KafkaUtils > import > org.apache.spark.streaming.kafka010.LocationStrategies.PreferConsistent > import org.apache.spark.streaming.kafka010.ConsumerStrategies.Subscribe > > But Eclipse is giving me the following errors: > Missing or invlaid dependency detected while loading class file > KafkaUtils.class. Could not access term clients in value org.apache.kafka > because it (or its dependencies) are missing. > Missing or invalid dependency detected while loading class file > KafkaUtils.class Could not access term kafka in package org.apache because > it (or its dependencies are missing) > missing or invalid dependencies detected while loading class file > KafkaUtils.class: could not access type ConsumerRecord in value > org.apache.consumer because it(or its dependencies are missing) > > So it seems i have some dependencies clashing. Has any one encountered a > similar error? > > kr > marco --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
