My bad! Confused myself with different build.sbt I tried in different
projects
Thx Cody for pointing that out(again)
Spark streaming Kafka was all I needed
Kr
On 6 Feb 2017 9:02 pm, "Cody Koeninger" wrote:
> You should not need to include jars for Kafka, the spark connectors
You should not need to include jars for Kafka, the spark connectors
have the appropriate transitive dependency on the correct version.
On Sat, Feb 4, 2017 at 3:25 PM, Marco Mistroni wrote:
> Hi
> not sure if this will help at all, and pls take it with a pinch of salt as
> i
Hi
not sure if this will help at all, and pls take it with a pinch of salt as
i dont have your setup and i am not running on a cluster
I have tried to run a kafka example which was originally workkign on spark
1.6.1 on spark 2.
These are the jars i am using
I am getting this error with Spark 2. which works with CDH 5.5.1 (Spark
1.5).
Admittedly I am messing around with Spark-shell. However, I am surprised
why this does not work with Spark 2 and is ok with CDH 5.1
scala> val dstream = KafkaUtils.createDirectStream[String, String,
StringDecoder,