Re: SSpark streaming: Could not initialize class kafka.consumer.FetchRequestAndResponseStatsRegistry$

2017-02-06 Thread Marco Mistroni
My bad! Confused myself with different build.sbt I tried in different projects Thx Cody for pointing that out(again) Spark streaming Kafka was all I needed Kr On 6 Feb 2017 9:02 pm, "Cody Koeninger" wrote: > You should not need to include jars for Kafka, the spark connectors

Re: SSpark streaming: Could not initialize class kafka.consumer.FetchRequestAndResponseStatsRegistry$

2017-02-06 Thread Cody Koeninger
You should not need to include jars for Kafka, the spark connectors have the appropriate transitive dependency on the correct version. On Sat, Feb 4, 2017 at 3:25 PM, Marco Mistroni wrote: > Hi > not sure if this will help at all, and pls take it with a pinch of salt as > i

Re: SSpark streaming: Could not initialize class kafka.consumer.FetchRequestAndResponseStatsRegistry$

2017-02-04 Thread Marco Mistroni
Hi not sure if this will help at all, and pls take it with a pinch of salt as i dont have your setup and i am not running on a cluster I have tried to run a kafka example which was originally workkign on spark 1.6.1 on spark 2. These are the jars i am using

SSpark streaming: Could not initialize class kafka.consumer.FetchRequestAndResponseStatsRegistry$

2017-02-04 Thread Mich Talebzadeh
I am getting this error with Spark 2. which works with CDH 5.5.1 (Spark 1.5). Admittedly I am messing around with Spark-shell. However, I am surprised why this does not work with Spark 2 and is ok with CDH 5.1 scala> val dstream = KafkaUtils.createDirectStream[String, String, StringDecoder,