Re: spark streaming kafka connector questions

Thanks, That is what I am missing. I have added cache before action, and that 2nd processing is avoided. 2016-09-10 5:10 GMT-07:00 Cody Koeninger : > Hard to say without seeing the code, but if you do multiple actions on an > Rdd without caching, the Rdd will be computed

Re: spark streaming kafka connector questions

message in context: http://apache-spark-user-list. 1001560.n3.nabble.com/spark-streaming-kafka-connector- questions-tp27681p27687.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-

Re: spark streaming kafka connector questions

hed without really doing the work. Help is hugely appreciated. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-streaming-kafka-connector-questions-tp27681p27687.html Sent from the Apache Spark User List mailing list archive at Nabble.

Re: spark streaming kafka connector questions

have tried to > pass > > following properties to KafkaUtils > > > > kafkaParams.put("auto.commit.enable", "true"); > > kafkaParams.put("auto.commit.interval.ms", "1000"); > > kafkaParams.put("zookeeper.session.timeout.ms", "6"); >

Re: spark streaming kafka connector questions

auto.commit.enable", "true"); > kafkaParams.put("auto.commit.interval.ms", "1000"); > kafkaParams.put("zookeeper.session.timeout.ms", "6"); > kafkaParams.put("zookeeper.connection.timeout.ms", "6"); > > S

spark streaming kafka connector questions

t("auto.commit.interval.ms", "1000"); kafkaParams.put("zookeeper.session.timeout.ms", "6"); kafkaParams.put("zookeeper.connection.timeout.ms", "6"); Still not working. Help is greatly appreciated ! -- View this message in context