Hi Kidong, Just now I tested the Low Level Consumer with Spark 1.2 and I did not see any issue with Receiver.Store method . It is able to fetch messages form Kafka.
Can you cross check other configurations in your setup like Kafka broker IP , topic name, zk host details, consumer id etc. Dib On Fri, Jan 16, 2015 at 11:50 AM, Dibyendu Bhattacharya < dibyendu.bhattach...@gmail.com> wrote: > Hi Kidong, > > No , I have not tried yet with Spark 1.2 yet. I will try this out and let > you know how this goes. > > By the way, is there any change in Receiver Store method happened in Spark > 1.2 ? > > > > Regards, > Dibyendu > > > > On Fri, Jan 16, 2015 at 11:25 AM, mykidong <mykid...@gmail.com> wrote: > >> Hi Dibyendu, >> >> I am using kafka 0.8.1.1 and spark 1.2.0. >> After modifying these version of your pom, I have rebuilt your codes. >> But I have not got any messages from ssc.receiverStream(new >> KafkaReceiver(_props, i)). >> >> I have found, in your codes, all the messages are retrieved correctly, but >> _receiver.store(_dataBuffer.iterator()) which is spark streaming abstract >> class's method does not seem to work correctly. >> >> Have you tried running your spark streaming kafka consumer with kafka >> 0.8.1.1 and spark 1.2.0 ? >> >> - Kidong. >> >> >> >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Low-Level-Kafka-Consumer-for-Spark-tp11258p21180.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> >> >
