[ https://issues.apache.org/jira/browse/SPARK-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14317304#comment-14317304 ]
Saisai Shao commented on SPARK-2808: ------------------------------------ I'd like to upgrade Kafka to 0.8.2, currently in ReliableKafkaReceiver, we use ZK to manage the offsets, potentially it will be a bottleneck, since 0.8.2 already supports managing offset by Kafka itself which will get better performance and scalability, I'd like to introduce it in ReliableKafkaReceiver, here is the JIRA SPARK-5718 :). > update kafka to version 0.8.2 > ----------------------------- > > Key: SPARK-2808 > URL: https://issues.apache.org/jira/browse/SPARK-2808 > Project: Spark > Issue Type: Sub-task > Components: Build, Spark Core > Reporter: Anand Avati > > First kafka_2.11 0.8.1 has to be released -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org