[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370642#comment-16370642 ]
Sönke Liebau commented on SPARK-18057: -------------------------------------- I think in addition to the naming convention issue there was also the question of whether or not to wait for [KAFKA-4897|https://issues.apache.org/jira/browse/KAFKA-4879] which as I understand it causes a stress test in Spark to hang indefinitely. However I do not think that that ticket will get fixed anytime soon, its currently assigned to the 2.0 release which I believe is scheduled to land around October, but that will change of course if no one works on it.. Since repeatedly deleting an recreating topics is not really a common use case I'd be in favor of moving forward with updating the version regardless. On the naming convention, as [~guozhang] mentioned, with [KAFKA-4462|https://issues.apache.org/jira/browse/KAFKA-4462] now merged the strict dependence on binary protocol versions that Kafka used to impose have been lifted to a large degree, so I think an argument could be made that we don't need the Kafka version in the artifact name any more. > Update structured streaming kafka from 10.0.1 to 10.2.0 > ------------------------------------------------------- > > Key: SPARK-18057 > URL: https://issues.apache.org/jira/browse/SPARK-18057 > Project: Spark > Issue Type: Improvement > Components: Structured Streaming > Reporter: Cody Koeninger > Priority: Major > > There are a couple of relevant KIPs here, > https://archive.apache.org/dist/kafka/0.10.1.0/RELEASE_NOTES.html -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org