[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370780#comment-16370780 ]
Michael Armbrust commented on SPARK-18057: ------------------------------------------ +1 to upgrading and it would also be great to add support for any new features (i.e. starting a query based on the time index rather than a specific offset). I personally don't think that fixing KAFKA-4897 is mandatory, but keeping our stress tests running without hanging or losing coverage is. Regarding naming, I'd probably just stop changing the name and say that "kafka-0-10-sql" works with any broker that is 0.10.0+. We could also get rid of it, but that seems like an unnecessary change to me that just causes unnecessary pain to existing users. > Update structured streaming kafka from 10.0.1 to 10.2.0 > ------------------------------------------------------- > > Key: SPARK-18057 > URL: https://issues.apache.org/jira/browse/SPARK-18057 > Project: Spark > Issue Type: Improvement > Components: Structured Streaming > Reporter: Cody Koeninger > Priority: Major > > There are a couple of relevant KIPs here, > https://archive.apache.org/dist/kafka/0.10.1.0/RELEASE_NOTES.html -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org