[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16441793#comment-16441793 ]
Cody Koeninger commented on SPARK-18057: ---------------------------------------- Just adding the extra dependency on 0.11 probably won't work, since there were some actual code changes not just a dependency bump. As long as you aren't deleting topics, the blocker KAFKA-4879 issue shouldn't affect you trying out a branch with the changes, and it wouldn't require changing your spark deployment, just the app assembly. [~sliebau] [~Yohan123] do you have an up to date branch of spark with the kafka client dependency change that Jordan can try out? If not I can make one. > Update structured streaming kafka from 0.10.0.1 to 1.1.0 > -------------------------------------------------------- > > Key: SPARK-18057 > URL: https://issues.apache.org/jira/browse/SPARK-18057 > Project: Spark > Issue Type: Improvement > Components: Structured Streaming > Reporter: Cody Koeninger > Priority: Major > > There are a couple of relevant KIPs here, > https://archive.apache.org/dist/kafka/0.10.1.0/RELEASE_NOTES.html -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org