[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983396#comment-15983396 ]
Shixiong Zhu edited comment on SPARK-18057 at 4/25/17 6:29 PM: --------------------------------------------------------------- [~guozhang] We have a stress test to test Spark Kafka connector for various cases, and it will try to frequently delete / re-create topics. Topic deletion may not be common in production, but it will just hang forever and waste resources. It requires users to set up some monitor scripts to restart a job if it doesn't make any progress for a long time. was (Author: zsxwing): [~guozhang] We have a stress test to test Spark Kafka connector for various cases, and it will try to frequently delete / re-create topics. > Update structured streaming kafka from 10.0.1 to 10.2.0 > ------------------------------------------------------- > > Key: SPARK-18057 > URL: https://issues.apache.org/jira/browse/SPARK-18057 > Project: Spark > Issue Type: Improvement > Components: Structured Streaming > Reporter: Cody Koeninger > > There are a couple of relevant KIPs here, > https://archive.apache.org/dist/kafka/0.10.1.0/RELEASE_NOTES.html -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org