HeartSaVioR commented on pull request #25135: URL: https://github.com/apache/spark/pull/25135#issuecomment-646420436
@Tagar Please refer the comment in JIRA issue: https://issues.apache.org/jira/browse/SPARK-28367?focusedCommentId=17088514&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17088514 In short, it's OK to use the new API in executors (we may need to set longer timeout then), but still not be ideal to use it in driver. It requires Spark to implement the subscription modes by itself with AdminClient API, which is not impossible but brings complexity to match the behavior same as we expect from Kafka client. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
