gaborgsomogyi commented on pull request #29131: URL: https://github.com/apache/spark/pull/29131#issuecomment-659918072
I think this is conservative enough since retry still happens and now we're speaking about potential issues which has been never reported but I see your point, closing it. The intention here is to simplify the offset reader because it's not easy to solve SPARK-32032. The more compact the consumer usage is the easier to discuss it through w/ the Kafka guys. My point is not solving and/or delaying to solve SPARK-32032 is at least that severe just like this one (when SPARK-32032 hits then the whole query stops and there is no workaround). ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org