Hi Fellow Devs, Please share your thoughts on the pull request that allows spark to have more graceful retries with kinesis streaming.
The patch removes simple hard codings in the code and allows user to pass the values in config. This will help users to cope up with kinesis throttling errors and make spark recovery faster. I would love to work on the suggested changes. https://github.com/apache/spark/pull/17467 Best Regards, Yash
