Re: [Spark on Kubernetes]: Seeking Guidance on Handling Persistent Executor Failures

2024-02-19 Thread Sri Potluri
engineers and scientists to focus on the application logic without needing to implement and test infrastructure resilience mechanisms. Thank you again for your time and assistance. Best regards, Sri Potluri On Mon, Feb 19, 2024 at 5:03 PM Mich Talebzadeh wrote: > Went through your is

[Spark on Kubernetes]: Seeking Guidance on Handling Persistent Executor Failures

2024-02-19 Thread Sri Potluri
Hello Spark Community, I am currently leveraging Spark on Kubernetes, managed by the Spark Operator, for running various Spark applications. While the system generally works well, I've encountered a challenge related to how Spark applications handle executor failures, specifically in scenarios