Re: Spark Issue with Istio in Distributed Mode

2022-09-12 Thread Deepak Sharma
Was able to resolve the idle connections being terminated issue using EnvoyFilter On Sat, 3 Sept 2022 at 18:14, Ilan Filonenko wrote: > Must be set in envoy (maybe could passthrough via istio) > >

Re: Spark Issue with Istio in Distributed Mode

2022-09-03 Thread Deepak Sharma
Thank for the reply IIan . Can we set this in spark conf or does it need to goto istio / envoy conf? On Sat, 3 Sept 2022 at 10:28, Ilan Filonenko wrote: > This might be a result of the idle_timeout that is configured in envoy. > The default is an hour. > > On Sat, Sep 3, 2022 at 12:17 AM

Spark Issue with Istio in Distributed Mode

2022-09-02 Thread Deepak Sharma
Hi All, In 1 of our cluster , we enabled Istio where spark is running in distributed mode. Spark works fine when we run it with Istio in standalone mode. In spark distributed mode , we are seeing that every 1 hour or so the workers are getting disassociated from master and then master is not able