Re: [SPARK STRUCTURED STREAMING] : Rocks DB uses off-heap usage

2022-09-12 Thread Artemis User
The off-heap memory isn't subjected to GC.  So the obvious reason is that your have too many states to maintain in your streaming app, and the GC couldn't keep up, and end up with resources but to die. Are you using continues processing or microbatch in structured streaming?  You may want to

Re: Spark Issue with Istio in Distributed Mode

2022-09-12 Thread Deepak Sharma
Was able to resolve the idle connections being terminated issue using EnvoyFilter On Sat, 3 Sept 2022 at 18:14, Ilan Filonenko wrote: > Must be set in envoy (maybe could passthrough via istio) > >