Is there a way to get the total no. of active states in memory at any given point in a Stateful Spark Structured Streaming job? We are thinking of using this metric for 'Auto Scaling' our Spark cluster.
- No. of active states? Something Something
- Re: No. of active states? Jungtaek Lim
- Re: No. of active states? Something Something
- Re: No. of active states? Jungtaek Lim
- Re: No. of active states? Edgardo Szrajber