Re: Advanced GC Tuning

2021-07-20 Thread Sean Owen
https://spark.apache.org/docs/3.1.2/tuning.html#garbage-collection-tuning>, > specifically section on “Advanced GC Tuning”. It is stated that if OldGen > region is getting full, it is recommended to lower *spark.memory.fraction*. > I am wondering if this would lower the overall amount of

Advanced GC Tuning

2021-07-20 Thread Kuznetsov, Oleksandr
Hello, I was reading the Garbage Collection Tuning guide here: Tuning - Spark 3.1.2 Documentation (apache.org)<https://spark.apache.org/docs/3.1.2/tuning.html#garbage-collection-tuning>, specifically section on "Advanced GC Tuning". It is stated that if OldGen region