Hi,
The docs say that we should be careful to increase spark.akka.threads when our cluster size increases. Is there a rule of thumb for how much we should increase it? For instance, the recommendation for default parallelism is 2x cores.
Hi,
The docs say that we should be careful to increase spark.akka.threads when our cluster size increases. Is there a rule of thumb for how much we should increase it? For instance, the recommendation for default parallelism is 2x cores.