|
Hello, I recently came across the "--driver-cores" option when, for example, launching a PySpark shell. Provided that there are idle CPUs on driver's node, what would be the benefit of having multiple driver cores? For example, will this accelerate the "collect()" operations? Will they be done in parallel? Can't find any documentation about how the behavior will change from using just 1 core for the driver. Thanks in advance. Judit --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org |
