It is actually number of cores. If your processor has hyperthreading then
it will be more (number of processors your OS sees)
niedz., 22 mar 2015, 4:51 PM Ted Yu użytkownik yuzhih...@gmail.com
napisał:
I assume spark.default.parallelism is 4 in the VM Ashish was using.
Cheers
I assume spark.default.parallelism is 4 in the VM Ashish was using.
Cheers
://apache-spark-user-list.1001560.n3.nabble.com/How-Does-aggregate-work-tp22179.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional
for the help.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-Does-aggregate-work-tp22179.html
Sent from the Apache Spark User List mailing list archive at Nabble.com