, there are two options which may be helpful
to your problem, they are --total-executor-cores NUM(standalone and
mesos only), --executor-cores(yarn only)
qinwei
From: myasukaDate: 2014-09-28 11:44To: userSubject: How to use multi
thread in RDD map function ?Hi, everyone
I come across
.nabble.com/How-to-use-multi-thread-in-RDD-map-function-tp15286.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail
.
Is there any one can provide some example code to use Java multi thread
in RDD transformation, or give any idea to increase the concurrency ?
Thanks for all
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-use-multi-thread-in-RDD-map-function-tp15286
in the options of spark-submit, there are two options which may be helpful to
your problem, they are --total-executor-cores NUM(standalone and mesos only),
--executor-cores(yarn only)
qinwei
From: myasukaDate: 2014-09-28 11:44To: userSubject: How to use multi thread in
RDD map function
