he.org<mailto:user@spark.apache.org>
Subject: Concurrent execution of actions within a driver
Does spark run different actions of an rdd within a driver in parallel also?
Let's say
class Driver{
val rdd1= sc. textFile("... ")
val rdd2=sc.textFile("")
rdd1. collect /
Spark executes tasks on an action. An action is broken down to multiple
tasks. Multiple tasks from different actions run either in FIFO or FAIR
mode depending on spark.scheduler.mode.
Of course to get benefit of FAIR scheduling the two actions should be
called by different threads.
On Mon, Oct
