RE: Concurrent execution of actions within a driver

There is a collectAsync action if you want to run them in parallel, but keep in mind the two jobs will need to share resources and you should use the FAIR scheduler. From: praveen S Sent: ‎10/‎26/‎2015 4:27 AM To: user@spark.apache.org<

Re: Concurrent execution of actions within a driver

Spark executes tasks on an action. An action is broken down to multiple tasks. Multiple tasks from different actions run either in FIFO or FAIR mode depending on spark.scheduler.mode. Of course to get benefit of FAIR scheduling the two actions should be called by different threads. On Mon, Oct 26,

Re: Concurrent execution of actions within a driver

not parallel. Spark only execute tasks with Action,(‘collect' here) rdd1.collect and rdd2.collect are executed sequencely, so Spark execute two tasks one by one. > On Oct 26, 2015, at 7:26 PM, praveen S wrote: > > Does spark run different actions of an rdd within a driver in parallel als