There is a collectAsync action if you want to run them in parallel, but keep in mind the two jobs will need to share resources and you should use the FAIR scheduler. ________________________________ From: praveen S<mailto:mylogi...@gmail.com> Sent: 10/26/2015 4:27 AM To: user@spark.apache.org<mailto:user@spark.apache.org> Subject: Concurrent execution of actions within a driver
Does spark run different actions of an rdd within a driver in parallel also? Let's say class Driver{ val rdd1= sc. textFile("... ") val rdd2=sc.textFile("....") rdd1. collect //Action 1 rdd2. collect //Action 2 } Does Spark run Action 1 & 2 run in parallel? ( some kind of a pass through the driver code and than start the execution)? if not than is using threads safe for independent actions/red's?