RE: Scheduling across applications - Need suggestion

2015-04-22 Thread yana
arunp.bigd...@gmail.com /divdivDate:04/22/2015 6:28 AM (GMT-05:00) /divdivTo: user user@spark.apache.org /divdivSubject: Scheduling across applications - Need suggestion /divdiv /divI believe we can use the properties like --executor-memory --total-executor-cores to configure the resources

Re: Scheduling across applications - Need suggestion

2015-04-22 Thread Lan Jiang
. Original message From: Arun Patel Date:04/22/2015 6:28 AM (GMT-05:00) To: user Subject: Scheduling across applications - Need suggestion I believe we can use the properties like --executor-memory --total-executor-cores to configure the resources allocated for each application

Scheduling across applications - Need suggestion

2015-04-22 Thread Arun Patel
I believe we can use the properties like --executor-memory --total-executor-cores to configure the resources allocated for each application. But, in a multi user environment, shells and applications are being submitted by multiple users at the same time. All users are requesting resources with