If you run your jobs with debug logging on in Mesos, it should print why
the offer is being declined:
https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala#L301
On Tue, Jul 26, 2016 at 6:38 PM, Rodrick Brow
Shuffle service has nothing to do with constraints it is however advised to
run the mesos-shuffle-service on each of your agent nodes running spark.
Here is the command I use to run a typical spark jobs on my cluster using
constraints (this is generated but from another script we run but should
gi
Hi,
I am also trying to use the spark.mesos.constraints but it gives me the
same error: job has not be accepted by any resources.
I am doubting that I should start some additional service like
./sbin/start-mesos-shuffle-service.sh. Am I correct?
Thanks,
Jia
On Tue, Dec 1, 2015 at 5:14 PM, rared
I am trying to add mesos constraints to my spark-submit command in my
marathon file I am setting it to spark.mesos.coarse=true.
Here is an example of a constraint I am trying to set.
--conf spark.mesos.constraint=cpus:2
I want to use the constraints to control the amount of executors are creat
