Re: Can not allocate executor when running spark on mesos

On Thu, Sep 10, 2015 at 3:35 AM, canan chen wrote: > Finally got the answer. Actually it works fine. The allocation behavior > on mesos is a little different from yarn/standalone. Seems the executor in > mesos is lazily allocated (only when job is executed) while executor in >

Re: Can not allocate executor when running spark on mesos

Finally got the answer. Actually it works fine. The allocation behavior on mesos is a little different from yarn/standalone. Seems the executor in mesos is lazily allocated (only when job is executed) while executor in yarn/standalone is allocated when spark-shell is started. On Tue, Sep 8,

Can not allocate executor when running spark on mesos

Hi all, I try to run spark on mesos, but it looks like I can not allocate resources from mesos. I am not expert of mesos, but from the mesos log, it seems spark always decline the offer from mesos. Not sure what's wrong, maybe need some configuration change. Here's the mesos master log I0908

Re: Can not allocate executor when running spark on mesos

In which mode are you submitting your application? (coarse-grained or fine-grained(default)). Have you gone through this documentation already? http://spark.apache.org/docs/latest/running-on-mesos.html#using-a-mesos-master-url Thanks Best Regards On Tue, Sep 8, 2015 at 12:54 PM, canan chen

Re: Can not allocate executor when running spark on mesos

Yes, I follow the guide in this doc, and run it as mesos client mode On Tue, Sep 8, 2015 at 6:31 PM, Akhil Das wrote: > In which mode are you submitting your application? (coarse-grained or > fine-grained(default)). Have you gone through this documentation already? >