I am facing a problem with a framework not getting any resource offers for
15-20 minutes, while other frameworks (8-9 of them) continuously get offers.
The framework is Spark (running in fine-grained mode), and is launched with
Chronos. After a few tasks successfully executed, it stops getting off
Have you inspected the framework page/tab in the Mesos master web UI? Perhaps,
as you already suspect, DRF is only handing out resources to frameworks which
have a lower dominant resource. So you could check if your spark instance has a
high dominant resource due to the executors taking up a lot
Thanks for your reply.
I checked the UI, but I'm not sure where to find this info. I can see the
number of CPUs or memory, but nothing about it's dominant resource or
share... (Mesos 0.21.1). I guess I can compute the share by looking at the
total cores and memory, though :)
It'd be great if ther
On 08/24/2015 05:33 AM, Iulian Dragoș wrote:
Hello Iulian,
Ok, so I eventually build spark from 100% sources, after some
intermediate builds on gentoo. Gentoo is not the best platform for
Java development, but those issues related to spark builds are slowly
being fixed on gentoo. Where (ho
On Mon, Aug 24, 2015 at 7:16 PM, CCAAT wrote:
> On 08/24/2015 05:33 AM, Iulian Dragoș wrote:
>
>
> Hello Iulian,
>
> Ok, so I eventually build spark from 100% sources, after some intermediate
> builds on gentoo. Gentoo is not the best platform for Java development,
> but those issues related to
THANKS, as I have not kept up on the spark lists
James
On 08/25/2015 04:28 AM, Iulian Dragoș wrote:
On Mon, Aug 24, 2015 at 7:16 PM, CCAAT mailto:cc...@tampabay.rr.com>> wrote:
On 08/24/2015 05:33 AM, Iulian Dragoș wrote:
Hello Iulian,
Ok, so I eventually build spark from
Wanted to add that, even if there wasn’t a preview package, you can clone from
GIT, and checkout a tag, where in this case v1.5.0-rc1 is tagged. Then
proceeded normally as you would’ve had a source distro as described in the
already mentioned http://spark.apache.org/docs/latest/building-spark.ht
7 matches
Mail list logo
