Re: spark on mesos with docker issue

2015-10-22 Thread Iulian Dragoș
On Thu, Oct 22, 2015 at 9:10 PM, Rad Gruchalski wrote: > Stavros, > > Spark does not support this. I am currently in the process of submitting > patches for it however it first has to pass through the legal team at the > company I work for. > What exactly is missing in Spark? > Kind regards, >

Not getting resource offers for 20 min

2015-08-19 Thread Iulian Dragoș
I am facing a problem with a framework not getting any resource offers for 15-20 minutes, while other frameworks (8-9 of them) continuously get offers. The framework is Spark (running in fine-grained mode), and is launched with Chronos. After a few tasks successfully executed, it stops getting off

Re: Not getting resource offers for 20 min

2015-08-19 Thread Iulian Dragoș
chance of getting the same amount of > memory, but as their dominant resource is lower (memory) they more often > get CPU resources compared to that first instance. Counter intuitively, the > first instance finishes last. > > On 19 Aug 2015, at 14:07, Iulian Dragoș > wrote: > &

Re: Allocation algorithm

2015-08-25 Thread Iulian Dragoș
On Mon, Aug 24, 2015 at 5:42 PM, Hans van den Bogert wrote: > Can anyone tell how the Mesos allocation algorithm works: > Does Mesos offer every free resource it has to one framework at a time? Or > does the allocator divide the max offer size by the amount of > active/registered frameworks? >

Re: Not getting resource offers for 20 min

2015-08-25 Thread Iulian Dragoș
On Mon, Aug 24, 2015 at 7:16 PM, CCAAT wrote: > On 08/24/2015 05:33 AM, Iulian Dragoș wrote: > > > Hello Iulian, > > Ok, so I eventually build spark from 100% sources, after some intermediate > builds on gentoo. Gentoo is not the best platform for Java development, >