Resending since user@mesos bounced earlier. My apologies.
On Thu, Oct 15, 2015 at 12:19 PM, Bharath Ravi Kumar
wrote:
> (Reviving this thread since I ran into similar issues...)
>
> I'm running two spark jobs (in mesos fine grained mode), each belonging to
> a different mesos
Can someone respond if you're aware of the reason for such a memory
footprint? It seems unintuitive and hard to reason about.
Thanks,
Bharath
On Thu, Oct 15, 2015 at 12:29 PM, Bharath Ravi Kumar
wrote:
> Resending since user@mesos bounced earlier. My apologies.
>
> On Thu, Oct
t way to solve this is to use a higher
> level tool that can run your spark jobs through one mesos framework and
> then you can let spark distribute the resources more effectively.
>
> I hope that helps!
>
> Tom.
>
> On 17 Oct 2015, at 06:47, Bharath Ravi Kumar wrote:
>
>
To be precise, the MesosExecutorBackend's Xms & Xmx equal
spark.executor.memory. So there's no question of expanding or contracting
the memory held by the executor.
On Sat, Oct 17, 2015 at 5:38 PM, Bharath Ravi Kumar
wrote:
> David, Tom,
>
> Thanks for the explan
Hi,
I'd like to understand if oversubscription will consider unused resources
reserved for certain quotas (i.e. the new roles-quotas feature being worked
on). If so, that would enable reserving minimum number of resources are
always available for certain roles while ensuring that the cluster can b
subscription".
>
>
>
> Thanks,
>
> Guangya
>
> On Wed, Oct 21, 2015 at 11:35 AM, Bharath Ravi Kumar
> wrote:
>
>> Hi,
>>
>> I'd like to understand if oversubscription will consider unused resources
>> reserved for certain quotas (i.e.
Hi,
I'm aware of mesos' IP-per-container capability and the authors' reasons
for not modeling an IP address as a resource on a host. However, for
operational simplicity, I prefer an implementation that does not interact
with multiple other services (e.g. an IPAM). I'm hence considering the
followi
t
> in production. I suggest reaching out to the user@
> <http://aurora.apache.org/community/> for Aurora to get the latest update.
>
> On Fri, May 6, 2016 at 6:36 AM, Bharath Ravi Kumar
> wrote:
>
>> Hi,
>>
>> I'm aware of mesos' IP-per-container
ing support for arbitrary resources with this
>>> exact usecase in mind. The code isn't complete yet and it hasn't been tried
>>> out in production. I suggest reaching out to the user@
>>> <http://aurora.apache.org/community/> for Aurora to get the latest
Hi,
I want to be able to run jobs compiled against MRv2 on mesos through the
hadoop-on-mesos framework. Please let me know if support for this will be
implemented in the near future. Thanks.
(Aside: Myraid isn't applicable since I'd like to run MRv2 jobs without the
intervening YARN runtime.)
Tha
intrinsically designed around it.
>
> Cheers,
>
> --
>
> Tom Arnfeld
> Developer // DueDil
>
> On Tuesday, Apr 28, 2015 at 9:24 am, Bharath Ravi Kumar <
> reachb...@gmail.com>, wrote:
>
>> Hi,
>>
>> I want to be able to run jobs compiled again
11 matches
Mail list logo
