Re: [RESULT] [VOTE] Release Apache Mesos 0.23.0 (rc1)

Yup. Just critical bug fixes and updated documentation. All the bug fixes for rc2 have landed, so we'll update docs/CHANGELOG, then cut rc2 tomorrow. On Tue, Jul 7, 2015 at 9:35 PM, Marco Massenzio wrote: > As a general rule, we should not include anything other than the fixes in > an RC, to av

Re: Java detector for mess masters and leader

@Nikolaos Ballas neXus I can see no way to instantiate the Curator LeaderSelector without actually becoming a participant in leader election. If I do instantiate that class, it does not accept a null value for the LeaderSelectorListener and so anything instantiating LeaderSelector must also beco

Re: Java detector for mess masters and leader

Don…the bellow code will return leader node for mesos & marathon framework. import … public class SomeClass { CuratorFramework client; public void init(){ client = CuratorFrameworkFactory.newClient(connectionString, new ExponentialBackoffRetry(1000, 3)) } public String getMasterN

Re: Java detector for mess masters and leader

awesome sharing of code! I’ll add that if you are using Mesos-DNS, that the dns name master.mesos will resolve to the masters and leader.mesos will resolve to the leader. if you are looking to resolve to marathon leader you would have to use the code below against zk at the moment. - ken > On

Re: Java detector for mess masters and leader

@ Nicolaos I really don’t think that will work. When you use this code, it creates a node under /mesos named like: _c_e7007a30-1eaf-4826-bb99-011e8a33ac111-lock-99 because it is gaining leadership. It does not create nodes like mesos does, with names like info_000123. It therefore d

RE: Java detector for mess masters and leader

I have code without curator if you want.I will send it to you that does exactly what you described Sent from my Samsung device Original message From: Donald Laidlaw Date: 08/07/2015 19:49 (GMT+01:00) To: user@mesos.apache.org Subject: Re: Java detector for mess masters and

Cleaning out old mesos-slave sandbox directories

Hey, I'm wondering if anyone in the community has a decent solution to this; when a slave restarts and re-registers (perhaps it was offline for too long) it will get a new slave ID, and use a new directory inside the work_dir for sandboxes. When this happens the old slave directories appear n

Re: Java detector for mess masters and leader

@Nicolaos Thanks for the offer. But I am almost finished writing what I outlined below. I am good to go. Best regards, -Don > On Jul 8, 2015, at 2:51 PM, Nikolaos Ballas neXus > wrote: > > I have code without curator if you want.I will send it to you that does > exactly what you described

RE: Java detector for mess masters and leader

Great Sent from my Samsung device Original message From: Donald Laidlaw Date: 08/07/2015 19:57 (GMT+01:00) To: user@mesos.apache.org Subject: Re: Java detector for mess masters and leader @Nicolaos Thanks for the offer. But I am almost finished writing what I outlined belo

Re: Cleaning out old mesos-slave sandbox directories

On Wed, Jul 8, 2015 at 10:54 AM, Tom Arnfeld wrote: > When this happens the old slave directories appear not to be tracked by > the mesos GC process, and stay around indefinitely. Over time if enough > full slave restarts happen (say, due to reconfiguration) the disks can be > completely filled a

Re: Cleaning out old mesos-slave sandbox directories

In this instance there were three old slave directories, and there are three log lines in the mesos-slave.INFO file; I0708 11:24:52.023453  2425 slave.cpp:3499] Garbage collecting old slave 20150515-105200-84152492-5050-9915-S46 I0708 11:24:52.023923  2425 slave.cpp:3499] Garbage collecting

Re: Cleaning out old mesos-slave sandbox directories

Are there any special files (mounts etc) in your slave directory? The logic Mesos uses to delete a directory is likely different from the shell utility 'rm'. On Wed, Jul 8, 2015 at 11:09 AM,

Re: Cleaning out old mesos-slave sandbox directories

Good question, there are likely mounts, yup... though they should be being unmounted cleanly, though perhaps not in all cases and maybe we need to retry deleting things in the gc process. Do you know if the mesos-slave will re-schedule something for GC if it fails deletion? -- Tom Arnfe

Re: Cleaning out old mesos-slave sandbox directories

On Wed, Jul 8, 2015 at 11:20 AM, Tom Arnfeld wrote: > Do you know if the mesos-slave will re-schedule something for GC if it > fails deletion? > No it doesn't.

[VOTE] Release Apache Mesos 0.23.0 (rc2)

Hello Mesos community, Please vote on releasing the following candidate as Apache Mesos 0.23.0. 0.23.0 includes the following: - Per-container network isolation - Dockerized slaves will properly recover Docker contai

Re: [VOTE] Release Apache Mesos 0.23.0 (rc2)

-1 (non-binding) The Python test ExamplesTest.PythonFramework still fails on RHEL7, unless building the mesos native Python package isn't part of make check. It pops on an ImportError for mesos.native See here for more details: https://gist.github.com/SEJeff/05a31c1d2d10fecc97a1 On Wednesday,

Re: [VOTE] Release Apache Mesos 0.23.0 (rc2)

-1 sorry! We just found a backwards incompatible change while fixing: https://issues.apache.org/jira/browse/MESOS-2940 Schedulers still running a 0.22.0 driver against a 0.23.0 master will not function correctly because StatusUpdate.uuid is now optional and no longer set for reconciliation updates

Re: Java detector for mess masters and leader

Sorry for showing up late to the party. Good answers so far. I just want to add that if you know any master, you can hit http:///master/redirect to get a 307 Temporary Redirect which you can unpack to find the leading master's hostname:port. On Wed, Jul 8, 2015 at 10:59 AM, Nikolaos Ballas neXus <

Re: Hadoop on Mesos. HDFS question.

Blatant product plug: The easiest way to run hdfs-mesos on Mesos (using Marathon) is to launch a DCOS (EE) cluster. https://mesosphere.com/product/ You might also want to look at the custom DCOS config in https://github.com/mesosphere/hdfs/tree/master/example-conf/mesosphere-dcos For basic instruc