Re: [VOTE] Release Apache Mesos 0.26.1 (rc4)

2016-04-07 Thread Kapil Arya
+1 (binding) CI runs with: amd64/centos/6 amd64/centos/7 amd64/debian/jessie amd64/ubuntu/precise amd64/ubuntu/trusty amd64/ubuntu/vivid amd64/ubuntu/wily On Wed, Apr 6, 2016 at 11:53 PM, Vinod Kone wrote: > +1(binding) > > Tested on ASF CI. > > The centos failures are

Re: orphaned_tasks cleanup and prevention method

2016-04-07 Thread Greg Mann
Hi June, Are these Spark tasks being run in cluster mode or client mode? If it's client mode, then perhaps your local Spark scheduler is tearing itself down before the executors exit, thus leaving them orphaned. I'd love to see master/agent logs during the time that the tasks are becoming

Re: orphaned_tasks cleanup and prevention method

2016-04-07 Thread June Taylor
Just a quick update... I was only able to get the orphans cleared by stopping mesos-slave, deleting the contents of the scratch directory, and then restarting mesos-slave. Thanks, June Taylor System Administrator, Minnesota Population Center University of Minnesota On Thu, Apr 7, 2016 at 12:01

Re: [VOTE] Release Apache Mesos 0.25.1 (rc4)

2016-04-07 Thread Kapil Arya
+1 (binding) CI runs for amd64/centos/6 amd64/centos/7 amd64/debian/jessie amd64/ubuntu/precise amd64/ubuntu/trusty amd64/ubuntu/vivid amd64/ On Wed, Apr 6, 2016 at 9:43 PM, Vinod Kone wrote: > +1 (binding) > > `./configure && make check` on ubuntu 14.04 > > On Wed, Apr

Re: [VOTE] Release Apache Mesos 0.24.2 (rc5)

2016-04-07 Thread Kapil Arya
+1 (binding) CI runs for amd64/centos/6 amd64/centos/7 amd64/debian/jessie amd64/ubuntu/precise amd64/ubuntu/trusty amd64/ubuntu/vivid amd64/ On Thu, Apr 7, 2016 at 12:44 AM, Vinod Kone wrote: > +1 (binding) > > make check on ubuntu 14.04 > > On Wed, Apr 6, 2016 at

Re: orphaned_tasks cleanup and prevention method

2016-04-07 Thread haosdent
Hmm, sorry for didn't express my idea clear. I mean kill those orphan tasks here. On Thu, Apr 7, 2016 at 11:57 PM, June Taylor wrote: > Forgive my ignorance, are you literally saying I should just sigkill these > instances? How will that clean up the mesos orphans? > > > Thanks, >

Re: orphaned_tasks cleanup and prevention method

2016-04-07 Thread June Taylor
Forgive my ignorance, are you literally saying I should just sigkill these instances? How will that clean up the mesos orphans? Thanks, June Taylor System Administrator, Minnesota Population Center University of Minnesota On Thu, Apr 7, 2016 at 10:44 AM, haosdent wrote: >

Re: orphaned_tasks cleanup and prevention method

2016-04-07 Thread haosdent
Support you --work_dir=/tmp/mesos. So you could $ find /tmp/mesos -name $YOUR_EXECUTOR_ID Then you could get a folder list and then could use lsof on them. As a example, my executor id is "test" here. $ find /tmp/mesos/ -name 'test'

Das

2016-04-07 Thread Stephan Hadan
Stephan Hadan Senior IT Operations Engineer NOLTE Seidenstraße 19 70174 Stuttgart +49 160 94 81 00 08 stephan.ha...@nolte-lauth.com www.nolteundlauth.de NOLTE GmbH - Seidenstraße 19 - 70174

Re: orphaned_tasks cleanup and prevention method

2016-04-07 Thread June Taylor
I do have the executor ID. Can you advise how to kill it? I have one master and three slaves. Each slave has one of these orphans. Thanks, June Taylor System Administrator, Minnesota Population Center University of Minnesota On Thu, Apr 7, 2016 at 10:14 AM, haosdent wrote:

Re: orphaned_tasks cleanup and prevention method

2016-04-07 Thread June Taylor
Here is one of three orphaned tasks (first two octets of IP removed): "orphan_tasks": [ { "executor_id": "", "name": "Task 1", "framework_id": "14cddded-e692-4838-9893-6e04a81481d8-0006", "state": "TASK_RUNNING", "statuses": [

Re: orphaned_tasks cleanup and prevention method

2016-04-07 Thread haosdent
> pyspark executors hanging around and consuming resources marked as Idle in mesos Web UI Do you have some logs about this? >is there an API call I can make to kill these orphans? As I know, mesos agent would try to clean orphan containers when restart. But I not sure the orphan I mean here is

Re: Mesos 0.28 SSL in official packages

2016-04-07 Thread haosdent
Hi, ssl didn't enable default. You need compile it by following this doc http://mesos.apache.org/documentation/latest/ssl/ On Thu, Apr 7, 2016 at 10:04 PM, Kamil Wokitajtis wrote: > This is my first post, so Hi everyone! > > Is SSL enabled in official packages (CentOS in

orphaned_tasks cleanup and prevention method

2016-04-07 Thread June Taylor
Greetings mesos users! I am debugging an issue with pyspark executors hanging around and consuming resources marked as Idle in mesos Web UI. These tasks also show up in the orphaned_tasks key in `mesos state`. I'm first wondering how to clear them out - is there an API call I can make to kill

Mesos 0.28 SSL in official packages

2016-04-07 Thread Kamil Wokitajtis
This is my first post, so Hi everyone! Is SSL enabled in official packages (CentOS in my case)? I can see libssl in ldd output, but I cannot see libevent. I had to compile mesos from sources to run it over ssl. I would prefer to install it from packages. Regards, Kamil