System dependencies with Mesos

2014-02-04 Thread Tom Arnfeld
I’m investigating the possibility of using Mesos to solve the problem of resource allocation between a Hadoop cluster and set of Jenkins slaves (and I like the possibility of being able to easily deploy other frameworks). One of the biggest overhanging questions I can’t seem to find an answer to

Re: System dependencies with Mesos

2014-02-05 Thread Tobias Knaup
Hi Tom, Docker is definitely a good option for this. Marathon already has basic support for Docker, and there has been some work recently to integrate it more tightly with Mesos. Cheers, Tobi On Tue, Feb 4, 2014 at 4:31 AM, Tom Arnfeld wrote: > I'm investigating the possibility of using Meso

Re: System dependencies with Mesos

2014-02-06 Thread Tom Arnfeld
Hey Tobi, That’s my thinking too.. Having taken a closer look at Marathon I now realise at what level it sits (I previously thought it was a framework itself). Do you know of anyone currently running Hadoop task trackers using Marathon? If so, do you think it would be possible to implement a si

Re: System dependencies with Mesos

2014-02-26 Thread Tobias Knaup
Sorry to drop off the thread here. Airbnb is using mesos/hadoop. Not sure if I understand the question - mesos/hadoop manages the task tracker lifecycle so there is no need for Marathon here. With the upcoming Docker integration you'll be able to isolate them in a container: https://github.com/meso