Hey everyone,
I thought it best to send an email to the list before merging and tagging a
0.1.0 release for the Hadoop on Mesos framework. This release is for a new
feature we've been working on for quite some time, which allows Hadoop
TaskTrackers to be semi-terminated when they are idle, wit
Does this have any pros / cons over Myriad, which runs Yarn on Mesos? Other
than not requiring Yarn :)
On Saturday, March 28, 2015, Tom Arnfeld wrote:
> Hey everyone,
>
> I thought it best to send an email to the list before merging and tagging
> a 0.1.0 release for the Hadoop on Mesos framewor
We're running the framework to support our legacy jobs written in Hadoop MRv1.
Essentially this is a feature that moves further towards getting Hadoop to play
nicely on a shared cluster.
The Hadoop on Mesos framework is pretty greedy at the moment, and it can be
quite problematic if you're try
To follow up, this is also a decent solution to a nasty problem in the current
framework detailed here, https://github.com/mesos/hadoop/issues/32.
--
Tom Arnfeld
Developer // DueDil
On Sat, Mar 28, 2015 at 2:40 PM, Jeff Schroeder
wrote:
> Does this have any pros / cons over Myriad, which
Gotcha so this is just a better mesos framework for Hadoop and has nothing
to do with the Myriad / Yarn stuff, which similarly, prevents you from
having to statically setup a Hadoop cluster.
https://mesosphere.com/2015/02/11/yarn-on-mesos-big-data/
Nice stuff
On Saturday, March 28, 2015, Tom Arn
That's precisely it.
The framework has actually been around for quite some time, probably one of the
very early Mesos PoC framework implementations. It's certainly very stable and
get's the job done for us, and allows us to focus on progressing with more
appropriate technologies like Spark (
This is great, thanks Tom.
On Sat, Mar 28, 2015 at 6:52 AM, Tom Arnfeld wrote:
> Hey everyone,
>
>
> I thought it best to send an email to the list before merging and tagging
> a 0.1.0 release for the Hadoop on Mesos framework. This release is for a
> new feature we've been working on for quite
+1 Sounds great, thanks for making the improvements.
-Elizabeth
On Saturday, March 28, 2015, Brenden Matthews wrote:
> This is great, thanks Tom.
>
> On Sat, Mar 28, 2015 at 6:52 AM, Tom Arnfeld > wrote:
>
> > Hey everyone,
> >
> >
> > I thought it best to send an email to the list before merg
8 matches
Mail list logo
