Re: Large feature development

2012-09-03 Thread Arun C Murthy
Todd, On Sep 2, 2012, at 6:12 PM, Todd Lipcon wrote: First, let me apologize if my email came off as a personal snipe against the project or anyone working on it. I know the team has been hard at work for multiple years now on the project, and I certainly don't mean to denigrate the work

Re: Large feature development

2012-09-03 Thread Arun C Murthy
On Sep 3, 2012, at 12:05 AM, Arun C Murthy wrote: Todd, I'll unfair to tag-team me while consistently ignoring what I write. Ugh, late Sunday night school-boy error - should have read: I'll point out it's unfair [...] Arun

Re: Large feature development

2012-09-03 Thread Todd Lipcon
On Mon, Sep 3, 2012 at 12:05 AM, Arun C Murthy a...@hortonworks.com wrote: But, I'll stand by my point that YARN is at this point more alpha than HDFS2. I'll unfair to tag-team me while consistently ignoring what I write. I'm not sure I ignored what you wrote. I understand that Yahoo is

Re: Large feature development

2012-09-03 Thread Arun C Murthy
On Sep 3, 2012, at 12:31 AM, Todd Lipcon wrote: On Mon, Sep 3, 2012 at 12:05 AM, Arun C Murthy a...@hortonworks.com wrote: But, I'll stand by my point that YARN is at this point more alpha than HDFS2. I'll unfair to tag-team me while consistently ignoring what I write. I'm not sure I

Re: [DISCUSS] Spin out MR, HDFS and YARN as their own TLPs and disband Hadoop umbrella project

2012-09-03 Thread Arun C Murthy
Andrew, On Sep 1, 2012, at 6:32 AM, Andrew Purtell wrote: I'd imagine such a MR(v1) in Hadoop, if this happened, would concentrate on performance improvements, maybe such things as alternate shuffle plugins. Perhaps a HA JobTracker for parity with HDFS. Lots of this has already happened in

Re: Large feature development (YARN vs HDFS)

2012-09-03 Thread Eric Baldeschwieler
Referring back to Chris M.s thread, this YARN vs HDFS discussion sounds a lot like an umbrella project issue to me. On Sep 2, 2012, at 3:11 PM, Arun Murthy wrote: Eli, On Sep 2, 2012, at 1:01 PM, Eli Collins e...@cloudera.com wrote: On Sat, Sep 1, 2012 at 12:47 PM, Arun C Murthy

Re: Large feature development (YARN vs HDFS)

2012-09-03 Thread Arun C Murthy
Agreed... it does seem like a case of 'my wife is prettier'. Maybe I'm oversensitive and it may even be understandable given how much of my waking time I've devoted to YARN over the last 30 months; but I do apologize for indulging in the behavior I accused others of. A good night's sleep does