Re: Thinking about the next hadoop mainline release

2011-06-24 Thread Suresh Srinivas
+1. Arun, I can also help you with managing the release for HDFS. On 6/17/11 7:15 AM, Arun C Murthy ar...@yahoo-inc.com wrote: I volunteer to be the RM for the release since I've been leading the NG NR effort. Are folks ok with this? thanks, Arun Sent from my iPhone On Jun 17,

Re: Thinking about the next hadoop mainline release

2011-06-24 Thread Mahadev Konar
+1. I'd be happy to help in any way possible. thanks mahadev On Fri, Jun 24, 2011 at 2:07 PM, Suresh Srinivas sures...@yahoo-inc.com wrote: +1. Arun, I can also help you with managing the release for HDFS. On 6/17/11 7:15 AM, Arun C Murthy ar...@yahoo-inc.com wrote: I volunteer to be the

Re: Thinking about the next hadoop mainline release

2011-06-24 Thread Arun C Murthy
Thanks Suresh! Todd - I'd appreciate if you could help on some of the HBase/Performance jiras... thanks! Sent from my iPhone On Jun 24, 2011, at 2:09 PM, Suresh Srinivas sures...@yahoo-inc.com wrote: +1. Arun, I can also help you with managing the release for HDFS. On 6/17/11 7:15 AM,

Re: Thinking about the next hadoop mainline release

2011-06-24 Thread Todd Lipcon
On Fri, Jun 24, 2011 at 5:28 PM, Arun C Murthy ar...@yahoo-inc.com wrote: Thanks Suresh! Todd - I'd appreciate if you could help on some of the HBase/Performance jiras... thanks! Sure thing. -Todd -- Todd Lipcon Software Engineer, Cloudera

Re: Thinking about the next hadoop mainline release

2011-06-21 Thread Steve Loughran
On 17/06/2011 21:27, Allen Wittenauer wrote: On Jun 17, 2011, at 10:31 AM, Allen Wittenauer wrote: On Jun 17, 2011, at 12:17 AM, Eric Baldeschwieler wrote: Yahoo stands ready to help us (the Apache Hadoop Community) turn this new release into a stable release by running it through its 9

Re: Thinking about the next hadoop mainline release

2011-06-20 Thread Sanjay Radia
On Jun 17, 2011, at 7:15 AM, Arun C Murthy wrote: I volunteer to be the RM for the release since I've been leading the NG NR effort. Are folks ok with this? +1 sanjay thanks, Arun Sent from my iPhone On Jun 17, 2011, at 1:45 PM, Ted Dunning tdunn...@maprtech.com wrote: NG map

Re: Thinking about the next hadoop mainline release

2011-06-18 Thread Eric Baldeschwieler
Hey Allen, I agree with you that we should avoid future regressions like this. I think the tradeoff that got security working well on one heavily used platform was the right one for hadoop-with-security, but I'll be sure to raise such issues for discussion in the future as soon as I become

Re: Thinking about the next hadoop mainline release

2011-06-17 Thread Ryan Rawson
HDFS-918 and HDFS-347 are absolutely critical for random read performance. The smarter sites are already running HDFS-347 (I guess they aren't running Hadoop then?), and soon they will be testing and running HDFS-918 as well. Opening 1 socket for every read just isn't really scalable. -ryan On

RE: Thinking about the next hadoop mainline release

2011-06-17 Thread Doug Meil
+1 on what Ryan said. -Original Message- From: Ryan Rawson [mailto:ryano...@gmail.com] Sent: Friday, June 17, 2011 3:36 AM To: general@hadoop.apache.org Subject: Re: Thinking about the next hadoop mainline release HDFS-918 and HDFS-347 are absolutely critical for random read performance

Re: Thinking about the next hadoop mainline release

2011-06-17 Thread Arun C Murthy
I volunteer to be the RM for the release since I've been leading the NG NR effort. Are folks ok with this? thanks, Arun Sent from my iPhone On Jun 17, 2011, at 1:45 PM, Ted Dunning tdunn...@maprtech.com wrote: NG map reduce is a huge deal both in terms of making things better for users,

Re: Thinking about the next hadoop mainline release

2011-06-17 Thread Brian Bockelman
Hi Ryan, Eric, Just looked at those two for the first time in awhile. - HDFS-918 (now 1323?) doesn't seem like it's too controversial, but does seem like there's a bit of validation left. - HDFS-347 has a long, contentious history. However, it seems that most of the strong objections have been

Re: Thinking about the next hadoop mainline release

2011-06-17 Thread Allen Wittenauer
On Jun 17, 2011, at 12:36 AM, Ryan Rawson wrote: HDFS-918 and HDFS-347 are absolutely critical for random read performance. The smarter sites are already running HDFS-347 (I guess they aren't running Hadoop then?), and soon they will be testing and running HDFS-918 as well. Opening 1

Re: Thinking about the next hadoop mainline release

2011-06-17 Thread Todd Lipcon
On Fri, Jun 17, 2011 at 7:15 AM, Arun C Murthy ar...@yahoo-inc.com wrote: I volunteer to be the RM for the release since I've been leading the NG NR effort. Are folks ok with this? +1. It would be an honor to fix bugs for you, Arun. -Todd Sent from my iPhone On Jun 17, 2011, at 1:45

Re: Thinking about the next hadoop mainline release

2011-06-17 Thread Allen Wittenauer
On Jun 17, 2011, at 10:31 AM, Allen Wittenauer wrote: On Jun 17, 2011, at 12:17 AM, Eric Baldeschwieler wrote: Yahoo stands ready to help us (the Apache Hadoop Community) turn this new release into a stable release by running it through its 9 month test and burn in process. The result

Re: Thinking about the next hadoop mainline release

2011-06-17 Thread Rajiv Chittajallu
Allen Wittenauer wrote on 06/17/11 at 13:27:43 -0700: Actually, I was just reminded about the complete disaster that is metrics. So while it may be pseudo-stable, it isn't actually usable for anyone but Yahoo!. Did you try to use the new metrics framework? Are you complaining cause

Re: Thinking about the next hadoop mainline release

2011-06-17 Thread Allen Wittenauer
On Jun 17, 2011, at 7:02 PM, Rajiv Chittajallu wrote: Allen Wittenauer wrote on 06/17/11 at 13:27:43 -0700: Actually, I was just reminded about the complete disaster that is metrics. So while it may be pseudo-stable, it isn't actually usable for anyone but Yahoo!. Did you try

Re: Thinking about the next hadoop mainline release

2011-06-17 Thread Arun C Murthy
Allen, Can we pls focus on the next release here, on this thread? Please provide your valuable f/b to the RM abt stuff you'd like to see in the next release. thanks, Arun Sent from my iPhone On Jun 18, 2011, at 7:45 AM, Allen Wittenauer a...@apache.org wrote: On Jun 17, 2011, at 7:02 PM,