Re: Add Append-HBase support in upcoming 20.205

2011-09-02 Thread Arun C Murthy
On Sep 1, 2011, at 10:56 PM, Andrew Purtell wrote: From: Arun C Murthy a...@hortonworks.com +1 I think it's high time (I thought so too last Dec too: http://s.apache.org/jr) we had an official Hadoop release which supports HBase. Thanks for all the effort Andrew - it will be really

Re: Add Append-HBase support in upcoming 20.205

2011-09-02 Thread Suresh Srinivas
I also propose following jiras, which are non append related bug fixes from 0.20-append branch: - HDFS-1164. TestHdfsProxy is failing. - HDFS-1211. Block receiver should not log rewind packets at INFO level. - HDFS-1118. Fix socketleak on DFSClient. - HDFS-1210. DFSClient should

Re: Add Append-HBase support in upcoming 20.205

2011-09-02 Thread Todd Lipcon
The following other JIRAs have been committed in CDH for 18 months or so, for the purpose of HBase. You may want to consider backporting them as well - many were never committed to 0.20-append due to lack of reviews by HDFS committers at the time. HDFS-1056. Fix possible multinode deadlocks

Re: Add Append-HBase support in upcoming 20.205

2011-09-02 Thread Matt Foley
Hi Todd, Thank you, this is tremendously valuable input! I'll have to look in detail at each of these ten jiras, and will get back to the list with more info shortly. --Matt On Fri, Sep 2, 2011 at 1:03 PM, Todd Lipcon t...@cloudera.com wrote: The following other JIRAs have been committed in

Re: Add Append-HBase support in upcoming 20.205

2011-09-02 Thread Eli Collins
Hey Matt, You can see the full change log here: http://archive.cloudera.com/cdh/3/hadoop-0.20.2+923.97.CHANGES.txt Most changes done for HBase have it listed in the Reason field. There's a directory in the source tarball that contains all the individual patches broken out. Cheers, Eli On Fri,

Changing mvn builds

2011-09-02 Thread Arun C Murthy
Gang, A request - if anyone is changing hadoop-project/pom.xml or any shared build infrastructure *please* do test all 3 projects (common, hdfs mapreduce). Else, folks are spinning too much trying to fix stuff later (HADOOP-7606, MAPREDUCE-2926 etc.). thanks, Arun

Re: Content request for 0.20.205 Sustaining Release

2011-09-02 Thread Matei Zaharia
Hi Matt, I'd like to propose backporting some of the new fair scheduler features that have been out for almost 2 years now (in the 0.21 branch and trunk) into 0.20.205, especially https://issues.apache.org/jira/browse/MAPREDUCE-551 and https://issues.apache.org/jira/browse/MAPREDUCE-706. I

Re: Content request for 0.20.205 Sustaining Release

2011-09-02 Thread Arun Murthy
Agree, +1. It will be good to ensure we get a more modern version of FairScheduler for interested folks. Arun Sent from my iPhone On Sep 2, 2011, at 5:55 PM, Matei Zaharia ma...@eecs.berkeley.edu wrote: Hi Matt, I'd like to propose backporting some of the new fair scheduler features that