Re: Add Append-HBase support in upcoming 20.205

2011-09-02 Thread Arun C Murthy
To: general@hadoop.apache.org Cc: Sent: Friday, September 2, 2011 6:36 AM Subject: Re: Add Append-HBase support in upcoming 20.205 On Aug 31, 2011, at 11:41 AM, sanjay Radia wrote: I propose that the 20-append patches (details below) be included in 20.205 which will become the first official

Re: Add Append-HBase support in upcoming 20.205

2011-09-02 Thread Suresh Srinivas
I also propose following jiras, which are non append related bug fixes from 0.20-append branch: - HDFS-1164. TestHdfsProxy is failing. - HDFS-1211. Block receiver should not log rewind packets at INFO level. - HDFS-1118. Fix socketleak on DFSClient. - HDFS-1210. DFSClient should

Re: Add Append-HBase support in upcoming 20.205

2011-09-02 Thread Todd Lipcon
The following other JIRAs have been committed in CDH for 18 months or so, for the purpose of HBase. You may want to consider backporting them as well - many were never committed to 0.20-append due to lack of reviews by HDFS committers at the time. HDFS-1056. Fix possible multinode deadlocks

Re: Add Append-HBase support in upcoming 20.205

2011-09-02 Thread Matt Foley
Hi Todd, Thank you, this is tremendously valuable input! I'll have to look in detail at each of these ten jiras, and will get back to the list with more info shortly. --Matt On Fri, Sep 2, 2011 at 1:03 PM, Todd Lipcon t...@cloudera.com wrote: The following other JIRAs have been committed in

Re: Add Append-HBase support in upcoming 20.205

2011-09-02 Thread Eli Collins
Hey Matt, You can see the full change log here: http://archive.cloudera.com/cdh/3/hadoop-0.20.2+923.97.CHANGES.txt Most changes done for HBase have it listed in the Reason field. There's a directory in the source tarball that contains all the individual patches broken out. Cheers, Eli On Fri,

Re: Add Append-HBase support in upcoming 20.205

2011-09-01 Thread Dhruba Borthakur
This seems like a good effort to allow HBase to run on a released Apache branch. +1. -dhruba On Wed, Aug 31, 2011 at 11:41 AM, sanjay Radia san...@hortonworks.comwrote: I propose that the 20-append patches (details below) be included in 20.205 which will become the first official Apache

Re: Add Append-HBase support in upcoming 20.205

2011-09-01 Thread Milind.Bhandarkar
For example, https://issues.apache.org/jira/browse/HDFS-2288 can cause HBase to fail to recover its WAL during a crash scenario. There are some others that I'll be likely working through in the coming months. Thanks Todd. Will go through it to test against 0.22. - milind --- Milind

Re: Add Append-HBase support in upcoming 20.205

2011-09-01 Thread Arun C Murthy
On Aug 31, 2011, at 11:41 AM, sanjay Radia wrote: I propose that the 20-append patches (details below) be included in 20.205 which will become the first official Apache release of Hadoop that supports Append and HBase. Background: There hasn't been a official Apache release that

RE: Add Append-HBase support in upcoming 20.205

2011-09-01 Thread Rottinghuis, Joep
Subject: Re: Add Append-HBase support in upcoming 20.205 FWIW, Stack has already done the work needed to make sure that Hbase works with Hadoop 0.22 branch, and I suppose if https://issues.apache.org/jira/browse/MAPREDUCE-2767 is committed, it removes the last blocker from 0.22.0, so that it can

Re: Add Append-HBase support in upcoming 20.205

2011-09-01 Thread Stack
+1 I'm biased. And if we were adding any other feature but sync/append in a minor release on 0.20 I'd be praising the work but not voting for its inclusion. So I'm a hypocrite too but I can't help myself. St.Ack P.S. Below is the hbase projects' 'official' story on the version of hadoop

Re: Add Append-HBase support in upcoming 20.205

2011-09-01 Thread Andrew Purtell
a...@hortonworks.com To: general@hadoop.apache.org Cc: Sent: Friday, September 2, 2011 6:36 AM Subject: Re: Add Append-HBase support in upcoming 20.205 On Aug 31, 2011, at 11:41 AM, sanjay Radia wrote: I propose that the 20-append patches (details below)  be included in 20.205 which

Add Append-HBase support in upcoming 20.205

2011-08-31 Thread sanjay Radia
I propose that the 20-append patches (details below) be included in 20.205 which will become the first official Apache release of Hadoop that supports Append and HBase. Background: There hasn't been a official Apache release that supports HBase. The HBase community have instead been using the