Hi all, Just an update from the HBase side: I've run some cluster tests on HDFS 0.23 (as of about a month ago) and it generally works well. Performance for some workloads is ~2x due to HDFS-941, and can be improved a bit more if I finish HDFS-2080 in time. I did not do extensive failure testing (to stress the new append/sync code) but I do plan to do that in the coming months.
HBase trunk can compile against 0.23 by using -Dhadoop23 on the maven build. Currently some 15 or so tests are failing - the following HBase JIRA tracks those issues: https://issues.apache.org/jira/browse/HBASE-4254 (these may be indicative of HDFS side bugs) Any help there from the community would be appreciated! -Todd On Tue, Sep 27, 2011 at 12:24 PM, Roman Shaposhnik <r...@apache.org> wrote: > Hi Arun! > > Thanks for the quick reply! > > I'm sorry if I had too many questions in my original email, but I can't find > an answer to my "integration tests" question. Could you, please, share > a URL with us where I can find out more about them? > > On Mon, Sep 26, 2011 at 11:20 PM, Arun C Murthy <a...@hortonworks.com> wrote: >> # We made changes to Pig - rather we got help from the Pig team, >> particularly Daniel. >> >> So, we plan to work through the rest of the stack - Hive, Oozie etc. very >> soon and we'll >> depend on updated releases from the individual projects. > > Do we have any kinds of commitment from downstream projects as far as those > updates are concerned? Are they targeting these changes as part of point > (patch) > release of an already released version (like Pig 0.9.X for example) or > will it be > part of a brand new major release? > > Thanks, > Roman. > -- Todd Lipcon Software Engineer, Cloudera
