I think this is a good idea. The only thing I think is that it may make sense to split such an effort into two components: one for the testing of Hadoop and the projects themselves and one to test end user applications and libraries. Performance testing tools like YCSB are probably more in the former camp where mrunit is the latter, as a for instance. I think it's important to have separate artifacts to minimize uber-jar issues (or contrib-like situations where release cycles are coupled).
On Tue, Feb 15, 2011 at 4:58 PM, Konstantin Boudnik <c...@apache.org> wrote: > While MrUnit discussion draws to its natural conclusion I would like > to bring up another point which might be well aligned with that > discussion. Patrick Hunt has brought up this idea earlier today and I > believe it has to be elaborated further. > > A number of testing projects both for Hadoop and Hadoop-related > component were brought to life over last year or two. Among those are > MRUnit, PigUnit, YCSB, Herriot, and perhaps a few more. They all > focusing on more or less the same problem e.g. validation of Hadoop or > on-top-of-Hadoop components, or application level testing for Hadoop. > However, the fact that they all are spread across a wide variety of > projects seems to confuse/mislead Hadoop users. > > How about incubating a bigger Hadoop (Pig, Oozie, HBase) testing > project which will take care about development and support of common > (where's possible) tools, frameworks and the like? Please feel free to > share your thoughts :) > -- > Take care, > Konstantin (Cos) Boudnik > > > On Tue, Feb 15, 2011 at 10:44, Eric Sammer <esam...@cloudera.com> wrote: > > I've started the wiki page proposal for Incubator for mrunit. I'll ping > > people off list for mentoring. Much appreciated for all the help! > > > > On Tue, Feb 15, 2011 at 1:36 PM, Nigel Daley <nda...@mac.com> wrote: > > > >> I'm happy to help mentor as well. > >> > >> Cheers, > >> Nige > >> > >> On Feb 11, 2011, at 11:52 AM, Patrick Hunt wrote: > >> > >> > On Fri, Feb 11, 2011 at 9:44 AM, Mattmann, Chris A (388J) > >> > <chris.a.mattm...@jpl.nasa.gov> wrote: > >> >> Guys, BTW, if you need help or a mentor in Apache Incubator-ville for > >> MRUnit, I would be happy to help. > >> > > >> > I was going to suggest the same thing (mrunit to incubator). I would > >> > also be happy to be a mentor. > >> > > >> > Patrick > -- Eric Sammer twitter: esammer data: www.cloudera.com
