I'll definitly encourage this integration. The architecture document at: https://issues.apache.org/jira/secure/attachment/12486023/MapReduce_NextGen_Architecture.pdf captures a lot of details.
Best Regards Ahmed On Thu, Sep 1, 2011 at 10:39 AM, Josh Patterson <[email protected]> wrote: > From the Cloudera side, there is also Ahmed Radwan, who I'm sure would > answer questions you may have. > > JP > > On Thu, Sep 1, 2011 at 1:39 PM, Josh Patterson <[email protected]> wrote: > > This feature seems to be principly driven by a few folks @ Yahoo. Arun > > Murthy seems to be quite involved. > > > > Hama is also getting into the MRv2 game: > > https://issues.apache.org/jira/browse/HAMA-431 > > > > Quick presentation on the framework by Sharad Agarwal (Yahoo): > > > https://issues.apache.org/jira/secure/attachment/12485267/hadoop_contributors_meet_07_01_2011.pdf > > > > Seems to be a considerably more native/clean approach than managing a > > bunch of C++ to Java wrappers, imho. I'd really like to see a lot of > > frameworks on Hadoop; could have a language like Pig that then > > compiled down not only to different ML techniques, but also execute > > them on the proper framework in MRv2 as well. > > > > JP > > > > On Thu, Sep 1, 2011 at 1:12 PM, Danny Bickson <[email protected]> > wrote: > >> This is definitely a very interesting option to integrate both projects. > I > >> will forward this to my > >> collaborators - specifically, Joey Gonzalez was recently an Intern at > Yahoo! > >> and looked at similar directions. > >> I will try to learn the technical details better to see how this > >> interoperability works. > >> Who is working on this project in case we need more details? > >> > >> Thanks, > >> > >> Danny Bickson > >> > >> On Thu, Sep 1, 2011 at 7:26 PM, Josh Patterson <[email protected]> > wrote: > >> > >>> Danny, > >>> (Only tangentially understanding the internals of GraphLab) --- is > >>> there any interest in having this framework run as a first class > >>> citizen on hadoop (beside MR) similar to: > >>> > >>> MPI on hadoop > >>> https://issues.apache.org/jira/browse/MAPREDUCE-2911 > >>> > >>> via the new MRv2 framework? I think that would be a really interesting > >>> way to get GraphLab to work with Mahout as I see MRv2 as enabling a > >>> lot more functionality in Mahout as we move forward. > >>> > >>> Thoughts? > >>> > >>> JP > >>> > >>> > >> > > > > > > > > -- > > Twitter: @jpatanooga > > Solution Architect @ Cloudera > > hadoop: http://www.cloudera.com > > > > > > -- > Twitter: @jpatanooga > Solution Architect @ Cloudera > hadoop: http://www.cloudera.com >
