Danny, (Only tangentially understanding the internals of GraphLab) --- is there any interest in having this framework run as a first class citizen on hadoop (beside MR) similar to:
MPI on hadoop https://issues.apache.org/jira/browse/MAPREDUCE-2911 via the new MRv2 framework? I think that would be a really interesting way to get GraphLab to work with Mahout as I see MRv2 as enabling a lot more functionality in Mahout as we move forward. Thoughts? JP On Sun, Aug 28, 2011 at 10:44 AM, Danny Bickson <[email protected]> wrote: > Yes, it is not using map reduce - we have our own communication > infrastructure written in C++. > You can learn more by looking at http://graphlab.org > > 2011/8/28 myn <[email protected]> > >> Is that a non hadoop mapreduce project? >> >> >> At 2011-08-28 21:32:51,myn <[email protected]> wrote: >> >> >> >> sorry i can`t visit the page >> >> http://bickson.blogspot.com/2011/08/graphlab-and-mahout-compatability.html >> >> At 2011-08-28 20:13:06,"Danny Bickson" <[email protected]> wrote: >> >Hi Mahouters! >> >In the last couple of months we are trying to improve CMU GraphLab's large >> >scale machine learning (http://graphlab.org) compatibility with Mahout. >> >As a first step, we changed our open source license to Apache. Now we are >> >working on writing some of the GraphLab wrapper code in Java, >> >thus allowing for better interaction between the projects. Our vision is >> to >> >use Mahout for the inherently parallel tasks for large scale data it is >> very >> >good at, >> >while having GraphLab functionality of more complex interactions of data. >> > >> >I am looking for any Mahout users who have large scale matrices that are >> >factorized using Mahout SVD, who want to try out GraphLab SVD solver. >> >I wrote some code to allow for easy transition between Mahout >> >SequetialAccessSparseVector to GraphLab's binary format. If anyone wants >> to >> >try >> >it out, instructions are found on: >> > >> http://bickson.blogspot.com/2011/08/graphlab-and-mahout-compatability.html >> >Any feedback is welcome! >> > >> >- Danny Bickson >> >> >> >> > -- Twitter: @jpatanooga Solution Architect @ Cloudera hadoop: http://www.cloudera.com
