[ https://issues.apache.org/jira/browse/MAPREDUCE-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094340#comment-13094340 ]
Arun C Murthy commented on MAPREDUCE-2911: ------------------------------------------ {quote} "hamster" is a client application that connects to the RM, asks it to create an AM with 32 containers, and after all of those are launched, executed a.out inside them, after setting some environment variables for connecting to the AM to get the "node list". {quote} Milind, I'm fairly ignorant about OpenMPI - does this mean you don't need a 'unix process' other than the one running a.out itself? Or, do you still need to run some other daemon to then fork a.out? > Hamster: Hadoop And Mpi on the same cluSTER > ------------------------------------------- > > Key: MAPREDUCE-2911 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2911 > Project: Hadoop Map/Reduce > Issue Type: New Feature > Components: mrv2 > Affects Versions: 0.23.0 > Environment: All Unix-Environments > Reporter: Milind Bhandarkar > Assignee: Milind Bhandarkar > Fix For: 0.23.0 > > Original Estimate: 336h > Remaining Estimate: 336h > > MPI is commonly used for many machine-learning applications. OpenMPI > (http://www.open-mpi.org/) is a popular BSD-licensed version of MPI. In the > past, running MPI application on a Hadoop cluster was achieved using Hadoop > Streaming (http://videolectures.net/nipsworkshops2010_ye_gbd/), but it was > kludgy. After the resource-manager separation from JobTracker in Hadoop, we > have all the tools needed to make MPI a first-class citizen on a Hadoop > cluster. I am currently working on the patch to make MPI an > application-master. Initial version of this patch will be available soon > (hopefully before September 10.) This jira will track the development of > Hamster: The application master for MPI. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira