The solution I provided was to run MPI tasks with Mesos was with the help of Docker Swarm. It required me to develop a Mesos Framework and an Executor [here <http://mesos.apache.org/documentation/latest/app-framework-development-guide/>]. Mesos containers could not communicate with each other and that was the reason to bring Docker Swarm into the picture. However now, Mesos container can communicate with help of Calico [here <https://docs.projectcalico.org/v1.5/getting-started/mesos/>]. Calico provides an overlay network and each Mesos container gets a unique IP address.
Thanks Pankaj On Mon, Dec 17, 2018 at 12:13 PM Pamidighantam, Sudhakar V < [email protected]> wrote: > I thought Pankaj presented a way to implement MPI executions through mesos > more recently. > > He may want to comment on this.. > > > > Thanks, > > Sudakar. > > > > *From: *Marlon Pierce <[email protected]> > *Reply-To: *<[email protected]> > *Date: *Monday, December 17, 2018 at 8:52 AM > *To: *"[email protected]" <[email protected]> > *Subject: *Re: Metascheduler work > > > > Hi Dimuthu, > > > > This is something we should re-evaluate. Mangirish Wangle looked at Mesos > integration with Airavata back in 2016, but he ultimately ran into many > difficulties, including getting MPI jobs to work, if I recall correctly. > > > > Marlon > > > > > > *From: *"[email protected]" <[email protected]> > *Reply-To: *dev <[email protected]> > *Date: *Sunday, December 16, 2018 at 7:30 AM > *To: *dev <[email protected]> > *Subject: *Metascheduler work > > > > Hi Folks, > > > > I found this [1] mail thread and the JIRA ticket [2] which have discussed > about coming up with an Airavata specific job scheduler. At the end of the > discussion, seems like an approach based on Mesos has been chosen to > tryout. Is there any other discussion/ documents regarding this topic? Has > anyone worked on this and if so, where are the code / design documents? > > > > [1] > https://markmail.org/message/tdae5y3togyq4duv#query:+page:1+mid:tdae5y3togyq4duv+state:results > > [2] https://issues.apache.org/jira/browse/AIRAVATA-1436 > > > > Thanks > > Dimuthu >
