Hi Mark, I think you're hitting an RSIP port limit. If you bind to ipogif0 then you should have much better luck, unless you're trying to have open mpi span outside the cray HPN.
You can use the oob mca parameter: oob-tcp-if-include ipogif0 You may want to put that in your .openmpi/mca-params.conf file if you have one installed, but don't forget if your home directory is accesible from different machines, some of which may not be Cray XE/XC then probably don't want to do that. Messed me up with runs on carver system at NERSC for a while. Howard 2015-08-27 9:42 GMT-06:00 Mark Santcroos <mark.santcr...@rutgers.edu>: > Hi, > > For some reason that is currently still beyond me, I can't bind to > INADDR_ANY for more than 74 ports on a Cray compute node, without getting > EADDRINUSE. > This impacts my use of the oob_tcp_listener.c:create_listen() code on that > machine (through means of orte-submit). > > I've implemented a proof of concept that gets the address from a hardcoded > interface and uses that for the binding, and then everything is hunky dory. > > Although I'm interested in the root cause also, that may likely be outside > of my control, so I wonder whether the hack can be turned into something > more appropriate. > > So some questions: > > - I can't stop to think that somewhere in the codebase there is probably > some portable code to extract addresses from an interface. > - Is there already some MCA parameter that can be (re)used to specify the > interface to use for this kind of purpose. > - (And why is the "client" listening on a socket in the first place?) > > Thanks! > > Mark > _______________________________________________ > devel mailing list > de...@open-mpi.org > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel > Link to this post: > http://www.open-mpi.org/community/lists/devel/2015/08/17882.php >
