Josh, I was following this thread as I had similar symptoms and discovered a peculiar error. when I launch the program, openmpi follows the $TMPDIR environment variable and puts the session information in the $TMPDIR directory. However ompi-checkpoint seems to be requiring the sessions file to be in /tmp ignoring the $TMPDIR. Is this by design and what would I have to do to get it to obey the $TMPDIR environment variable.
-- Jazcek Braden