The Open MPI Team, representing a consortium of research, academic, and industry partners, is pleased to announce the release of Open MPI version 2.0.0.
v2.0.0 is a major new release series containing many new features and bug fixes. As a community, the Open MPI Team is incredibly thankful and appreciative of all the time, effort, and downright hard work contributed by its members and all of its users. Thank you all! We couldn't have done this without you! Increasing the major release number to "2" is indicative the magnitude of the changes in this release: v2.0.0 is effectively a new generation of Open MPI compared to the v1.10 series (see https://www.open-mpi.org/software/ompi/versions/ for a description of Open MPI's versioning scheme). Many of the changes are visible to users, but equally importantly, there are many changes "under the hood" that add stability and performance improvements to the inner workings of Open MPI. Note that this release also retires support for some legacy systems, and is not ABI compatible with the v1.10 series. Users will need to recompile their MPI applications to use Open MPI v2.0.0. As with any new major series, while the Open MPI community has tested the v2.0.0 release extensively, production users are encouraged to test thoroughly when upgrading from a prior version of Open MPI. After reading the "Changes in behavior compared to prior versions" and "Known issues" sections below, please be sure to report any issues that you find on Github (https://github.com/open-mpi/ompi/issues/new) or the Open MPI user's mailing list. Please note: although the v1.10 series is still supported -- and will be for quite some time -- the main focus of Open MPI development is on v2.0.1, v2.1.x, and beyond. The v1.10 series is effectively "frozen" at this point, and will have no new features added (only bug fixes applied as necessary). Here are a list of the major new features in Open MPI v2.0.0: - Open MPI is now MPI-3.1 compliant. - Many enhancements to MPI RMA. Open MPI now maps MPI RMA operations on to native RMA operations for those networks which support this capability. - Greatly improved support for MPI_THREAD_MULTIPLE (when configured with --enable-mpi-thread-multiple). - Enhancements to reduce the memory footprint for jobs at scale. A new MCA parameter, "mpi_add_procs_cutoff", is available to set the threshold for using this feature. - Completely revamped support for memory registration hooks when using OS-bypass network transports. - Significant OMPIO performance improvements and many bug fixes. - Add support for PMIx - Process Management Interface for Exascale. Version 1.1.2 of PMIx is included internally in this release. - Add support for PLFS file systems in Open MPI I/O. - Add support for UCX transport. - Simplify build process for Cray XC systems. Add support for using native SLURM. - Add a --tune mpirun command line option to simplify setting many environment variables and MCA parameters. - Add a new MCA parameter "orte_default_dash_host" to offer an analogue to the existing "orte_default_hostfile" MCA parameter. - Add the ability to specify the number of desired slots in the mpirun --host option. Changes in behavior compared to prior versions: - In environments where mpirun cannot automatically determine the number of slots available (e.g., when using a hostfile that does not specify "slots", or when using --host without specifying a ":N" suffix to hostnames), mpirun now requires the use of "-np N" to specify how many MPI processes to launch. - The MPI C++ bindings -- which were removed from the MPI standard in v3.0 -- are no longer built by default and will be removed in some future version of Open MPI. Use the --enable-mpi-cxx-bindings configure option to build the deprecated/removed MPI C++ bindings. - ompi_info now shows all components, even if they do not have MCA parameters. The prettyprint output now separates groups with a dashed line. - OMPIO is now the default implementation of parallel I/O, with the exception for Lustre parallel filesystems (where ROMIO is still the default). The default selection of OMPI vs. ROMIO can be controlled via the "--mca io ompi|romio" command line switch to mpirun. - Per Open MPI's versioning scheme (see the README), increasing the major version number to 2 indicates that this version is not ABI-compatible with prior versions of Open MPI. You will need to recompile MPI and OpenSHMEM applications to work with this version of Open MPI. - Removed checkpoint/restart code due to loss of maintainer. :-( - Change the behavior for handling certain signals when using PSM and PSM2 libraries. Previously, the PSM and PSM2 libraries would trap certain signals in order to generate tracebacks. The mechanism was found to cause issues with Open MPI's own error reporting mechanism. If not already set, Open MPI now sets the IPATH_NO_BACKTRACE and HFI_NO_BACKTRACE environment variables to disable PSM/PSM2's handling these signals. Removed legacy support: - Removed support for OS X Leopard. - Removed support for Cray XT systems. - Removed VampirTrace. - Removed support for Myrinet/MX. - Removed legacy collective module: ML. - Removed support for Alpha processors. - Removed --enable-mpi-profiling configure option. Known issues (to be addressed in v2.0.1): - See the list of fixes slated for v2.0.1 here: https://github.com/open-mpi/ompi/milestone/16, and https://github.com/open-mpi/ompi-release/milestone/16 (note that the "ompi-release" Github repo will be folded/absorbed into the "ompi" Github repo at some point in the future) - ompi-release#986: Fix data size counter for large ops with fcoll/static - ompi-release#987: Fix OMPIO performance on Lustre - ompi-release#1013: Fix potential inconsistency in btl/openib default settings - ompi-release#1014: Do not return MPI_ERR_PENDING from collectives - ompi-release#1056: Remove dead profile code from oshmem - ompi-release#1081: Fix MPI_IN_PLACE checking for IALLTOALL{V|W} - ompi-release#1081: Fix memchecker in MPI_IALLTOALLW - ompi-release#1081: Support MPI_IN_PLACE in MPI_(I)ALLTOALLW and MPI_(I)EXSCAN - ompi-release#1107: Allow future PMIx support for RM spawn limits - ompi-release#1108: Fix sparse group process reference counting - ompi-release#1109: If specified to be oversubcribed, disable binding - ompi-release#1122: Allow NULL arrays for empty datatypes - ompi-release#1123: Fix signed vs. unsigned compiler warnings - ompi-release#1123: Make max hostname length uniform across code base - ompi-release#1127: Fix MPI_Compare_and_swap - ompi-release#1127: Fix MPI_Win_lock when used with MPI_Win_fence - ompi-release#1132: Fix typo in help message for --enable-mca-no-build - ompi-release#1154: Ensure pairwise coll algorithms disqualify themselves properly - ompi-release#1165: Fix typos in debugging/verbose message output - ompi-release#1178: Fix ROMIO filesystem check on OpenBSD 5.7 - ompi-release#1197: Fix Fortran pthread configure check - ompi-release#1205: Allow using external PMIx 1.1.4 and 2.0 - ompi-release#1215: Fix configure to support the NAG Fortran compiler - ompi-release#1220: Fix combiner args for MPI_HINDEXED_BLOCK - ompi-release#1225: Fix combiner args for MPI_DARRAY - ompi-release#1226: Disable old memory hooks with recent gcc versions - ompi-release#1231: Fix new "patcher" support for some XLC platforms - ompi-release#1244: Fix Java error handling - ompi-release#1250: Ensure TCP is not selected for RDMA operations - ompi-release#1252: Fix verbose output in coll selection - ompi-release#1253: Set a default name for user-defined MPI_Op - ompi-release#1254: Add count==0 checks in some non-blocking colls - ompi-release#1258: Fix "make distclean" when using external pmix/hwloc/libevent - ompi-release#1260: Clean up/uniform mca/coll/base memory management - ompi-release#1261: Remove "patcher" warning message for static builds - ompi-release#1263: Fix IO MPI_Request for 0-size read/write - ompi-release#1264: Add blocking fence for SLURM operations Bug fixes / minor enhancements: - Updated internal/embedded copies of third-party software: - Update the internal copy of ROMIO to that which shipped in MPICH 3.1.4. - Update internal copy of libevent to v2.0.22. - Update internal copy of hwloc to v1.11.2. - Notable new MCA parameters: - opal_progress_lp_call_ration: Control how often low-priority callbacks are made during Open MPI's main progress loop. - opal_common_verbs_want_fork_support: This replaces the btl_openib_want_fork_support parameter. - Add --with-platform-patches-dir configure option. - Add --with-pmi-libdir configure option for environments that install PMI libs in a non-default location. - Various configure-related compatibility updates for newer versions of libibverbs and OFED. - Numerous fixes/improvements to orte-dvm. Special thanks to Mark Santcroos for his help. - Fix a problem with timer code on ia32 platforms. Thanks to Paul Hargrove for reporting this and providing a patch. - Fix a problem with use of a 64 bit atomic counter. Thanks to Paul Hargrove for reporting. - Fix a problem with singleton job launching. Thanks to Lisandro Dalcin for reporting. - Fix a problem with use of MPI_UNDEFINED with MPI_COMM_SPLIT_TYPE. Thanks to Lisandro Dalcin for reporting. - Silence a compiler warning in PSM MTL. Thanks to Adrian Reber for reporting this. - Properly detect Intel TrueScale and OmniPath devices in the ACTIVE state. Thanks to Durga Choudhury for reporting the issue. - Fix detection and use of Solaris Studio 12.5 (beta) compilers. Thanks to Paul Hargrove for reporting and debugging. - Fix various small memory leaks. - Allow NULL arrays when creating empty MPI datatypes. - Replace use of alloca with malloc for certain datatype creation functions. Thanks to Bogdan Sataric for reporting this. - Fix use of MPI_LB and MPI_UB in creation of of certain MPI datatypes. Thanks to Gus Correa for helping to fix this. - Implement a workaround for a GNU Libtool problem. Thanks to Eric Schnetter for reporting and fixing. - Improve hcoll library detection in configure. Thanks to David Shrader and Ake Sandgren for reporting this. - Miscellaneous minor bug fixes in the hcoll component. - Miscellaneous minor bug fixes in the ugni component. - Fix problems with XRC detection in OFED 3.12 and older releases. Thanks to Paul Hargrove for his analysis of this problem. - Update (non-standard/experimental) Java MPI interfaces to support MPI-3.1 functionality. - Fix an issue with MCA parameters for Java bindings. Thanks to Takahiro Kawashima and Siegmar Gross for reporting this issue. - Fix a problem when using persistent requests in the Java bindings. Thanks to Nate Chambers for reporting. - Fix problem with Java bindings on OX X 10.11. Thanks to Alexander Daryin for reporting this issue. - Fix a performance problem for large messages for Cray XC systems. Thanks to Jerome Vienne for reporting this. - Fix an issue with MPI_WIN_LOCK_ALL. Thanks to Thomas Jahns for reporting. - Fix an issue with passing a parameter to configure multiple times. Thanks to QuesarVII for reporting and supplying a fix. - Add support for ALPS resource allocation system on Cray CLE 5.2 and later. Thanks to Mark Santcroos. - Corrections to the HACKING file. Thanks to Maximilien Levesque. - Fix an issue with user supplied reduction operator functions. Thanks to Rupert Nash for reporting this. - Fix an issue with an internal list management function. Thanks to Adrian Reber for reporting this. - Fix a problem with MPI-RMA PSCW epochs. Thanks to Berk Hess for reporting this. - Fix a problem in neighborhood collectives. Thanks to Lisandro Dalcin for reporting. - Fix MPI_IREDUCE_SCATTER_BLOCK for a one-process communicator. Thanks to Lisandro Dalcin for reporting. - Add (Open MPI-specific) additional flavors to MPI_COMM_SPLIT_TYPE. See MPI_Comm_split_type(3) for details. Thanks to Nick Andersen for supplying this enhancement. - Improve closing of file descriptors during the job launch phase. Thanks to Piotr Lesnicki for reporting and providing this enhancement. - Fix a problem in MPI_GET_ACCUMULATE and MPI_RGET_ACCUMULATE when using Portals4. Thanks to Nicolas Chevalier for reporting. - Use correct include file for lstat prototype in ROMIO. Thanks to William Throwe for finding and providing a fix. - Add missing Fortran bindings for MPI_WIN_ALLOCATE. Thanks to Christoph Niethammer for reporting and fixing. - Fortran related fixes to handle Intel 2016 compiler. Thanks to Fabrice Roy for reporting this. - Fix a Fortran linkage issue. Thanks to Macro Atzeri for finding and suggesting a fix. - Fix problem with using BIND(C) for Fortran bindings with logical parameters. Thanks to Paul Romano for reporting. - Fix an issue with use of DL-related macros in opal library. Thanks to Scott Atchley for finding this. - Fix an issue with parsing mpirun command line options which contain colons. Thanks to Lev Given for reporting. - Fix a problem with Open MPI's package configury files. Thanks to Christoph Junghans for reporting. - Fix a typo in the MPI_INTERCOMM_MERGE man page. Thanks To Harald Servat for reporting and correcting. - Update man pages for non-blocking sends per MPI 3.1 standard. Thanks to Alexander Pozdneev for reporting. - Fix problem when compiling against PVFS2. Thanks to Dave Love for reporting. - Fix problems with MPI_NEIGHBOR_ALLTOALL{V,W}. Thanks to Willem Vermin for reporting this issue. - Fix various compilation problems on Cygwin. Thanks to Marco Atzeri for supplying these fixes. - Fix problem with resizing of subarray and darray data types. Thanks to Keith Bennett and Dan Garmann for reporting. - Fix a problem with MPI_COMBINER_RESIZED. Thanks to James Ramsey for the report. - Fix an hwloc binding issue. Thanks to Ben Menadue for reporting. - Fix a problem with the shared memory (sm) BTL. Thanks to Peter Wind for the report. - Fixes for heterogeneous support. Thanks to Siegmar Gross for reporting. - Fix a problem with memchecker. Thanks to Clinton Simpson for reporting. - Fix a problem with MPI_UNWEIGHTED in topology functions. Thanks to Jun Kudo for reporting. - Fix problem with a MCA parameter base filesystem types. Thanks to Siegmar Gross for reporting. - Fix a problem with some windows info argument types. Thanks to Alastair McKinstry for reporting. -- Jeff Squyres jsquy...@cisco.com For corporate legal information go to: http://www.cisco.com/web/about/doing_business/legal/cri/
