[OMPI devel] "Open MPI"-based MPI library used by K computer

2011-06-24 Thread Rayson Ho
Interesting... page 11: http://www.fujitsu.com/downloads/TC/sc10/programming-on-k-computer.pdf Open MPI based: * Open Standard, Open Source, Multi-Platform including PC Cluster. * Adding extension to Open MPI for "Tofu" interconnect Rayson == Grid Engine / Open Grid Sch

Re: [OMPI devel] "Open MPI"-based MPI library used by K computer

2011-06-27 Thread Rayson Ho
hort version: yes, Open MPI is used on K and was used to power the 8PF runs. > > w00t! > > > > On Jun 24, 2011, at 7:16 PM, Jeff Squyres wrote: > >> w00t! >> >> OMPI powers 8 petaflops! >> (at least I'm guessing that -- does anyone know if that's t

[OMPI devel] IBM to acquire Platform Computing!

2011-10-11 Thread Rayson Ho
I guess Platform MPI (which is a "merge" of Scali MPI & HP-MPI) will get technologies from IBM MPI as well... or "merge" IBM's MPI into Platform MPI (merge is around quotes because it is in general hard to merge technologies - like I told a co-worker 10 years ago that one can't just merge SGE with

Re: [OMPI devel] openmpi-1.5.5rc1: 2nd gmake dependence (mostly VT)

2011-12-20 Thread Rayson Ho
On Tue, Dec 20, 2011 at 8:28 PM, Larry Baker wrote: >> I am pretty sure a literal "rm -rf" should be fine. > > Not necessarily.  I'm not at work.  But I think either -f or -r might not be > legal on all Unix's (Tru64 Unix?  AIX?). I used to code on AIX daily, and I am pretty sure that "rm -rf" w

Re: [OMPI devel] RFC: Java MPI bindings

2012-02-07 Thread Rayson Ho
Currently, Hadoop tasks (in a job) are independent of each. If Hadoop is going to use MPI for inter-task communication, then make sure they understand that the MPI standard currently does not address fault folerant. Note that it is not uncommon to run map reduce jobs on Amazon EC2's spot instances

Re: [OMPI devel] RFC: Java MPI bindings

2012-02-07 Thread Rayson Ho
, 2012, at 1:05 PM, Rayson Ho wrote: > >> Currently, Hadoop tasks (in a job) are independent of each. If Hadoop >> is going to use MPI for inter-task communication, then make sure they >> understand that the MPI standard currently does not address fault >> folerant. >>

[OMPI devel] MVAPICH2 vs Open-MPI

2012-02-14 Thread Rayson Ho
See P. 38 - 40, MVAPICH2 outperforms Open-MPI for each test, so is it something that they are doing to optimize for CUDA & GPUs and those optimizations are not in OMPI, or did they specifically tune MVAPICH2 to make it shine?? http://hpcadvisorycouncil.com/events/2012/Israel-Workshop/Presentations

Re: [OMPI devel] algorithm selection in open mpi

2012-04-03 Thread Rayson Ho
Performance depends on the network topology & node hardware, and the benchmark - so we don't have enough information to determine the root of the issue... However, you can do some debugging on your end (once you master the techniques you will be able to debug all sorts of performance problems - no

Re: [OMPI devel] RFC: opal_cache_line_size

2012-04-23 Thread Rayson Ho
On Mon, Apr 23, 2012 at 4:21 PM, Jeffrey Squyres wrote: > No one replied to this RFC.  Does anyone have an opinion about it? > > I have attached a patch (including some debugging output) showing my initial > implementation.  If no one objects by the end of this week, I'll commit to > the trunk.

Re: [OMPI devel] RFC: opal_cache_line_size

2012-04-23 Thread Rayson Ho
On Mon, Apr 23, 2012 at 5:56 PM, Jeffrey Squyres wrote: > On Apr 23, 2012, at 5:53 PM, George Bosilca wrote: > >> However, I did a quick grep and most of our headers are larger than a single >> line of cache (even Itanium L2) so I suppose that making >> opal_cache_line_size equal to the L2 cache

Re: [OMPI devel] OpenMPI and SGE integration made more stable

2012-07-27 Thread Rayson Ho
On Fri, Jul 27, 2012 at 8:53 AM, Daniel Gruber wrote: > A while after u5 the open source repository was closed and most of the > German engineers from Sun/Oracle moved to Univa, working on Univa > Grid Engine. Currently you have the choice between Univa Grid Engine, > Son of Grid Engine (free acad

Re: [OMPI devel] "Open MPI"-based MPI library used by K computer

2012-09-20 Thread Rayson Ho
,000 processes level! We feel pleasure to >>> utilize such a great open-source software. >>> >>> We cannot tell detail of our technology yet because of our contract >>> with RIKEN AICS, however, we will plan to feedback of our improvements >>> a

[OMPI devel] ROMIO code in OMPI

2012-11-06 Thread Rayson Ho
ints and trying to fix the bug myself, > but I've been short on time so haven't gotten around to it yet. > > Richard > > On Saturday, 20 October, 2012 at 10:12 AM, Rayson Ho wrote: > > Hi Eric, > > Sounds like it's also related to this problem reported by

Re: [OMPI devel] ROMIO code in OMPI

2012-11-08 Thread Rayson Ho
. > > Alternatively, you might check with Edgar Gabriel about the ompio component > and see if it either supports > 2GB sizes or can also be extended to do so. > Might be that a simple change to select that module instead of ROMIO would > meet the need. > > Appreciate your int

Re: [OMPI devel] "Open MPI"-based MPI library used by K computer

2013-01-09 Thread Rayson Ho
by someone else, so long as we don't get into copyright > issues. > > On Sep 19, 2012, at 11:57 PM, Rayson Ho wrote: > >> I found this paper recently, "MPI Library and Low-Level Communication >> on the K computer", available at: >> >> http://www.fuj

[OMPI devel] MIPS/Linux port?

2009-04-14 Thread Rayson Ho
I googled but found no precise answer... Is it true that some features are disabled if the code is not supported for the target platform?? http://www.open-mpi.org/community/lists/devel/2007/07/1896.php http://www.open-mpi.org/community/lists/devel/2007/07/1886.php I got everything compiled on MI

Re: [OMPI devel] MIPS/Linux port?

2009-04-16 Thread Rayson Ho
What would the MIPS/Linux port miss if ompi_info prints: Thread support: posix (mpi: yes, progress: yes) TIA, Rayson On Tue, Apr 14, 2009 at 10:00 AM, Rayson Ho wrote: > I googled but found no precise answer... > > Is it true that some features are disabled if the code is not &g

Re: [OMPI devel] OpenMPI without RSH

2009-04-29 Thread Rayson Ho
On Wed, Apr 29, 2009 at 12:38 PM, Jerry Ye wrote: > I’m currently working in an environment where I cannot use SSH to launch > child processes. Instead, the process with rank 0 skips the ssh_child > function in plm_rsh_module.c and the child processes are all started at the > same time on differe

Re: [OMPI devel] processor affinity -- OpenMPI / batch system integration

2009-10-22 Thread Rayson Ho
- give us the list of cores available > to us so we can map and do affinity, and pass in your own mapping. Maybe > with some logic so we can decide which to use based on whether OMPI or GE > did the mapping?? > > Not sure here - just thinking out loud. > Ralph > > On Sep 30

Re: [OMPI devel] New OMPI MPI extension

2010-04-22 Thread Rayson Ho
Hi Jeff, There's a typo in trunk/README: -> 1175 ...unrelated to wach other I guess you mean "unrelated to each other". Rayson On Wed, Apr 21, 2010 at 12:35 PM, Jeff Squyres wrote: > Per the telecon Tuesday, I committed a new OMPI MPI extension to the trunk: > >    https://svn.open-mpi.org/

Re: [OMPI devel] New OMPI MPI extension

2010-04-22 Thread Rayson Ho
BTW, another 2 typos in README: 1193subdirectory off <- directory "of" 1199 thse extensions <- "these" extensions Rayson On Thu, Apr 22, 2010 at 10:35 AM, Jeff Squyres wrote: > Fixed -- thanks! > > On Apr 22, 2010, at 12:35 AM, Rayson Ho wrote: > >&

[OMPI devel] MPI_Pack & MPI_Unpack Performance

2010-05-19 Thread Rayson Ho
In the MPITypes paper (Processing MPI Datatypes Outside MPI), page 7: Test: Vector Element type: float MPICH2: 1788.85 MB/sec OpenMPI: 1088.01 MB/sec <- * MPITypes: 1789.37 MB/sec Manual Copy: 1791.59 MB/sec Test: YZ Face Element type: float MPICH2: 145.32 MB/sec OpenMPI: 93.08 MB/sec <- *

[OMPI devel] processor affinity -- OpenMPI/batch system integration

2008-01-09 Thread Rayson Ho
Hello, I'm from the Sun Grid Engine (SGE) project ( http://gridengine.sunsource.net ). I am working on processor affinity support for SGE. In 2005, we had some discussions on the SGE mailing list with Jeff on this topic. As quad-core processors are available from AMD and Intel, and higher core co

[OMPI devel] On Host Topology Description (carto)

2008-01-11 Thread Rayson Ho
, "NUMA and interconnect transfers": http://opensolaris.org/jive/thread.jspa?messageID=185268 Rayson On Jan 11, 2008 6:22 AM, Pak Lui wrote: > https://svn.open-mpi.org/trac/ompi/wiki/OnHostTopologyDescription > > > Rayson Ho wrote: > > Hello, > > > > I&

Re: [OMPI devel] Logo as a vector graphic

2008-03-13 Thread Rayson Ho
What is the license of the logo?? If it is under a free license, then may be I can upload it to wikipedia and update the page: http://en.wikipedia.org/wiki/Open_MPI Rayson On 3/13/08, Jeff Squyres wrote: > On Mar 13, 2008, at 8:35 AM, Adrian Knoth wrote: > > >> We usually snip off the words a

Re: [OMPI devel] processor affinity -- OpenMPI/batch system integration

2008-09-30 Thread Rayson Ho
e- > > socket > > relationship in order to address the multicore issue. I think there > > are > > other folks in the team who are actively working on it so they > > probably > > can address it better than I can. Here some descriptions on the wiki > > for it: