Re: [OMPI users] run openMPI jobs with SGE,
Hi, Am 09.04.2010 um 23:48 schrieb Cristobal Navarro: > Thanks, > now i get mixed results and everything seems to be working ok with mixed mpi > xecution > > is it normal that after receiving the results, the hosts remain busy like 15 > seconds ?? > example yes. This is the time SGE needs for housekeeping, ist can even take some minutes (especially if you kill a parallel job). -- Reuti > master:common master$ qrsh -verbose -pe orte 10 /opt/openmpi-1.4.1/bin/mpirun > -np 10 hostname > Your job 65 ("mpirun") has been submitted > waiting for interactive job to be scheduled ... > Your interactive job 65 has been successfully scheduled. > Establishing builtin session to host worker00.local ... > worker00.local > worker00.local > worker00.local > worker00.local > worker00.local > master.local > master.local > master.local > master.local > master.local > #after some seconds, i query the hosts status and slots are still used > master:common master$ qstat -f > queuename qtype resv/used/tot. load_avg arch > states > - > all.q@master.local BIP 0/5/16 0.02 darwin-x86 > 65 0.55500 mpirun master r 04/09/2010 17:44:36 5 > > - > all.q@worker00.local BIP 0/5/16 0.01 darwin-x86 > 65 0.55500 mpirun master r 04/09/2010 17:44:36 5 > > master:common master$ > > but after waiting more time, they get free again > master:common master$ qstat -f > queuename qtype resv/used/tot. load_avg arch > states > - > all.q@master.local BIP 0/0/16 0.01 darwin-x86 > - > all.q@worker00.local BIP 0/0/16 0.01 darwin-x86 > > anyways these are just details, thanks to your help the important aspects are > working. > Cristobal > > > > > On Fri, Apr 9, 2010 at 1:34 PM, Reuti wrote: > Am 09.04.2010 um 18:57 schrieb Cristobal Navarro: > > > sorry the command was missing a number > > > > as you said it should be > > > > qrsh -verbose -pe pempi 6 mpirun -np 6 hostname > > waiting for interactive job to be scheduled ... > > > > Your "qrsh" request could not be scheduled, try again later. > > --- > > this is my parallel enviroment > > qconf -sp pempi > > pe_namepempi > > slots 210 > > user_lists NONE > > xuser_listsNONE > > start_proc_args/usr/bin/true > > stop_proc_args /usr/bin/true > > allocation_rule$pe_slots > > $pe_slots means that all slots must come from one and the same machine (e.g. > for smp jobs). You can try $round_robin. > > -- Reuti > > > > control_slaves TRUE > > job_is_first_task FALSE > > urgency_slots min > > accounting_summary TRUE > > > > this is the queue > > qconf -sq cola.q > > qname cola.q > > hostlist @allhosts > > seq_no0 > > load_thresholds np_load_avg=1.75 > > suspend_thresholdsNONE > > nsuspend 1 > > suspend_interval 00:05:00 > > priority 0 > > min_cpu_interval 00:05:00 > > processorsUNDEFINED > > qtype BATCH INTERACTIVE > > ckpt_list NONE > > pe_list make pempi > > rerun FALSE > > slots 2 > > tmpdir/tmp > > shell /bin/csh > > > > i noticed that if i put 2 slots (since the queue has 2 slots) on the -pe > > pempi N argument and also the full path to mpirun as you guys pointed, it > > works!!! > > cristobal@neoideo:~$ qrsh -verbose -pe pempi 2 > > /opt/openmpi-1.4.1/bin/mpirun -np 6 hostname > > Your job 125 ("mpirun") has been submitted > > waiting for interactive job to be scheduled ... > > Your interactive job 125 has been successfully scheduled. > > Establishing builtin session to host ijorge.local ... > > ijorge.local > > ijorge.local > > ijorge.local > > ijorge.local > > ijorge.local > > ijorge.local > > cristobal@neoideo:~$ qrsh -verbose -pe pempi 2 > > /opt/openmpi-1.4.1/bin/mpirun -np 6 hostname > > Your job 126 ("mpirun") has been submitted > > waiting for interactive job to be scheduled ... > > Your interactive job 126 has been successfully scheduled. > > Establishing builtin session to host neoideo ... > > neoideo > > neoideo > > neoideo > > neoideo > > neoideo > > neoideo > > cristobal@neoideo:~$ > > > > i just wonder why i didnt get mixed hostnames? like > > neoideo > > neoideo > > ijorge.local > > ijorge.local > > neoideo > > ijorge.local > > > > ?? > > > > thanks for the help already!!! > > > > Cristobal > > > > > > > > > > On Fri, Apr 9, 2010 at 8:58 AM, Huynh Thuc C
[OMPI users] OpenMPI Checkpoint/Restart is failed
Hi Members, I tried to use checkpoint/restart by openmpi. But I can not get collect checkpoint data. I prepared execution environment as follows, the strings in () mean name of output file which attached on next e-mail ( for mail size limitation ): 1. installed BLCR and checked BLCR is working correctly by "make check" 2. executed ./configure with some parameters on openMPI source dir (config.output / config.log) 3. executed make and make install (make.output.2 / install.output.2) 4. confirmed that mca_crs_blcr.[la|so], mca_crs_self.[la|so] on /${INSTALL_DIR}/lib/openmpi 5. make ~/.openmpi/mca-params.conf (mca-params.conf) 6. compiled NPB and executed with -am ft-enable-cr 7. invoked ompi-checkpoint As result, I got the message "Checkpoint failed: no processes checkpointed." (cr_test_cg) In addition, when I confirmed open_info output as your demo movie, I got "MCA crs: none (MCA v2.0, API v2.0, Component v1.4.1)" (open_info.output) How should I do for checkpointing ? Any guidance in this regard would be highly appreciated. Thank you, Hideyuki -- Sincerely Yours, Hideyuki Jitsumoto (jitum...@gsic.titech.ac.jp) Tokyo Institute of Technology Global Scientific Information and Computing center (Matsuoka Lab.)
Re: [OMPI users] OpenMPI Checkpoint/Restart is failed
I attache a file (1/2) on this email as mentioned previous one. I'm very sorry to send the large log file. Thank you, Hideyuki * ** ** ** WARNING: This email contains an attachment of a very suspicious type. ** ** You are urged NOT to open this attachment unless you are absolutely ** ** sure it is legitimate. Opening this attachment may cause irreparable ** ** damage to your computer and your files. If you have any questions ** ** about the validity of this message, PLEASE SEEK HELP BEFORE OPENING IT. ** ** ** ** This warning was added by the IU Computer Science Dept. mail scanner. ** * <>
Re: [OMPI users] OpenMPI Checkpoint/Restart is failed
I attache a file (2/2) on this email as mentioned previous one. Thank you, Hideyuki * ** ** ** WARNING: This email contains an attachment of a very suspicious type. ** ** You are urged NOT to open this attachment unless you are absolutely ** ** sure it is legitimate. Opening this attachment may cause irreparable ** ** damage to your computer and your files. If you have any questions ** ** about the validity of this message, PLEASE SEEK HELP BEFORE OPENING IT. ** ** ** ** This warning was added by the IU Computer Science Dept. mail scanner. ** * <>
Re: [OMPI users] OpenMPI Checkpoint/Restart is failed
I resend this mail for sending error ( I misused the email address on FROM.) Sorry if you receive multiple copies of this email. I attache a file (1/2) on this email as mentioned previous one. openmpi_config_log.tar.gz Description: GNU Zip compressed data
Re: [OMPI users] OpenMPI Checkpoint/Restart is failed
I resend this mail for sending error ( I misused the email address on FROM.) Sorry if you receive multiple copies of this email. I attache a file (2/2) on this email as mentioned previous one. Thank you, Hideyuki openmpi_others_log.tar.gz Description: GNU Zip compressed data
Re: [OMPI users] OpenMPI Checkpoint/Restart is failed
On Mon, Apr 12, 2010 at 7:36 AM, Hideyuki Jitsumoto wrote: > Hi Members, > > I tried to use checkpoint/restart by openmpi. > But I can not get collect checkpoint data. > I prepared execution environment as follows, the strings in () mean > name of output file which attached on next e-mail ( for mail size > limitation ): > > 1. installed BLCR and checked BLCR is working correctly by "make check" > 2. executed ./configure with some parameters on openMPI source dir > (config.output / config.log) > 3. executed make and make install (make.output.2 / install.output.2) > 4. confirmed that mca_crs_blcr.[la|so], mca_crs_self.[la|so] on > /${INSTALL_DIR}/lib/openmpi > 5. make ~/.openmpi/mca-params.conf (mca-params.conf) > 6. compiled NPB and executed with -am ft-enable-cr > 7. invoked ompi-checkpoint > > As result, I got the message "Checkpoint failed: no processes checkpointed." > (cr_test_cg) Are you using a shared file system? You need to use a shared file system for checkpointing with 1.4.1: https://svn.open-mpi.org/trac/ompi/ticket/2139 Regards,
Re: [OMPI users] Installing MPE on existing Open-MPI installation for C++ programs
Try using "mpecc -mpicc=" to compile your C++ program. "mpicc -mpilog" is only available in the MPICH (not MPICH2 which provides mpicc -mpe=mpilog). Non-MPICH(2) based implementation needs to use mpecc instead to enable MPE. A.Chan - "Ridhi Dua" wrote: > Hello, > I have successfully installed MPE for my existing Open-MPI > installation and > have been able compile using the compiler wrapper 'mpecc'. > But, I have some C++ MPI programs which cannot be compiled using > mpecc. How > do I achieve this,or do I need to make changes to my MPE installation > procedure? I used the following command for my current installation. > > ./configure --prefix=/gpfs/fs3/home/xxx/mybin \ > MPI_CC=/sw/openmpi/bin/mpicc \ > --disable-f77 \ > --with-java=/usr/java/jdk1.6.0_13 > > (Also, I have managed to use mpecc, but not 'mpicc -mpilog hello.c' Is > this > assumption even correct for Open-MPI or is it an option only for MPICH > ) > > Thank you. > ~ ridZ > > ___ > users mailing list > us...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/users