Hello,
Attached please find the help (in html). The same information is also
included in the README file in the contrib folder.
Best
raymond
On 1 May 2014 14:30, Philipp Koehn pko...@inf.ed.ac.uk wrote:
Hi,
great stuff -
It would be good to have documentation on how this works.
-phi
On Wed, Apr 30, 2014 at 11:53 AM, Hieu Hoang hieu.ho...@ed.ac.uk wrote:
thanks. I've parked your code in
/contrib/mert-sge-nosync
If anyone wants to use it, they can start fiddling around with it there
On 27 April 2014 21:47, Raymond W. M. Ng wm...@sheffield.ac.uk wrote:
I tried to push to a remote branch and get an HTTP request fail. Please
help upload the code attached in this mail. Thanks very much.
--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
MERT-SGE-NOSYNC
The parallel MERT tuning scripts in moses cannot run in the SGE "no-sync" mode (where job submission is done in one go, after which user can go offline while leaving the SGE to manage the whole process). Scripts provided in this site are for parallel MERT in SGE no-sync mode. You will need to have SSH support in perl (Step 2), and set up public ssh-keys between the running hosts and the submission hosts (Step 3).
1. Untar the scipts in ${MOSES}/scripts/
2. Download and install OpenSSH packages for perl:
Net-OpenSSH-Compat (http://search.cpan.org/CPAN/authors/id/S/SA/SALVA/Net-OpenSSH-Compat-0.06.tar.gz)
$ cd Net-OpenSSH-Compat-0.06
$ perl Makefile.PL
(You may have dependency issue and need to install IO-Tty and Net-OpenSSH in advance)
IO-Tty-1.10 (http://search.cpan.org/CPAN/authors/id/T/TO/TODDR/IO-Tty-1.10.tar.gz)
Net-OpenSSH-0.60 (http://search.cpan.org/CPAN/authors/id/S/SA/SALVA/Net-OpenSSH-0.60.tar.gz)
3. Set up public ssh-keys for accessing the submithost (machine from which qsub is executed) from the running hosts (machines which actually runs the scripts)
http://www.linuxproblem.org/art_9.html
4. Run parallel MERT by
nohup nice ${MOSES}/scripts/training/mert-moses-sge-nosync.pl ${TM_DEVTEXT_SOURCE} \
--threads 20 --jobs 20 \
--queue-flags='-q normal.q -P project' \
--submithost='squeal' \
${TM_DEVTEXT_TARGET} ${MOSES}/dist/bin/moses ${WORKINGDIR}/train/model/moses.ini \
--mertdir ${MOSES}/dist/bin/ ${WORKINGDIR}/mert.out
(tested on moses version Built Apr 2012 version)
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
