Hi Barry, Both problems are gone now on SGE. Excellent.
Cheers, Guchun On 9 November 2012 13:41, Guchun Zhang <gzh...@alphacrc.com> wrote: > Hi Barry, > > I am doing it now. :-) > > Cheers, > > Guchun > > > On 9 November 2012 13:35, Barry Haddow <bhad...@staffmail.ed.ac.uk> wrote: > >> Hi Guchun >> >> The -text-type problem should be fixed by a commit I made yesterday. I >> haven't tested SGE operation though, so can you try again with the latest >> EMS? >> >> cheers - Barry >> >> >> On 09/11/12 13:26, Guchun Zhang wrote: >> >>> Thanks, Barry. >>> >>> The following is the output file of one of the qsub jobs: >>> >>> Linux ubuntu11 3.2.0-24-generic #39-Ubuntu SMP Mon May 21 16:52:17 UTC >>> 2012 x86_64 x86_64 x86_64 GNU/Linux >>> Defined parameters (per moses.ini or switch): >>> config: /home/guchun/Data/mt-files/** >>> tests/exp-new-training/model/**EN_US-FR_FR//evaluation/model.**filtered.ini.1 >>> >>> cube-pruning-pop-limit: 5000 >>> distortion-file: 0-0 wbe-msd-bidirectional-fe-allff 6 >>> /home/guchun/Data/mt-files/**tests/exp-new-training/model/** >>> EN_US-FR_FR//evaluation/model.**filtered.1/reordering-table.1.**0-0.wbe-msd-bidirectional-fe >>> >>> distortion-limit: 6 >>> input-factors: 0 >>> input-file: model.input.tc.1.split16701-aa >>> inputtype: 0 >>> lmodel-file: 0 0 7 /home/guchun/Data/mt-files/** >>> tests/exp-new-training/model/**EN_US-FR_FR//lm/model.lm.1 0 1 7 >>> /home/guchun/Data/mt-files/**tests/exp-new-training/model/**EN_US-FR_FR//lm/model=pos.lm.1 >>> >>> mapping: 0 T 0 >>> search-algorithm: 1 >>> stack: 5000 >>> ttable-file: 1 0 0,1 5 /home/guchun/Data/mt-files/** >>> tests/exp-new-training/model/**EN_US-FR_FR//evaluation/model.** >>> filtered.1/phrase-table.0-0,1.**1.1 >>> ttable-limit: 20 >>> weight-d: 0.063647 0.0630623 0.0827805 0.0571843 0.0856819 >>> 0.0255637 0.0459574 >>> weight-l: 0.139309 0.0196229 >>> weight-t: 0.136273 0.0197609 0.021245 0.0725207 -0.0529247 >>> weight-w: -0.114467 >>> *ERROR:illegal switch: -t-text-type* >>> >>> exit status 1 >>> exit status 0 >>> >>> I checked -t wasn't present in the config file but appeared in the >>> command. A typo in mert-moses.pl <http://mert-moses.pl>? >>> >>> >>> I will pull the change you made and try it out in a moment. >>> >>> Cheers, >>> >>> Guchun >>> On 9 November 2012 12:15, Barry Haddow <bhad...@staffmail.ed.ac.uk<mailto: >>> bhad...@staffmail.ed.**ac.uk <bhad...@staffmail.ed.ac.uk>>> wrote: >>> >>> Hi Guchun >>> >>> I've pushed a change that may fix the second error. Can you let me >>> know, and if it doesn't fix it, can you send me your ini file to >>> help with testing. >>> >>> For the first error, could you post one of the decoder log files >>> to see why the decoder is crashing, >>> >>> cheers - Barry >>> >>> >>> On 09/11/12 11:15, Guchun Zhang wrote: >>> >>> Hi there, >>> >>> I hope you can help me out with two new problems after >>> installing a new Moses commit. I have spent some time on them, >>> but to no avail. >>> >>> The first occurred during decode. The command is >>> >>> ##### >>> /home/guchun/Work/moses/moses- scripts/generic/moses- >>> parallel.pl <http://moses-parallel.pl> >>> <http://moses-parallel.pl> -decoder /home/guchun/Work/moses/ >>> mosesdecoder/bin/moses -config /home/guchun/Data/mt-files/ >>> tests/exp-new-training/model/ EN_US-FR_FR//evaluation/model. >>> filtered.ini.1 -input-file /home/guchun/Data/mt-files/ >>> tests/exp-new-training/model/ EN_US-FR_FR//evaluation/model. >>> >>> input.tc.1 *--jobs 32* -decoder-parameters "-search-algorithm >>> 1 -cube-pruning-pop-limit 5000 -s 5000 -t" > >>> /home/guchun/Data/mt-files/ tests/exp-new-training/model/ >>> EN_US-FR_FR//evaluation/model. output.2 -text-type "test" >>> >>> >>> ##### >>> >>> The models are built using the EMS factored example. The error >>> message is >>> >>> ----- >>> Split (-aa) were not entirely translated >>> outputN=0 inputN=36 >>> outputfile=model.input.tc.1. split17159-aa.trans >>> inputfile=model.input.tc.1. split17159-aa >>> .... >>> everything crashed, not trying to resubmit jobs >>> Got interrupt or something failed. >>> kill_all_and_quit >>> qdel 17791 >>> Executing: qdel 17791 >>> Exit code: 1 >>> .... >>> Translation was not performed correctly >>> or some of the submitted jobs died. >>> qdel function was called for all submitted jobs >>> ----- >>> >>> Using bin/moses -thread 32 .... works fine. >>> >>> The second error is during the first iteration of tuning with >>> a corpus having 4 factors. The command is >>> >>> ##### >>> /home/guchun/Work/moses/moses- scripts/training/mert-moses.pl >>> <http://mert-moses.pl> <http://mert-moses.pl> >>> /home/guchun/Data/mt-files/ tests/exp-new-training/model/ >>> EN_US-FR_FR/rb//tuning/input. tc.1 /home/guchun/Data/mt-files/ >>> tests/exp-new-training/model/ EN_US-FR_FR/rb//tuning/ >>> reference.tc.1 /home/guchun/Work/moses/ mosesdecoder/bin/moses >>> /home/guchun/Data/mt-files/ tests/exp-new-training/model/ >>> EN_US-FR_FR/rb//tuning/moses. filtered.ini.2 --nbest 100 >>> --working-dir /home/guchun/Data/mt-files/ >>> tests/exp-new-training/model/ EN_US-FR_FR/rb//tuning/tmp.2 >>> --decoder-flags "" --rootdir /home/guchun/Work/moses/moses- >>> scripts -mertdir /home/guchun/Work/moses/ mosesdecoder/bin >>> >>> --no-filter-phrase-table *--jobs 32* >>> >>> ##### >>> >>> The error message is >>> >>> ----- >>> The decoder returns the scores in this order: d d d d d d d lm >>> lm w tm tm tm tm tm tm tm tm tm tm tm tm tm tm tm g g g g >>> Mismatched lambdas. Decoder returned d d d d d d d lm lm w tm >>> tm tm tm tm tm tm tm tm tm tm tm tm tm tm g g g g, we expected >>> d d d d d d d lm lm w tm tm tm tm tm g g tm tm tm tm tm g g tm >>> tm tm tm tm at /home/guchun/Work/moses/moses- >>> scripts/training/mert-moses.pl <http://mert-moses.pl> >>> <http://mert-moses.pl> line 1155. >>> >>> ----- >>> >>> I never had these problems with a previous commit back in >>> March. Any hints will be warmly welcomed. >>> >>> Many thanks, >>> >>> Guchun >>> >>> >>> ______________________________ _________________ >>> Moses-support mailing list >>> Moses-support@mit.edu <mailto:Moses-support@mit.edu> >>> http://mailman.mit.edu/ mailman/listinfo/moses-support >>> >>> >>> <http://mailman.mit.edu/**mailman/listinfo/moses-support<http://mailman.mit.edu/mailman/listinfo/moses-support> >>> **> >>> >>> >>> >>> -- The University of Edinburgh is a charitable body, registered >>> in >>> Scotland, with registration number SC005336. >>> >>> >>> >>> >> >> -- >> The University of Edinburgh is a charitable body, registered in >> Scotland, with registration number SC005336. >> >> >> >
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
