On 13 June 2013 15:57, Arezki Sadoune <[email protected]> wrote:
> Dear Hieu, > > Thank you for your answer, our data set is too big to have it readily > available for you to look at it (plus we have some NDA we need to respect). > Do you know if there are nay special characters in a corpus that could > generate this error message ? so that we would screen for it. > yes, you need to screen for the characters | [ ] Double spaces and tabs are also not a good idea. Your corpus should be in utf8. the script scripts/training/clean-corpus-n.perl will do the cleaning for you > Thank you again and Kind Regards > A.S > > --- En date de : *Jeu 13.6.13, Hieu Hoang <[email protected]>* a écrit : > > > De: Hieu Hoang <[email protected]> > Objet: Re: [Moses-support] Problem with lexical reordering scoring > À: "Arezki Sadoune" <[email protected]> > Cc: [email protected] > Date: Jeudi 13 juin 2013, 12h41 > > > thats strange. > > i can't see anything wrong with that command. > > can you make your data available for download and i'll try and debug it. > > On 11/06/2013 16:14, Arezki Sadoune wrote: > > > Dear all > > I have tried several times to run a training using the following command > script, everything goes well until it gets to the scoring step: > > > nohup /home/Moses/mosesdecoder/scripts/training/train-model.perl > --parallel -root-dir /disque4/disque3/train-kiid-low-nbrs/training-fr-en/ > -corpus /disque4/disque3/train-kiid-low-nbrs/KIID.0.clen -f fr -e en > -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm > 1:5:/disque4/disque3/train-kiid-low-nbrs/training-fr-en/lm/lm.kiid.0.blm.en > -external-bin-dir /root/external-bin-dir/ -mgiza -mgiza-cpus 32 >& > /disque4/disque3/train-kiid-low-nbrs/training-fr-en/training.out & > > Here is the section of the training.out file that contains the faillure > reports: > > > (7) learn reordering model @ Thu Jun 6 23:46:49 CEST 2013 > (7.1) [no factors] learn reordering model @ Thu Jun 6 23:46:49 CEST 2013 > (7.2) building tables @ Thu Jun 6 23:46:49 CEST 2013 > Executing: > /home/Moses/mosesdecoder/scripts/../bin/lexical-reordering-score > /disque4/disque3/train-kiid-low-nbrs/training-fr-en/model/extract.o.sorted.gz > 0.5 > /disque4/disque3/train-kiid-low-nbrs/training-fr-en/model/reordering-table. > --model "wbe msd wbe-msd-bidirectional-fe" > Lexical Reordering Scorer > scores lexical reordering models of several types (hierarchical, > phrase-based and word-based-extraction > Illegal reordering type used: agnie > Exit code: 1 > ERROR: Lexical reordering scoring failed at > /home/Moses/mosesdecoder/scripts/training/train-model.perl line 1629. > > ....................................................................................................................................... > > ....................................................................................................................................... > .................................................................. > > Thanks a lot for your help > > Arezki SADOUNE > > > > > > > _______________________________________________ > Moses-support mailing [email protected] > <http://mc/[email protected]>http://mailman.mit.edu/mailman/listinfo/moses-support > > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > -- Hieu Hoang Research Associate University of Edinburgh http://www.hoang.co.uk/hieu
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
