Re: [Moses-support] ERROR: Lexical reordering scoring failed at moses/scripts/training/train-model.perl line 1738.
Hi Barry, Thanks for the instructions. I check the tmp directory and it seems that the align. file is broken. And I rerun the extract-parallel perl separately but it doesn't work either. Here is the link to my small corpus. https://www.dropbox.com/sh/beffab8g215awz6/2dCp0G_pdj Thank you, Hui 2014-02-24 18:46 GMT+01:00 Barry Haddow bhad...@staffmail.ed.ac.uk: Hi Hui I have a vague memory that very short corpora cause problems ... If you edit scripts/generic/extract-parallel.perl to comment out the following line (line 223 in my version): $cmd = rm -rf $TMPDIR \n; then rerun, it should retain the tmp directory created during extraction. You could then rerun extract manually and look for the problem. If you don't see anything odd, then upload to pastebin of dropbox and send out the link - or just email if it's small. cheers - Barry On 24/02/14 16:00, 李惠惠 wrote: Hi Barry, I tried to use absolute paths like this: hli@themisto:~$ /home/hli/MT/moses/scripts/training/train-model.perl /home/hli/MT -corpus /home/hli/MT/lm/1545.test.lowercased -external-bin-dir /home/hli/MT/bin -e de -f ade -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:3:/home/hli/MT/lm/1545.test.lm training.out but the same error still exists. Is that anything wrong with my corpus? Best, Hui 2014-02-24 16:48 GMT+01:00 Barry Haddow bhad...@staffmail.ed.ac.uk mailto:bhad...@staffmail.ed.ac.uk: Hi Hui It looks like your extract failed, but there is no error message. Do you think it ran out of disk? Could you try again, but use absolute paths everywhere? cheers - Barry ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] ERROR: Lexical reordering scoring failed at moses/scripts/training/train-model.perl line 1738.
Hi Hui What do you mean by broken? I meant for you to upload the contents of the tmp directory to dropbox, cheers - Barry On 25/02/14 15:54, 李惠惠 wrote: Hi Barry, Thanks for the instructions. I check the tmp directory and it seems that the align. file is broken. And I rerun the extract-parallel perl separately but it doesn't work either. Here is the link to my small corpus. https://www.dropbox.com/sh/beffab8g215awz6/2dCp0G_pdj Thank you, Hui 2014-02-24 18:46 GMT+01:00 Barry Haddow bhad...@staffmail.ed.ac.uk mailto:bhad...@staffmail.ed.ac.uk: Hi Hui I have a vague memory that very short corpora cause problems ... If you edit scripts/generic/extract-parallel.perl to comment out the following line (line 223 in my version): $cmd = rm -rf $TMPDIR \n; then rerun, it should retain the tmp directory created during extraction. You could then rerun extract manually and look for the problem. If you don't see anything odd, then upload to pastebin of dropbox and send out the link - or just email if it's small. cheers - Barry On 24/02/14 16:00, 李惠惠 wrote: Hi Barry, I tried to use absolute paths like this: hli@themisto:~$ /home/hli/MT/moses/scripts/training/train-model.perl /home/hli/MT -corpus /home/hli/MT/lm/1545.test.lowercased -external-bin-dir /home/hli/MT/bin -e de -f ade -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:3:/home/hli/MT/lm/1545.test.lm training.out but the same error still exists. Is that anything wrong with my corpus? Best, Hui 2014-02-24 16:48 GMT+01:00 Barry Haddow bhad...@staffmail.ed.ac.uk mailto:bhad...@staffmail.ed.ac.uk mailto:bhad...@staffmail.ed.ac.uk mailto:bhad...@staffmail.ed.ac.uk: Hi Hui It looks like your extract failed, but there is no error message. Do you think it ran out of disk? Could you try again, but use absolute paths everywhere? cheers - Barry The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] ERROR: Lexical reordering scoring failed at moses/scripts/training/train-model.perl line 1738.
Hi Hui Something went wrong earlier in training which meant that extract.o.sorted.gz was not created. You need to attach the log of train-model, cheers - Barry On 24/02/14 08:38, 李惠惠 wrote: Hi all, when I was training the phrase model, hli@themisto:~/MT$ moses/scripts/training/train-model.perl home/hli/MT -corpus lm/1545.test.lowercased -external-bin-dir bin -e de -f ade -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:3:/home/hli/MT/lm/1545.test.lm I obtained this error: scores lexical reordering models of several types (hierarchical, phrase-based and word-based-extraction terminate called after throwing an instance of 'util::ErrnoException' what(): util/file.cc:67 in int util::OpenReadOrThrow(const char*) threw ErrnoException because `-1 == (ret = open(name, 00))'. No such file or directory while opening ./model/extract.o.sorted.gz Aborted (core dumped) Exit code: 134 ERROR: Lexical reordering scoring failed at moses/scripts/training/train-model.perl line 1738. Attached is my corpus, could you help me to find out what's wrong with it ? Thx a lot! Best Regards, Hui Li Institute of Computer Science Heidelberg * * ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] ERROR: Lexical reordering scoring failed at moses/scripts/training/train-model.perl line 1738.
Hi Hui It looks like your extract failed, but there is no error message. Do you think it ran out of disk? Could you try again, but use absolute paths everywhere? cheers - Barry On 24/02/14 09:44, 李惠惠 wrote: Hi Barry, attached is my log of phrase model training. Thx a lot. Best, Hui 2014-02-24 10:18 GMT+01:00 Barry Haddow bhad...@staffmail.ed.ac.uk mailto:bhad...@staffmail.ed.ac.uk: Hi Hui Something went wrong earlier in training which meant that extract.o.sorted.gz was not created. You need to attach the log of train-model, cheers - Barry On 24/02/14 08:38, 李惠惠 wrote: Hi all, when I was training the phrase model, hli@themisto:~/MT$ moses/scripts/training/train-model.perl home/hli/MT -corpus lm/1545.test.lowercased -external-bin-dir bin -e de -f ade -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:3:/home/hli/MT/lm/1545.test.lm I obtained this error: scores lexical reordering models of several types (hierarchical, phrase-based and word-based-extraction terminate called after throwing an instance of 'util::ErrnoException' what(): util/file.cc:67 in int util::OpenReadOrThrow(const char*) threw ErrnoException because `-1 == (ret = open(name, 00))'. No such file or directory while opening ./model/extract.o.sorted.gz Aborted (core dumped) Exit code: 134 ERROR: Lexical reordering scoring failed at moses/scripts/training/train-model.perl line 1738. Attached is my corpus, could you help me to find out what's wrong with it ? Thx a lot! Best Regards, Hui Li Institute of Computer Science Heidelberg * * ___ Moses-support mailing list Moses-support@mit.edu mailto:Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] ERROR: Lexical reordering scoring failed at moses/scripts/training/train-model.perl line 1738.
Hi Barry, I tried to use absolute paths like this: hli@themisto:~$ /home/hli/MT/moses/scripts/training/train-model.perl /home/hli/MT -corpus /home/hli/MT/lm/1545.test.lowercased -external-bin-dir /home/hli/MT/bin -e de -f ade -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:3:/home/hli/MT/lm/1545.test.lm training.out but the same error still exists. Is that anything wrong with my corpus? Best, Hui 2014-02-24 16:48 GMT+01:00 Barry Haddow bhad...@staffmail.ed.ac.uk: Hi Hui It looks like your extract failed, but there is no error message. Do you think it ran out of disk? Could you try again, but use absolute paths everywhere? cheers - Barry On 24/02/14 09:44, 李惠惠 wrote: Hi Barry, attached is my log of phrase model training. Thx a lot. Best, Hui 2014-02-24 10:18 GMT+01:00 Barry Haddow bhad...@staffmail.ed.ac.ukmailto: bhad...@staffmail.ed.ac.uk: Hi Hui Something went wrong earlier in training which meant that extract.o.sorted.gz was not created. You need to attach the log of train-model, cheers - Barry On 24/02/14 08:38, 李惠惠 wrote: Hi all, when I was training the phrase model, hli@themisto:~/MT$ moses/scripts/training/train-model.perl home/hli/MT -corpus lm/1545.test.lowercased -external-bin-dir bin -e de -f ade -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:3:/home/hli/MT/lm/1545.test.lm I obtained this error: scores lexical reordering models of several types (hierarchical, phrase-based and word-based-extraction terminate called after throwing an instance of 'util::ErrnoException' what(): util/file.cc:67 in int util::OpenReadOrThrow(const char*) threw ErrnoException because `-1 == (ret = open(name, 00))'. No such file or directory while opening ./model/extract.o.sorted.gz Aborted (core dumped) Exit code: 134 ERROR: Lexical reordering scoring failed at moses/scripts/training/train-model.perl line 1738. Attached is my corpus, could you help me to find out what's wrong with it ? Thx a lot! Best Regards, Hui Li Institute of Computer Science Heidelberg * * ___ Moses-support mailing list Moses-support@mit.edu mailto:Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] ERROR: Lexical reordering scoring failed at moses/scripts/training/train-model.perl line 1738.
Hi Hui I have a vague memory that very short corpora cause problems ... If you edit scripts/generic/extract-parallel.perl to comment out the following line (line 223 in my version): $cmd = rm -rf $TMPDIR \n; then rerun, it should retain the tmp directory created during extraction. You could then rerun extract manually and look for the problem. If you don't see anything odd, then upload to pastebin of dropbox and send out the link - or just email if it's small. cheers - Barry On 24/02/14 16:00, 李惠惠 wrote: Hi Barry, I tried to use absolute paths like this: hli@themisto:~$ /home/hli/MT/moses/scripts/training/train-model.perl /home/hli/MT -corpus /home/hli/MT/lm/1545.test.lowercased -external-bin-dir /home/hli/MT/bin -e de -f ade -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:3:/home/hli/MT/lm/1545.test.lm training.out but the same error still exists. Is that anything wrong with my corpus? Best, Hui 2014-02-24 16:48 GMT+01:00 Barry Haddow bhad...@staffmail.ed.ac.uk mailto:bhad...@staffmail.ed.ac.uk: Hi Hui It looks like your extract failed, but there is no error message. Do you think it ran out of disk? Could you try again, but use absolute paths everywhere? cheers - Barry On 24/02/14 09:44, 李惠惠 wrote: Hi Barry, attached is my log of phrase model training. Thx a lot. Best, Hui 2014-02-24 10:18 GMT+01:00 Barry Haddow bhad...@staffmail.ed.ac.uk mailto:bhad...@staffmail.ed.ac.uk mailto:bhad...@staffmail.ed.ac.uk mailto:bhad...@staffmail.ed.ac.uk: Hi Hui Something went wrong earlier in training which meant that extract.o.sorted.gz was not created. You need to attach the log of train-model, cheers - Barry On 24/02/14 08:38, 李惠惠 wrote: Hi all, when I was training the phrase model, hli@themisto:~/MT$ moses/scripts/training/train-model.perl home/hli/MT -corpus lm/1545.test.lowercased -external-bin-dir bin -e de -f ade -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:3:/home/hli/MT/lm/1545.test.lm I obtained this error: scores lexical reordering models of several types (hierarchical, phrase-based and word-based-extraction terminate called after throwing an instance of 'util::ErrnoException' what(): util/file.cc:67 in int util::OpenReadOrThrow(const char*) threw ErrnoException because `-1 == (ret = open(name, 00))'. No such file or directory while opening ./model/extract.o.sorted.gz Aborted (core dumped) Exit code: 134 ERROR: Lexical reordering scoring failed at moses/scripts/training/train-model.perl line 1738. Attached is my corpus, could you help me to find out what's wrong with it ? Thx a lot! Best Regards, Hui Li Institute of Computer Science Heidelberg * * ___ Moses-support mailing list Moses-support@mit.edu mailto:Moses-support@mit.edu mailto:Moses-support@mit.edu mailto:Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. ___ Moses-support mailing list Moses-support@mit.edu mailto:Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
