Arefeh, you should binarize phrase-table and lexicalised reordering
models, it will speed up loading and running a translation:
http://www.statmt.org/moses/?n=Moses.Baseline
at the title *Testing*:
mkdir ~/working/binarised-model
cd ~/working
~/mosesdecoder/bin/processPhraseTable -ttable 0 0
train/model/phrase-table.gz -nscores 5 -out binarised-model/phrase-table
~/mosesdecoder/bin/processLexicalTable -in
train/model/reordering-table.wbe-msd-bidirectional-fe.gz -out
binarised-model/reordering-table
Then make a copy of the |~/working/mert-work/moses.ini| in the
binarised-model directory and change the phrase and reordering
tables to point to the binarised versions. My diff between the tuned
and binarised versions is as follows:
[bhaddow@hoenir working]$ diff mert-work/moses.ini
binarised-model/moses.ini
22c22
< 0 0 0 5 /home/bhaddow/working/train/model/phrase-table.gz
---
> 1 0 0 5 /home/bhaddow/working/binarised-model/phrase-table
38c38
< 0-0 wbe-msd-bidirectional-fe-allff 6
/home/bhaddow/working/train/model/reordering-table.wbe-msd-bidirectional-fe.gz
---
> 0-0 wbe-msd-bidirectional-fe-allff 6
/home/bhaddow/working/binarised-model/reordering-table
Dne 12.5.2013 15:56, pis(e Tom Hoar:
Arefeh, it looks like you need to study a bit about the Linux command
line. Your command line will sit forever waiting for user input. This
command line will send one sentence to the Moses binary and print the
translation to the terminal:
$ echo "please translate this sentence." | {path-to-moses}/moses -f
/opt/tools/working/train/model/moses.ini
This command line will send each line in a UTF-8 text file to the
Moses and print each translation to the terminal:
$ {path-to-moses}/moses -f /opt/tools/working/train/model/moses.ini <
{path-to-text-file}/mysource.txt
On 05/12/2013 02:37 PM, arefeh Kazemi wrote:
Hello
when I do the testing step, after a long time (nearly 20 hours!)
nothing happens. it gets the following output and the process is
continued!
any idea about why this happens?
Thank you
root@ubuntu:/opt/tools/working/binarised-model#
/opt/tools/mosesdecoder-RELEASE-1.0/mosesdecoder-RELEASE-1.0/bin/moses -f
/opt/tools/working/train/model/moses.ini "please translate this
sentence. "
Defined parameters (per moses.ini or switch):
config: /opt/tools/working/train/model/moses.ini please translate
this sentence.
distortion-file: 0-0 wbe-msd-bidirectional-fe-allff 6
/opt/tools/working/train/model/reordering-table.wbe-msd-bidirectional-fe.gz
distortion-limit: 6
input-factors: 0
lmodel-file: 8 0 3 /opt/tools/lm/fa-en.blm.fa
mapping: 0 T 0
ttable-file: 0 0 0 5 /opt/tools/working/train/model/phrase-table.gz
ttable-limit: 20
weight-d: 0.3 0.3 0.3 0.3 0.3 0.3 0.3
weight-l: 0.5000
weight-t: 0.20 0.20 0.20 0.20 0.20
weight-w: -1
/opt/tools/mosesdecoder-RELEASE-1.0/mosesdecoder-RELEASE-1.0/bin
ScoreProducer: Distortion start: 0 end: 1
ScoreProducer: WordPenalty start: 1 end: 2
ScoreProducer: !UnknownWordPenalty start: 2 end: 3
Loading lexical distortion models...have 1 models
ScoreProducer: LexicalReordering_wbe-msd-bidirectional-fe-allff
start: 3 end: 9
Creating lexical reordering...
weights: 0.300 0.300 0.300 0.300 0.300 0.300
Loading table into memory...done.
Start loading LanguageModel /opt/tools/lm/fa-en.blm.fa : [761.794]
seconds
ScoreProducer: LM start: 9 end: 10
Finished loading LanguageModels : [976.797] seconds
Start loading PhraseTable
/opt/tools/working/train/model/phrase-table.gz : [976.811] seconds
filePath: /opt/tools/working/train/model/phrase-table.gz
ScoreProducer: PhraseModel start: 10 end: 15
Finished loading phrase tables : [976.817] seconds
Start loading phrase table from
/opt/tools/working/train/model/phrase-table.gz : [976.942] seconds
Reading /opt/tools/working/train/model/phrase-table.gz
----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
**************************************************************
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
--
Jani Dugonik, dipl. inz(. rac(. in inf. tehnol.
Laboratorij za rac(unalnis(ke arhitekture in jezike
Ins(titut za rac(unalnis(tvo
Fakulteta za elektrotehniko, rac(unalnis(tvo in informatiko
Univerza v Mariboru
Smetanova 17, 2000 Maribor
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
