Dear All,
When I try to train transliteration i get following error, I dont know what is missing please help. Extracting Transliteration Pairs > Constructing Graph > Computing Probs : iteration 1 > Computing Probs : iteration 2 > Computing Probs : iteration 3 > Computing Probs : iteration 4 > Computing Probs : iteration 5 > Computing Probs : iteration 6 > Computing Probs : iteration 7 > Computing Probs : iteration 8 > Computing Probs : iteration 9 > Computing Probs : iteration 10 > Finished... > Selecting Transliteration Pairs with threshold 0.5 > Name "main::hash" used only once: possible typo at > /home/sanjana/Documents/SMT/mosesdecoder/scripts/Transliteration/ > threshold.pl line 26. > Preparing Corpus > Align Corpus > Using SCRIPTS_ROOTDIR: /home/sanjana/Documents/SMT/mosesdecoder/scripts > Using multi-thread GIZA > ERROR: Cannot find > /home/sanjana/Documents/SMT/mosesdecoder/tools/merge_alignment.py at > /home/sanjana/Documents/SMT/mosesdecoder/scripts/training/train-model.perl > line 393. > Using SCRIPTS_ROOTDIR: /home/sanjana/Documents/SMT/mosesdecoder/scripts > Using multi-thread GIZA > ERROR: Cannot find > /home/sanjana/Documents/SMT/mosesdecoder/tools/merge_alignment.py at > /home/sanjana/Documents/SMT/mosesdecoder/scripts/training/train-model.perl > line 393. > Using SCRIPTS_ROOTDIR: /home/sanjana/Documents/SMT/mosesdecoder/scripts > Using multi-thread GIZA > ERROR: Cannot find > /home/sanjana/Documents/SMT/mosesdecoder/tools/merge_alignment.py at > /home/sanjana/Documents/SMT/mosesdecoder/scripts/training/train-model.perl > line 393. > Using SCRIPTS_ROOTDIR: /home/sanjana/Documents/SMT/mosesdecoder/scripts > using gzip > (3) generate word alignment @ Thu May 5 16:19:50 IST 2016 > Combining forward and inverted alignment from files: > > /home/sanjana/Documents/SMT/Transliteration/training/giza-inverse/en-hi.A3.final.{bz2,gz} > > /home/sanjana/Documents/SMT/Transliteration/training/giza/hi-en.A3.final.{bz2,gz} > ERROR: Can't read > /home/sanjana/Documents/SMT/Transliteration/training/giza-inverse/en-hi.A3.final.{bz2,gz} > Train Translation Models > Using SCRIPTS_ROOTDIR: /home/sanjana/Documents/SMT/mosesdecoder/scripts > using gzip > (4) generate lexical translation table 0-0 @ Thu May 5 16:19:50 IST 2016 > > (/home/sanjana/Documents/SMT/Transliteration/training/corpus.en,/home/sanjana/Documents/SMT/Transliteration/training/corpus.hi,/home/sanjana/Documents/SMT/Transliteration/model/lex) > ERROR: Can't read > /home/sanjana/Documents/SMT/Transliteration/model/aligned.grow-diag-final-and > at > /home/sanjana/Documents/SMT/mosesdecoder/scripts/training/LexicalTranslationModel.pm > line 92. > Using SCRIPTS_ROOTDIR: /home/sanjana/Documents/SMT/mosesdecoder/scripts > using gzip > (5) extract phrases @ Thu May 5 16:19:50 IST 2016 > File not found: > /home/sanjana/Documents/SMT/Transliteration/model/aligned.grow-diag-final-and > at > /home/sanjana/Documents/SMT/mosesdecoder/scripts/training/train-model.perl > line 1609. > Using SCRIPTS_ROOTDIR: /home/sanjana/Documents/SMT/mosesdecoder/scripts > using gzip > (6) score phrases @ Thu May 5 16:19:50 IST 2016 > (6.1) creating table half > /home/sanjana/Documents/SMT/Transliteration/model/phrase-table.half.f2e @ > Thu May 5 16:19:50 IST 2016 > /home/sanjana/Documents/SMT/mosesdecoder/scripts/generic/score-parallel.perl > 8 "sort " /home/sanjana/Documents/SMT/mosesdecoder/scripts/../bin/score > /home/sanjana/Documents/SMT/Transliteration/model/extract.sorted.gz > /home/sanjana/Documents/SMT/Transliteration/model/lex.f2e > /home/sanjana/Documents/SMT/Transliteration/model/phrase-table.half.f2e.gz > --KneserNey 0 > Executing: > /home/sanjana/Documents/SMT/mosesdecoder/scripts/generic/score-parallel.perl > 8 "sort " /home/sanjana/Documents/SMT/mosesdecoder/scripts/../bin/score > /home/sanjana/Documents/SMT/Transliteration/model/extract.sorted.gz > /home/sanjana/Documents/SMT/Transliteration/model/lex.f2e > /home/sanjana/Documents/SMT/Transliteration/model/phrase-table.half.f2e.gz > --KneserNey 0 > using gzip > Started Thu May 5 16:19:50 2016 > gzip: /home/sanjana/Documents/SMT/Transliteration/model/extract.sorted.gz: > No such file or directory > /home/sanjana/Documents/SMT/mosesdecoder/scripts/../bin/score > /home/sanjana/Documents/SMT/Transliteration/model/tmp.10464/extract.0.gz > /home/sanjana/Documents/SMT/Transliteration/model/lex.f2e > /home/sanjana/Documents/SMT/Transliteration/model/tmp.10464/phrase-table.half.0000000.gz > --KneserNey 2>> /dev/stderr > /home/sanjana/Documents/SMT/Transliteration/model/tmp.10464/ > run.0.sh/home/sanjana/Documents/SMT/Transliteration/model/tmp.10464/run.1.sh/home/sanjana/Documents/SMT/Transliteration/model/tmp.10464/run.2.sh/home/sanjana/Documents/SMT/Transliteration/model/tmp.10464/run.3.sh/home/sanjana/Documents/SMT/Transliteration/model/tmp.10464/run.4.sh/home/sanjana/Documents/SMT/Transliteration/model/tmp.10464/run.5.sh/home/sanjana/Documents/SMT/Transliteration/model/tmp.10464/run.6.sh/home/sanjana/Documents/SMT/Transliteration/model/tmp.10464/run.7.shScore > v2.1 -- scoring methods for extracted rules > adjusting phrase translation probabilities with Kneser Ney discounting > Loading lexical translation table from > /home/sanjana/Documents/SMT/Transliteration/model/lex.f2eCan't read > /home/sanjana/Documents/SMT/Transliteration/model/lex.f2e > mv > /home/sanjana/Documents/SMT/Transliteration/model/tmp.10464/phrase-table.half.0000000.gz > /home/sanjana/Documents/SMT/Transliteration/model/phrase-table.half.f2e.gzmv: > cannot stat > '/home/sanjana/Documents/SMT/Transliteration/model/tmp.10464/phrase-table.half.0000000.gz': > No such file or directory > Exit code: 1 > ERROR: Scoring of phrases failed at > /home/sanjana/Documents/SMT/mosesdecoder/scripts/training/train-model.perl > line 1773. > (6.3) creating table half > /home/sanjana/Documents/SMT/Transliteration/model/phrase-table.half.e2f @ > Thu May 5 16:19:50 IST 2016 > /home/sanjana/Documents/SMT/mosesdecoder/scripts/generic/score-parallel.perl > 8 "sort " /home/sanjana/Documents/SMT/mosesdecoder/scripts/../bin/score > /home/sanjana/Documents/SMT/Transliteration/model/extract.inv.sorted.gz > /home/sanjana/Documents/SMT/Transliteration/model/lex.e2f > /home/sanjana/Documents/SMT/Transliteration/model/phrase-table.half.e2f.gz > --Inverse --KneserNey 1 > Executing: > /home/sanjana/Documents/SMT/mosesdecoder/scripts/generic/score-parallel.perl > 8 "sort " /home/sanjana/Documents/SMT/mosesdecoder/scripts/../bin/score > /home/sanjana/Documents/SMT/Transliteration/model/extract.inv.sorted.gz > /home/sanjana/Documents/SMT/Transliteration/model/lex.e2f > /home/sanjana/Documents/SMT/Transliteration/model/phrase-table.half.e2f.gz > --Inverse --KneserNey 1 > using gzip > Started Thu May 5 16:19:50 2016 > gzip: > /home/sanjana/Documents/SMT/Transliteration/model/extract.inv.sorted.gz: No > such file or directory > /home/sanjana/Documents/SMT/mosesdecoder/scripts/../bin/score > /home/sanjana/Documents/SMT/Transliteration/model/tmp.10512/extract.0.gz > /home/sanjana/Documents/SMT/Transliteration/model/lex.e2f > /home/sanjana/Documents/SMT/Transliteration/model/tmp.10512/phrase-table.half.0000000.gz > --Inverse --KneserNey 2>> /dev/stderr > /home/sanjana/Documents/SMT/Transliteration/model/tmp.10512/ > run.0.sh/home/sanjana/Documents/SMT/Transliteration/model/tmp.10512/run.1.sh/home/sanjana/Documents/SMT/Transliteration/model/tmp.10512/run.2.sh/home/sanjana/Documents/SMT/Transliteration/model/tmp.10512/run.3.sh/home/sanjana/Documents/SMT/Transliteration/model/tmp.10512/run.5.sh/home/sanjana/Documents/SMT/Transliteration/model/tmp.10512/run.6.sh/home/sanjana/Documents/SMT/Transliteration/model/tmp.10512/run.7.sh/home/sanjana/Documents/SMT/Transliteration/model/tmp.10512/run.4.shScore > v2.1 -- scoring methods for extracted rules > using inverse mode > adjusting phrase translation probabilities with Kneser Ney discounting > Loading lexical translation table from > /home/sanjana/Documents/SMT/Transliteration/model/lex.e2fCan't read > /home/sanjana/Documents/SMT/Transliteration/model/lex.e2f > gunzip -c > /home/sanjana/Documents/SMT/Transliteration/model/tmp.10512/phrase-table.half.*.gz > 2>> /dev/stderr| LC_ALL=C sort -T > /home/sanjana/Documents/SMT/Transliteration/model/tmp.10512 | gzip -c > > /home/sanjana/Documents/SMT/Transliteration/model/phrase-table.half.e2f.gz > 2>> /dev/stderr gzip: > /home/sanjana/Documents/SMT/Transliteration/model/tmp.10512/phrase-table.half.*.gz: > No such file or directory > rm -rf /home/sanjana/Documents/SMT/Transliteration/model/tmp.10512 > Finished Thu May 5 16:19:50 2016 > (6.6) consolidating the two halves @ Thu May 5 16:19:50 IST 2016 > Executing: > /home/sanjana/Documents/SMT/mosesdecoder/scripts/../bin/consolidate > /home/sanjana/Documents/SMT/Transliteration/model/phrase-table.half.f2e.gz > /home/sanjana/Documents/SMT/Transliteration/model/phrase-table.half.e2f.gz > /dev/stdout --KneserNey > /home/sanjana/Documents/SMT/Transliteration/model/phrase-table.half.f2e.gz.coc > | gzip -c > > /home/sanjana/Documents/SMT/Transliteration/model/phrase-table.gz > Consolidate v2.0 written by Philipp Koehn > consolidating direct and indirect rule tables > adjusting phrase translation probabilities with Kneser Ney discounting > Can't read > /home/sanjana/Documents/SMT/Transliteration/model/phrase-table.half.f2e.gz.coc > Executing: rm -f > /home/sanjana/Documents/SMT/Transliteration/model/phrase-table.half.* > Train Language Models > one of required modified KneserNey count-of-counts is zero > error in discount estimator for order 2 > while opening /home/sanjana/Documents/SMT/Transliteration/lm/targetLM > ERROR > Create Config File > Using SCRIPTS_ROOTDIR: /home/sanjana/Documents/SMT/mosesdecoder/scripts > using gzip > ERROR: Language model file not found or empty: > /home/sanjana/Documents/SMT/Transliteration/lm/targetLM.bin at > /home/sanjana/Documents/SMT/mosesdecoder/scripts/training/train-model.perl > line 602. > Running Tuning for Transliteration Module > Using SCRIPTS_ROOTDIR: /home/sanjana/Documents/SMT/mosesdecoder/scripts > using gzip > (9) create moses.ini @ Thu May 5 16:19:50 IST 2016 > Executing: mkdir -p > /home/sanjana/Documents/SMT/Transliteration/tuning/filtered > Stripping XML... > Executing: > /home/sanjana/Documents/SMT/mosesdecoder/scripts/training/../generic/strip-xml.perl > < /home/sanjana/Documents/SMT/Transliteration/tuning/input > > /home/sanjana/Documents/SMT/Transliteration/tuning/filtered/input.10592 > pt:PhraseDictionaryMemory name=TranslationModel0 num-features=4 > path=/home/sanjana/Documents/SMT/Transliteration/model/phrase-table > input-factor=0 output-factor=0 > Considering factor 0 > Filtering files... > filtering /home/sanjana/Documents/SMT/Transliteration/model/phrase-table > -> > /home/sanjana/Documents/SMT/Transliteration/tuning/filtered/phrase-table.0-0.1.1... > No phrases found in > /home/sanjana/Documents/SMT/Transliteration/model/phrase-table! at > /home/sanjana/Documents/SMT/mosesdecoder/scripts/training/ > filter-model-given-input.pl line 398. > sh: 1: cannot open > /home/sanjana/Documents/SMT/Transliteration/model/moses.ini: No such file > Using SCRIPTS_ROOTDIR: /home/sanjana/Documents/SMT/mosesdecoder/scripts > File not found: > /home/sanjana/Documents/SMT/Transliteration/tuning/moses.filtered.ini > (interpreted as > /home/sanjana/Documents/SMT/Transliteration/tuning/moses.filtered.ini). at > /home/sanjana/Documents/SMT/mosesdecoder/scripts/training/mert-moses.pl > line 494. > cp: cannot stat > ‘/home/sanjana/Documents/SMT/Transliteration/tuning/tmp/moses.ini’: No such > file or directory > ERROR cannot open base-ini > '/home/sanjana/Documents/SMT/Transliteration/model/moses.ini': No such file > or directory at > /home/sanjana/Documents/SMT/mosesdecoder/scripts/ems/support/substitute-weights.perl > line 16. > Training Transliteration Module - End Thu May 5 16:19:50 IST 2016 > > -- Thanks and regards, Sanjanasri J.P
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support