Re: [Moses-support] EMS help

2015-07-28 Thread Vincent Nguyen
Many thanks it seems to have fixed the issue, maybe worth to fix it on github. Le 28/07/2015 15:44, Barry Haddow a écrit : Hi Vincent I think the quotes are getting stripped off further down the pipeline. You could work around by changing to the compact phrase table. Or try editing binarize

Re: [Moses-support] Problem in translation

2015-07-28 Thread Barry Haddow
Hi Fatma I don't see any error in the file. What do you mean "the output was wrong." ? cheers - Barry On 28/07/15 19:13, fatma elzahraa Eltaher wrote: Dear All, I try to build a Model but I get an attached error file . is this mean that there are a problem in model . Because I test it by w

[Moses-support] Problem in translation

2015-07-28 Thread fatma elzahraa Eltaher
Dear All, I try to build a Model but I get an attached error file . is this mean that there are a problem in model . Because I test it by word in training data but the output was wrong. kindly find the attached file. thank you, Fatma El-Zahraa El -Taher Teaching Assistant at Computer & Syst

[Moses-support] Generation step for factorized translation

2015-07-28 Thread Marco Damonte
Hi, I'm using EMS and factorized translation. For instance, I have this setting: input-factors = word output-factors = word brown50 alignment-factors = "word -> word" translation-factors = "word -> word+brown50" generation-factors = "brown50" reordering-factors = "word -> word" decoding-steps = "

Re: [Moses-support] EMS help

2015-07-28 Thread Barry Haddow
Hi Vincent I think the quotes are getting stripped off further down the pipeline. You could work around by changing to the compact phrase table. Or try editing binarize-model.perl to change safesystem("$RealBin/filter-model-given-input.pl $targetdir $input_config /dev/null $hierarchical -n

Re: [Moses-support] EMS help

2015-07-28 Thread Vincent Nguyen
same error: #!/bin/bash PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games" cd /home/moses/working echo 'starting at '`date`' on '`hostname` mkdir -p /home/moses/working/training mkdir -p /home/moses/working/model /home/moses/mosesdecoder/scripts/traini

Re: [Moses-support] EMS help

2015-07-28 Thread Barry Haddow
Hi Vincent It could be a bug. Could you edit mosesdecoder/scripts/ems/experiment.meta and change the line: template: $binarize-all IN OUT -Binarizer $ttable-binarizer to template: $binarize-all IN OUT -Binarizer "$ttable-binarizer" Note that I have added quotes. Then you'll have to dele

Re: [Moses-support] EMS help

2015-07-28 Thread Barry Haddow
Hi Vincent If you look at the error log, you will see: > Usage: /home/moses/mosesdecoder/bin/CreateOnDiskPt numSourceFactors > numTargetFactors numScores tableLimit sortScoreIndex inputPath outputPath You are missing the first 5 arguments to CreateOnDiskPt, as given in config.basic. cheers -

Re: [Moses-support] EMS help

2015-07-28 Thread Vincent Nguyen
I don't know why but the binarize crashes see below > >> in my working directory I have 2 subdir, >> "tuning" with inside moses.filtered.ini.5 moses.ini.5 moses.tuned.ini.5 >> and >> "model" with inside moses.ini.5 (apparently this one does not have the >> tuned weights) >> >> those in the t

Re: [Moses-support] EMS help

2015-07-28 Thread Vincent Nguyen
I am NOT talking about the [CORPUS:europarl] section but the [LM:europarl] I think in this section you need the $pair-extension same as [LM:nc] where it was fine Anyway :yes I had an error Europarl releases usually contain the parallel files (e.g. europarl-v7.fr-en.fr) and monolingual files (

Re: [Moses-support] EMS help

2015-07-28 Thread Barry Haddow
Hi Vincent On 28/07/15 10:18, Vincent Nguyen wrote: > Thanks Barry. Answers and other questions below. > > Le 28/07/2015 10:25, Barry Haddow a écrit : >> Hi Vincent >> >>> 2 bugs report : >>> in the LM Corpus definition for Europarl : the $pair-extension is >>> missing before .$output-extension >>

Re: [Moses-support] EMS help

2015-07-28 Thread Vincent Nguyen
Thanks Barry. Answers and other questions below. Le 28/07/2015 10:25, Barry Haddow a écrit : > Hi Vincent > >> 2 bugs report : >> in the LM Corpus definition for Europarl : the $pair-extension is >> missing before .$output-extension >> in the step 5 (maybe for others too) generation of the moses.t

Re: [Moses-support] EMS help

2015-07-28 Thread Barry Haddow
Hi Vincent > 2 bugs report : > in the LM Corpus definition for Europarl : the $pair-extension is > missing before .$output-extension > in the step 5 (maybe for others too) generation of the moses.tuned.ini.5 > file there is a missing ".gz" at the end of phrase-table.5 > in the PhraseDictionaryMemo

[Moses-support] Errors while running phrase based tutorial from Moses manual

2015-07-28 Thread Sudip Mahajan
Hello I want to run the following command with moses %train-model.perl \ --root-dir unfactored \ --corpus factored-corpus/proj-syndicate \ --f de --e en \ --lm 0:3:factored-corpus/surface.lm:0 \ --external-bin-dir .../tools \ --input-factor-max 4 This creates a moses.ini file but the POS table cr