[Moses-support] Problem with tuning

2010-09-27 Thread Souhir Gahbiche
Hi all,

I'm trying to tune my system, but the tuning stops at the first
iteration. Here is my mert.log file:

After default: -l mem_free=0.5G -hard
Using SCRIPTS_ROOTDIR: /vol/mt2/tools/nadi/moses-scripts/scripts-20090923-1833/
SYNC distortionchecking weight-count for ttable-file
checking weight-count for lmodel-file
checking weight-count for distortion-file
Executing: mkdir -p /working/tuningdev2009/mert
Executing: 
/vol/mt2/tools/nadi/moses-scripts/scripts-20090923-1833//training/filter-model-given-input.pl
./filtered /tmp/souhir
/model/mosesdev2009.ini
/working/tuningdev2009/ar.project-syndicate.2009-07.v1.de
v.bw.mada.tok
filtering the phrase tables... Fri Aug 27 16:43:10 CEST 2010
The filtered model was ready in /working/tuningdev2009/mert/filtered,
not doing a
nything.
run 1 start at Fri Aug 27 16:43:10 CEST 2010
Parsing --decoder-flags: |-v 0|
Saving new config to: ./run1.moses.ini
Saved: ./run1.moses.ini
Normalizing lambdas: 0 1 1 1 1 1 1 1 1 0.3 0.2 0.3 0.2 0
DECODER_CFG = -w %.6f -lm %.6f -d %.6f %.6f %.6f %.6f %.6f %.6f %.6f
-tm %.6f %.6f %.6f %.6f %.6f
 values = 0 0.111 0.111 0.111
0.111 0.111 0.111 0.1
11 0.111 0.0333 0.0222
0.0333 0.0222 0
Executing: /vol/mt2/tools/nadi/moses/moses-cmd/src/moses -v 0  -config
filtered/moses.ini -inputtype 0 -w 0.00 -lm 0.11
 -d 0.11 0.11 0.11 0.11 0.11 0.11 0.11 -tm
0.03 0.02 0.03 0.02 0.00  -n-best-li
st run1.best100.out 100 -i
/working/tuningdev2009/ar.project-syndicate.2009-07.v1
.dev.bw.mada.tok > run1.out
(1) run decoder to produce n-best lists
params = -v 0
decoder_config = -w 0.00 -lm 0.11 -d 0.11 0.11
0.11 0.11 0.11 0.11 0.11 -tm 0.03 0.0222
22 0.03 0.02 0.00
Loading lexical distortion models...
have 1 models
Creating lexical reordering...
weights: 0.111 0.111 0.111 0.111 0.111 0.111
Loading table into memory...done.
Created lexical orientation reordering
[ERROR] Malformed input at
  Expected input to have words composed of 1 factor(s) (form FAC1|FAC2|...)
  but instead received input with 0 factor(s).
sh: line 1:  5114 Aborted
/vol/mt2/tools/nadi/moses/moses-cmd/src/moses -v 0 -config
filtered/moses.ini -inputt
ype 0 -w 0.00 -lm 0.11 -d 0.11 0.11 0.11 0.11
0.11 0.11 0.11 -tm 0.03 0.02 0.03
 0.02 0.00 -n-best-list run1.best100.out 100 -i
/working/tuningdev2009/ar
.project-syndicate.2009-07.v1.dev.bw.mada.tok > run1.out
Exit code: 134
The decoder died. CONFIG WAS -w 0.00 -lm 0.11 -d 0.11
0.11 0.11 0.11 0.11 0.11 0.11 -tm 0.0
3 0.02 0.03 0.02 0.00

The file run1.out is empty. I tried many times, but every time it
stopps at the same level.
I looked for the moses.ini. It works perfectly when I use two phrase tables.

Here's my moses.ini used :

#
### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0

# translation tables: source-factors, target-factors, number of scores, file
[ttable-file]
0 0 5 /working/model/phrase

# no generation models, no generation-file section

# language models: type(srilm/irstlm), factors, order, file
[lmodel-file]
0 0 4 /working/lmm/newsLM+news-train08.fr.4gki.arpa.gz

# limit on how many phrase translations e for each phrase f are loaded
# 0 = all elements loaded
[ttable-limit]
20

# distortion (reordering) files
[distortion-file]
0-0 msd-bidirectional-fe 6 /working/model/reordering-table.gz

# distortion (reordering) weight
[weight-d]
0.3
0.3
0.3
0.3
0.3
0.3
0.3

# language model weights
[weight-l]
0.5000

# translation model weights
[weight-t]
0.2
0.2
0.2
0.2
0.2

# no generation models, no weight-generation section

# word penalty
[weight-w]
-1

[distortion-limit]
6

Any ideas?
Thanks
SG
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Problem with tuning

2010-09-27 Thread Miles Osborne
looking at your output:
>[ERROR] Malformed input at
 Expected input to have words composed of 1 factor(s) (form FAC1|FAC2|...)
 but instead received input with 0 factor(s).
sh: line 1:  5114 Aborted
>

make sure you have no bar (|) characters in the data

Miles


On 27 September 2010 14:45, Souhir Gahbiche  wrote:
> Hi all,
>
> I'm trying to tune my system, but the tuning stops at the first
> iteration. Here is my mert.log file:
>
> After default: -l mem_free=0.5G -hard
> Using SCRIPTS_ROOTDIR: 
> /vol/mt2/tools/nadi/moses-scripts/scripts-20090923-1833/
> SYNC distortionchecking weight-count for ttable-file
> checking weight-count for lmodel-file
> checking weight-count for distortion-file
> Executing: mkdir -p /working/tuningdev2009/mert
> Executing: 
> /vol/mt2/tools/nadi/moses-scripts/scripts-20090923-1833//training/filter-model-given-input.pl
> ./filtered /tmp/souhir
> /model/mosesdev2009.ini
> /working/tuningdev2009/ar.project-syndicate.2009-07.v1.de
> v.bw.mada.tok
> filtering the phrase tables... Fri Aug 27 16:43:10 CEST 2010
> The filtered model was ready in /working/tuningdev2009/mert/filtered,
> not doing a
> nything.
> run 1 start at Fri Aug 27 16:43:10 CEST 2010
> Parsing --decoder-flags: |-v 0|
> Saving new config to: ./run1.moses.ini
> Saved: ./run1.moses.ini
> Normalizing lambdas: 0 1 1 1 1 1 1 1 1 0.3 0.2 0.3 0.2 0
> DECODER_CFG = -w %.6f -lm %.6f -d %.6f %.6f %.6f %.6f %.6f %.6f %.6f
> -tm %.6f %.6f %.6f %.6f %.6f
>     values = 0 0.111 0.111 0.111
> 0.111 0.111 0.111 0.1
> 11 0.111 0.0333 0.0222
> 0.0333 0.0222 0
> Executing: /vol/mt2/tools/nadi/moses/moses-cmd/src/moses -v 0  -config
> filtered/moses.ini -inputtype 0 -w 0.00 -lm 0.11
>  -d 0.11 0.11 0.11 0.11 0.11 0.11 0.11 -tm
> 0.03 0.02 0.03 0.02 0.00  -n-best-li
> st run1.best100.out 100 -i
> /working/tuningdev2009/ar.project-syndicate.2009-07.v1
> .dev.bw.mada.tok > run1.out
> (1) run decoder to produce n-best lists
> params = -v 0
> decoder_config = -w 0.00 -lm 0.11 -d 0.11 0.11
> 0.11 0.11 0.11 0.11 0.11 -tm 0.03 0.0222
> 22 0.03 0.02 0.00
> Loading lexical distortion models...
> have 1 models
> Creating lexical reordering...
> weights: 0.111 0.111 0.111 0.111 0.111 0.111
> Loading table into memory...done.
> Created lexical orientation reordering
> [ERROR] Malformed input at
>  Expected input to have words composed of 1 factor(s) (form FAC1|FAC2|...)
>  but instead received input with 0 factor(s).
> sh: line 1:  5114 Aborted
> /vol/mt2/tools/nadi/moses/moses-cmd/src/moses -v 0 -config
> filtered/moses.ini -inputt
> ype 0 -w 0.00 -lm 0.11 -d 0.11 0.11 0.11 0.11
> 0.11 0.11 0.11 -tm 0.03 0.02 0.03
>  0.02 0.00 -n-best-list run1.best100.out 100 -i
> /working/tuningdev2009/ar
> .project-syndicate.2009-07.v1.dev.bw.mada.tok > run1.out
> Exit code: 134
> The decoder died. CONFIG WAS -w 0.00 -lm 0.11 -d 0.11
> 0.11 0.11 0.11 0.11 0.11 0.11 -tm 0.0
> 3 0.02 0.03 0.02 0.00
>
> The file run1.out is empty. I tried many times, but every time it
> stopps at the same level.
> I looked for the moses.ini. It works perfectly when I use two phrase tables.
>
> Here's my moses.ini used :
>
> #
> ### MOSES CONFIG FILE ###
> #
>
> # input factors
> [input-factors]
> 0
>
> # mapping steps
> [mapping]
> 0 T 0
>
> # translation tables: source-factors, target-factors, number of scores, file
> [ttable-file]
> 0 0 5 /working/model/phrase
>
> # no generation models, no generation-file section
>
> # language models: type(srilm/irstlm), factors, order, file
> [lmodel-file]
> 0 0 4 /working/lmm/newsLM+news-train08.fr.4gki.arpa.gz
>
> # limit on how many phrase translations e for each phrase f are loaded
> # 0 = all elements loaded
> [ttable-limit]
> 20
>
> # distortion (reordering) files
> [distortion-file]
> 0-0 msd-bidirectional-fe 6 /working/model/reordering-table.gz
>
> # distortion (reordering) weight
> [weight-d]
> 0.3
> 0.3
> 0.3
> 0.3
> 0.3
> 0.3
> 0.3
>
> # language model weights
> [weight-l]
> 0.5000
>
> # translation model weights
> [weight-t]
> 0.2
> 0.2
> 0.2
> 0.2
> 0.2
>
> # no generation models, no weight-generation section
>
> # word penalty
> [weight-w]
> -1
>
> [distortion-limit]
> 6
>
> Any ideas?
> Thanks
> SG
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>



-- 
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Problem with tuning

2010-09-27 Thread Souhir Gahbiche
I'm sure that there's no bar characters in the data.

SG

2010/9/27, Miles Osborne :
> looking at your output:
>>[ERROR] Malformed input at
>  Expected input to have words composed of 1 factor(s) (form FAC1|FAC2|...)
>  but instead received input with 0 factor(s).
> sh: line 1:  5114 Aborted
>>
>
> make sure you have no bar (|) characters in the data
>
> Miles
>
>
> On 27 September 2010 14:45, Souhir Gahbiche  wrote:
>> Hi all,
>>
>> I'm trying to tune my system, but the tuning stops at the first
>> iteration. Here is my mert.log file:
>>
>> After default: -l mem_free=0.5G -hard
>> Using SCRIPTS_ROOTDIR:
>> /vol/mt2/tools/nadi/moses-scripts/scripts-20090923-1833/
>> SYNC distortionchecking weight-count for ttable-file
>> checking weight-count for lmodel-file
>> checking weight-count for distortion-file
>> Executing: mkdir -p /working/tuningdev2009/mert
>> Executing:
>> /vol/mt2/tools/nadi/moses-scripts/scripts-20090923-1833//training/filter-model-given-input.pl
>> ./filtered /tmp/souhir
>> /model/mosesdev2009.ini
>> /working/tuningdev2009/ar.project-syndicate.2009-07.v1.de
>> v.bw.mada.tok
>> filtering the phrase tables... Fri Aug 27 16:43:10 CEST 2010
>> The filtered model was ready in /working/tuningdev2009/mert/filtered,
>> not doing a
>> nything.
>> run 1 start at Fri Aug 27 16:43:10 CEST 2010
>> Parsing --decoder-flags: |-v 0|
>> Saving new config to: ./run1.moses.ini
>> Saved: ./run1.moses.ini
>> Normalizing lambdas: 0 1 1 1 1 1 1 1 1 0.3 0.2 0.3 0.2 0
>> DECODER_CFG = -w %.6f -lm %.6f -d %.6f %.6f %.6f %.6f %.6f %.6f %.6f
>> -tm %.6f %.6f %.6f %.6f %.6f
>>     values = 0 0.111 0.111 0.111
>> 0.111 0.111 0.111 0.1
>> 11 0.111 0.0333 0.0222
>> 0.0333 0.0222 0
>> Executing: /vol/mt2/tools/nadi/moses/moses-cmd/src/moses -v 0  -config
>> filtered/moses.ini -inputtype 0 -w 0.00 -lm 0.11
>>  -d 0.11 0.11 0.11 0.11 0.11 0.11 0.11 -tm
>> 0.03 0.02 0.03 0.02 0.00  -n-best-li
>> st run1.best100.out 100 -i
>> /working/tuningdev2009/ar.project-syndicate.2009-07.v1
>> .dev.bw.mada.tok > run1.out
>> (1) run decoder to produce n-best lists
>> params = -v 0
>> decoder_config = -w 0.00 -lm 0.11 -d 0.11 0.11
>> 0.11 0.11 0.11 0.11 0.11 -tm 0.03 0.0222
>> 22 0.03 0.02 0.00
>> Loading lexical distortion models...
>> have 1 models
>> Creating lexical reordering...
>> weights: 0.111 0.111 0.111 0.111 0.111 0.111
>> Loading table into memory...done.
>> Created lexical orientation reordering
>> [ERROR] Malformed input at
>>  Expected input to have words composed of 1 factor(s) (form FAC1|FAC2|...)
>>  but instead received input with 0 factor(s).
>> sh: line 1:  5114 Aborted
>> /vol/mt2/tools/nadi/moses/moses-cmd/src/moses -v 0 -config
>> filtered/moses.ini -inputt
>> ype 0 -w 0.00 -lm 0.11 -d 0.11 0.11 0.11 0.11
>> 0.11 0.11 0.11 -tm 0.03 0.02 0.03
>>  0.02 0.00 -n-best-list run1.best100.out 100 -i
>> /working/tuningdev2009/ar
>> .project-syndicate.2009-07.v1.dev.bw.mada.tok > run1.out
>> Exit code: 134
>> The decoder died. CONFIG WAS -w 0.00 -lm 0.11 -d 0.11
>> 0.11 0.11 0.11 0.11 0.11 0.11 -tm 0.0
>> 3 0.02 0.03 0.02 0.00
>>
>> The file run1.out is empty. I tried many times, but every time it
>> stopps at the same level.
>> I looked for the moses.ini. It works perfectly when I use two phrase
>> tables.
>>
>> Here's my moses.ini used :
>>
>> #
>> ### MOSES CONFIG FILE ###
>> #
>>
>> # input factors
>> [input-factors]
>> 0
>>
>> # mapping steps
>> [mapping]
>> 0 T 0
>>
>> # translation tables: source-factors, target-factors, number of scores,
>> file
>> [ttable-file]
>> 0 0 5 /working/model/phrase
>>
>> # no generation models, no generation-file section
>>
>> # language models: type(srilm/irstlm), factors, order, file
>> [lmodel-file]
>> 0 0 4 /working/lmm/newsLM+news-train08.fr.4gki.arpa.gz
>>
>> # limit on how many phrase translations e for each phrase f are loaded
>> # 0 = all elements loaded
>> [ttable-limit]
>> 20
>>
>> # distortion (reordering) files
>> [distortion-file]
>> 0-0 msd-bidirectional-fe 6 /working/model/reordering-table.gz
>>
>> # distortion (reordering) weight
>> [weight-d]
>> 0.3
>> 0.3
>> 0.3
>> 0.3
>> 0.3
>> 0.3
>> 0.3
>>
>> # language model weights
>> [weight-l]
>> 0.5000
>>
>> # translation model weights
>> [weight-t]
>> 0.2
>> 0.2
>> 0.2
>> 0.2
>> 0.2
>>
>> # no generation models, no weight-generation section
>>
>> # word penalty
>> [weight-w]
>> -1
>>
>> [distortion-limit]
>> 6
>>
>> Any ideas?
>> Thanks
>> SG
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>
>
> --
> The Univ

Re: [Moses-support] Problem with tuning

2010-09-27 Thread Hieu Hoang
  grep your model files. I'm pretty sure there's a | character in there 
somewhere

On 27/09/2010 15:02, Souhir Gahbiche wrote:
> I'm sure that there's no bar characters in the data.
>
> SG
>
> 2010/9/27, Miles Osborne:
>> looking at your output:
>>> [ERROR] Malformed input at
>>   Expected input to have words composed of 1 factor(s) (form FAC1|FAC2|...)
>>   but instead received input with 0 factor(s).
>> sh: line 1:  5114 Aborted
>> make sure you have no bar (|) characters in the data
>>
>> Miles
>>
>>
>> On 27 September 2010 14:45, Souhir Gahbiche  wrote:
>>> Hi all,
>>>
>>> I'm trying to tune my system, but the tuning stops at the first
>>> iteration. Here is my mert.log file:
>>>
>>> After default: -l mem_free=0.5G -hard
>>> Using SCRIPTS_ROOTDIR:
>>> /vol/mt2/tools/nadi/moses-scripts/scripts-20090923-1833/
>>> SYNC distortionchecking weight-count for ttable-file
>>> checking weight-count for lmodel-file
>>> checking weight-count for distortion-file
>>> Executing: mkdir -p /working/tuningdev2009/mert
>>> Executing:
>>> /vol/mt2/tools/nadi/moses-scripts/scripts-20090923-1833//training/filter-model-given-input.pl
>>> ./filtered /tmp/souhir
>>> /model/mosesdev2009.ini
>>> /working/tuningdev2009/ar.project-syndicate.2009-07.v1.de
>>> v.bw.mada.tok
>>> filtering the phrase tables... Fri Aug 27 16:43:10 CEST 2010
>>> The filtered model was ready in /working/tuningdev2009/mert/filtered,
>>> not doing a
>>> nything.
>>> run 1 start at Fri Aug 27 16:43:10 CEST 2010
>>> Parsing --decoder-flags: |-v 0|
>>> Saving new config to: ./run1.moses.ini
>>> Saved: ./run1.moses.ini
>>> Normalizing lambdas: 0 1 1 1 1 1 1 1 1 0.3 0.2 0.3 0.2 0
>>> DECODER_CFG = -w %.6f -lm %.6f -d %.6f %.6f %.6f %.6f %.6f %.6f %.6f
>>> -tm %.6f %.6f %.6f %.6f %.6f
>>>  values = 0 0.111 0.111 0.111
>>> 0.111 0.111 0.111 0.1
>>> 11 0.111 0.0333 0.0222
>>> 0.0333 0.0222 0
>>> Executing: /vol/mt2/tools/nadi/moses/moses-cmd/src/moses -v 0  -config
>>> filtered/moses.ini -inputtype 0 -w 0.00 -lm 0.11
>>>   -d 0.11 0.11 0.11 0.11 0.11 0.11 0.11 -tm
>>> 0.03 0.02 0.03 0.02 0.00  -n-best-li
>>> st run1.best100.out 100 -i
>>> /working/tuningdev2009/ar.project-syndicate.2009-07.v1
>>> .dev.bw.mada.tok>  run1.out
>>> (1) run decoder to produce n-best lists
>>> params = -v 0
>>> decoder_config = -w 0.00 -lm 0.11 -d 0.11 0.11
>>> 0.11 0.11 0.11 0.11 0.11 -tm 0.03 0.0222
>>> 22 0.03 0.02 0.00
>>> Loading lexical distortion models...
>>> have 1 models
>>> Creating lexical reordering...
>>> weights: 0.111 0.111 0.111 0.111 0.111 0.111
>>> Loading table into memory...done.
>>> Created lexical orientation reordering
>>> [ERROR] Malformed input at
>>>   Expected input to have words composed of 1 factor(s) (form FAC1|FAC2|...)
>>>   but instead received input with 0 factor(s).
>>> sh: line 1:  5114 Aborted
>>> /vol/mt2/tools/nadi/moses/moses-cmd/src/moses -v 0 -config
>>> filtered/moses.ini -inputt
>>> ype 0 -w 0.00 -lm 0.11 -d 0.11 0.11 0.11 0.11
>>> 0.11 0.11 0.11 -tm 0.03 0.02 0.03
>>>   0.02 0.00 -n-best-list run1.best100.out 100 -i
>>> /working/tuningdev2009/ar
>>> .project-syndicate.2009-07.v1.dev.bw.mada.tok>  run1.out
>>> Exit code: 134
>>> The decoder died. CONFIG WAS -w 0.00 -lm 0.11 -d 0.11
>>> 0.11 0.11 0.11 0.11 0.11 0.11 -tm 0.0
>>> 3 0.02 0.03 0.02 0.00
>>>
>>> The file run1.out is empty. I tried many times, but every time it
>>> stopps at the same level.
>>> I looked for the moses.ini. It works perfectly when I use two phrase
>>> tables.
>>>
>>> Here's my moses.ini used :
>>>
>>> #
>>> ### MOSES CONFIG FILE ###
>>> #
>>>
>>> # input factors
>>> [input-factors]
>>> 0
>>>
>>> # mapping steps
>>> [mapping]
>>> 0 T 0
>>>
>>> # translation tables: source-factors, target-factors, number of scores,
>>> file
>>> [ttable-file]
>>> 0 0 5 /working/model/phrase
>>>
>>> # no generation models, no generation-file section
>>>
>>> # language models: type(srilm/irstlm), factors, order, file
>>> [lmodel-file]
>>> 0 0 4 /working/lmm/newsLM+news-train08.fr.4gki.arpa.gz
>>>
>>> # limit on how many phrase translations e for each phrase f are loaded
>>> # 0 = all elements loaded
>>> [ttable-limit]
>>> 20
>>>
>>> # distortion (reordering) files
>>> [distortion-file]
>>> 0-0 msd-bidirectional-fe 6 /working/model/reordering-table.gz
>>>
>>> # distortion (reordering) weight
>>> [weight-d]
>>> 0.3
>>> 0.3
>>> 0.3
>>> 0.3
>>> 0.3
>>> 0.3
>>> 0.3
>>>
>>> # language model weights
>>> [weight-l]
>>> 0.5000
>>>
>>> # translation model weights
>>> [weight-t]
>>> 0.2
>>> 0.2
>>> 0.2
>>> 0.2
>>> 0.2
>>>
>>> # no generation models, no weight-generation section
>>>
>>> # wor

[Moses-support] Latest version of Moses for Mere Mortals published

2010-09-27 Thread Hilario Leal Fontes
Dear Moses users,

The latest version (1.15) of Moses for Mere Mortals (MMM) has been
published.
Main changes:
* MMM is now hosted in the Moses project
* works with Ubuntu 10.04 LTS
* uses the new version of Moses published/updated on 13/14 August 2010.
Link:
http://mosesdecoder.svn.sourceforge.net/viewvc/mosesdecoder/trunk/scripts/moses-for-mere-mortals/

For more info on MMM, please read below.

Regards,
Hilário Leal FontesMaria José MachadoJoão Rosas

MOSES FOR MERE MORTALS - A PROTOTYPE OF A REAL WORLD TRANSLATION CHAIN
MMM is a set of scripts that enables a quick installation, in a single step,
of Moses Machine Translation System and the training of large corpora, the
translation of documents and the automatic (BLEU and NIST) scoring of its
output.

MMM enables the use, in a simple way, of very large corpora and is being
used for that purpose (translation for real translators) in our working
environment. We have therefore coupled it with two Windows add-ins that
enable the conversion of TMX files into Moses corpora and
also the conversion of Moses translations into TMX files that can be
used with a translation memory tool.

MMM has been tested with Ubuntu 10.04 LTS and the Moses version published on
August 13, 2010 and updated on August 14, 2010.

A) SOME CHARACTERISTICS:

1) Compiles all the packages used by these scripts with a single
instruction;
2) Removes control characters from the input files (these can crash a
training);
3) Extracts from the corpus files 2 test files by pseudorandomly selecting
non-consecutive segments that are erased from the corpus files;
4) A new training does not interfere with the files of a previous training;
5) A new training reuses as much as possible the files created in previous
trainings (thus saving time);
6) Detects inversions of corpora (e.g., from en-pt to pt-en), allowing a
much quicker training than that of the original language pair (also checks
that the inverse training is correct);
7) Stops with an informative message if any of the phases of training
(language model building, recaser training, corpus training, memory-mapping,
tuning or training test) doesn't produce the expected results;
8) Can limit the duration of tuning;
9) Generates the BLEU and NIST scores of a translation or of a set of
translations placed in a single directory (either for each whole document or
for each segment of it);
10) Allows you to transfer your trainings to someone else's computer or to
another Moses installation in the same computer;
11) All the mkcls, GIZA and MGIZA parameters can be controlled through
parameters of the train script;
12) Selected parameters of the Moses scripts and the Moses decoder can be
controlled with the train and translate scripts.

B) MOSES VERY SIMPLE DEMO
-
MMM is meant to quickly allow getting results with Moses. It can be placed
anywhere on the hard disk of a computer and then each of its several scripts
can be run with a single command:
a) create (in order to compile Moses and the packages it uses with a single
command);
b) make-test-files;
c) train;
d) translate;
e) score the translation(s) you got; and
f) transfer trained corpora between users or to other places of your disk.

MMM uses non-factored training, a type of training that in our experience
already produces good results in a significant number of language pairs, and
mainly with non-morphologically rich languages or with language pairs in
which the target language is not morphologically rich. A
Quick-Start-Guide helps to quickly get the feel of it and start getting
results.

It comes with a small demo corpus, too small to do justice to the quality
that Moses can achieve, but sufficient to get a general overview of SMT and
an idea of how useful Moses can be.
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support