Re: [Moses-support] Tuning with no language model

[Read, James C]

The following command works fine for when a language model is specified. 
Deleting the line KENLM lazyken=0 name=LM0 factor=0 path=$PWD/blm.en order=3
 causes the script to fail with error:


ERROR: Failed to run '/pathtomoses/mosesdecoder/bin/moses  -config 
/pathtodata/binarised/moses.ini -show-weights'. at 
/pathtomoses/mosesdecoder/scripts/training/mert-moses.pl line 1744.


#
### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0

[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4 
path=/pathtodata/binarised/phrase-table input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6 
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 
path=/pathtodata/binarised/reordering-table
Distortion
KENLM lazyken=0 name=LM0 factor=0 path=/pathtodata/blm.en order=3

# dense weights for feature functions
[weight]
# The default weights are NOT optimized for translation quality. You MUST tune 
the weights.
# Documentation for tuning is here: 
http://www.statmt.org/moses/?n=FactoredTraining.Tuning
UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3
LM0= 0.5

 /pathtomoses/mosesdecoder/scripts/training/mert-moses.pl 
-no-filter-phrase-table true.fr true.en /pathtomoses/mosesdecoder/bin/moses 
binarised/moses.ini --mertdir /pathtomoses/mosesdecoder/bin/

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Tuning with no language model

[Hieu Hoang]

Can you please send me the moses.ini file you're using and the exact 
command you're executing.


You should be able to tune without a LM. I've done it myself a couple of 
years ago. There's no distinction between a LM and any other feature 
function


On 13/01/16 13:22, Read, James C wrote:


Returning to an old discussion we once had on this list.


I've tried to tune some systems with no reference in the configuration 
file to a language model so that I can do Moses justice when comparing 
it to a number of lines of work I have done that use only translation 
models and various schemes of phrase table filtering.



It seems that the tuning script will not run when supplied with a 
config file minus a reference to a language model. I could run a 
baseline with the weights learned from tuning with a config file but 
again this would be almost as meaningless as comparing my work against 
a Moses system with default weights as the weights would not be 
optimised to a system with no language model. I'm trying to come up 
with some kind of work around so that I can make a TM only Moses based 
baseline with sensible weights in the config file that are optimised 
to a TM only situation (no LM). I'm running short of ideas about how 
best to approach this.



I was wondering if the following approach might work. If I was to make 
some kind of minimal dummy LM file with only one entry for some work 
which doesn't exist would that be enough to fool the MERT script to 
run so I could get some sensible weights optimised to a no LM scenario?



I'm open to any other suggestions of how I can obtain such weights if 
anybody knows a clever way of doing this.



Just to be clear this support request is not an invitation to discuss 
whether or not one would want to tune a system with no language model 
or not.




___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


--
Hieu Hoang
http://www.hoang.co.uk/hieu

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Tuning with no language model

[Hieu Hoang]

there lies your problem. There's a weight for a non-existant feature 
function


On 13/01/16 13:57, Read, James C wrote:


no




*From:* Hieu Hoang <hieuho...@gmail.com>
*Sent:* Wednesday, January 13, 2016 1:56 PM
*To:* Read, James C; Moses Support
*Subject:* Re: [Moses-support] Tuning with no language model
did you delete the line
  LM0= 0.5
too?

On 13/01/16 13:53, Read, James C wrote:


The following command works fine for when a language model is 
specified. Deleting the line KENLM lazyken=0 name=LM0 factor=0 
path=$PWD/blm.en order=3

 causes the script to fail with error:


ERROR: Failed to run '/pathtomoses/mosesdecoder/bin/moses  -config 
/pathtodata/binarised/moses.ini -show-weights'. at 
/pathtomoses/mosesdecoder/scripts/training/mert-moses.pl line 1744.



#
### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0

[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4 
path=/pathtodata/binarised/phrase-table input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6 
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 
path=/pathtodata/binarised/reordering-table

Distortion
KENLM lazyken=0 name=LM0 factor=0 path=/pathtodata/blm.en order=3

# dense weights for feature functions
[weight]
# The default weights are NOT optimized for translation quality. You 
MUST tune the weights.
# Documentation for tuning is here: 
http://www.statmt.org/moses/?n=FactoredTraining.Tuning

<http://www.statmt.org/moses/?n=FactoredTraining.Tuning>

Moses - FactoredTraining/Tuning 
<http://www.statmt.org/moses/?n=FactoredTraining.Tuning>

www.statmt.org
Tuning. Overview. During decoding, Moses scores translation 
hypotheses using a linear model. In the traditional approach, the 
features of the model are the ...



UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3
LM0= 0.5

 /pathtomoses/mosesdecoder/scripts/training/mert-moses.pl 
-no-filter-phrase-table true.fr true.en 
/pathtomoses/mosesdecoder/bin/moses binarised/moses.ini --mertdir 
/pathtomoses/mosesdecoder/bin/


--
Hieu Hoang
http://www.hoang.co.uk/hieu


--
Hieu Hoang
http://www.hoang.co.uk/hieu

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Tuning with no language model

[Read, James C]

So now I get the following error:



Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Loading Distortion0
Loading TranslationModel0
LM0
The following weights have no feature function. Maybe incorrectly spelt 
weights: LM0,Exit code: 1


I didn't get this error without deleting LM0 line.


From: Hieu Hoang <hieuho...@gmail.com>
Sent: Wednesday, January 13, 2016 1:58 PM
To: Read, James C; Moses Support
Subject: Re: [Moses-support] Tuning with no language model

there lies your problem. There's a weight for a non-existant feature function

On 13/01/16 13:57, Read, James C wrote:

no



From: Hieu Hoang <hieuho...@gmail.com><mailto:hieuho...@gmail.com>
Sent: Wednesday, January 13, 2016 1:56 PM
To: Read, James C; Moses Support
Subject: Re: [Moses-support] Tuning with no language model

did you delete the line
  LM0= 0.5
too?

On 13/01/16 13:53, Read, James C wrote:

The following command works fine for when a language model is specified. 
Deleting the line KENLM lazyken=0 name=LM0 factor=0 path=$PWD/blm.en order=3
 causes the script to fail with error:


ERROR: Failed to run '/pathtomoses/mosesdecoder/bin/moses  -config 
/pathtodata/binarised/moses.ini -show-weights'. at 
/pathtomoses/mosesdecoder/scripts/training/mert-moses.pl line 1744.


#
### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0

[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4 
path=/pathtodata/binarised/phrase-table input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6 
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 
path=/pathtodata/binarised/reordering-table
Distortion
KENLM lazyken=0 name=LM0 factor=0 path=/pathtodata/blm.en order=3

# dense weights for feature functions
[weight]
# The default weights are NOT optimized for translation quality. You MUST tune 
the weights.
# Documentation for tuning is here: 
<http://www.statmt.org/moses/?n=FactoredTraining.Tuning> 
http://www.statmt.org/moses/?n=FactoredTraining.Tuning
[http://www.statmt.org/moses/img/coin-tiny.png]<http://www.statmt.org/moses/?n=FactoredTraining.Tuning>

Moses - 
FactoredTraining/Tuning<http://www.statmt.org/moses/?n=FactoredTraining.Tuning>
www.statmt.org<http://www.statmt.org>
Tuning. Overview. During decoding, Moses scores translation hypotheses using a 
linear model. In the traditional approach, the features of the model are the ...


UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3
LM0= 0.5

 /pathtomoses/mosesdecoder/scripts/training/mert-moses.pl 
-no-filter-phrase-table true.fr true.en /pathtomoses/mosesdecoder/bin/moses 
binarised/moses.ini --mertdir /pathtomoses/mosesdecoder/bin/


--
Hieu Hoang
http://www.hoang.co.uk/hieu


--
Hieu Hoang
http://www.hoang.co.uk/hieu
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Tuning with no language model

[Read, James C]

The following command works fine for when a language model is specified. 
Deleting the line KENLM lazyken=0 name=LM0 factor=0 path=/pathtodata/blm.en 
order=3

  causes the script to fail with error:


ERROR: Failed to run '/pathtomoses/mosesdecoder/bin/moses  -config 
/pathtodata/binarised/moses.ini -show-weights'. at 
/pathtomoses/mosesdecoder/scripts/training/mert-moses.pl line 1744.


#
### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0

[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4 
path=/pathtodata/binarised/phrase-table input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6 
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 
path=/pathtodata/binarised/reordering-table
Distortion
KENLM lazyken=0 name=LM0 factor=0 path=/pathtodata/blm.en order=3

# dense weights for feature functions
[weight]
# The default weights are NOT optimized for translation quality. You MUST tune 
the weights.
# Documentation for tuning is here: 
http://www.statmt.org/moses/?n=FactoredTraining.Tuning
UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3
LM0= 0.5

 /pathtomoses/mosesdecoder/scripts/training/mert-moses.pl 
-no-filter-phrase-table true.fr true.en /pathtomoses/mosesdecoder/bin/moses 
binarised/moses.ini --mertdir /pathtomoses/mosesdecoder/bin/

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Tuning with no language model

[Read, James C]

no



From: Hieu Hoang <hieuho...@gmail.com>
Sent: Wednesday, January 13, 2016 1:56 PM
To: Read, James C; Moses Support
Subject: Re: [Moses-support] Tuning with no language model

did you delete the line
  LM0= 0.5
too?

On 13/01/16 13:53, Read, James C wrote:

The following command works fine for when a language model is specified. 
Deleting the line KENLM lazyken=0 name=LM0 factor=0 path=$PWD/blm.en order=3
 causes the script to fail with error:


ERROR: Failed to run '/pathtomoses/mosesdecoder/bin/moses  -config 
/pathtodata/binarised/moses.ini -show-weights'. at 
/pathtomoses/mosesdecoder/scripts/training/mert-moses.pl line 1744.


#
### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0

[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4 
path=/pathtodata/binarised/phrase-table input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6 
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 
path=/pathtodata/binarised/reordering-table
Distortion
KENLM lazyken=0 name=LM0 factor=0 path=/pathtodata/blm.en order=3

# dense weights for feature functions
[weight]
# The default weights are NOT optimized for translation quality. You MUST tune 
the weights.
# Documentation for tuning is here: 
http://www.statmt.org/moses/?n=FactoredTraining.Tuning
[http://www.statmt.org/moses/img/coin-tiny.png]<http://www.statmt.org/moses/?n=FactoredTraining.Tuning>

Moses - 
FactoredTraining/Tuning<http://www.statmt.org/moses/?n=FactoredTraining.Tuning>
www.statmt.org
Tuning. Overview. During decoding, Moses scores translation hypotheses using a 
linear model. In the traditional approach, the features of the model are the ...


UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3
LM0= 0.5

 /pathtomoses/mosesdecoder/scripts/training/mert-moses.pl 
-no-filter-phrase-table true.fr true.en /pathtomoses/mosesdecoder/bin/moses 
binarised/moses.ini --mertdir /pathtomoses/mosesdecoder/bin/


--
Hieu Hoang
http://www.hoang.co.uk/hieu
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Tuning with no language model

[Hieu Hoang]

please show me the EXACT moses.ini and command that you use.




Hieu Hoang
http://www.hoang.co.uk/hieu

On 13 January 2016 at 14:04, Read, James C <jcr...@essex.ac.uk> wrote:

> So now I get the following error:
>
>
>
> Loading UnknownWordPenalty0
> Loading WordPenalty0
> Loading PhrasePenalty0
> Loading LexicalReordering0
> Loading Distortion0
> Loading TranslationModel0
> LM0
> The following weights have no feature function. Maybe incorrectly spelt
> weights: LM0,Exit code: 1
>
> I didn't get this error without deleting LM0 line.
>
> --
> *From:* Hieu Hoang <hieuho...@gmail.com>
> *Sent:* Wednesday, January 13, 2016 1:58 PM
>
> *To:* Read, James C; Moses Support
> *Subject:* Re: [Moses-support] Tuning with no language model
>
> there lies your problem. There's a weight for a non-existant feature
> function
>
> On 13/01/16 13:57, Read, James C wrote:
>
> no
>
>
> --
> *From:* Hieu Hoang <hieuho...@gmail.com> <hieuho...@gmail.com>
> *Sent:* Wednesday, January 13, 2016 1:56 PM
> *To:* Read, James C; Moses Support
> *Subject:* Re: [Moses-support] Tuning with no language model
>
> did you delete the line
>   LM0= 0.5
> too?
>
> On 13/01/16 13:53, Read, James C wrote:
>
> The following command works fine for when a language model is specified.
> Deleting the line KENLM lazyken=0 name=LM0 factor=0 path=$PWD/blm.en order=3
>  causes the script to fail with error:
>
>
> ERROR: Failed to run '/pathtomoses/mosesdecoder/bin/moses  -config
> /pathtodata/binarised/moses.ini -show-weights'. at
> /pathtomoses/mosesdecoder/scripts/training/mert-moses.pl line 1744.
>
>
> #
> ### MOSES CONFIG FILE ###
> #
>
> # input factors
> [input-factors]
> 0
>
> # mapping steps
> [mapping]
> 0 T 0
>
> [distortion-limit]
> 6
>
> # feature functions
> [feature]
> UnknownWordPenalty
> WordPenalty
> PhrasePenalty
> PhraseDictionaryCompact name=TranslationModel0 num-features=4
> path=/pathtodata/binarised/phrase-table input-factor=0 output-factor=0
> LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/pathtodata/binarised/reordering-table
> Distortion
> KENLM lazyken=0 name=LM0 factor=0 path=/pathtodata/blm.en order=3
>
> # dense weights for feature functions
> [weight]
> # The default weights are NOT optimized for translation quality. You MUST
> tune the weights.
> # Documentation for tuning is here:
> <http://www.statmt.org/moses/?n=FactoredTraining.Tuning>
> http://www.statmt.org/moses/?n=FactoredTraining.Tuning
> <http://www.statmt.org/moses/?n=FactoredTraining.Tuning>
> Moses - FactoredTraining/Tuning
> <http://www.statmt.org/moses/?n=FactoredTraining.Tuning>
> www.statmt.org
> Tuning. Overview. During decoding, Moses scores translation hypotheses
> using a linear model. In the traditional approach, the features of the
> model are the ...
>
> UnknownWordPenalty0= 1
> WordPenalty0= -1
> PhrasePenalty0= 0.2
> TranslationModel0= 0.2 0.2 0.2 0.2
> LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
> Distortion0= 0.3
> LM0= 0.5
>
>  /pathtomoses/mosesdecoder/scripts/training/mert-moses.pl
> -no-filter-phrase-table true.fr true.en
> /pathtomoses/mosesdecoder/bin/moses binarised/moses.ini --mertdir
> /pathtomoses/mosesdecoder/bin/
>
>
> --
> Hieu Hoanghttp://www.hoang.co.uk/hieu
>
>
> --
> Hieu Hoanghttp://www.hoang.co.uk/hieu
>
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Tuning with no language model

[Hieu Hoang]

looks fine to me. This is what I get when I used it to run
  # $MOSES_DIR/bin/moses -f moses.ini -show-weights
   
LexicalReordering0= 0.30 0.30 0.30 0.30 0.30 0.30
Distortion0= 0.30
UnknownWordPenalty0 UNTUNEABLE
WordPenalty0= -1.00
PhrasePenalty0= 0.20
TranslationModel0= 0.20 0.20 0.20 0.20

Double check that the moses.ini file you sent me is truly what you're using.

To be sure, you MUST use absolute paths for all file names, ie. not
  binarised/moses-tm.ini
but
  /media/bigdata/whatever/binarised/moses-tm.ini

On 13/01/16 14:16, Read, James C wrote:


#
### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0

[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4 
path=/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/phrase-table 
input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6 
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 
path=/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/reordering-table

Distortion

# dense weights for feature functions
[weight]
# The default weights are NOT optimized for translation quality. You 
MUST tune the weights.
# Documentation for tuning is here: 
http://www.statmt.org/moses/?n=FactoredTraining.Tuning

UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3


/media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/mert-moses.pl 
-no-filter-phrase-table ../tuning_data/true.bg ../tuning_data/true.en 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses 
binarised/moses-tm.ini --mertdir 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/





*From:* Hieu Hoang <hieuho...@gmail.com>
*Sent:* Wednesday, January 13, 2016 2:05 PM
*To:* Read, James C
*Cc:* Moses Support
*Subject:* Re: [Moses-support] Tuning with no language model
please show me the EXACT moses.ini and command that you use.




Hieu Hoang
http://www.hoang.co.uk/hieu

On 13 January 2016 at 14:04, Read, James C <jcr...@essex.ac.uk 
<mailto:jcr...@essex.ac.uk>> wrote:


So now I get the following error:



Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Loading Distortion0
Loading TranslationModel0
LM0
The following weights have no feature function. Maybe incorrectly
spelt weights: LM0,Exit code: 1

I didn't get this error without deleting LM0 line.



*From:* Hieu Hoang <hieuho...@gmail.com <mailto:hieuho...@gmail.com>>
*Sent:* Wednesday, January 13, 2016 1:58 PM

*To:* Read, James C; Moses Support
    *Subject:* Re: [Moses-support] Tuning with no language model
there lies your problem. There's a weight for a non-existant
feature function

On 13/01/16 13:57, Read, James C wrote:


no




*From:* Hieu Hoang <hieuho...@gmail.com> <mailto:hieuho...@gmail.com>
*Sent:* Wednesday, January 13, 2016 1:56 PM
*To:* Read, James C; Moses Support
*Subject:* Re: [Moses-support] Tuning with no language model
did you delete the line
  LM0= 0.5
too?

On 13/01/16 13:53, Read, James C wrote:


The following command works fine for when a language model is
specified. Deleting the line KENLM lazyken=0 name=LM0 factor=0
path=$PWD/blm.en order=3
 causes the script to fail with error:


ERROR: Failed to run '/pathtomoses/mosesdecoder/bin/moses
-config /pathtodata/binarised/moses.ini -show-weights'. at
/pathtomoses/mosesdecoder/scripts/training/mert-moses.pl
<http://mert-moses.pl> line 1744.


#
### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0

[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4
path=/pathtodata/binarised/phrase-table input-factor=0
output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0
output-factor=0 path=/pathtodata/binarised/reordering-table
Distortion
KENLM lazyken=0 name=LM0 factor=0 path=/pathtodata/blm.en order=3

# dense weights for feature functions
[weight]
# The default weights ar

Re: [Moses-support] Tuning with no language model

[Hieu Hoang]

ok. The mert script create a temporary directory every time you run it. By
default it's named
   mert-work
Since you ran mert with an incorrect moses.ini previously, it may have
polluted the temporary directory and cause problem now.

You should find this temporary directory and delete it before running mert
again.

ps ALL directories must be absolute, eg  ../tuning_data/true.bg


Hieu Hoang
http://www.hoang.co.uk/hieu

On 13 January 2016 at 14:45, Read, James C <jcr...@essex.ac.uk> wrote:

>
> /media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data$
> /media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/
> mert-moses.pl -no-filter-phrase-table ../tuning_data/true.bg
> ../tuning_data/true.en
> /media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses
> /media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/moses-tm.ini
> --mertdir /media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/
>
> with absolute path to moses-tm.ini does not resolve the problem. Still get
> the same error.
>
> --
> *From:* Read, James C
> *Sent:* Wednesday, January 13, 2016 2:40 PM
> *To:* Hieu Hoang
>
> *Cc:* Moses Support
> *Subject:* Re: [Moses-support] Tuning with no language model
>
>
> This is what I get when I run the same command as you:
>
>
> LexicalReordering0= 0.30 0.30 0.30 0.30 0.30 0.30
> Distortion0= 0.30
> UnknownWordPenalty0 UNTUNEABLE
> WordPenalty0= -1.00
> PhrasePenalty0= 0.20
> TranslationModel0= 0.20 0.20 0.20 0.20
>
> Looks just like your output. However, this is what I get when I run the
> mert script with the following command:
>
>
> /media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data$
> /media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/
> mert-moses.pl -no-filter-phrase-table ../tuning_data/true.bg
> ../tuning_data/true.en
> /media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses
> binarised/moses-tm.ini --mertdir
> /media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/
>
>
> Loading UnknownWordPenalty0
> Loading WordPenalty0
> Loading PhrasePenalty0
> Loading LexicalReordering0
> Loading Distortion0
> Loading TranslationModel0
> LM0
> The following weights have no feature function. Maybe incorrectly spelt
> weights: LM0,Exit code: 1
> The decoder died. CONFIG WAS -weight-overwrite 'PhrasePenalty0= 0.043478
> WordPenalty0= -0.217391 TranslationModel0= 0.043478 0.043478 0.043478
> 0.043478 Distortion0= 0.065217 LM0= 0.108696 LexicalReordering0= 0.065217
> 0.065217 0.065217 0.065217 0.065217 0.065217'
>
>
>
>
>
> ------
> *From:* Hieu Hoang <hieuho...@gmail.com>
> *Sent:* Wednesday, January 13, 2016 2:27 PM
> *To:* Read, James C
> *Cc:* Moses Support
> *Subject:* Re: [Moses-support] Tuning with no language model
>
> looks fine to me. This is what I get when I used it to run
>   # $MOSES_DIR/bin/moses -f moses.ini -show-weights
>
> LexicalReordering0= 0.30 0.30 0.30 0.30 0.30 0.30
> Distortion0= 0.30
> UnknownWordPenalty0 UNTUNEABLE
> WordPenalty0= -1.00
> PhrasePenalty0= 0.20
> TranslationModel0= 0.20 0.20 0.20 0.20
>
> Double check that the moses.ini file you sent me is truly what you're
> using.
>
> To be sure, you MUST use absolute paths for all file names, ie. not
>   binarised/moses-tm.ini
> but
>   /media/bigdata/whatever/binarised/moses-tm.ini
>
> On 13/01/16 14:16, Read, James C wrote:
>
> #
> ### MOSES CONFIG FILE ###
> #
>
> # input factors
> [input-factors]
> 0
>
> # mapping steps
> [mapping]
> 0 T 0
>
> [distortion-limit]
> 6
>
> # feature functions
> [feature]
> UnknownWordPenalty
> WordPenalty
> PhrasePenalty
> PhraseDictionaryCompact name=TranslationModel0 num-features=4
> path=/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/phrase-table
> input-factor=0 output-factor=0
> LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/reordering-table
> Distortion
>
> # dense weights for feature functions
> [weight]
> # The default weights are NOT optimized for translation quality. You MUST
> tune the weights.
> # Documentation for tuning is here:
> http://www.statmt.org/moses/?n=FactoredTraining.Tuning
> <http://www.statmt.org/moses/?n=FactoredTraining.Tuning>
> Moses - FactoredTrainin

Re: [Moses-support] Tuning with no language model

[Read, James C]

Thanks,


and if I wanted Moses to use one feature of TM alone I'm guessing there's no 
way to do this other than zeroing out the undesired TM features?



From: Hieu Hoang <hieuho...@gmail.com>
Sent: Wednesday, January 13, 2016 3:05 PM
To: Read, James C
Cc: Moses Support
Subject: Re: [Moses-support] Tuning with no language model

you can delete all feature functions except for the UnknownWordPenalty. In the 
current moses, thats hardcoded into decoding. So be my guest and delete away!

Hieu Hoang
http://www.hoang.co.uk/hieu

On 13 January 2016 at 15:02, Read, James C 
<jcr...@essex.ac.uk<mailto:jcr...@essex.ac.uk>> wrote:

OK, looks like it's running. Probably won't be able to see if it generates 
useful weights until tomorrow. Thanks.


As a side line of thought. I was wondering how many lines of configuration I 
could get away with deleting? How would Moses behave if I were to delete the 
lexical reordering lines? The distortion? The word penalty? The phrase penalty?


My goal is to get Moses to choose the best translation with reference to the 
translation model only.


If I delete these other configuration lines will Moses use defaults for these 
other options or completely disable their operation leaving just the TM?



From: Hieu Hoang <hieuho...@gmail.com<mailto:hieuho...@gmail.com>>
Sent: Wednesday, January 13, 2016 2:51 PM

To: Read, James C
Cc: Moses Support
Subject: Re: [Moses-support] Tuning with no language model

ok. The mert script create a temporary directory every time you run it. By 
default it's named
   mert-work
Since you ran mert with an incorrect moses.ini previously, it may have polluted 
the temporary directory and cause problem now.

You should find this temporary directory and delete it before running mert 
again.

ps ALL directories must be absolute, eg  ../tuning_data/true.bg<http://true.bg/>


Hieu Hoang
http://www.hoang.co.uk/hieu

On 13 January 2016 at 14:45, Read, James C 
<jcr...@essex.ac.uk<mailto:jcr...@essex.ac.uk>> wrote:


/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data$ 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/mert-moses.pl<http://mert-moses.pl>
 -no-filter-phrase-table ../tuning_data/true.bg<http://true.bg> 
../tuning_data/true.en 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses 
/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/moses-tm.ini
 --mertdir /media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/


with absolute path to moses-tm.ini does not resolve the problem. Still get the 
same error.


From: Read, James C
Sent: Wednesday, January 13, 2016 2:40 PM
To: Hieu Hoang

Cc: Moses Support
Subject: Re: [Moses-support] Tuning with no language model


This is what I get when I run the same command as you:


LexicalReordering0= 0.30 0.30 0.30 0.30 0.30 0.30
Distortion0= 0.30
UnknownWordPenalty0 UNTUNEABLE
WordPenalty0= -1.00
PhrasePenalty0= 0.20
TranslationModel0= 0.20 0.20 0.20 0.20


Looks just like your output. However, this is what I get when I run the mert 
script with the following command:


/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data$ 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/mert-moses.pl<http://mert-moses.pl>
 -no-filter-phrase-table ../tuning_data/true.bg<http://true.bg> 
../tuning_data/true.en 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses 
binarised/moses-tm.ini --mertdir 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/


Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Loading Distortion0
Loading TranslationModel0
LM0
The following weights have no feature function. Maybe incorrectly spelt 
weights: LM0,Exit code: 1
The decoder died. CONFIG WAS -weight-overwrite 'PhrasePenalty0= 0.043478 
WordPenalty0= -0.217391 TranslationModel0= 0.043478 0.043478 0.043478 0.043478 
Distortion0= 0.065217 LM0= 0.108696 LexicalReordering0= 0.065217 0.065217 
0.065217 0.065217 0.065217 0.065217'





From: Hieu Hoang <hieuho...@gmail.com<mailto:hieuho...@gmail.com>>
Sent: Wednesday, January 13, 2016 2:27 PM
To: Read, James C
Cc: Moses Support
Subject: Re: [Moses-support] Tuning with no language model

looks fine to me. This is what I get when I used it to run
  # $MOSES_DIR/bin/moses -f moses.ini -show-weights
   
LexicalReordering0= 0.30 0.30 0.30 0.30 0.30 0.30
Distortion0= 0.30
UnknownWordPenalty0 UNTUNEABLE
WordPenalty0= -1.00
PhrasePenalty0= 0.20
TranslationModel0= 0.20 0.20 0.20 0.20

Double check that the moses.ini file you sent me is truly what you're using.

To be sure, you MUST use absolute path

Re: [Moses-support] Tuning with no language model

[Read, James C]

This is what I get when I run the same command as you:


LexicalReordering0= 0.30 0.30 0.30 0.30 0.30 0.30
Distortion0= 0.30
UnknownWordPenalty0 UNTUNEABLE
WordPenalty0= -1.00
PhrasePenalty0= 0.20
TranslationModel0= 0.20 0.20 0.20 0.20


Looks just like your output. However, this is what I get when I run the mert 
script with the following command:


/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data$ 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/mert-moses.pl
 -no-filter-phrase-table ../tuning_data/true.bg ../tuning_data/true.en 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses 
binarised/moses-tm.ini --mertdir 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/


Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Loading Distortion0
Loading TranslationModel0
LM0
The following weights have no feature function. Maybe incorrectly spelt 
weights: LM0,Exit code: 1
The decoder died. CONFIG WAS -weight-overwrite 'PhrasePenalty0= 0.043478 
WordPenalty0= -0.217391 TranslationModel0= 0.043478 0.043478 0.043478 0.043478 
Distortion0= 0.065217 LM0= 0.108696 LexicalReordering0= 0.065217 0.065217 
0.065217 0.065217 0.065217 0.065217'





From: Hieu Hoang <hieuho...@gmail.com>
Sent: Wednesday, January 13, 2016 2:27 PM
To: Read, James C
Cc: Moses Support
Subject: Re: [Moses-support] Tuning with no language model

looks fine to me. This is what I get when I used it to run
  # $MOSES_DIR/bin/moses -f moses.ini -show-weights
   
LexicalReordering0= 0.30 0.30 0.30 0.30 0.30 0.30
Distortion0= 0.30
UnknownWordPenalty0 UNTUNEABLE
WordPenalty0= -1.00
PhrasePenalty0= 0.20
TranslationModel0= 0.20 0.20 0.20 0.20

Double check that the moses.ini file you sent me is truly what you're using.

To be sure, you MUST use absolute paths for all file names, ie. not
  binarised/moses-tm.ini
but
  /media/bigdata/whatever/binarised/moses-tm.ini

On 13/01/16 14:16, Read, James C wrote:

#
### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0

[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4 
path=/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/phrase-table
 input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6 
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 
path=/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/reordering-table
Distortion

# dense weights for feature functions
[weight]
# The default weights are NOT optimized for translation quality. You MUST tune 
the weights.
# Documentation for tuning is here: 
http://www.statmt.org/moses/?n=FactoredTraining.Tuning

[http://www.statmt.org/moses/img/coin-tiny.png]<http://www.statmt.org/moses/?n=FactoredTraining.Tuning>

Moses - 
FactoredTraining/Tuning<http://www.statmt.org/moses/?n=FactoredTraining.Tuning>
www.statmt.org
Tuning. Overview. During decoding, Moses scores translation hypotheses using a 
linear model. In the traditional approach, the features of the model are the ...


UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3


/media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/mert-moses.pl
 -no-filter-phrase-table ../tuning_data/true.bg ../tuning_data/true.en 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses 
binarised/moses-tm.ini --mertdir 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/



From: Hieu Hoang <hieuho...@gmail.com><mailto:hieuho...@gmail.com>
Sent: Wednesday, January 13, 2016 2:05 PM
To: Read, James C
Cc: Moses Support
Subject: Re: [Moses-support] Tuning with no language model

please show me the EXACT moses.ini and command that you use.




Hieu Hoang
http://www.hoang.co.uk/hieu

On 13 January 2016 at 14:04, Read, James C 
<jcr...@essex.ac.uk<mailto:jcr...@essex.ac.uk>> wrote:

So now I get the following error:



Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Loading Distortion0
Loading TranslationModel0
LM0
The following weights have no feature function. Maybe incorrectly spelt 
weights: LM0,Exit code: 1


I didn't get this error without deleting LM0 line.


From: Hieu Hoang <hieuho...@gmail.com<mailto:hieuho...@gmail.com>>
Sent: Wednesday, January 13, 2016 1:58 PM

To: Read, James C; Moses Support
Subject: Re: [Moses-support] Tuning with no language model

there lies you

Re: [Moses-support] Tuning with no language model

[Read, James C]

Defined parameters (per moses.ini or switch):
config: 
/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/moses-tm.ini


Found this in the output so I'm sure it's using the right config file.



From: Read, James C
Sent: Wednesday, January 13, 2016 2:45 PM
To: Hieu Hoang
Cc: Moses Support
Subject: Re: [Moses-support] Tuning with no language model



/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data$ 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/mert-moses.pl
 -no-filter-phrase-table ../tuning_data/true.bg ../tuning_data/true.en 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses 
/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/moses-tm.ini
 --mertdir /media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/


with absolute path to moses-tm.ini does not resolve the problem. Still get the 
same error.


From: Read, James C
Sent: Wednesday, January 13, 2016 2:40 PM
To: Hieu Hoang
Cc: Moses Support
Subject: Re: [Moses-support] Tuning with no language model


This is what I get when I run the same command as you:


LexicalReordering0= 0.30 0.30 0.30 0.30 0.30 0.30
Distortion0= 0.30
UnknownWordPenalty0 UNTUNEABLE
WordPenalty0= -1.00
PhrasePenalty0= 0.20
TranslationModel0= 0.20 0.20 0.20 0.20


Looks just like your output. However, this is what I get when I run the mert 
script with the following command:


/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data$ 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/mert-moses.pl
 -no-filter-phrase-table ../tuning_data/true.bg ../tuning_data/true.en 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses 
binarised/moses-tm.ini --mertdir 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/


Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Loading Distortion0
Loading TranslationModel0
LM0
The following weights have no feature function. Maybe incorrectly spelt 
weights: LM0,Exit code: 1
The decoder died. CONFIG WAS -weight-overwrite 'PhrasePenalty0= 0.043478 
WordPenalty0= -0.217391 TranslationModel0= 0.043478 0.043478 0.043478 0.043478 
Distortion0= 0.065217 LM0= 0.108696 LexicalReordering0= 0.065217 0.065217 
0.065217 0.065217 0.065217 0.065217'





From: Hieu Hoang <hieuho...@gmail.com>
Sent: Wednesday, January 13, 2016 2:27 PM
To: Read, James C
Cc: Moses Support
Subject: Re: [Moses-support] Tuning with no language model

looks fine to me. This is what I get when I used it to run
  # $MOSES_DIR/bin/moses -f moses.ini -show-weights
   
LexicalReordering0= 0.30 0.30 0.30 0.30 0.30 0.30
Distortion0= 0.30
UnknownWordPenalty0 UNTUNEABLE
WordPenalty0= -1.00
PhrasePenalty0= 0.20
TranslationModel0= 0.20 0.20 0.20 0.20

Double check that the moses.ini file you sent me is truly what you're using.

To be sure, you MUST use absolute paths for all file names, ie. not
  binarised/moses-tm.ini
but
  /media/bigdata/whatever/binarised/moses-tm.ini

On 13/01/16 14:16, Read, James C wrote:

#
### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0

[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4 
path=/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/phrase-table
 input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6 
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 
path=/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/reordering-table
Distortion

# dense weights for feature functions
[weight]
# The default weights are NOT optimized for translation quality. You MUST tune 
the weights.
# Documentation for tuning is here: 
http://www.statmt.org/moses/?n=FactoredTraining.Tuning

[http://www.statmt.org/moses/img/coin-tiny.png]<http://www.statmt.org/moses/?n=FactoredTraining.Tuning>

Moses - 
FactoredTraining/Tuning<http://www.statmt.org/moses/?n=FactoredTraining.Tuning>
www.statmt.org
Tuning. Overview. During decoding, Moses scores translation hypotheses using a 
linear model. In the traditional approach, the features of the model are the ...


UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3


/media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/mert-moses.pl
 -no-filter-phrase-table ../tuning_data/true.bg ../tuning_data/true.en 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/mose

Re: [Moses-support] Tuning with no language model

[Read, James C]

OK, looks like it's running. Probably won't be able to see if it generates 
useful weights until tomorrow. Thanks.


As a side line of thought. I was wondering how many lines of configuration I 
could get away with deleting? How would Moses behave if I were to delete the 
lexical reordering lines? The distortion? The word penalty? The phrase penalty?


My goal is to get Moses to choose the best translation with reference to the 
translation model only.


If I delete these other configuration lines will Moses use defaults for these 
other options or completely disable their operation leaving just the TM?



From: Hieu Hoang <hieuho...@gmail.com>
Sent: Wednesday, January 13, 2016 2:51 PM
To: Read, James C
Cc: Moses Support
Subject: Re: [Moses-support] Tuning with no language model

ok. The mert script create a temporary directory every time you run it. By 
default it's named
   mert-work
Since you ran mert with an incorrect moses.ini previously, it may have polluted 
the temporary directory and cause problem now.

You should find this temporary directory and delete it before running mert 
again.

ps ALL directories must be absolute, eg  ../tuning_data/true.bg<http://true.bg/>


Hieu Hoang
http://www.hoang.co.uk/hieu

On 13 January 2016 at 14:45, Read, James C 
<jcr...@essex.ac.uk<mailto:jcr...@essex.ac.uk>> wrote:


/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data$ 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/mert-moses.pl<http://mert-moses.pl>
 -no-filter-phrase-table ../tuning_data/true.bg<http://true.bg> 
../tuning_data/true.en 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses 
/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/moses-tm.ini
 --mertdir /media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/


with absolute path to moses-tm.ini does not resolve the problem. Still get the 
same error.


From: Read, James C
Sent: Wednesday, January 13, 2016 2:40 PM
To: Hieu Hoang

Cc: Moses Support
Subject: Re: [Moses-support] Tuning with no language model


This is what I get when I run the same command as you:


LexicalReordering0= 0.30 0.30 0.30 0.30 0.30 0.30
Distortion0= 0.30
UnknownWordPenalty0 UNTUNEABLE
WordPenalty0= -1.00
PhrasePenalty0= 0.20
TranslationModel0= 0.20 0.20 0.20 0.20


Looks just like your output. However, this is what I get when I run the mert 
script with the following command:


/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data$ 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/mert-moses.pl<http://mert-moses.pl>
 -no-filter-phrase-table ../tuning_data/true.bg<http://true.bg> 
../tuning_data/true.en 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses 
binarised/moses-tm.ini --mertdir 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/


Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Loading Distortion0
Loading TranslationModel0
LM0
The following weights have no feature function. Maybe incorrectly spelt 
weights: LM0,Exit code: 1
The decoder died. CONFIG WAS -weight-overwrite 'PhrasePenalty0= 0.043478 
WordPenalty0= -0.217391 TranslationModel0= 0.043478 0.043478 0.043478 0.043478 
Distortion0= 0.065217 LM0= 0.108696 LexicalReordering0= 0.065217 0.065217 
0.065217 0.065217 0.065217 0.065217'





From: Hieu Hoang <hieuho...@gmail.com<mailto:hieuho...@gmail.com>>
Sent: Wednesday, January 13, 2016 2:27 PM
To: Read, James C
Cc: Moses Support
Subject: Re: [Moses-support] Tuning with no language model

looks fine to me. This is what I get when I used it to run
  # $MOSES_DIR/bin/moses -f moses.ini -show-weights
   
LexicalReordering0= 0.30 0.30 0.30 0.30 0.30 0.30
Distortion0= 0.30
UnknownWordPenalty0 UNTUNEABLE
WordPenalty0= -1.00
PhrasePenalty0= 0.20
TranslationModel0= 0.20 0.20 0.20 0.20

Double check that the moses.ini file you sent me is truly what you're using.

To be sure, you MUST use absolute paths for all file names, ie. not
  binarised/moses-tm.ini
but
  /media/bigdata/whatever/binarised/moses-tm.ini

On 13/01/16 14:16, Read, James C wrote:

#
### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0

[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4 
path=/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/phrase-table
 input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6 
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 
path

Re: [Moses-support] Tuning with no language model

[Hieu Hoang]

you can delete all feature functions except for the UnknownWordPenalty. In
the current moses, thats hardcoded into decoding. So be my guest and delete
away!

Hieu Hoang
http://www.hoang.co.uk/hieu

On 13 January 2016 at 15:02, Read, James C <jcr...@essex.ac.uk> wrote:

> OK, looks like it's running. Probably won't be able to see if it generates
> useful weights until tomorrow. Thanks.
>
>
> As a side line of thought. I was wondering how many lines of configuration
> I could get away with deleting? How would Moses behave if I were to delete
> the lexical reordering lines? The distortion? The word penalty? The phrase
> penalty?
>
>
> My goal is to get Moses to choose the best translation with reference to
> the translation model only.
>
>
> If I delete these other configuration lines will Moses use defaults for
> these other options or completely disable their operation leaving just the
> TM?
>
>
> --
> *From:* Hieu Hoang <hieuho...@gmail.com>
> *Sent:* Wednesday, January 13, 2016 2:51 PM
>
> *To:* Read, James C
> *Cc:* Moses Support
> *Subject:* Re: [Moses-support] Tuning with no language model
>
> ok. The mert script create a temporary directory every time you run it. By
> default it's named
>mert-work
> Since you ran mert with an incorrect moses.ini previously, it may have
> polluted the temporary directory and cause problem now.
>
> You should find this temporary directory and delete it before running mert
> again.
>
> ps ALL directories must be absolute, eg  ../tuning_data/true.bg
>
>
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
> On 13 January 2016 at 14:45, Read, James C <jcr...@essex.ac.uk> wrote:
>
>>
>> /media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data$
>> /media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/
>> mert-moses.pl -no-filter-phrase-table ../tuning_data/true.bg
>> ../tuning_data/true.en
>> /media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses
>> /media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/moses-tm.ini
>> --mertdir /media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/
>>
>> with absolute path to moses-tm.ini does not resolve the problem. Still
>> get the same error.
>>
>> --
>> *From:* Read, James C
>> *Sent:* Wednesday, January 13, 2016 2:40 PM
>> *To:* Hieu Hoang
>>
>> *Cc:* Moses Support
>> *Subject:* Re: [Moses-support] Tuning with no language model
>>
>>
>> This is what I get when I run the same command as you:
>>
>>
>> LexicalReordering0= 0.30 0.30 0.30 0.30 0.30 0.30
>> Distortion0= 0.30
>> UnknownWordPenalty0 UNTUNEABLE
>> WordPenalty0= -1.00
>> PhrasePenalty0= 0.20
>> TranslationModel0= 0.20 0.20 0.20 0.20
>>
>> Looks just like your output. However, this is what I get when I run the
>> mert script with the following command:
>>
>>
>> /media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data$
>> /media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/
>> mert-moses.pl -no-filter-phrase-table ../tuning_data/true.bg
>> ../tuning_data/true.en
>> /media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses
>> binarised/moses-tm.ini --mertdir
>> /media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/
>>
>>
>> Loading UnknownWordPenalty0
>> Loading WordPenalty0
>> Loading PhrasePenalty0
>> Loading LexicalReordering0
>> Loading Distortion0
>> Loading TranslationModel0
>> LM0
>> The following weights have no feature function. Maybe incorrectly spelt
>> weights: LM0,Exit code: 1
>> The decoder died. CONFIG WAS -weight-overwrite 'PhrasePenalty0= 0.043478
>> WordPenalty0= -0.217391 TranslationModel0= 0.043478 0.043478 0.043478
>> 0.043478 Distortion0= 0.065217 LM0= 0.108696 LexicalReordering0= 0.065217
>> 0.065217 0.065217 0.065217 0.065217 0.065217'
>>
>>
>>
>>
>>
>> --
>> *From:* Hieu Hoang <hieuho...@gmail.com>
>> *Sent:* Wednesday, January 13, 2016 2:27 PM
>> *To:* Read, James C
>> *Cc:* Moses Support
>> *Subject:* Re: [Moses-support] Tuning with no language model
>>
>> looks fine to me. This is what I get when I used it to run
>>   # $MOSES_DIR/bin/moses -f moses.ini -show-weights
>>
>> LexicalReordering0= 0.30 0.30 0.30 0.30 0.30 0.30
>> Distortion0= 0.30
>> UnknownWordPenalty0 UNTUNEAB

Re: [Moses-support] Tuning with no language model

[Read, James C]

#
### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0

[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4 
path=/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/phrase-table
 input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6 
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 
path=/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/reordering-table
Distortion

# dense weights for feature functions
[weight]
# The default weights are NOT optimized for translation quality. You MUST tune 
the weights.
# Documentation for tuning is here: 
http://www.statmt.org/moses/?n=FactoredTraining.Tuning
UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3


/media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/mert-moses.pl
 -no-filter-phrase-table ../tuning_data/true.bg ../tuning_data/true.en 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses 
binarised/moses-tm.ini --mertdir 
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/



From: Hieu Hoang <hieuho...@gmail.com>
Sent: Wednesday, January 13, 2016 2:05 PM
To: Read, James C
Cc: Moses Support
Subject: Re: [Moses-support] Tuning with no language model

please show me the EXACT moses.ini and command that you use.




Hieu Hoang
http://www.hoang.co.uk/hieu

On 13 January 2016 at 14:04, Read, James C 
<jcr...@essex.ac.uk<mailto:jcr...@essex.ac.uk>> wrote:

So now I get the following error:



Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Loading Distortion0
Loading TranslationModel0
LM0
The following weights have no feature function. Maybe incorrectly spelt 
weights: LM0,Exit code: 1


I didn't get this error without deleting LM0 line.


From: Hieu Hoang <hieuho...@gmail.com<mailto:hieuho...@gmail.com>>
Sent: Wednesday, January 13, 2016 1:58 PM

To: Read, James C; Moses Support
Subject: Re: [Moses-support] Tuning with no language model

there lies your problem. There's a weight for a non-existant feature function

On 13/01/16 13:57, Read, James C wrote:

no



From: Hieu Hoang <hieuho...@gmail.com><mailto:hieuho...@gmail.com>
Sent: Wednesday, January 13, 2016 1:56 PM
To: Read, James C; Moses Support
Subject: Re: [Moses-support] Tuning with no language model

did you delete the line
  LM0= 0.5
too?

On 13/01/16 13:53, Read, James C wrote:

The following command works fine for when a language model is specified. 
Deleting the line KENLM lazyken=0 name=LM0 factor=0 path=$PWD/blm.en order=3
 causes the script to fail with error:


ERROR: Failed to run '/pathtomoses/mosesdecoder/bin/moses  -config 
/pathtodata/binarised/moses.ini -show-weights'. at 
/pathtomoses/mosesdecoder/scripts/training/mert-moses.pl<http://mert-moses.pl> 
line 1744.


#
### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0

[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4 
path=/pathtodata/binarised/phrase-table input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6 
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 
path=/pathtodata/binarised/reordering-table
Distortion
KENLM lazyken=0 name=LM0 factor=0 path=/pathtodata/blm.en order=3

# dense weights for feature functions
[weight]
# The default weights are NOT optimized for translation quality. You MUST tune 
the weights.
# Documentation for tuning is here: 
<http://www.statmt.org/moses/?n=FactoredTraining.Tuning> 
http://www.statmt.org/moses/?n=FactoredTraining.Tuning
[http://www.statmt.org/moses/img/coin-tiny.png]<http://www.statmt.org/moses/?n=FactoredTraining.Tuning>

Moses - 
FactoredTraining/Tuning<http://www.statmt.org/moses/?n=FactoredTraining.Tuning>
www.statmt.org<http://www.statmt.org>
Tuning. Overview. During decoding, Moses scores translation hypotheses using a 
linear model. In the traditional approach, the features of the model are the ...


UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3
LM0= 0.5

 /pathtomoses/mosesdecoder/scripts/training/mert-moses.pl<http://mert-moses.pl> 
-no-filter-phrase-table true.fr<http://true.fr> true.en 
/pathtomoses/mosesdecoder/bin/moses binarised/moses.ini --mertdir 

Re: [Moses-support] Tuning with no language model

[Matthias Huck]

Hi,

If you don't need all score components of a phrase table, the easiest
way to get rid of them is to set the scaling factors for the undesired
phrase table feature function components to 0 before tuning, and ask
the optimizer to ignore them. The feature function configuration
parameter "tuneable-components" can be used to tune only selected
components of the feature function.
http://permalink.gmane.org/gmane.comp.nlp.moses.user/12464

I'm using this quite frequently with MIRA. It's conceivable that it
won't work with MERT, though, since maybe this combination was never
tested.

Alternatively, remove any undesired score columns from your phrase
table. The latter approach has advantages as well. E.g., that way it's
less likely to end up with unnoticed mistakes in the configuration
files.

As always, check the content of your log files and any intermediate
files to avoid unexpected behavior. If you decide to give "tuneable
-components" a try, it will be easy to figure out whether it does what
it's supposed to do by just inspecting the tuned weights.

If you end up using only a single feature function with one score
component (assuming that you get rid of UnknownWordPenalty in one way
or another), then you won't have to tune. There's nothing to
interpolate if there's only one feature. The only thing you'll have to
think about is whether to set its scaling factor to a negative or to a
positive value. Search in Moses does argmax, some other decoders may
implement argmin.

Cheers,
Matthias


On Wed, 2016-01-13 at 15:20 +, Read, James C wrote:
> Thanks,
> 
> and if I wanted Moses to use one feature of TM alone I'm guessing
> there's no way to do this other than zeroing out the undesired TM
> features?
> 
> 
> From: Hieu Hoang <hieuho...@gmail.com>
> Sent: Wednesday, January 13, 2016 3:05 PM
> To: Read, James C
> Cc: Moses Support
> Subject: Re: [Moses-support] Tuning with no language model
>  
> you can delete all feature functions except for the
> UnknownWordPenalty. In the current moses, thats hardcoded into
> decoding. So be my guest and delete away!
> 
> Hieu Hoang
> http://www.hoang.co.uk/hieu
> 
> On 13 January 2016 at 15:02, Read, James C <jcr...@essex.ac.uk>
> wrote:
> > OK, looks like it's running. Probably won't be able to see if it
> > generates useful weights until tomorrow. Thanks.
> > 
> > As a side line of thought. I was wondering how many lines of
> > configuration I could get away with deleting? How would Moses
> > behave if I were to delete the lexical reordering lines? The
> > distortion? The word penalty? The phrase penalty?
> > 
> > My goal is to get Moses to choose the best translation with
> > reference to the translation model only.
> > 
> > If I delete these other configuration lines will Moses use defaults
> > for these other options or completely disable their operation
> > leaving just the TM?
> > 
> > 
> > From: Hieu Hoang <hieuho...@gmail.com>
> > Sent: Wednesday, January 13, 2016 2:51 PM
> > 
> > To: Read, James C
> > Cc: Moses Support
> > Subject: Re: [Moses-support] Tuning with no language model
> >  
> > ok. The mert script create a temporary directory every time you run
> > it. By default it's named
> >mert-work
> > Since you ran mert with an incorrect moses.ini previously, it may
> > have polluted the temporary directory and cause problem now.
> > 
> > You should find this temporary directory and delete it before
> > running mert again.
> > 
> > ps ALL directories must be absolute, eg  ../tuning_data/true.bg
> > 
> > 
> > Hieu Hoang
> > http://www.hoang.co.uk/hieu
> > 
> > On 13 January 2016 at 14:45, Read, James C <jcr...@essex.ac.uk>
> > wrote:
> > > 
> > > /media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg
> > > -en/training_data$
> > > /media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/tra
> > > ining/mert-moses.pl -no-filter-phrase-table
> > > ../tuning_data/true.bg ../tuning_data/true.en
> > > /media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses
> > > /media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg
> > > -en/training_data/binarised/moses-tm.ini --mertdir
> > > /media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/
> > > 
> > > with absolute path to moses-tm.ini does not resolve the problem.
> > > Still get the same error.
> > > 
> > > From: Read, James C
> > > Sent: Wednesday, January 13, 2016 2:40 PM
> > > To: Hieu Hoang
> > > 
> > > Cc: Moses Support
> > > Subject: Re: [Moses-support] Tuning with no

Re: [Moses-support] tuning failure with language model type unknown

[ezgi yıldırım]

Thanks for quick reply! I had changed the path for a trick, and
unfortunately i forgot to revert it.

Ezgi


On Wed, Dec 19, 2012 at 12:27 PM, Kenneth Heafield mo...@kheafield.comwrote:

 The moses executable lives in /home/ezgi/mosesdecoder/bin/moses .
 Please update your command line accordingly.

 Kenneth

 On 12/19/12 09:15, Ezgi Yildirim wrote:
  Dear all,
 
  I am using moses compiled with srilm library. I compiled moses with
 ./bjam --
  toolset=gcc-4.6.1 --with-srilm=/home/ezgi/tools/srilm -j 32 command.
 
  I did not appeal to binarized language model. This is my language file
  specification in /home/ezgi/working-v1/model/moses.ini file:
 
  [lmodel-file]
  0 0 5 /home/ezgi/working-v1/lm/SETIMES.en-tr.lm
 
  I used the following command for tuning step and I got an error message
 can be
  seen below (home/ezgi/working-v1/tuning/mert.out file).
 
  mosesdecoder/scripts/training/mert-moses.pl /home/ezgi/working-
  v1/tuning/SETIMES.en-tr.dev.lowercased.en /home/ezgi/working-
  v1/tuning/SETIMES.en-tr.dev.lowercased.tr /home/ezgi/mosesdecoder/moses-
  cmd/src/moses /home/ezgi/working-v1/model/moses.ini --working-dir
  /home/ezgi/working-v1/tuning/mert --mertdir /home/ezgi/mosesdecoder/mert
 --
  rootdir /home/ezgi/mosesdecoder/scripts/ --decoder-flags -v 0
  working-
  v1/tuning/mert.out
 
 
  (home/ezgi/working-v1/tuning/mert.out)
 
  Using SCRIPTS_ROOTDIR: /home/ezgi/mosesdecoder/scripts/
  filtering the phrase tables... Tue Dec 18 17:11:08 EET 2012
  exec: /home/ezgi/mosesdecoder/scripts/training/
 filter-model-given-input.pl
  ./filtered /home/ezgi/working-v1/model/moses.ini /home/ezgi/working-
  v1/tuning/SETIMES.en-tr.dev.lowercased.en
  Executing: /home/ezgi/mosesdecoder/scripts/training/
 filter-model-given-input.pl
  ./filtered /home/ezgi/working-v1/model/moses.ini /home/ezgi/working-
  v1/tuning/SETIMES.en-tr.dev.lowercased.en  filterphrases.out 2
  filterphrases.err
  Asking moses for feature names and values from filtered/moses.ini
  Executing: /home/ezgi/mosesdecoder/moses-cmd/src/moses -v 0 -config
  filtered/moses.ini  -inputtype 0 -show-weights  ./features.list
  /home/ezgi/mosesdecoder/moses-cmd/src
  Creating lexical reordering...
  weights: 0.300 0.300 0.300 0.300 0.300 0.300
  Loading table into memory...done.
  ERROR:Language model type unknown. Probably not compiled into library
  ERROR:no LM created. We probably don't have it compiled
  Exit code: 1
  Failed to run moses with the config filtered/moses.ini at
  mosesdecoder/scripts/training/mert-moses.pl line 1169.
 
  What can I do to fix this?
 
  Thanks in advance,
  Ezgi
 
  ___
  Moses-support mailing list
  Moses-support@mit.edu
  http://mailman.mit.edu/mailman/listinfo/moses-support
 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Tuning failure with Language model type unknown.

[Ronan]

Hi,
It was resolved by removing the lm-binarizer option in the config file.
Thanks for your answer,

Ronan
2009/12/28 Barry Haddow bhad...@inf.ed.ac.uk:
 Hi Ronan

 This is the problem:

             ERROR:Language model type unknown. Probably not compiled
 into library

 You need to compile with irstlm in order to use a binarised language model.

 See here for instructions:
 http://www.statmt.org/moses/?n=Development.GetStarted

 regards
 Barry



 On Monday 28 Dec 2009 00:34:48 Ronan wrote:
 Hello,
 I am currently trying to train a Moses system, which goes fine until
 the tuning step. I get the following error :

             Creating lexical reordering...
             weights: 0.11 0.11 0.11 0.11 0.11 0.11
             binary file loaded, default OFF_T: -1
             Created lexical orientation reordering
             ERROR:Language model type unknown. Probably not compiled
 into library
             ERROR:no LM created. We probably don't have it compiled
             Exit code: 1
             The decoder died. CONFIG WAS -w 0.00 -lm 0.11 -d
 0.11 0.11 0.11 0.11 0.11 0.11 0.11 -tm
 0.03 0.02 0.03 0.02 0.00

 I have checked the archives of the mailing list, and couldn't find
 anything to resolve the problem.
 The language model line in the run1.moses.ini is the following
             # language models: type(srilm/irstlm), factors, order, file
             [lmodel-file]
             1 0 5 /home/s0678231/disk1/mt-system/lm/europarl.binlm.1

 Is anyone able to help with this ?

 Thanks in advance,
 Ronan
 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support




___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Tuning failure with Language model type unknown.

[Barry Haddow]

Hi Ronan

This is the problem:

 ERROR:Language model type unknown. Probably not compiled
 into library

You need to compile with irstlm in order to use a binarised language model.

See here for instructions:
http://www.statmt.org/moses/?n=Development.GetStarted

regards
Barry



On Monday 28 Dec 2009 00:34:48 Ronan wrote:
 Hello,
 I am currently trying to train a Moses system, which goes fine until
 the tuning step. I get the following error :
 
 Creating lexical reordering...
 weights: 0.11 0.11 0.11 0.11 0.11 0.11
 binary file loaded, default OFF_T: -1
 Created lexical orientation reordering
 ERROR:Language model type unknown. Probably not compiled
 into library
 ERROR:no LM created. We probably don't have it compiled
 Exit code: 1
 The decoder died. CONFIG WAS -w 0.00 -lm 0.11 -d
 0.11 0.11 0.11 0.11 0.11 0.11 0.11 -tm
 0.03 0.02 0.03 0.02 0.00
 
 I have checked the archives of the mailing list, and couldn't find
 anything to resolve the problem.
 The language model line in the run1.moses.ini is the following
 # language models: type(srilm/irstlm), factors, order, file
 [lmodel-file]
 1 0 5 /home/s0678231/disk1/mt-system/lm/europarl.binlm.1
 
 Is anyone able to help with this ?
 
 Thanks in advance,
 Ronan
 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support
 

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support