subject:"Re\: \[Moses\-support\] Running Moses with a compact lexical reordering"

Re: [Moses-support] Running Moses with a compact lexical reordering

2014-12-01 Thread Massinissa Ahmim

Hi,

Yes, I just finished processing another one and still I'm getting the same
message :

Loading table into memory...Exception: vector::_M_range_check

2014-12-01 17:13 GMT+01:00 Marcin Junczys-Dowmunt :

>  Hm, OK,
> paths look good. Do you have another compact reordering table somewhere
> that you can substitute there and try? I am starting to suspect that the
> current one is corrupted for some reason. If it works with another table,
> then we would have proof.
>
> W dniu 01.12.2014 o 17:08, Massinissa Ahmim pisze:
>
>  Hi Marcin,
>
>  Please find here attached the file
>
> Many thanks
>
>  Massinissa
>
> 2014-12-01 17:02 GMT+01:00 Marcin Junczys-Dowmunt :
>
>>  Hm, slighlty clueless by now.
>>
>> Can you execute
>>
>> find /home/train-degaulle-fren > paths.txt
>>
>> and send me the paths.txt file to my e-mails address? Do not put that on
>> the support-list.
>>
>> W dniu 01.12.2014 o 17:00, Massinissa Ahmim pisze:
>>
>>  Hi,
>>
>>  I'm getting the first error message now :
>>
>> Loading table into memory...Exception: vector::_M_range_check
>>
>> 2014-12-01 16:56 GMT+01:00 Marcin Junczys-Dowmunt :
>>
>>>  Put the suffix .minlexr back, that was a failed advise.
>>>
>>> W dniu 01.12.2014 o 16:56, Massinissa Ahmim pisze:
>>>
>>> I'm getting the same message :
>>>
>>> Can't read /home/train-degaulle-fren/training/model/reordering-table
>>>
>>> 2014-12-01 16:49 GMT+01:00 Marcin Junczys-Dowmunt :
>>>
  Could you check whether this happens if you do not use the phrase
 table combination? Just one normal phrase table and a standard decoding
 path "0 T 0" ?

 W dniu 01.12.2014 o 16:43, Massinissa Ahmim pisze:

  Hi Marcin,

  the reordering table is over 12 GB, can I send a sample of the inital
 file instead?

  here is my moses.ini :

 ### MOSES CONFIG FILE ###
 #

 # input factors
 [input-factors]
 0

 # mapping steps
 [mapping]
 0 T 2


 [distortion-limit]
 6

 # feature functions
 [feature]
 UnknownWordPenalty
 WordPenalty
 PhrasePenalty
 #PhraseDictionaryCompact tuneable=false name=TranslationModel0
 num-features=4
 path=/home/Update4/train-pros-fren-update4/binarised-model/phrase-table-pros-fren-update4.minphr
 input-factor=0 output-factor=0 table-limit=20


 PhraseDictionaryCompact tuneable=false name=TranslationModel0
 num-features=4
 path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-firsthalf.minphr
 input-factor=0 output-factor=0 table-limit=20


 PhraseDictionaryCompact tuneable=false name=TranslationModel1
 num-features=4
 path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-secondhalf.minphr
 input-factor=0 output-factor=0 table-limit=20




 PhraseDictionaryMultiModel num-features=4 input-factor=0
 output-factor=0 table-limit=20 mode=interpolate lambda=0.5,0.5
 components=TranslationModel0,TranslationModel1

 LexicalReordering name=LexicalReordering0 num-features=6
 type=wbe-msd-bidirectional-fe-
 allff input-factor=0 output-factor=0
 path=/home/train-degaulle-fren/training/model/reordering-table.minlexr


 Distortion
 KENLM lazyken=0 name=LM0 factor=0 path=/home/DATA/LM/Corps-lm.blm.en.mm
 order=5

 # dense weights for feature functions




 [threads]
 all
 [weight]

 LexicalReordering0= 0.0564145 -0.00809962 0.0939308 0.114042 0.0630804
 0.0683044
 Distortion0= 0.0452205
 LM0= 0.140316
 WordPenalty0= 0.0793205
 PhrasePenalty0= 0.113696
 PhraseDictionaryMultiModel0= 0.0608326 0.102939 0.0533373 0.000466626
 TranslationModel0= 0 0 1 0
 TranslationModel1= 0 0 1 0
 UnknownWordPenalty0= 1


 2014-12-01 16:30 GMT+01:00 Marcin Junczys-Dowmunt :

>  Hm,
> weird. In that case you should keep the suffix. Can you make the
> reordering table available for download somehow? Can I see your full
> INI-file?
>
> W dniu 01.12.2014 o 16:27, Massinissa Ahmim pisze:
>
>   Hi Marcin,
>
> I'm getting this now :
>
> Can't read /home/train-degaulle-fren/training/model/reordering-table
>
>  I double checked the paths, they seem to be correct
>
>  Thanks
>
>  Massinissa
>
> 2014-12-01 16:17 GMT+01:00 Marcin Junczys-Dowmunt 
> :
>
>>  Hi,
>> try removing the ".minlexr" suffix from the ini file. Does it work
>> after that?
>>
>> W dniu 01.12.2014 o 16:14, Massinissa Ahmim pisze:
>>
>>Dear all,
>>
>> I'm having troubles running moses with a compact lexical reordering
>> table.
>>
>> After sorting the initial table, I ran the following command :
>>
>> /home/Moses/mosesdecoder/bin/processLexicalTableMin -in
>> reordering-table.sort -out reordering-table -threads 32

Re: [Moses-support] Running Moses with a compact lexical reordering

2014-12-01 Thread Marcin Junczys-Dowmunt


Hm, OK,
paths look good. Do you have another compact reordering table somewhere 
that you can substitute there and try? I am starting to suspect that the 
current one is corrupted for some reason. If it works with another 
table, then we would have proof.


W dniu 01.12.2014 o 17:08, Massinissa Ahmim pisze:

Hi Marcin,

Please find here attached the file

Many thanks

Massinissa

2014-12-01 17:02 GMT+01:00 Marcin Junczys-Dowmunt >:


Hm, slighlty clueless by now.

Can you execute

find /home/train-degaulle-fren > paths.txt

and send me the paths.txt file to my e-mails address? Do not put
that on the support-list.

W dniu 01.12.2014 o 17:00, Massinissa Ahmim pisze:

Hi,

I'm getting the first error message now :

Loading table into memory...Exception: vector::_M_range_check

2014-12-01 16:56 GMT+01:00 Marcin Junczys-Dowmunt
mailto:junc...@amu.edu.pl>>:

Put the suffix .minlexr back, that was a failed advise.

W dniu 01.12.2014 o 16:56, Massinissa Ahmim pisze:

I'm getting the same message :

Can't read
/home/train-degaulle-fren/training/model/reordering-table

2014-12-01 16:49 GMT+01:00 Marcin Junczys-Dowmunt
mailto:junc...@amu.edu.pl>>:

Could you check whether this happens if you do not use
the phrase table combination? Just one normal phrase
table and a standard decoding path "0 T 0" ?

W dniu 01.12.2014 o 16:43, Massinissa Ahmim pisze:

Hi Marcin,

the reordering table is over 12 GB, can I send a sample
of the inital file instead?

here is my moses.ini :

### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 2


[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
#PhraseDictionaryCompact tuneable=false
name=TranslationModel0 num-features=4

path=/home/Update4/train-pros-fren-update4/binarised-model/phrase-table-pros-fren-update4.minphr
input-factor=0 output-factor=0 table-limit=20


PhraseDictionaryCompact tuneable=false
name=TranslationModel0 num-features=4

path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-firsthalf.minphr
input-factor=0 output-factor=0 table-limit=20


PhraseDictionaryCompact tuneable=false
name=TranslationModel1 num-features=4

path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-secondhalf.minphr
input-factor=0 output-factor=0 table-limit=20




PhraseDictionaryMultiModel num-features=4
input-factor=0 output-factor=0 table-limit=20
mode=interpolate lambda=0.5,0.5
components=TranslationModel0,TranslationModel1

LexicalReordering name=LexicalReordering0
num-features=6 type=wbe-msd-bidirectional-fe-
allff input-factor=0 output-factor=0

path=/home/train-degaulle-fren/training/model/reordering-table.minlexr


Distortion
KENLM lazyken=0 name=LM0 factor=0
path=/home/DATA/LM/Corps-lm.blm.en.mm
 order=5

# dense weights for feature functions




[threads]
all
[weight]

LexicalReordering0= 0.0564145 -0.00809962 0.0939308
0.114042 0.0630804 0.0683044
Distortion0= 0.0452205
LM0= 0.140316
WordPenalty0= 0.0793205
PhrasePenalty0= 0.113696
PhraseDictionaryMultiModel0= 0.0608326 0.102939
0.0533373 0.000466626
TranslationModel0= 0 0 1 0
TranslationModel1= 0 0 1 0
UnknownWordPenalty0= 1


2014-12-01 16:30 GMT+01:00 Marcin Junczys-Dowmunt
mailto:junc...@amu.edu.pl>>:

Hm,
weird. In that case you should keep the suffix. Can
you make the reordering table available for
download somehow? Can I see your full INI-file?

W dniu 01.12.2014 o 16:27, Massinissa Ahmim pisze:

Hi Marcin,

I'm getting this now :

Can't read
/home/train-degaulle-fren/training/model/reordering-table

I double checked the paths, they seem to be correct

Thanks

Massinissa

2014-12-01 16:17 GMT+01:00 Marcin Junczys-Dowmunt
mailto:junc...@amu.edu.pl>>:

Hi,
try removing the ".minlexr" suffix from the
ini file.

Re: [Moses-support] Running Moses with a compact lexical reordering

2014-12-01 Thread Marcin Junczys-Dowmunt


Hm, slighlty clueless by now.

Can you execute

find /home/train-degaulle-fren > paths.txt

and send me the paths.txt file to my e-mails address? Do not put that on 
the support-list.


W dniu 01.12.2014 o 17:00, Massinissa Ahmim pisze:

Hi,

I'm getting the first error message now :

Loading table into memory...Exception: vector::_M_range_check

2014-12-01 16:56 GMT+01:00 Marcin Junczys-Dowmunt >:


Put the suffix .minlexr back, that was a failed advise.

W dniu 01.12.2014 o 16:56, Massinissa Ahmim pisze:

I'm getting the same message :

Can't read /home/train-degaulle-fren/training/model/reordering-table

2014-12-01 16:49 GMT+01:00 Marcin Junczys-Dowmunt
mailto:junc...@amu.edu.pl>>:

Could you check whether this happens if you do not use the
phrase table combination? Just one normal phrase table and a
standard decoding path "0 T 0" ?

W dniu 01.12.2014 o 16:43, Massinissa Ahmim pisze:

Hi Marcin,

the reordering table is over 12 GB, can I send a sample of
the inital file instead?

here is my moses.ini :

### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 2


[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
#PhraseDictionaryCompact tuneable=false
name=TranslationModel0 num-features=4

path=/home/Update4/train-pros-fren-update4/binarised-model/phrase-table-pros-fren-update4.minphr
input-factor=0 output-factor=0 table-limit=20


PhraseDictionaryCompact tuneable=false
name=TranslationModel0 num-features=4

path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-firsthalf.minphr
input-factor=0 output-factor=0 table-limit=20


PhraseDictionaryCompact tuneable=false
name=TranslationModel1 num-features=4

path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-secondhalf.minphr
input-factor=0 output-factor=0 table-limit=20




PhraseDictionaryMultiModel num-features=4 input-factor=0
output-factor=0 table-limit=20 mode=interpolate
lambda=0.5,0.5 components=TranslationModel0,TranslationModel1

LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-
allff input-factor=0 output-factor=0
path=/home/train-degaulle-fren/training/model/reordering-table.minlexr


Distortion
KENLM lazyken=0 name=LM0 factor=0
path=/home/DATA/LM/Corps-lm.blm.en.mm
 order=5

# dense weights for feature functions




[threads]
all
[weight]

LexicalReordering0= 0.0564145 -0.00809962 0.0939308 0.114042
0.0630804 0.0683044
Distortion0= 0.0452205
LM0= 0.140316
WordPenalty0= 0.0793205
PhrasePenalty0= 0.113696
PhraseDictionaryMultiModel0= 0.0608326 0.102939 0.0533373
0.000466626
TranslationModel0= 0 0 1 0
TranslationModel1= 0 0 1 0
UnknownWordPenalty0= 1


2014-12-01 16:30 GMT+01:00 Marcin Junczys-Dowmunt
mailto:junc...@amu.edu.pl>>:

Hm,
weird. In that case you should keep the suffix. Can you
make the reordering table available for download
somehow? Can I see your full INI-file?

W dniu 01.12.2014 o 16:27, Massinissa Ahmim pisze:

Hi Marcin,

I'm getting this now :

Can't read
/home/train-degaulle-fren/training/model/reordering-table

I double checked the paths, they seem to be correct

Thanks

Massinissa

2014-12-01 16:17 GMT+01:00 Marcin Junczys-Dowmunt
mailto:junc...@amu.edu.pl>>:

Hi,
try removing the ".minlexr" suffix from the ini
file. Does it work after that?

W dniu 01.12.2014 o 16:14, Massinissa Ahmim pisze:

Dear all,

I'm having troubles running moses with a compact
lexical reordering table.

After sorting the initial table, I ran the
following command :

/home/Moses/mosesdecoder/bin/processLexicalTableMin -in
reordering-table.sort -out reordering-table
-threads 32

the process has been successfully completed so
I've updated my moses.ini file :

LexicalReordering name=LexicalReordering0
num-features=6 type=wbe-msd-bidirectional-fe-allff
input-factor=0 output-factor=0 path=/home/train-deg
aulle-fren/training/model/reordering-table.minlexr

Re: [Moses-support] Running Moses with a compact lexical reordering

2014-12-01 Thread Massinissa Ahmim

Hi,

I'm getting the first error message now :

Loading table into memory...Exception: vector::_M_range_check

2014-12-01 17:00 GMT+01:00 Massinissa Ahmim <
massinissa.ah...@linguacustodia.com>:

> Hi,
>
> I'm getting the first error message now :
>
> Loading table into memory...Exception: vector::_M_range_check
>
> 2014-12-01 16:56 GMT+01:00 Marcin Junczys-Dowmunt :
>
>>  Put the suffix .minlexr back, that was a failed advise.
>>
>> W dniu 01.12.2014 o 16:56, Massinissa Ahmim pisze:
>>
>> I'm getting the same message :
>>
>> Can't read /home/train-degaulle-fren/training/model/reordering-table
>>
>> 2014-12-01 16:49 GMT+01:00 Marcin Junczys-Dowmunt :
>>
>>>  Could you check whether this happens if you do not use the phrase
>>> table combination? Just one normal phrase table and a standard decoding
>>> path "0 T 0" ?
>>>
>>> W dniu 01.12.2014 o 16:43, Massinissa Ahmim pisze:
>>>
>>>  Hi Marcin,
>>>
>>>  the reordering table is over 12 GB, can I send a sample of the inital
>>> file instead?
>>>
>>>  here is my moses.ini :
>>>
>>> ### MOSES CONFIG FILE ###
>>> #
>>>
>>> # input factors
>>> [input-factors]
>>> 0
>>>
>>> # mapping steps
>>> [mapping]
>>> 0 T 2
>>>
>>>
>>> [distortion-limit]
>>> 6
>>>
>>> # feature functions
>>> [feature]
>>> UnknownWordPenalty
>>> WordPenalty
>>> PhrasePenalty
>>> #PhraseDictionaryCompact tuneable=false name=TranslationModel0
>>> num-features=4
>>> path=/home/Update4/train-pros-fren-update4/binarised-model/phrase-table-pros-fren-update4.minphr
>>> input-factor=0 output-factor=0 table-limit=20
>>>
>>>
>>> PhraseDictionaryCompact tuneable=false name=TranslationModel0
>>> num-features=4
>>> path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-firsthalf.minphr
>>> input-factor=0 output-factor=0 table-limit=20
>>>
>>>
>>> PhraseDictionaryCompact tuneable=false name=TranslationModel1
>>> num-features=4
>>> path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-secondhalf.minphr
>>> input-factor=0 output-factor=0 table-limit=20
>>>
>>>
>>>
>>>
>>> PhraseDictionaryMultiModel num-features=4 input-factor=0 output-factor=0
>>> table-limit=20 mode=interpolate lambda=0.5,0.5
>>> components=TranslationModel0,TranslationModel1
>>>
>>> LexicalReordering name=LexicalReordering0 num-features=6
>>> type=wbe-msd-bidirectional-fe-
>>> allff input-factor=0 output-factor=0
>>> path=/home/train-degaulle-fren/training/model/reordering-table.minlexr
>>>
>>>
>>> Distortion
>>> KENLM lazyken=0 name=LM0 factor=0 path=/home/DATA/LM/Corps-lm.blm.en.mm
>>> order=5
>>>
>>> # dense weights for feature functions
>>>
>>>
>>>
>>>
>>> [threads]
>>> all
>>> [weight]
>>>
>>> LexicalReordering0= 0.0564145 -0.00809962 0.0939308 0.114042 0.0630804
>>> 0.0683044
>>> Distortion0= 0.0452205
>>> LM0= 0.140316
>>> WordPenalty0= 0.0793205
>>> PhrasePenalty0= 0.113696
>>> PhraseDictionaryMultiModel0= 0.0608326 0.102939 0.0533373 0.000466626
>>> TranslationModel0= 0 0 1 0
>>> TranslationModel1= 0 0 1 0
>>> UnknownWordPenalty0= 1
>>>
>>>
>>> 2014-12-01 16:30 GMT+01:00 Marcin Junczys-Dowmunt :
>>>
  Hm,
 weird. In that case you should keep the suffix. Can you make the
 reordering table available for download somehow? Can I see your full
 INI-file?

 W dniu 01.12.2014 o 16:27, Massinissa Ahmim pisze:

   Hi Marcin,

 I'm getting this now :

 Can't read /home/train-degaulle-fren/training/model/reordering-table

  I double checked the paths, they seem to be correct

  Thanks

  Massinissa

 2014-12-01 16:17 GMT+01:00 Marcin Junczys-Dowmunt :

>  Hi,
> try removing the ".minlexr" suffix from the ini file. Does it work
> after that?
>
> W dniu 01.12.2014 o 16:14, Massinissa Ahmim pisze:
>
>Dear all,
>
> I'm having troubles running moses with a compact lexical reordering
> table.
>
> After sorting the initial table, I ran the following command :
>
> /home/Moses/mosesdecoder/bin/processLexicalTableMin -in
> reordering-table.sort -out reordering-table -threads 32
>
>  the process has been successfully completed so I've updated my
> moses.ini file :
>
> LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/home/train-deg
> aulle-fren/training/model/reordering-table.minlexr
>
>
>  and ran moses like this :
>
> /home/Moses/mosesdecoder/bin/moses -f moses2.ini -minlexr-memory
>
>  and I'm getting the following error :
>
> 
> line=LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/home/train-degaulle-fren/training/model/reordering-table.minlexr
> FeatureFunction: LexicalReordering0 start: 15 end: 20
> Initializing LexicalReordering..
> line=Distortion
> FeatureFunction: Distortion0 star

Re: [Moses-support] Running Moses with a compact lexical reordering

2014-12-01 Thread Massinissa Ahmim

Hi,

I'm getting the first error message now :

Loading table into memory...Exception: vector::_M_range_check

2014-12-01 16:56 GMT+01:00 Marcin Junczys-Dowmunt :

>  Put the suffix .minlexr back, that was a failed advise.
>
> W dniu 01.12.2014 o 16:56, Massinissa Ahmim pisze:
>
> I'm getting the same message :
>
> Can't read /home/train-degaulle-fren/training/model/reordering-table
>
> 2014-12-01 16:49 GMT+01:00 Marcin Junczys-Dowmunt :
>
>>  Could you check whether this happens if you do not use the phrase table
>> combination? Just one normal phrase table and a standard decoding path "0 T
>> 0" ?
>>
>> W dniu 01.12.2014 o 16:43, Massinissa Ahmim pisze:
>>
>>  Hi Marcin,
>>
>>  the reordering table is over 12 GB, can I send a sample of the inital
>> file instead?
>>
>>  here is my moses.ini :
>>
>> ### MOSES CONFIG FILE ###
>> #
>>
>> # input factors
>> [input-factors]
>> 0
>>
>> # mapping steps
>> [mapping]
>> 0 T 2
>>
>>
>> [distortion-limit]
>> 6
>>
>> # feature functions
>> [feature]
>> UnknownWordPenalty
>> WordPenalty
>> PhrasePenalty
>> #PhraseDictionaryCompact tuneable=false name=TranslationModel0
>> num-features=4
>> path=/home/Update4/train-pros-fren-update4/binarised-model/phrase-table-pros-fren-update4.minphr
>> input-factor=0 output-factor=0 table-limit=20
>>
>>
>> PhraseDictionaryCompact tuneable=false name=TranslationModel0
>> num-features=4
>> path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-firsthalf.minphr
>> input-factor=0 output-factor=0 table-limit=20
>>
>>
>> PhraseDictionaryCompact tuneable=false name=TranslationModel1
>> num-features=4
>> path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-secondhalf.minphr
>> input-factor=0 output-factor=0 table-limit=20
>>
>>
>>
>>
>> PhraseDictionaryMultiModel num-features=4 input-factor=0 output-factor=0
>> table-limit=20 mode=interpolate lambda=0.5,0.5
>> components=TranslationModel0,TranslationModel1
>>
>> LexicalReordering name=LexicalReordering0 num-features=6
>> type=wbe-msd-bidirectional-fe-
>> allff input-factor=0 output-factor=0
>> path=/home/train-degaulle-fren/training/model/reordering-table.minlexr
>>
>>
>> Distortion
>> KENLM lazyken=0 name=LM0 factor=0 path=/home/DATA/LM/Corps-lm.blm.en.mm
>> order=5
>>
>> # dense weights for feature functions
>>
>>
>>
>>
>> [threads]
>> all
>> [weight]
>>
>> LexicalReordering0= 0.0564145 -0.00809962 0.0939308 0.114042 0.0630804
>> 0.0683044
>> Distortion0= 0.0452205
>> LM0= 0.140316
>> WordPenalty0= 0.0793205
>> PhrasePenalty0= 0.113696
>> PhraseDictionaryMultiModel0= 0.0608326 0.102939 0.0533373 0.000466626
>> TranslationModel0= 0 0 1 0
>> TranslationModel1= 0 0 1 0
>> UnknownWordPenalty0= 1
>>
>>
>> 2014-12-01 16:30 GMT+01:00 Marcin Junczys-Dowmunt :
>>
>>>  Hm,
>>> weird. In that case you should keep the suffix. Can you make the
>>> reordering table available for download somehow? Can I see your full
>>> INI-file?
>>>
>>> W dniu 01.12.2014 o 16:27, Massinissa Ahmim pisze:
>>>
>>>   Hi Marcin,
>>>
>>> I'm getting this now :
>>>
>>> Can't read /home/train-degaulle-fren/training/model/reordering-table
>>>
>>>  I double checked the paths, they seem to be correct
>>>
>>>  Thanks
>>>
>>>  Massinissa
>>>
>>> 2014-12-01 16:17 GMT+01:00 Marcin Junczys-Dowmunt :
>>>
  Hi,
 try removing the ".minlexr" suffix from the ini file. Does it work
 after that?

 W dniu 01.12.2014 o 16:14, Massinissa Ahmim pisze:

Dear all,

 I'm having troubles running moses with a compact lexical reordering
 table.

 After sorting the initial table, I ran the following command :

 /home/Moses/mosesdecoder/bin/processLexicalTableMin -in
 reordering-table.sort -out reordering-table -threads 32

  the process has been successfully completed so I've updated my
 moses.ini file :

 LexicalReordering name=LexicalReordering0 num-features=6
 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
 path=/home/train-deg
 aulle-fren/training/model/reordering-table.minlexr


  and ran moses like this :

 /home/Moses/mosesdecoder/bin/moses -f moses2.ini -minlexr-memory

  and I'm getting the following error :

 
 line=LexicalReordering name=LexicalReordering0 num-features=6
 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
 path=/home/train-degaulle-fren/training/model/reordering-table.minlexr
 FeatureFunction: LexicalReordering0 start: 15 end: 20
 Initializing LexicalReordering..
 line=Distortion
 FeatureFunction: Distortion0 start: 21 end: 21
 line=KENLM lazyken=0 name=LM0 factor=0 path=/home/DATA/LM/
 Corps-lm.blm.en.mm order=5
 FeatureFunction: LM0 start: 22 end: 22
 Loading UnknownWordPenalty0
 Loading WordPenalty0
 Loading PhrasePenalty0
 Loading LexicalReordering0
 Loading table into memory...Exception: vector::_M_range_check


  Many thanks

Re: [Moses-support] Running Moses with a compact lexical reordering

2014-12-01 Thread Massinissa Ahmim

I'm getting the same message :

Can't read /home/train-degaulle-fren/training/model/reordering-table

2014-12-01 16:49 GMT+01:00 Marcin Junczys-Dowmunt :

>  Could you check whether this happens if you do not use the phrase table
> combination? Just one normal phrase table and a standard decoding path "0 T
> 0" ?
>
> W dniu 01.12.2014 o 16:43, Massinissa Ahmim pisze:
>
>  Hi Marcin,
>
>  the reordering table is over 12 GB, can I send a sample of the inital
> file instead?
>
>  here is my moses.ini :
>
> ### MOSES CONFIG FILE ###
> #
>
> # input factors
> [input-factors]
> 0
>
> # mapping steps
> [mapping]
> 0 T 2
>
>
> [distortion-limit]
> 6
>
> # feature functions
> [feature]
> UnknownWordPenalty
> WordPenalty
> PhrasePenalty
> #PhraseDictionaryCompact tuneable=false name=TranslationModel0
> num-features=4
> path=/home/Update4/train-pros-fren-update4/binarised-model/phrase-table-pros-fren-update4.minphr
> input-factor=0 output-factor=0 table-limit=20
>
>
> PhraseDictionaryCompact tuneable=false name=TranslationModel0
> num-features=4
> path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-firsthalf.minphr
> input-factor=0 output-factor=0 table-limit=20
>
>
> PhraseDictionaryCompact tuneable=false name=TranslationModel1
> num-features=4
> path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-secondhalf.minphr
> input-factor=0 output-factor=0 table-limit=20
>
>
>
>
> PhraseDictionaryMultiModel num-features=4 input-factor=0 output-factor=0
> table-limit=20 mode=interpolate lambda=0.5,0.5
> components=TranslationModel0,TranslationModel1
>
> LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-
> allff input-factor=0 output-factor=0
> path=/home/train-degaulle-fren/training/model/reordering-table.minlexr
>
>
> Distortion
> KENLM lazyken=0 name=LM0 factor=0 path=/home/DATA/LM/Corps-lm.blm.en.mm
> order=5
>
> # dense weights for feature functions
>
>
>
>
> [threads]
> all
> [weight]
>
> LexicalReordering0= 0.0564145 -0.00809962 0.0939308 0.114042 0.0630804
> 0.0683044
> Distortion0= 0.0452205
> LM0= 0.140316
> WordPenalty0= 0.0793205
> PhrasePenalty0= 0.113696
> PhraseDictionaryMultiModel0= 0.0608326 0.102939 0.0533373 0.000466626
> TranslationModel0= 0 0 1 0
> TranslationModel1= 0 0 1 0
> UnknownWordPenalty0= 1
>
>
> 2014-12-01 16:30 GMT+01:00 Marcin Junczys-Dowmunt :
>
>>  Hm,
>> weird. In that case you should keep the suffix. Can you make the
>> reordering table available for download somehow? Can I see your full
>> INI-file?
>>
>> W dniu 01.12.2014 o 16:27, Massinissa Ahmim pisze:
>>
>>   Hi Marcin,
>>
>> I'm getting this now :
>>
>> Can't read /home/train-degaulle-fren/training/model/reordering-table
>>
>>  I double checked the paths, they seem to be correct
>>
>>  Thanks
>>
>>  Massinissa
>>
>> 2014-12-01 16:17 GMT+01:00 Marcin Junczys-Dowmunt :
>>
>>>  Hi,
>>> try removing the ".minlexr" suffix from the ini file. Does it work after
>>> that?
>>>
>>> W dniu 01.12.2014 o 16:14, Massinissa Ahmim pisze:
>>>
>>>Dear all,
>>>
>>> I'm having troubles running moses with a compact lexical reordering
>>> table.
>>>
>>> After sorting the initial table, I ran the following command :
>>>
>>> /home/Moses/mosesdecoder/bin/processLexicalTableMin -in
>>> reordering-table.sort -out reordering-table -threads 32
>>>
>>>  the process has been successfully completed so I've updated my
>>> moses.ini file :
>>>
>>> LexicalReordering name=LexicalReordering0 num-features=6
>>> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
>>> path=/home/train-deg
>>> aulle-fren/training/model/reordering-table.minlexr
>>>
>>>
>>>  and ran moses like this :
>>>
>>> /home/Moses/mosesdecoder/bin/moses -f moses2.ini -minlexr-memory
>>>
>>>  and I'm getting the following error :
>>>
>>> 
>>> line=LexicalReordering name=LexicalReordering0 num-features=6
>>> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
>>> path=/home/train-degaulle-fren/training/model/reordering-table.minlexr
>>> FeatureFunction: LexicalReordering0 start: 15 end: 20
>>> Initializing LexicalReordering..
>>> line=Distortion
>>> FeatureFunction: Distortion0 start: 21 end: 21
>>> line=KENLM lazyken=0 name=LM0 factor=0 path=/home/DATA/LM/
>>> Corps-lm.blm.en.mm order=5
>>> FeatureFunction: LM0 start: 22 end: 22
>>> Loading UnknownWordPenalty0
>>> Loading WordPenalty0
>>> Loading PhrasePenalty0
>>> Loading LexicalReordering0
>>> Loading table into memory...Exception: vector::_M_range_check
>>>
>>>
>>>  Many thanks
>>>
>>> Massinissa
>>>
>>> --
>>>
>>> [image: Description : Description : lingua_custodia_final full logo]
>>>
>>>  *The Translation Trustee*
>>>
>>> *1, Place Charles de Gaulle*
>>>
>>> *78180 Montigny-le-Bretonneux*
>>>
>>> *Tel : +33 1 30 44 04 23   Mobile : +33 7 61 44 40 84*
>>>
>>> *Email :*  *massinissa.ah...@linguacustodia.com
>>> *
>>>
>>> *Website :*  *www.linguacustodia.com  -
>>> www.thetranslationtrust

Re: [Moses-support] Running Moses with a compact lexical reordering

2014-12-01 Thread Marcin Junczys-Dowmunt


Put the suffix .minlexr back, that was a failed advise.

W dniu 01.12.2014 o 16:56, Massinissa Ahmim pisze:

I'm getting the same message :

Can't read /home/train-degaulle-fren/training/model/reordering-table

2014-12-01 16:49 GMT+01:00 Marcin Junczys-Dowmunt >:


Could you check whether this happens if you do not use the phrase
table combination? Just one normal phrase table and a standard
decoding path "0 T 0" ?

W dniu 01.12.2014 o 16:43, Massinissa Ahmim pisze:

Hi Marcin,

the reordering table is over 12 GB, can I send a sample of the
inital file instead?

here is my moses.ini :

### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 2


[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
#PhraseDictionaryCompact tuneable=false name=TranslationModel0
num-features=4

path=/home/Update4/train-pros-fren-update4/binarised-model/phrase-table-pros-fren-update4.minphr
input-factor=0 output-factor=0 table-limit=20


PhraseDictionaryCompact tuneable=false name=TranslationModel0
num-features=4

path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-firsthalf.minphr
input-factor=0 output-factor=0 table-limit=20


PhraseDictionaryCompact tuneable=false name=TranslationModel1
num-features=4

path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-secondhalf.minphr
input-factor=0 output-factor=0 table-limit=20




PhraseDictionaryMultiModel num-features=4 input-factor=0
output-factor=0 table-limit=20 mode=interpolate lambda=0.5,0.5
components=TranslationModel0,TranslationModel1

LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-
allff input-factor=0 output-factor=0
path=/home/train-degaulle-fren/training/model/reordering-table.minlexr


Distortion
KENLM lazyken=0 name=LM0 factor=0
path=/home/DATA/LM/Corps-lm.blm.en.mm 
order=5

# dense weights for feature functions




[threads]
all
[weight]

LexicalReordering0= 0.0564145 -0.00809962 0.0939308 0.114042
0.0630804 0.0683044
Distortion0= 0.0452205
LM0= 0.140316
WordPenalty0= 0.0793205
PhrasePenalty0= 0.113696
PhraseDictionaryMultiModel0= 0.0608326 0.102939 0.0533373 0.000466626
TranslationModel0= 0 0 1 0
TranslationModel1= 0 0 1 0
UnknownWordPenalty0= 1


2014-12-01 16:30 GMT+01:00 Marcin Junczys-Dowmunt
mailto:junc...@amu.edu.pl>>:

Hm,
weird. In that case you should keep the suffix. Can you make
the reordering table available for download somehow? Can I
see your full INI-file?

W dniu 01.12.2014 o 16:27, Massinissa Ahmim pisze:

Hi Marcin,

I'm getting this now :

Can't read
/home/train-degaulle-fren/training/model/reordering-table

I double checked the paths, they seem to be correct

Thanks

Massinissa

2014-12-01 16:17 GMT+01:00 Marcin Junczys-Dowmunt
mailto:junc...@amu.edu.pl>>:

Hi,
try removing the ".minlexr" suffix from the ini file.
Does it work after that?

W dniu 01.12.2014 o 16:14, Massinissa Ahmim pisze:

Dear all,

I'm having troubles running moses with a compact
lexical reordering table.

After sorting the initial table, I ran the following
command :

/home/Moses/mosesdecoder/bin/processLexicalTableMin -in
reordering-table.sort -out reordering-table -threads 32

the process has been successfully completed so I've
updated my moses.ini file :

LexicalReordering name=LexicalReordering0
num-features=6 type=wbe-msd-bidirectional-fe-allff
input-factor=0 output-factor=0 path=/home/train-deg
aulle-fren/training/model/reordering-table.minlexr


and ran moses like this :

/home/Moses/mosesdecoder/bin/moses -f moses2.ini
-minlexr-memory

and I'm getting the following error :


line=LexicalReordering name=LexicalReordering0
num-features=6 type=wbe-msd-bidirectional-fe-allff
input-factor=0 output-factor=0

path=/home/train-degaulle-fren/training/model/reordering-table.minlexr
FeatureFunction: LexicalReordering0 start: 15 end: 20
Initializing LexicalReordering..
line=Distortion
FeatureFunction: Distortion0 start: 21 end: 21
line=KENLM lazyken=0 name=LM0 factor=0
path=/home/DATA/LM/Corps-lm.blm.en.mm
 order=5
FeatureFunction: LM0 start: 22 end: 22
L

Re: [Moses-support] Running Moses with a compact lexical reordering

2014-12-01 Thread Marcin Junczys-Dowmunt

Could you check whether this happens if you do not use the phrase table 
combination? Just one normal phrase table and a standard decoding path 
"0 T 0" ?


W dniu 01.12.2014 o 16:43, Massinissa Ahmim pisze:

Hi Marcin,

the reordering table is over 12 GB, can I send a sample of the inital 
file instead?


here is my moses.ini :

### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 2


[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
#PhraseDictionaryCompact tuneable=false name=TranslationModel0 
num-features=4 
path=/home/Update4/train-pros-fren-update4/binarised-model/phrase-table-pros-fren-update4.minphr 
input-factor=0 output-factor=0 table-limit=20



PhraseDictionaryCompact tuneable=false name=TranslationModel0 
num-features=4 
path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-firsthalf.minphr 
input-factor=0 output-factor=0 table-limit=20



PhraseDictionaryCompact tuneable=false name=TranslationModel1 
num-features=4 
path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-secondhalf.minphr 
input-factor=0 output-factor=0 table-limit=20





PhraseDictionaryMultiModel num-features=4 input-factor=0 
output-factor=0 table-limit=20 mode=interpolate lambda=0.5,0.5 
components=TranslationModel0,TranslationModel1


LexicalReordering name=LexicalReordering0 num-features=6 
type=wbe-msd-bidirectional-fe-
allff input-factor=0 output-factor=0 
path=/home/train-degaulle-fren/training/model/reordering-table.minlexr



Distortion
KENLM lazyken=0 name=LM0 factor=0 
path=/home/DATA/LM/Corps-lm.blm.en.mm  order=5


# dense weights for feature functions




[threads]
all
[weight]

LexicalReordering0= 0.0564145 -0.00809962 0.0939308 0.114042 0.0630804 
0.0683044

Distortion0= 0.0452205
LM0= 0.140316
WordPenalty0= 0.0793205
PhrasePenalty0= 0.113696
PhraseDictionaryMultiModel0= 0.0608326 0.102939 0.0533373 0.000466626
TranslationModel0= 0 0 1 0
TranslationModel1= 0 0 1 0
UnknownWordPenalty0= 1


2014-12-01 16:30 GMT+01:00 Marcin Junczys-Dowmunt >:


Hm,
weird. In that case you should keep the suffix. Can you make the
reordering table available for download somehow? Can I see your
full INI-file?

W dniu 01.12.2014 o 16:27, Massinissa Ahmim pisze:

Hi Marcin,

I'm getting this now :

Can't read /home/train-degaulle-fren/training/model/reordering-table

I double checked the paths, they seem to be correct

Thanks

Massinissa

2014-12-01 16:17 GMT+01:00 Marcin Junczys-Dowmunt
mailto:junc...@amu.edu.pl>>:

Hi,
try removing the ".minlexr" suffix from the ini file. Does it
work after that?

W dniu 01.12.2014 o 16:14, Massinissa Ahmim pisze:

Dear all,

I'm having troubles running moses with a compact lexical
reordering table.

After sorting the initial table, I ran the following command :

/home/Moses/mosesdecoder/bin/processLexicalTableMin -in
reordering-table.sort -out reordering-table -threads 32

the process has been successfully completed so I've updated
my moses.ini file :

LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0
output-factor=0 path=/home/train-deg
aulle-fren/training/model/reordering-table.minlexr


and ran moses like this :

/home/Moses/mosesdecoder/bin/moses -f moses2.ini -minlexr-memory

and I'm getting the following error :


line=LexicalReordering name=LexicalReordering0
num-features=6 type=wbe-msd-bidirectional-fe-allff
input-factor=0 output-factor=0
path=/home/train-degaulle-fren/training/model/reordering-table.minlexr
FeatureFunction: LexicalReordering0 start: 15 end: 20
Initializing LexicalReordering..
line=Distortion
FeatureFunction: Distortion0 start: 21 end: 21
line=KENLM lazyken=0 name=LM0 factor=0
path=/home/DATA/LM/Corps-lm.blm.en.mm
 order=5
FeatureFunction: LM0 start: 22 end: 22
Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Loading table into memory...Exception: vector::_M_range_check


Many thanks

Massinissa

-- 


Description : Description : lingua_custodia_final full logo

*/The Translation Trustee/*

*1, Place Charles de Gaulle*

*78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23   Mobile : +33 7 61 44 40 84*

*Email :massinissa.ah...@linguacustodia.com
***

*Website :www.linguacustodia.com
 -
www.thetranslationtrustee.c

Re: [Moses-support] Running Moses with a compact lexical reordering

2014-12-01 Thread Massinissa Ahmim

Hi Marcin,

the reordering table is over 12 GB, can I send a sample of the inital file
instead?

here is my moses.ini :

### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 2


[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
#PhraseDictionaryCompact tuneable=false name=TranslationModel0
num-features=4
path=/home/Update4/train-pros-fren-update4/binarised-model/phrase-table-pros-fren-update4.minphr
input-factor=0 output-factor=0 table-limit=20


PhraseDictionaryCompact tuneable=false name=TranslationModel0
num-features=4
path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-firsthalf.minphr
input-factor=0 output-factor=0 table-limit=20


PhraseDictionaryCompact tuneable=false name=TranslationModel1
num-features=4
path=/home/train-degaulle-fren/binarised-model/phrase-table-degaulle-secondhalf.minphr
input-factor=0 output-factor=0 table-limit=20




PhraseDictionaryMultiModel num-features=4 input-factor=0 output-factor=0
table-limit=20 mode=interpolate lambda=0.5,0.5
components=TranslationModel0,TranslationModel1

LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-
allff input-factor=0 output-factor=0
path=/home/train-degaulle-fren/training/model/reordering-table.minlexr


Distortion
KENLM lazyken=0 name=LM0 factor=0 path=/home/DATA/LM/Corps-lm.blm.en.mm
order=5

# dense weights for feature functions




[threads]
all
[weight]

LexicalReordering0= 0.0564145 -0.00809962 0.0939308 0.114042 0.0630804
0.0683044
Distortion0= 0.0452205
LM0= 0.140316
WordPenalty0= 0.0793205
PhrasePenalty0= 0.113696
PhraseDictionaryMultiModel0= 0.0608326 0.102939 0.0533373 0.000466626
TranslationModel0= 0 0 1 0
TranslationModel1= 0 0 1 0
UnknownWordPenalty0= 1


2014-12-01 16:30 GMT+01:00 Marcin Junczys-Dowmunt :

>  Hm,
> weird. In that case you should keep the suffix. Can you make the
> reordering table available for download somehow? Can I see your full
> INI-file?
>
> W dniu 01.12.2014 o 16:27, Massinissa Ahmim pisze:
>
>   Hi Marcin,
>
> I'm getting this now :
>
> Can't read /home/train-degaulle-fren/training/model/reordering-table
>
>  I double checked the paths, they seem to be correct
>
>  Thanks
>
>  Massinissa
>
> 2014-12-01 16:17 GMT+01:00 Marcin Junczys-Dowmunt :
>
>>  Hi,
>> try removing the ".minlexr" suffix from the ini file. Does it work after
>> that?
>>
>> W dniu 01.12.2014 o 16:14, Massinissa Ahmim pisze:
>>
>>Dear all,
>>
>> I'm having troubles running moses with a compact lexical reordering
>> table.
>>
>> After sorting the initial table, I ran the following command :
>>
>> /home/Moses/mosesdecoder/bin/processLexicalTableMin -in
>> reordering-table.sort -out reordering-table -threads 32
>>
>>  the process has been successfully completed so I've updated my moses.ini
>> file :
>>
>> LexicalReordering name=LexicalReordering0 num-features=6
>> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
>> path=/home/train-deg
>> aulle-fren/training/model/reordering-table.minlexr
>>
>>
>>  and ran moses like this :
>>
>> /home/Moses/mosesdecoder/bin/moses -f moses2.ini -minlexr-memory
>>
>>  and I'm getting the following error :
>>
>> 
>> line=LexicalReordering name=LexicalReordering0 num-features=6
>> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
>> path=/home/train-degaulle-fren/training/model/reordering-table.minlexr
>> FeatureFunction: LexicalReordering0 start: 15 end: 20
>> Initializing LexicalReordering..
>> line=Distortion
>> FeatureFunction: Distortion0 start: 21 end: 21
>> line=KENLM lazyken=0 name=LM0 factor=0 path=/home/DATA/LM/
>> Corps-lm.blm.en.mm order=5
>> FeatureFunction: LM0 start: 22 end: 22
>> Loading UnknownWordPenalty0
>> Loading WordPenalty0
>> Loading PhrasePenalty0
>> Loading LexicalReordering0
>> Loading table into memory...Exception: vector::_M_range_check
>>
>>
>>  Many thanks
>>
>> Massinissa
>>
>> --
>>
>> [image: Description : Description : lingua_custodia_final full logo]
>>
>>  *The Translation Trustee*
>>
>> *1, Place Charles de Gaulle*
>>
>> *78180 Montigny-le-Bretonneux*
>>
>> *Tel : +33 1 30 44 04 23   Mobile : +33 7 61 44 40 84*
>>
>> *Email :*  *massinissa.ah...@linguacustodia.com
>> *
>>
>> *Website :*  *www.linguacustodia.com  -
>> www.thetranslationtrustee.com  *
>>
>> A Young Innovative Company recognised by the French Research Ministry and
>> Paris Finance Innovation cluster
>>
>> [image: Logo labellisé FI small]
>>
>>
>>  ___
>> Moses-support mailing 
>> listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
>
> --
>
> [image: Description : Description : lingua_cus

Re: [Moses-support] Running Moses with a compact lexical reordering

2014-12-01 Thread Marcin Junczys-Dowmunt


Hm,
weird. In that case you should keep the suffix. Can you make the 
reordering table available for download somehow? Can I see your full 
INI-file?


W dniu 01.12.2014 o 16:27, Massinissa Ahmim pisze:

Hi Marcin,

I'm getting this now :

Can't read /home/train-degaulle-fren/training/model/reordering-table

I double checked the paths, they seem to be correct

Thanks

Massinissa

2014-12-01 16:17 GMT+01:00 Marcin Junczys-Dowmunt >:


Hi,
try removing the ".minlexr" suffix from the ini file. Does it work
after that?

W dniu 01.12.2014 o 16:14, Massinissa Ahmim pisze:

Dear all,

I'm having troubles running moses with a compact lexical
reordering table.

After sorting the initial table, I ran the following command :

/home/Moses/mosesdecoder/bin/processLexicalTableMin -in
reordering-table.sort -out reordering-table -threads 32

the process has been successfully completed so I've updated my
moses.ini file :

LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0
output-factor=0 path=/home/train-deg
aulle-fren/training/model/reordering-table.minlexr


and ran moses like this :

/home/Moses/mosesdecoder/bin/moses -f moses2.ini -minlexr-memory

and I'm getting the following error :


line=LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0
output-factor=0
path=/home/train-degaulle-fren/training/model/reordering-table.minlexr
FeatureFunction: LexicalReordering0 start: 15 end: 20
Initializing LexicalReordering..
line=Distortion
FeatureFunction: Distortion0 start: 21 end: 21
line=KENLM lazyken=0 name=LM0 factor=0
path=/home/DATA/LM/Corps-lm.blm.en.mm 
order=5
FeatureFunction: LM0 start: 22 end: 22
Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Loading table into memory...Exception: vector::_M_range_check


Many thanks

Massinissa

-- 


Description : Description : lingua_custodia_final full logo

*/The Translation Trustee/*

*1, Place Charles de Gaulle*

*78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23   Mobile : +33 7 61 44 40 84*

*Email :massinissa.ah...@linguacustodia.com
***

*Website :www.linguacustodia.com
 - www.thetranslationtrustee.com
*

A Young Innovative Company recognised by the French Research
Ministry and Paris Finance Innovation cluster

Logo labellisé FI small



___
Moses-support mailing list
Moses-support@mit.edu  
http://mailman.mit.edu/mailman/listinfo/moses-support



___
Moses-support mailing list
Moses-support@mit.edu 
http://mailman.mit.edu/mailman/listinfo/moses-support




--

Description : Description : lingua_custodia_final full logo

*/The Translation Trustee/*

*1, Place Charles de Gaulle*

*78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23  Mobile : +33 7 61 44 40 84*

*Email :massinissa.ah...@linguacustodia.com 
***


*Website :www.linguacustodia.com 
 - www.thetranslationtrustee.com 
*


A Young Innovative Company recognised by the French Research Ministry 
and Paris Finance Innovation cluster


Logo labellisé FI small



___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Running Moses with a compact lexical reordering

2014-12-01 Thread Massinissa Ahmim

Hi Marcin,

I'm getting this now :

Can't read /home/train-degaulle-fren/training/model/reordering-table

I double checked the paths, they seem to be correct

Thanks

Massinissa

2014-12-01 16:17 GMT+01:00 Marcin Junczys-Dowmunt :

>  Hi,
> try removing the ".minlexr" suffix from the ini file. Does it work after
> that?
>
> W dniu 01.12.2014 o 16:14, Massinissa Ahmim pisze:
>
>   Dear all,
>
> I'm having troubles running moses with a compact lexical reordering table.
>
> After sorting the initial table, I ran the following command :
>
> /home/Moses/mosesdecoder/bin/processLexicalTableMin -in
> reordering-table.sort -out reordering-table -threads 32
>
>  the process has been successfully completed so I've updated my moses.ini
> file :
>
> LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/home/train-deg
> aulle-fren/training/model/reordering-table.minlexr
>
>
>  and ran moses like this :
>
> /home/Moses/mosesdecoder/bin/moses -f moses2.ini -minlexr-memory
>
>  and I'm getting the following error :
>
> 
> line=LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/home/train-degaulle-fren/training/model/reordering-table.minlexr
> FeatureFunction: LexicalReordering0 start: 15 end: 20
> Initializing LexicalReordering..
> line=Distortion
> FeatureFunction: Distortion0 start: 21 end: 21
> line=KENLM lazyken=0 name=LM0 factor=0 path=/home/DATA/LM/
> Corps-lm.blm.en.mm order=5
> FeatureFunction: LM0 start: 22 end: 22
> Loading UnknownWordPenalty0
> Loading WordPenalty0
> Loading PhrasePenalty0
> Loading LexicalReordering0
> Loading table into memory...Exception: vector::_M_range_check
>
>
>  Many thanks
>
> Massinissa
>
> --
>
> [image: Description : Description : lingua_custodia_final full logo]
>
>  *The Translation Trustee*
>
> *1, Place Charles de Gaulle*
>
> *78180 Montigny-le-Bretonneux*
>
> *Tel : +33 1 30 44 04 23   Mobile : +33 7 61 44 40 84*
>
> *Email :*  *massinissa.ah...@linguacustodia.com
> *
>
> *Website :*  *www.linguacustodia.com  -
> www.thetranslationtrustee.com  *
>
> A Young Innovative Company recognised by the French Research Ministry and
> Paris Finance Innovation cluster
>
> [image: Logo labellisé FI small]
>
>
> ___
> Moses-support mailing 
> listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


-- 

[image: Description : Description : lingua_custodia_final full logo]

 *The Translation Trustee*

*1, Place Charles de Gaulle*

*78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23   Mobile : +33 7 61 44 40 84*

*Email :*  *massinissa.ah...@linguacustodia.com
*

*Website :*  *www.linguacustodia.com  -
www.thetranslationtrustee.com  *

A Young Innovative Company recognised by the French Research Ministry and
Paris Finance Innovation cluster

[image: Logo labellisé FI small]
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Running Moses with a compact lexical reordering

2014-12-01 Thread Marcin Junczys-Dowmunt


Hi,
try removing the ".minlexr" suffix from the ini file. Does it work after 
that?


W dniu 01.12.2014 o 16:14, Massinissa Ahmim pisze:

Dear all,

I'm having troubles running moses with a compact lexical reordering 
table.


After sorting the initial table, I ran the following command :

/home/Moses/mosesdecoder/bin/processLexicalTableMin -in 
reordering-table.sort -out reordering-table -threads 32


the process has been successfully completed so I've updated my 
moses.ini file :


LexicalReordering name=LexicalReordering0 num-features=6 
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 
path=/home/train-deg

aulle-fren/training/model/reordering-table.minlexr


and ran moses like this :

/home/Moses/mosesdecoder/bin/moses -f moses2.ini -minlexr-memory

and I'm getting the following error :


line=LexicalReordering name=LexicalReordering0 num-features=6 
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 
path=/home/train-degaulle-fren/training/model/reordering-table.minlexr

FeatureFunction: LexicalReordering0 start: 15 end: 20
Initializing LexicalReordering..
line=Distortion
FeatureFunction: Distortion0 start: 21 end: 21
line=KENLM lazyken=0 name=LM0 factor=0 
path=/home/DATA/LM/Corps-lm.blm.en.mm  order=5

FeatureFunction: LM0 start: 22 end: 22
Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Loading table into memory...Exception: vector::_M_range_check


Many thanks

Massinissa

--

Description : Description : lingua_custodia_final full logo

*/The Translation Trustee/*

*1, Place Charles de Gaulle*

*78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23   Mobile : +33 7 61 44 40 84*

*Email :massinissa.ah...@linguacustodia.com 
***


*Website :www.linguacustodia.com 
 - www.thetranslationtrustee.com 
*


A Young Innovative Company recognised by the French Research Ministry 
and Paris Finance Innovation cluster


Logo labellisé FI small



___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Running Moses with a compact lexical reordering

Re: [Moses-support] Running Moses with a compact lexical reordering

Re: [Moses-support] Running Moses with a compact lexical reordering

Re: [Moses-support] Running Moses with a compact lexical reordering

Re: [Moses-support] Running Moses with a compact lexical reordering

Re: [Moses-support] Running Moses with a compact lexical reordering

Re: [Moses-support] Running Moses with a compact lexical reordering

Re: [Moses-support] Running Moses with a compact lexical reordering

Re: [Moses-support] Running Moses with a compact lexical reordering

Re: [Moses-support] Running Moses with a compact lexical reordering

Re: [Moses-support] Running Moses with a compact lexical reordering

Re: [Moses-support] Running Moses with a compact lexical reordering

12 matches

Site Navigation

Mail list logo

Footer information