[Moses-support] Moses SMT Evaluation

2016-11-23 Thread Emmanuel Dennis
Is there a way to evaluate SMT system online using BLEU??


I will appreciate your feedback.
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Output Loglinear score with n-best outputs

2016-11-23 Thread Nat Gillin
Thanks Hieu for the information!

Regards,
Nat

On Wed, Nov 23, 2016 at 6:58 PM, Hieu Hoang  wrote:

> yep, it's the highest score
>
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
> On 23 November 2016 at 10:31, Vito Mandorino  linguacustodia.com> wrote:
>
>> I think it's the highest score but I am not completely sure.
>>
>> 2016-11-23 11:10 GMT+01:00 Nat Gillin :
>>
>>> Dear Vito,
>>>
>>> Thanks for the tip! And does the distinct hypotheses outputs their
>>> highest/averaged log-linear score?
>>>
>>> Regards,
>>> Nat
>>>
>>> On Wed, Nov 23, 2016 at 6:05 PM, Vito Mandorino <
>>> vito.mandor...@linguacustodia.com> wrote:
>>>
 Hi Nat,

 this is obtained by adding 'distinct' in the command i.e.

 ./moses -f moses.ini -n-best-list filename 10 distinct

 Vito

 2016-11-23 10:06 GMT+01:00 Nat Gillin :

> Dear Moses community,
>
> I found it! It's the last column in the -n-best-list output:
>
> 0 ||| one member for kara will be selected .  ||| LexicalReordering0=
> -2.12026 0 0 -1.60944 0 0 Distortion0= 0 LM0= -20.2445 WordPenalty0= -8
> PhrasePenalty0= 2 TranslationModel0= -2.42529 -36.1231 -1.039 -16.2225 |||
> -3.80866
>
> I realized that the hypothesis from the n-best list isn't unique. Is
> there a way to get 3 unique n-best hypothesis, instead of the first 3
> hypothesis (non-unique)?
>
> Regards,
> Nat
>
>
> On Wed, Nov 23, 2016 at 4:41 PM, Nat Gillin 
> wrote:
>
>> Dear Moses community,
>>
>> When decoding, is there a way to output the loglinear score of each
>> hypothesis together with the n-best output?
>>
>> Regards,
>> Nat
>>
>
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


 --
 *M**. Vito MANDORINO -- Chief Scientist*


 [image: Description : Description : lingua_custodia_final full logo]

  *The Translation Trustee*

 *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*

 *Tel : +33 1 30 44 04 23   Mobile : +33 6 84 65 68 89
 <%2B33%206%2084%2065%2068%2089>*

 *Email :*  *vito.mandor...@linguacustodia.com
 *

 *Website :*
 *www.linguacustodia.finance *

>>>
>>>
>>
>>
>> --
>> *M**. Vito MANDORINO -- Chief Scientist*
>>
>>
>> [image: Description : Description : lingua_custodia_final full logo]
>>
>>  *The Translation Trustee*
>>
>> *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*
>>
>> *Tel : +33 1 30 44 04 23   Mobile : +33 6 84 65 68 89
>> <%2B33%206%2084%2065%2068%2089>*
>>
>> *Email :*  *vito.mandor...@linguacustodia.com
>> *
>>
>> *Website :*
>> *www.linguacustodia.finance *
>>
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Output Loglinear score with n-best outputs

2016-11-23 Thread Hieu Hoang
yep, it's the highest score

Hieu Hoang
http://www.hoang.co.uk/hieu

On 23 November 2016 at 10:31, Vito Mandorino <
vito.mandor...@linguacustodia.com> wrote:

> I think it's the highest score but I am not completely sure.
>
> 2016-11-23 11:10 GMT+01:00 Nat Gillin :
>
>> Dear Vito,
>>
>> Thanks for the tip! And does the distinct hypotheses outputs their
>> highest/averaged log-linear score?
>>
>> Regards,
>> Nat
>>
>> On Wed, Nov 23, 2016 at 6:05 PM, Vito Mandorino <
>> vito.mandor...@linguacustodia.com> wrote:
>>
>>> Hi Nat,
>>>
>>> this is obtained by adding 'distinct' in the command i.e.
>>>
>>> ./moses -f moses.ini -n-best-list filename 10 distinct
>>>
>>> Vito
>>>
>>> 2016-11-23 10:06 GMT+01:00 Nat Gillin :
>>>
 Dear Moses community,

 I found it! It's the last column in the -n-best-list output:

 0 ||| one member for kara will be selected .  ||| LexicalReordering0=
 -2.12026 0 0 -1.60944 0 0 Distortion0= 0 LM0= -20.2445 WordPenalty0= -8
 PhrasePenalty0= 2 TranslationModel0= -2.42529 -36.1231 -1.039 -16.2225 |||
 -3.80866

 I realized that the hypothesis from the n-best list isn't unique. Is
 there a way to get 3 unique n-best hypothesis, instead of the first 3
 hypothesis (non-unique)?

 Regards,
 Nat


 On Wed, Nov 23, 2016 at 4:41 PM, Nat Gillin 
 wrote:

> Dear Moses community,
>
> When decoding, is there a way to output the loglinear score of each
> hypothesis together with the n-best output?
>
> Regards,
> Nat
>


 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support


>>>
>>>
>>> --
>>> *M**. Vito MANDORINO -- Chief Scientist*
>>>
>>>
>>> [image: Description : Description : lingua_custodia_final full logo]
>>>
>>>  *The Translation Trustee*
>>>
>>> *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*
>>>
>>> *Tel : +33 1 30 44 04 23   Mobile : +33 6 84 65 68 89
>>> <%2B33%206%2084%2065%2068%2089>*
>>>
>>> *Email :*  *vito.mandor...@linguacustodia.com
>>> *
>>>
>>> *Website :*
>>> *www.linguacustodia.finance *
>>>
>>
>>
>
>
> --
> *M**. Vito MANDORINO -- Chief Scientist*
>
>
> [image: Description : Description : lingua_custodia_final full logo]
>
>  *The Translation Trustee*
>
> *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*
>
> *Tel : +33 1 30 44 04 23   Mobile : +33 6 84 65 68 89
> <%2B33%206%2084%2065%2068%2089>*
>
> *Email :*  *vito.mandor...@linguacustodia.com
> *
>
> *Website :*
> *www.linguacustodia.finance *
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Output Loglinear score with n-best outputs

2016-11-23 Thread Vito Mandorino
I think it's the highest score but I am not completely sure.

2016-11-23 11:10 GMT+01:00 Nat Gillin :

> Dear Vito,
>
> Thanks for the tip! And does the distinct hypotheses outputs their
> highest/averaged log-linear score?
>
> Regards,
> Nat
>
> On Wed, Nov 23, 2016 at 6:05 PM, Vito Mandorino  linguacustodia.com> wrote:
>
>> Hi Nat,
>>
>> this is obtained by adding 'distinct' in the command i.e.
>>
>> ./moses -f moses.ini -n-best-list filename 10 distinct
>>
>> Vito
>>
>> 2016-11-23 10:06 GMT+01:00 Nat Gillin :
>>
>>> Dear Moses community,
>>>
>>> I found it! It's the last column in the -n-best-list output:
>>>
>>> 0 ||| one member for kara will be selected .  ||| LexicalReordering0=
>>> -2.12026 0 0 -1.60944 0 0 Distortion0= 0 LM0= -20.2445 WordPenalty0= -8
>>> PhrasePenalty0= 2 TranslationModel0= -2.42529 -36.1231 -1.039 -16.2225 |||
>>> -3.80866
>>>
>>> I realized that the hypothesis from the n-best list isn't unique. Is
>>> there a way to get 3 unique n-best hypothesis, instead of the first 3
>>> hypothesis (non-unique)?
>>>
>>> Regards,
>>> Nat
>>>
>>>
>>> On Wed, Nov 23, 2016 at 4:41 PM, Nat Gillin 
>>> wrote:
>>>
 Dear Moses community,

 When decoding, is there a way to output the loglinear score of each
 hypothesis together with the n-best output?

 Regards,
 Nat

>>>
>>>
>>> ___
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>
>>
>> --
>> *M**. Vito MANDORINO -- Chief Scientist*
>>
>>
>> [image: Description : Description : lingua_custodia_final full logo]
>>
>>  *The Translation Trustee*
>>
>> *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*
>>
>> *Tel : +33 1 30 44 04 23   Mobile : +33 6 84 65 68 89
>> <%2B33%206%2084%2065%2068%2089>*
>>
>> *Email :*  *vito.mandor...@linguacustodia.com
>> *
>>
>> *Website :*
>> *www.linguacustodia.finance *
>>
>
>


-- 
*M**. Vito MANDORINO -- Chief Scientist*


[image: Description : Description : lingua_custodia_final full logo]

 *The Translation Trustee*

*1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23   Mobile : +33 6 84 65 68 89*

*Email :*  *vito.mandor...@linguacustodia.com
*

*Website :*
*www.linguacustodia.finance *
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Output Loglinear score with n-best outputs

2016-11-23 Thread Nat Gillin
Dear Vito,

Thanks for the tip! And does the distinct hypotheses outputs their
highest/averaged log-linear score?

Regards,
Nat

On Wed, Nov 23, 2016 at 6:05 PM, Vito Mandorino <
vito.mandor...@linguacustodia.com> wrote:

> Hi Nat,
>
> this is obtained by adding 'distinct' in the command i.e.
>
> ./moses -f moses.ini -n-best-list filename 10 distinct
>
> Vito
>
> 2016-11-23 10:06 GMT+01:00 Nat Gillin :
>
>> Dear Moses community,
>>
>> I found it! It's the last column in the -n-best-list output:
>>
>> 0 ||| one member for kara will be selected .  ||| LexicalReordering0=
>> -2.12026 0 0 -1.60944 0 0 Distortion0= 0 LM0= -20.2445 WordPenalty0= -8
>> PhrasePenalty0= 2 TranslationModel0= -2.42529 -36.1231 -1.039 -16.2225 |||
>> -3.80866
>>
>> I realized that the hypothesis from the n-best list isn't unique. Is
>> there a way to get 3 unique n-best hypothesis, instead of the first 3
>> hypothesis (non-unique)?
>>
>> Regards,
>> Nat
>>
>>
>> On Wed, Nov 23, 2016 at 4:41 PM, Nat Gillin  wrote:
>>
>>> Dear Moses community,
>>>
>>> When decoding, is there a way to output the loglinear score of each
>>> hypothesis together with the n-best output?
>>>
>>> Regards,
>>> Nat
>>>
>>
>>
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
>
> --
> *M**. Vito MANDORINO -- Chief Scientist*
>
>
> [image: Description : Description : lingua_custodia_final full logo]
>
>  *The Translation Trustee*
>
> *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*
>
> *Tel : +33 1 30 44 04 23   Mobile : +33 6 84 65 68 89
> <%2B33%206%2084%2065%2068%2089>*
>
> *Email :*  *vito.mandor...@linguacustodia.com
> *
>
> *Website :*
> *www.linguacustodia.finance *
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Output Loglinear score with n-best outputs

2016-11-23 Thread Vito Mandorino
Hi Nat,

this is obtained by adding 'distinct' in the command i.e.

./moses -f moses.ini -n-best-list filename 10 distinct

Vito

2016-11-23 10:06 GMT+01:00 Nat Gillin :

> Dear Moses community,
>
> I found it! It's the last column in the -n-best-list output:
>
> 0 ||| one member for kara will be selected .  ||| LexicalReordering0=
> -2.12026 0 0 -1.60944 0 0 Distortion0= 0 LM0= -20.2445 WordPenalty0= -8
> PhrasePenalty0= 2 TranslationModel0= -2.42529 -36.1231 -1.039 -16.2225 |||
> -3.80866
>
> I realized that the hypothesis from the n-best list isn't unique. Is there
> a way to get 3 unique n-best hypothesis, instead of the first 3 hypothesis
> (non-unique)?
>
> Regards,
> Nat
>
>
> On Wed, Nov 23, 2016 at 4:41 PM, Nat Gillin  wrote:
>
>> Dear Moses community,
>>
>> When decoding, is there a way to output the loglinear score of each
>> hypothesis together with the n-best output?
>>
>> Regards,
>> Nat
>>
>
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


-- 
*M**. Vito MANDORINO -- Chief Scientist*


[image: Description : Description : lingua_custodia_final full logo]

 *The Translation Trustee*

*1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23   Mobile : +33 6 84 65 68 89*

*Email :*  *vito.mandor...@linguacustodia.com
*

*Website :*
*www.linguacustodia.finance *
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Output Loglinear score with n-best outputs

2016-11-23 Thread Nat Gillin
Dear Moses community,

I found it! It's the last column in the -n-best-list output:

0 ||| one member for kara will be selected .  ||| LexicalReordering0=
-2.12026 0 0 -1.60944 0 0 Distortion0= 0 LM0= -20.2445 WordPenalty0= -8
PhrasePenalty0= 2 TranslationModel0= -2.42529 -36.1231 -1.039 -16.2225 |||
-3.80866

I realized that the hypothesis from the n-best list isn't unique. Is there
a way to get 3 unique n-best hypothesis, instead of the first 3 hypothesis
(non-unique)?

Regards,
Nat


On Wed, Nov 23, 2016 at 4:41 PM, Nat Gillin  wrote:

> Dear Moses community,
>
> When decoding, is there a way to output the loglinear score of each
> hypothesis together with the n-best output?
>
> Regards,
> Nat
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


[Moses-support] Output Loglinear score with n-best outputs

2016-11-23 Thread Nat Gillin
Dear Moses community,

When decoding, is there a way to output the loglinear score of each
hypothesis together with the n-best output?

Regards,
Nat
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support