Re: [Moses-support] Calculating final scores for sentences in an N-Best list

2011-10-03 Thread Burger, John D.
Philipp Koehn wrote: > if the input is provided as a lattice, then it is not > the case that all translations have the same number > of unknown words. Moreover, the penalty is certainly needed at weight-training time, correct? Then there are different input sentences with different amounts of O

Re: [Moses-support] Calculating final scores for sentences in an N-Best list

2011-10-03 Thread Kaveh Taghipour
Thanks a lot for helping. Best regards, Kaveh On Mon, Oct 3, 2011 at 2:33 PM, Philipp Koehn wrote: > Hi, > > if the input is provided as a lattice, then it is not > the case that all translations have the same number > of unknown words. > > -phi > > On Mon, Oct 3, 2011 at 11:28 AM, Kaveh Taghi

Re: [Moses-support] Calculating final scores for sentences in an N-Best list

2011-10-03 Thread Philipp Koehn
Hi, if the input is provided as a lattice, then it is not the case that all translations have the same number of unknown words. -phi On Mon, Oct 3, 2011 at 11:28 AM, Kaveh Taghipour wrote: > Hi Christian, > > Thanks. You are right. But I think there is no need for such a penalty, > since all ca

Re: [Moses-support] Calculating final scores for sentences in an N-Best list

2011-10-03 Thread Kaveh Taghipour
Hi Christian, Thanks. You are right. But I think there is no need for such a penalty, since all candidates for a given source sentence contain the same number of OOVs and so the penalty does not help at all. Do you know the reason? Cheers, Kaveh On Sun, Oct 2, 2011 at 9:53 PM, Christian Hardme

Re: [Moses-support] Calculating final scores for sentences in an N-Best list

2011-10-02 Thread Christian Hardmeier
I think you're on the right track. For some reason, moses doesn't report the OOV penalty feature, which adds a hardcoded penalty of -100 to the total score for each input word that was copied to the output because no suitable translation was found in the phrase table. Your test sentence probably

[Moses-support] Calculating final scores for sentences in an N-Best list

2011-10-02 Thread Kaveh Taghipour
Hi, I have generated an N-best list with moses, but I do not know how to compute the final score. I tried a log-linear model but came up with a wrong number. For example: moses.ini: # distortion (reordering) weight [weight-d] 0.120662 # language model wei