you can get kenlm to report perplexity as follows:

bin/query foo.arpa <text | tail -n 1

note that you need to be careful with OOVs if you are comparing models
that do not all use the same vocabulary.

(SRILM is broekn in this respect in that an OOV will give you a
probability of one)

Miles

-- 
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to