Re: [Moses-support] Moses-support Digest, Vol 162, Issue 3

2020-04-04 Thread nakul sharma
rding transliteration. How can I do > that in mosses using indic nlp or other if anyone has done this then I > kindly ask for their guidance. > -- next part -- > An HTML attachment was scrubbed... > URL: http://mailman.mit.edu/mailman/private/moses-support/attachm

[Moses-support] phrase-table with ' " and other strage things. Additional corpus cleaning necessary?

2020-04-04 Thread Artem Shevchenko
Hello, following the manual for baseline creaition, I have trained the model using Europarl v9 de-en pair. Now I observe that obtained phrase table contains a lot of noise. E.g. a lot of "' ", """ which seem to distort the model and decoder. E.g. truecasing did not work properly with those specia