Hello all,

I have a problem with the tokenizer.pl script. i get as a result a text ith
some special punctuation , like this for example :

EU 's Luxembourg-based statistical office reported

The input file is a .txt file

Is there any solution for this problem

Thank you in advance


Bests
-- 
*Cyrine*
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to