I'm trying to use the script tokenizer.perl, but nothing is happening. I`m using the following command:
perl tokenizer.perl -l pt \ < ~/moses/work/corpus/training.pt \> ~/moses/work/corpus/new.tok.pt pt is from a Protuguese corpus that i`m using. Sometimes, when I run it, it creates an empty file, but that's all. Thank`s for any help, Anibal.
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
