[Moses-support] unsolved) Moses eating up too much memory

2013-10-28 Thread Andrew Shin
I apologize since my previous question on the same topic didn't specify enough.I'm following the steps in http://www.statmt.org/moses/?n=Moses.Baseline exactly the same way,and when I try to run Moses with the following command:~/mosesdecoder/bin/moses -f ~/working/mert-work/moses.ini (often wit

[Moses-support] How to use the NeuralLM

2013-10-28 Thread Li Xiang
Hi, I just find the NeuralLM is added into the Moses. Could you give me an example about the usage? Thanks. -- Xiang Li ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] multi-threaded tuning not working

2013-10-28 Thread Hieu Hoang
20 hours for tuning isn't too bad. What is the EXACT command you ran? Can you also post your configuration file and Moses.ini for when you ask questions to help people debug your problem Sent while bumping into things > On 28 Oct 2013, at 22:49, Andrew Shin wrote: > > Hi, > > I've done tunin

[Moses-support] multi-threaded tuning not working

2013-10-28 Thread Andrew Shin
Hi, I've done tuning without the multi-core option,and it took about 20 hours for 650,000 lines of input files, and 5000 lines of tuning reference.I tried tuning with the multi-core option as--decoder-flags="-threads 4"but it doesn't initiate anything.I have macbook pro with 2.4 GHz i5 dual core

Re: [Moses-support] Running moses fills up hard disk space..

2013-10-28 Thread Tom Hoar
Running the Moses binary doesn't use either of the perl scripts. I've had experiences where moses buffered the translated output and accumulated significant RAM, but never hard drive space. What's the size of your nbest.txt output file? Is it possible that 25 the 25 n-best output sentences for eac

Re: [Moses-support] getting WER metrics

2013-10-28 Thread Francis Tyers
There is a package in Apertium which is a simple perl script which calculates WER and PER: https://svn.code.sf.net/p/apertium/svn/trunk/apertium-eval-translator http://wiki.apertium.org/wiki/Evaluation#Using_apertium-eval-translator_for_WER_and_PER Fran El dl 28 de 10 de 2013 a les 11:33 -0400,

Re: [Moses-support] getting WER metrics

2013-10-28 Thread Philipp Koehn
Hi, Moses currently does not include a tool to measure WER. It should be simple to write, so I would encourage you to implement it and contribute it back. -phi On Sun, Oct 27, 2013 at 11:11 PM, Andrew Shin wrote: > Hello, > sorry to ask another question.. > > I've done getting BLEU score in the

Re: [Moses-support] Running moses fills up hard disk space..

2013-10-28 Thread Tom Hoar
Your description is a bit unclear. Are you talking about running the Moses binary? Running Moses with binarized phrase table, reordering table and language model (or hierarchical equivalent) -- and configuring the moses.ini file to use them -- should not consume any additional hard disk space.