[Moses-support] KenLM scoring of long target phrases

2016-04-19 Thread Evgeny Matusov
Hi, my colleagues and I noticed the following in the KenLM code when a Hypo is evaluated with the LM: https://github.com/moses-smt/mosesdecoder/blob/master/moses/LM/Ken.cpp#L203 Do we understand it correctly that because of this line, for phrases longer than the LM order N only the first N

Re: [Moses-support] use placeholder with mosesserver

2015-11-17 Thread Evgeny Matusov
output and with different N-best sizes without having to restart the server (currently, this is the only way to do it). If there are no objections, I will put this parameter back into the code. Best, Evgeny. From: Evgeny Matusov Sent: Wednesday, November 11

Re: [Moses-support] use placeholder with mosesserver

2015-11-11 Thread Evgeny Matusov
Hi Uli, thanks a lot! We will try to add some test cases for Mosesserver, including XML input with/without placeholders. Best, Evgeny. From: Ulrich Germann Sent: Wednesday, November 11, 2015 2:58 AM To: Evgeny Matusov Cc: moses-support@mit.edu Subject: Re

Re: [Moses-support] use placeholder with mosesserver

2015-11-10 Thread Evgeny Matusov
Hi, can any of the more active recent developers advise what is the latest stable mosesserver implementation? It seems to be the one in moses/server, but the one in in contrib/server/mosesserver.cpp has been updated in August of this year with an important fix related to multiple threads: h

[Moses-support] Dependencies in EMS/Experiment.perl

2015-06-19 Thread Evgeny Matusov
Hi, to those of you using Experiment.perl for experiments, maybe you can help me solve the following problem: I added a step to filter full segment overlap of evaluation and tuning data with the training data. This steps removes all sentences from each CORPUS which are also found in EVALUATI

Re: [Moses-support] Memory leak when producing distinct N-best lists?

2009-11-16 Thread Evgeny Matusov
Hieu Hoang wrote: > Hi Evgeny > > I've tried to reproduce the mem leak with distinct n-best, I don't see a > problem. > > are you able to run valgrind and see where the leak is coming from? > > Evgeny Matusov wrote: > > Hi, > > > > I tried to r

[Moses-support] Memory leak when producing distinct N-best lists?

2009-11-13 Thread Evgeny Matusov
Hi, I tried to run Moses to produce N-best lists with distinct hypotheses (setting -nbest-list 500 distinct). Although I also set "-use-persistent-cache false", the memory usage continues to grow from sentence to sentence during translation. The memory consumption drops only 2-3 times in the firs

[Moses-support] Memory leak when producing distinct N-best lists?

2009-11-13 Thread Evgeny Matusov
Hi, I tried to run Moses to produce N-best lists with distinct hypotheses (setting -nbest-list 500 distinct). Although I also set "-use-persistent-cache false", the memory usage continues to grow from sentence to sentence during translation. The memory consumption drops only 2-3 times in the