[Moses-support] Who maintain the Moses website?

2011-08-29 Thread 蒋乾
Hi all, There is a command *za2bal.pl -d path-to-updated-tgt-to-src-ahmm -i path-to-updated-src-to-tgt-ahmm | symal -alignment=grow -diagonal=yes -final=yes -both=yes new-alignment-file * recorded in the Advanced features on the website. *Do you know who recorded the content and from whom I

Re: [Moses-support] Finite-State Language Models

2011-08-29 Thread Graham Neubig
Hi Lane, Thanks for the info! Sounds like nothing like this exists already so I'll try to do it myself (and contribute the code back if anyone else would be interested). Graham On Sun, Aug 28, 2011 at 5:37 PM, Lane Schwartz dowob...@gmail.com wrote: On Sun, Aug 28, 2011 at 12:48 PM, Graham

Re: [Moses-support] Who maintain the Moses website?

2011-08-29 Thread Nicola Bertoldi
Dear James most code of the word alignment symmetrization comes from FBK. I found an previous email where you asked giza2bal.plhttp://giza2bal.pl/ -d path-to-updated-tgt-to-src-ahmm -i path-to-updated-src-to-tgt-ahmm j symal -alignment=grow -diagonal=yes -final=yes -both=yes

Re: [Moses-support] can't understand the parameter of giza2bal.pl

2011-08-29 Thread Oliver Wilson
Hi James, I wrote the documentation you're referring to -- sorry it's not that easy to follow. The *hmm files you mentioned should have been generated by earlier steps. Could you post your gizacfg file? Regards, Oliver On Wed, Aug 24, 2011 at 10:58:37AM +0800, wrote: Hi moses-support,

[Moses-support] Moses caching questions

2011-08-29 Thread Tom Hoar
I've implemented a multi-threaded Python wrapper that loads moses decoder and pipes strings through the moses binary. It's similar to Ivan Uemlianin's code from May 04, 2010 on this listserv, but achieves a throughput efficiency 398% CPU load on a quad-core host across multiple documents

Re: [Moses-support] Moses caching questions

2011-08-29 Thread Barry Haddow
Hi Tom If one of the moses caches was filling up, then I would expect that the process memory would increase, until the machine ground to a halt. The problem that Ivan had with the original version of his wrapper was slightly different, there was a fixed size i/o buffer that he wasn't

Re: [Moses-support] Moses caching questions

2011-08-29 Thread marco turchi
Hi Tom, I'm running something similar to your wrapper in Java with a 16 core (thanks to hyperthreading) machines, and a common problem that I had at the beginning was the presence of the | characters in the source sentence. Cheers Marco On Mon, Aug 29, 2011 at 1:58 PM, Barry Haddow

Re: [Moses-support] Moses caching questions

2011-08-29 Thread Tom Hoar
Thanks Barry. The quote comes from http://www.statmt.org/moses/manual/manual.pdf, page 185, section 5.4.4, Caching across Sentences paragraph. I understood Ivan's problem. My script is only remotely similar. I also frequently use the multi-threading/multiprocessor configuration.

Re: [Moses-support] Using Input Features (Lattices) Breaks mert-moses

2011-08-29 Thread Nicola Bertoldi
finishes: --- The decoder returns the scores in this order: d d d d d d d lm w I tm tm tm tm tm Mismatched lambdas. Decoder returned d d d d d d d lm w I tm tm tm tm tm, we expected d d d d d d d lm w tm tm tm tm tm tm at /home/neubig/usr/bin/scripts-20110829-0448/training/mert-moses.pl

Re: [Moses-support] Using Input Features (Lattices) Breaks mert-moses

2011-08-29 Thread Barry Haddow
d d d d d d d lm w tm tm tm tm tm tm at /home/neubig/usr/bin/scripts-20110829-0448/training/mert-moses.pl line 959 --- Looking at the code quickly, it looks like the feature for the input weight is being registered as a PhraseDictionaryFeature, which is causing it to return tm instead

Re: [Moses-support] Using Input Features (Lattices) Breaks mert-moses

2011-08-29 Thread Alexander Fraser
d d d d d lm w tm tm tm tm tm tm at /home/neubig/usr/bin/scripts-20110829-0448/training/mert-moses.pl line 959 --- Looking at the code quickly, it looks like the feature for the input weight is being registered as a PhraseDictionaryFeature, which is causing it to return tm instead

Re: [Moses-support] Using Input Features (Lattices) Breaks mert-moses

2011-08-29 Thread Graham Neubig
tm tm at /home/neubig/usr/bin/scripts-20110829-0448/training/mert-moses.pl line 959 --- Looking at the code quickly, it looks like the feature for the input weight is being registered as a PhraseDictionaryFeature, which is causing it to return tm instead of the expected I, which is causing