Re: [Moses-support] nplm ngram total order in ems

2015-08-01 Thread John Joseph Morgan
Thanks Nick > On Aug 1, 2015, at 2:57 PM, Nikolay Bogoychev wrote: > > Hey John, > > This is correct. So imagine the situation of order 5 and source window 4: > > is aligned to and your source window is 4: 4 tokens before and > after s0, which results in a 14gram in total. > > Cheers, > >

Re: [Moses-support] nplm ngram total order in ems

2015-08-01 Thread Nikolay Bogoychev
Hey John, This is correct. So imagine the situation of order 5 and source window 4: is aligned to and your source window is 4: 4 tokens before and after s0, which results in a 14gram in total. Cheers, Nick On Sat, Aug 1, 2015 at 4:30 PM, John Joseph Morgan < johnjosephmor...@gmail.com> wrot

[Moses-support] nplm ngram total order in ems

2015-08-01 Thread John Joseph Morgan
I’m trying to run the toy bilingualnplm example with ems. The ngram order gets computed in experiment.perl on line 1868. The formula is: $order + 2 * $source_window + 1 If $order is 5 and $source_window is 4 this formula gives 14. Is this correct? It doesn't seem right. John __

Re: [Moses-support] Parallelizer multi core

2015-08-01 Thread Hieu Hoang
On 01/08/2015 12:51, Vincent Nguyen wrote: > > I am confused > LM section type = 8 is just for KenLM in model creation / training, > right ? no. type = 8 specify what LM is used during decoding - it puts the 'KENLM' into the moses.ini KENLM and IRSTLM also have binarizing programs to make the

Re: [Moses-support] Parallelizer multi core

2015-08-01 Thread Vincent Nguyen
I am confused LM section type = 8 is just for KenLM in model creation / training, right ? If I want to try IRSTLM for model creation training , then the LM section should not contain any KenLM / type stuff BUT in the tuning, section it will not use the KenLM since the moses.ini will have been g

[Moses-support] Language model creation error

2015-08-01 Thread kalu mera
Dear Members, I am trying to create a language model creation, I entered this command kalumera@kalumera-Satellite-C50-A534:~/mosesdecoder$ ./bjam --with-boost=~/workspace/temp/boost_1_55_0 -j4 but the build failed Please check the attachment for the command i entered and the error, and help advis

Re: [Moses-support] Parallelizer multi core

2015-08-01 Thread Hieu Hoang
in the [LM] section, make sure type = 8 On 01/08/2015 11:48, Vincent Nguyen wrote: > fair enough. > One thing though > When you use irstlm for LM and training, then the EMS crashes in multi > thread at tuning (decoder) > > What is the easiest way so that the tuning part uses KenLM each ti

Re: [Moses-support] Parallelizer multi core

2015-08-01 Thread Vincent Nguyen
fair enough. One thing though When you use irstlm for LM and training, then the EMS crashes in multi thread at tuning (decoder) What is the easiest way so that the tuning part uses KenLM each time multi threads is activated ? (I mean in EMS). Vincent Le 01/08/2015 09:38, Hieu Hoang a é

Re: [Moses-support] Parallelizer multi core

2015-08-01 Thread Hieu Hoang
oh alright. I've made it 4 cores. The example config files are aimed at beginners with laptops. On 01/08/2015 10:35, Marcin Junczys-Dowmunt wrote: > Hi, I agree with Nick. I am using a 64-core machine. "-threads all" will > grind to a still-stand. I am however fine with a few more threads, say 16