Re: [Moses-support] Training backward LM?

Hi Michael, Trying to check if you're tests on this subject were successful or not, can you follow up ? thanks ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Training backward LM?

Thanks for the explanations everyone. I added it back to the feature factory and it seems to be working. I'll run some tests and check it back in if nothing catches fire (since it's already building everything anyway). Best, Michael On Fri, Mar 11, 2016 at 11:30 AM, Hieu Hoang

Re: [Moses-support] Training backward LM?

FF/Factory.cpp There never was a LM/Factory.cpp Hieu Hoang http://www.hoang.co.uk/hieu On 11 March 2016 at 16:26, Lane Schwartz wrote: > Hieu, > > What happened to moses/LM/Factory.cpp? It's not there anymore. > > Lane > > > On Fri, Mar 11, 2016 at 10:22 AM, Lane Schwartz

Re: [Moses-support] Training backward LM?

Hieu, What happened to moses/LM/Factory.cpp? It's not there anymore. Lane On Fri, Mar 11, 2016 at 10:22 AM, Lane Schwartz wrote: > You'll also need to tell the moses.ini file that you want a BackwardLM. > > For example, see the code at revision >

Re: [Moses-support] Training backward LM?

You'll also need to tell the moses.ini file that you want a BackwardLM. For example, see the code at revision 8459a86137f7d15834009557a62c4278479da088 in moses/LM/Factory.cpp: + case BackwardLM: > +return ConstructBackwardLM(languageModelFile, factorTypes[0], > lmImplementation == LazyKen);

Re: [Moses-support] Training backward LM?

I see ngrams in the backward.arpa file that look like this: -1.263617 we > -1.263617 we when > -0.6615573 when -1.48317 . rights -1.48317 . works Based on that, and on my recollection, I think you just have to reverse the order of the words in each

Re: [Moses-support] Training backward LM?

I'm the one who wrote that code. I don't remember off hand exactly what was necessary, but I believe that I left notes in the git commit log. Somewhere in my archives I think I have the actual scripts that I used, but I don't have those easily accessible right now. I'll try to find them. In the

Re: [Moses-support] Training backward LM?

There were failing unit tests. Paging Lane Schwartz. On 03/11/2016 03:56 PM, Hieu Hoang wrote: > I remember there is compilation issues with it. I guess at some point > someone must have gotten tired of looking after it and took it out of > the build. > > On 10/03/2016 23:36, Michael Denkowski

Re: [Moses-support] Training backward LM?

I remember there is compilation issues with it. I guess at some point someone must have gotten tired of looking after it and took it out of the build. On 10/03/2016 23:36, Michael Denkowski wrote: As a follow-up, how exactly does one activate the BackwardLanguageModel feature? It doesn't

Re: [Moses-support] Training backward LM?

As a follow-up, how exactly does one activate the BackwardLanguageModel feature? It doesn't seem to be registered anywhere although it's been in Moses for awhile. Still work in progress? Best, Michael On Thu, Mar 10, 2016 at 4:33 PM, Michael Denkowski < michael.j.denkow...@gmail.com> wrote: >

[Moses-support] Training backward LM?

Hi Moses LM enthusiasts, This may be a silly question. If I want to use the BackwardLanguageModel feature, what (if anything) should I do to let KenLM know that it's a backward model? If I just reverse the words in each sentence and run lmplz/build_binary, will Moses do the right thing with the