Re: [Moses-support] Issue with alignment

2015-10-22 Thread gang tang
Dear Per, Thanks for your kind suggestions. I am digging into my data and the source code of giza++ to find out what happened to my precious pair of "sandalo vernice" and "vernice sandal". I will certainly look into how to utilize Hunalign to advance my cause later on. Thanks again, and

[Moses-support] factored tuning time

2015-10-22 Thread Tomasz Gawryl
Hi, I've one question to you about time of factored tuning. How many times longer it takes compared to phrase based tuning? I'm asking because it's 7'th day and it's still tuning (3,3 mln corpus sentences). Phrase based tuning took around 3h for the same corpus. Top shows me that moses uses

Re: [Moses-support] NPLM with Europarl ?

2015-10-22 Thread Rico Sennrich
Hi Vincent, here's some results on WMT data (not just Europarl): +0.6 BLEU for English->German (https://tacl2013.cs.columbia.edu/ojs/index.php/tacl/article/download/510/120) +/-0 for French->English, +0.7 for English->French, +0.4 for Finnish->English, +0.4 for English->Finnish

Re: [Moses-support] factored tuning time

2015-10-22 Thread Hieu Hoang
Can I have a look at your moses.ini file? You should be careful trying to use complicated factored models as they can take a long time to run. Also, you can use multithreading to make it run faster Hieu Hoang http://www.hoang.co.uk/hieu On 22 October 2015 at 07:28, Tomasz Gawryl

[Moses-support] lmplz error

2015-10-22 Thread Hieu Hoang
hi all does anyone know how to fix this error from lmplz: terminate called after throwing an instance of 'lm::builder::BadDiscountException' what(): ERROR: 4-gram discount out of range for adjusted count 3: -0.446424 The command I was running is .../lmplz --text

Re: [Moses-support] Issue with tuning - decoder died

2015-10-22 Thread Ya-chi Lin
Hi ALL, I'm building an English to Traditional Chinese system but have encountered a problem while performing tuning. Below is the content of mert.out file. Can anyone please tell me what went wrong here? Any help will be greatly appreciated. Using SCRIPTS_ROOTDIR: /opt/mosesdecoder/scripts

[Moses-support] lm integration in mosesdecoder

2015-10-22 Thread koormoosh
Hello, Are there any guidelines for integrating language models in mosesdecoder? Thanks. ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] lm integration in mosesdecoder

2015-10-22 Thread Hieu Hoang
you need to add your lm into FF/Factory.cpp Hieu Hoang http://www.hoang.co.uk/hieu On 22 October 2015 at 14:44, koormoosh wrote: > So based on SkeletonLM I can create my own MYOWN_LM.h and MYOWN_LM.cpp and > that's it? Is there anywhere else in the mosesdecoder that I

Re: [Moses-support] Issue with alignment

2015-10-22 Thread Per Tunedal
Dear Gang, To clarify: I used my own scripts for my experiments. I tried improving already aligned data (e.g. samples from the Europarl corpus) by eliminating bad alignments. I was inspired by Hunalign to try using dictionaries. An approach that proved useful to prevent unduly removal of

Re: [Moses-support] lm integration in mosesdecoder

2015-10-22 Thread Hieu Hoang
i don't think you do. Try it without. Once you've compiled with MYOWN, run ./bin/moses this should give you a list of feature functions. It should also have MYOWN Hieu Hoang http://www.hoang.co.uk/hieu On 22 October 2015 at 14:59, koormoosh wrote: > and also add it to