Re: [Moses-support] RNNLM Integration?

2016-03-08 Thread Matthias Huck
Hi, We once empirically compared two different recombination schemes in a hierarchical phrase-based system (without any kind of neural network language model): Recombination T. The T recombination scheme recombines derivations that produce identical translations. (I.e., hypotheses with the same

[Moses-support] philosophical question ....NMT/SMT

2016-03-08 Thread Vincent Nguyen
Guys, I got a question to the mathematicians that you all are :) I have been working and testing Moses as well as Groundhog for months now. When I compare results (when comparability is possible, using same corpus, in-domain, blablabla, ...) I do not see much difference in both systems. So whe

Re: [Moses-support] Scripts for n-best-list rescoring

2016-03-08 Thread Marcin Junczys-Dowmunt
Great. Thanks for that. W dniu 08.03.2016 o 16:02, Michael Denkowski pisze: I recently checked in the N-best re-scorer I wrote since I couldn't find a good existing one either: https://github.com/moses-smt/mosesdecoder/tree/master/scripts/nbest-rescore. Given an N-best list and references, it

Re: [Moses-support] Scripts for n-best-list rescoring

2016-03-08 Thread Michael Denkowski
I recently checked in the N-best re-scorer I wrote since I couldn't find a good existing one either: https://github.com/moses-smt/mosesdecoder/tree/master/scripts/nbest-rescore. Given an N-best list and references, it uses K-best MIRA to learn re-ranking weights relatively quickly. It's agnostic t

Re: [Moses-support] Replacing OOVs with a single OOV token

2016-03-08 Thread Lane Schwartz
Thanks, Marcin. That got me what I needed. On Tue, Mar 8, 2016 at 8:11 AM, Marcin Junczys-Dowmunt wrote: > -mark-unknown marks the unknown word in the output, from there you can > easily post-process. > > Best, > Marcin > > W dniu 08.03.2016 o 14:08, Lane Schwartz pisze: > > Is there an existin

Re: [Moses-support] Replacing OOVs with a single OOV token

2016-03-08 Thread Marcin Junczys-Dowmunt
-mark-unknown marks the unknown word in the output, from there you can easily post-process. Best, Marcin W dniu 08.03.2016 o 14:08, Lane Schwartz pisze: Is there an existing mechanism by which any OOV word would be replaced in the output with a single unique OOV token, instead of either being

[Moses-support] Replacing OOVs with a single OOV token

2016-03-08 Thread Lane Schwartz
Is there an existing mechanism by which any OOV word would be replaced in the output with a single unique OOV token, instead of either being passed through or dropped? Thanks, Lane ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.e

Re: [Moses-support] Scripts for n-best-list rescoring

2016-03-08 Thread Philipp Koehn
Hi, there is this mysterious check-in: Commit: c6314d927d8b7b638eca387f31ccfab7facb6624 https://github.com/moses-smt/mosesdecoder/commit/c6314d927d8b7b638eca387f31ccfab7facb6624 Author: Michael Denkowski Date: 2016-02-23 (Tue, 23 Feb 2016) Changed paths: A scripts/nbest-rescore/R

Re: [Moses-support] Scripts for n-best-list rescoring

2016-03-08 Thread Lane Schwartz
I don't think there is. At my previous lab, I believe we had to build our own in-house script. It would be nice to have one in moses. On Sat, Oct 31, 2015 at 12:56 PM, Marcin Junczys-Dowmunt wrote: > Hi, > does moses include scripts for n-best-list rescoring/resorting after a > new feature has b

[Moses-support] WMT 2016 Shared Task on Quality Estimation - Call for Participation

2016-03-08 Thread Lucia Specia
CALL FOR PARTICIPATION WMT 2016 Shared Task on Quality Estimation At WMT 2016 (collocated with ACL 2016) *News for 2016* 1) a phrase-level prediction task 2) a document-level predicti

[Moses-support] ** DEADLINE APPROACHING ** FINAL CFP: Computer Speech and Language Special Issue on Deep Learning for Machine Translation

2016-03-08 Thread Marta Ruiz
*Computer Speech and Language Special Issue on Deep Learning for Machine Translation * Deep Learning has been successfully applied to many areas including Natura