Dear Asad, There're several way to add dictionary to the MT process.
You can either (i) add it passively as additional training data or (ii) use the XML input (http://www.statmt.org/moses/?n=Advanced.Hybrid) during decoding. I've done some experiments on that, you can take a look here for a reference: https://www.aclweb.org/anthology/W/W15/W15-4105.pdf At decoding, there's some kinks about how to change the input into an XML and also what probabilities to assign and which lexical item to choose. In the experiment with Japanese-English dataset, I've used uniform probabilities and allow all inputs and I didn't get good results. You can try other setups with the XML-input decoding and see whether you can get some improvement on your dataset. I hope the information helps, have fun with dictionaries and moses! Regards, Liling On Tue, Sep 15, 2015 at 5:00 PM, <moses-support-requ...@mit.edu> wrote: > Send Moses-support mailing list submissions to > moses-support@mit.edu > > To subscribe or unsubscribe via the World Wide Web, visit > http://mailman.mit.edu/mailman/listinfo/moses-support > or, via email, send a message with subject or body 'help' to > moses-support-requ...@mit.edu > > You can reach the person managing the list at > moses-support-ow...@mit.edu > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Moses-support digest..." > > > Today's Topics: > > 1. Is it possible to add dictionary to MOSES? (Asad A.Malik) > 2. (no subject) (Sanjanashree Palanivel) > 3. Re: (no subject) (Rico Sennrich) > 4. Translating back to source language (Asad A.Malik) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Mon, 14 Sep 2015 17:31:42 +0000 (UTC) > From: "Asad A.Malik" <asad_12...@yahoo.com> > Subject: [Moses-support] Is it possible to add dictionary to MOSES? > To: Moses-support <moses-support@mit.edu> > Message-ID: > <1251348962.2284075.1442251902037.javamail.ya...@mail.yahoo.com> > Content-Type: text/plain; charset="utf-8" > > Hi All, > I've trained the english to urdu phrase based SMT. ?Now I wanted to add > the dictionary to the system for those words which are converted in target > text. So is it to add dictionary to the trained system??-- > > Kind Regards, > > Mr. Asad Abdul Malik > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20150914/e3985c0c/attachment-0001.html > > ------------------------------ > > Message: 2 > Date: Tue, 15 Sep 2015 12:54:31 +0530 > From: Sanjanashree Palanivel <sanjanash...@gmail.com> > Subject: [Moses-support] (no subject) > To: moses-support@mit.edu > Message-ID: > <CAAc_kp6Cy9jLgAHxRRB2+L4V97SYFxmG= > gwzaoy9bnw1n+s...@mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > Dear all, > > I tried building language model using NPLM. Llanguage model > was build succesfully, but, when I tried to compile NPLM with Moses using > "./bjam --with-nplm=path/to/nplm" I am getting an error. I am using boost > 1.55. I am attaching the log file for reference. I dont know where I went > wrong. Any help would be appreciated. > > > -- > Thanks and regards, > > Sanjanasri J.P > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20150915/53dca0c6/attachment-0001.html > -------------- next part -------------- > A non-text attachment was scrubbed... > Name: build.log.gz > Type: application/x-gzip > Size: 4550 bytes > Desc: not available > Url : > http://mailman.mit.edu/mailman/private/moses-support/attachments/20150915/53dca0c6/attachment-0001.gz > > ------------------------------ > > Message: 3 > Date: Tue, 15 Sep 2015 11:52:47 +0100 > From: Rico Sennrich <rico.sennr...@gmx.ch> > Subject: Re: [Moses-support] (no subject) > To: moses-support@mit.edu > Message-ID: <55f7f87f.6080...@gmx.ch> > Content-Type: text/plain; charset="windows-1252" > > Hello Sanjanasri, > > this looks like a version mismatch between Moses and NPLM. Specifically, > you're using an older Moses commit that is only compatible with nplm 0.2 > (or specifically, Kenneth's fork at https://github.com/kpu/nplm ). > > If you use the latest Moses version from > https://github.com/moses-smt/mosesdecoder , and the latest nplm version > from https://github.com/moses-smt/nplm , it should work. > > best wishes, > Rico > > On 15.09.2015 08:24, Sanjanashree Palanivel wrote: > > > > Dear all, > > > > I tried building language model using NPLM. Llanguage > > model was build succesfully, but, when I tried to compile NPLM with > > Moses using "./bjam --with-nplm=path/to/nplm" I am getting an error. I > > am using boost 1.55. I am attaching the log file for reference. I > > dont know where I went wrong. Any help would be appreciated. > > > > > > -- > > Thanks and regards, > > > > Sanjanasri J.P > > > > > > _______________________________________________ > > Moses-support mailing list > > Moses-support@mit.edu > > http://mailman.mit.edu/mailman/listinfo/moses-support > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20150915/d56a91da/attachment-0001.html > > ------------------------------ > > Message: 4 > Date: Tue, 15 Sep 2015 14:59:57 +0000 (UTC) > From: "Asad A.Malik" <asad_12...@yahoo.com> > Subject: [Moses-support] Translating back to source language > To: Moses-support <moses-support@mit.edu> > Message-ID: > <1866807479.193298.1442329197729.javamail.ya...@mail.yahoo.com> > Content-Type: text/plain; charset="utf-8" > > Hi All, > > I've trained system which is able to translate from language A to language > B and it is working pretty fine. Now I've trained system for translating > from language B to language A. but it is not working. I've changed the > language model directory and working directory for it. But it is not > translating the input text. Kindly guide that what should I do. > ?-- > > Kind Regards, > > Mr. Asad Abdul Malik > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20150915/874b6695/attachment.html > > ------------------------------ > > _______________________________________________ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support > > > End of Moses-support Digest, Vol 107, Issue 38 > ********************************************** >
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
