Hi, We have recently added a transliteration module in Moses. Here's how to use it:
http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc5 When enabled the model will try to mine transliteration pairs from the word-aligned parallel corpus and build a transliteration model over the resulting transliteration training data. It is totally unsupervised and language independent. You can find more details in this paper. http://aclweb.org/anthology//E/E14/E14-4029.pdf Cheers, Nadir On Sun, Jun 8, 2014 at 5:31 PM, <moses-support-requ...@mit.edu> wrote: > Send Moses-support mailing list submissions to > moses-support@mit.edu > > To subscribe or unsubscribe via the World Wide Web, visit > http://mailman.mit.edu/mailman/listinfo/moses-support > or, via email, send a message with subject or body 'help' to > moses-support-requ...@mit.edu > > You can reach the person managing the list at > moses-support-ow...@mit.edu > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Moses-support digest..." > > > Today's Topics: > > 1. Error in Phrase-Table-Triangulation (Megha Jhunjhunwala) > 2. Re: Error in Phrase-Table-Triangulation (Hieu Hoang) > 3. Transliteration Support in Moses (Shahid Khan) > 4. Mert-moses XML files (Cyrine NASRI) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Sun, 8 Jun 2014 17:07:23 +0530 > From: Megha Jhunjhunwala <jjw.me...@gmail.com> > Subject: [Moses-support] Error in Phrase-Table-Triangulation > To: moses-support@mit.edu > Message-ID: > <CAJM7Lf40zDiBqwhea=8qhew7au-a_ohzanrikl3t5uwaf9z...@mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > Hello, > > I am trying to do phrase-table triangulation to generate a new > phrase-table. But I am not being able to figure what the last 3 values in > the phrase-table signify. ????? > for ex : > ???????? ????? ||| ????????? ????? ||| 0.00864127194755 8.337659958e-08 > 0.00432064057394 1.13306222125e-06 2.718 ||| 0-0 1-1 1-2 2-3 ||| 1 2 1 > > > What do the values 1 2 1 are for ? > > Also does moses use the alignments 0-0 and 1-1 etc to give translations. > > Thanks > Megha > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20140608/31b3b653/attachment-0001.htm > > ------------------------------ > > Message: 2 > Date: Sun, 8 Jun 2014 12:47:15 +0100 > From: Hieu Hoang <hieu.ho...@ed.ac.uk> > Subject: Re: [Moses-support] Error in Phrase-Table-Triangulation > To: Megha Jhunjhunwala <jjw.me...@gmail.com> > Cc: moses-support <moses-support@mit.edu> > Message-ID: > <CAEKMkbgBFnZrDXU=wuhbcebeck7xxm_+5yko1k9dwgpqmfp...@mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > the 1 2 1 are the counts. They are used for debug and can be ignored, they > aren't used for decoder. > > the word alignments 0-0 and 1-1 are used by some new feature functions but > not by the basic feature functions. If you don't want to create them, then > leave them out > > > On 8 June 2014 12:37, Megha Jhunjhunwala <jjw.me...@gmail.com> wrote: > >> Hello, >> >> I am trying to do phrase-table triangulation to generate a new >> phrase-table. But I am not being able to figure what the last 3 values in >> the phrase-table signify. ????? >> for ex : >> ???????? ????? ||| ????????? ????? ||| 0.00864127194755 8.337659958e-08 >> 0.00432064057394 1.13306222125e-06 2.718 ||| 0-0 1-1 1-2 2-3 ||| 1 2 1 >> >> >> What do the values 1 2 1 are for ? >> >> Also does moses use the alignments 0-0 and 1-1 etc to give translations. >> >> Thanks >> Megha >> >> _______________________________________________ >> Moses-support mailing list >> Moses-support@mit.edu >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > > > -- > Hieu Hoang > Research Associate > University of Edinburgh > http://www.hoang.co.uk/hieu > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20140608/8e3d39b9/attachment-0001.htm > > ------------------------------ > > Message: 3 > Date: Sun, 8 Jun 2014 15:19:03 +0100 > From: Shahid Khan <tension.k...@gmail.com> > Subject: [Moses-support] Transliteration Support in Moses > To: moses-support@mit.edu > Message-ID: > <cacupstu_xp80pccsbveltiowtk-pkwfwaueurkz_notqnco...@mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > Hi, > > Is there a module to transliterate OOV words in Moses? Or any standalone > transliteration toolkit to do this? > > I am trying to translate some English data into Hindi. Our system is based > on the data provided for WMT this year and some additional in-domain data. > But the number of OOVs is still massive. However, at least half of these > could be transliterated. > > Regards, > Shahid > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20140608/4be9eecd/attachment-0001.htm > > ------------------------------ > > Message: 4 > Date: Sun, 8 Jun 2014 18:19:34 +0200 > From: Cyrine NASRI <cyrine.na...@univ-lorraine.fr> > Subject: [Moses-support] Mert-moses XML files > To: "moses-support@mit.edu" <moses-support@mit.edu> > Message-ID: > <CAPg_V0gwy2nrnADQPAvjBqUMSskVRsTcC+mEuQb=ks_ftrf...@mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > Hello, > > I have a question concern Mert-moses: Is it possible in Moses to do Mert on > XML files? > Is there any option to do this, or should i delete the XML tags manually > before doing MERT? > > Thank you in advance > > Bests > > Cyrine > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20140608/717c1e8c/attachment-0001.htm > > ------------------------------ > > _______________________________________________ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support > > > End of Moses-support Digest, Vol 92, Issue 19 > ********************************************* _______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
