I know Jakob Elming at UNICPH did prereordering before training MT models with Moses. He might be able to help.
-Andreas 2014/1/10 <moses-support-requ...@mit.edu> > Send Moses-support mailing list submissions to > moses-support@mit.edu > > To subscribe or unsubscribe via the World Wide Web, visit > http://mailman.mit.edu/mailman/listinfo/moses-support > or, via email, send a message with subject or body 'help' to > moses-support-requ...@mit.edu > > You can reach the person managing the list at > moses-support-ow...@mit.edu > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Moses-support digest..." > > > Today's Topics: > > 1. static build of mosesdecoder (Tak Kuya) > 2. zlib bug causing Moses training to fail (Barry Haddow) > 3. Re: Prereordering was: Re: Google Translate - technology & > paradigms behind it (Hieu Hoang) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Fri, 10 Jan 2014 18:56:33 +0900 > From: Tak Kuya <kuya...@gmail.com> > Subject: [Moses-support] static build of mosesdecoder > To: moses-support@mit.edu > Message-ID: > <CANaijngK2Q2QpaQ4CPP7z5= > wzrza48gmphukgcvppy2sr6g...@mail.gmail.com> > Content-Type: text/plain; charset="iso-8859-1" > > Hi. How do you build mosesdecoder using static libraries like > http://www.statmt.org/moses/RELEASE-1.0/binaries/ ? To make things > simple, I use the master branch instead of Rel.1.0 and edit > mosesdecoder/Jamroot a little and build the decoder only. > > I can build the normal "shared" version of moses without any problems > and usually use it (on CentOS 6.5 with boost 1.41). But I failed to > build moses with --static option. So I installed boost 1.41 to my home > directory. But I still couldn't build moses. It said "cannot find -lz > and -lrt" so I installed zlib-static and glibc-static with yum. > > And... It failed again. Here are build.log and Jamroot I used. Could > anyone teach me how to solve the problem? Thank you. > > Best regards, > Tak Kuya > -------------- next part -------------- > A non-text attachment was scrubbed... > Name: build.log > Type: application/octet-stream > Size: 2184 bytes > Desc: not available > Url : > http://mailman.mit.edu/mailman/private/moses-support/attachments/20140110/03806883/attachment-0002.obj > -------------- next part -------------- > A non-text attachment was scrubbed... > Name: Jamroot > Type: application/octet-stream > Size: 6038 bytes > Desc: not available > Url : > http://mailman.mit.edu/mailman/private/moses-support/attachments/20140110/03806883/attachment-0003.obj > > ------------------------------ > > Message: 2 > Date: Fri, 10 Jan 2014 14:13:57 +0000 > From: Barry Haddow <bhad...@staffmail.ed.ac.uk> > Subject: [Moses-support] zlib bug causing Moses training to fail > To: moses-support@mit.edu > Message-ID: <52d00025.9090...@staffmail.ed.ac.uk> > Content-Type: text/plain; charset=ISO-8859-1; format=flowed > > Hi > > I've discovered that an apparent bug in zlib (specifically version > 1.2.3.4 installed in Ubuntu 12.04) can cause the Moses training pipeline > to fail. Upgrading to the latest zlib (1.2.8) fixes the problem. > > The problem appears when the extract files are being read in order to > create the reordering tables or translation tables. For the reordering > table, an error message like this > > terminate called after throwing an instance of 'util::GZException' > what(): util/read_compressed.cc:163 in virtual std::size_t > util::{anonymous}::GZip::Read(void*, std::size_t, util::ReadCompressed&) > threw GZException'. > zlib encountered invalid distances set code -3 > > is printed, whilst for the translation table, the Moses scorer swallows > the zlib error but eventually fails in 'consolidate' like this: > > ERROR: source phrase does not match in line 289: 'clean .' != > 'definitely recommend to have' > > So far I haven't found any reports of this zlib bug, and it seems to be > quite intermittent. > > cheers - Barry > > > -- > The University of Edinburgh is a charitable body, registered in > Scotland, with registration number SC005336. > > > > ------------------------------ > > Message: 3 > Date: Fri, 10 Jan 2014 15:05:45 +0000 > From: Hieu Hoang <hieuho...@gmail.com> > Subject: Re: [Moses-support] Prereordering was: Re: Google Translate - > technology & paradigms behind it > To: moses-support@mit.edu > Message-ID: <52d00c49.7010...@gmail.com> > Content-Type: text/plain; charset="iso-8859-1" > > Not that I know of. If you create 1, please check it in. > > On 09/01/2014 15:49, Per Tunedal wrote: > > Hi, > > are there any tools to do prereordering with Moses? I suppose it has > > to be done both before training and translation. And that it > > presupposes tagging. > > How much does prereordering improve translation? > > Yours, > > Per Tunedal > > On Wed, Jan 8, 2014, at 22:42, Philipp Koehn wrote: > >> Hi, > >> Google lists its research papers here: > >> http://research.google.com/pubs/MachineTranslation.html > >> --- snip--- > >> maybe hierarchical, with pre-reordering. > >> ---snip --- > >> -phi > >> > >> > >> On Wed, Jan 8, 2014 at 8:47 PM, Ivan Dun?er <ivandun...@gmail.com > >> <mailto:ivandun...@gmail.com>> wrote: > >> > >> Hi everybody, > >> > >> is there any reading material (e.g. scientific articles etc.) on > what > >> MT approaches Google Translate uses? > >> Sorry for off-topic. > >> > >> Regards, > >> Ivan > >> _______________________________________________ > >> Moses-support mailing list > >> Moses-support@mit.edu <mailto:Moses-support@mit.edu> > >> http://mailman.mit.edu/mailman/listinfo/moses-support > >> > >> _________________________________________________ > >> Moses-support mailing list > >> Moses-support@mit.edu <mailto:Moses-support@mit.edu> > >> http://mailman.mit.edu/mailman/listinfo/moses-support > > > > > > _______________________________________________ > > Moses-support mailing list > > Moses-support@mit.edu > > http://mailman.mit.edu/mailman/listinfo/moses-support > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20140110/ebf90109/attachment.htm > > ------------------------------ > > _______________________________________________ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support > > > End of Moses-support Digest, Vol 87, Issue 20 > ********************************************* > -- Med venlig hilsen Andreas Søeborg Kirkedal
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
