Hi James, the Phrasal toolkit is freely available as well [http://nlp.stanford.edu/phrasal/], so why don't you consider extracting discontinuous phrases using Stanford's original implementation?
Cheers, Matthias On Tue, 2013-11-05 at 07:29 +0000, Read, James C wrote: > Interesting. > > This isn't going to be an issue for the kind of experiments I will be > running, though. I won't be using a language model or a reordering > model or a beam search during decoding (I know, not much of Moses > left). My main usage of 'Moses' at the moment is training translation > models so I can run experiments with 'units of translation' in > isolation from other variables in the system (language model, > reordering model, beam search). I would really like to be able to run > some experiments also with discontinuous phrases both source side and > target side. > > Any idea what kind of changes I would need to make to the training > process to be able to learn these kind of transformations? I suppose > I'm also going to need to modify the operation of the translation > model to get these working as well. > > thanks, > James > > ________________________________ > From: moses-support-boun...@mit.edu [moses-support-boun...@mit.edu] on behalf > of Daniel Cer [daniel....@gmail.com] > Sent: 04 November 2013 19:43 > To: Kenneth Heafield > Cc: moses-support@mit.edu > Subject: Re: [Moses-support] gappy phrases > > Hi everyone, > > Ken and I just spoke about this. > > Here's a quick synopsis of our semi-recent experience at Stanford with > discontinuous/gappy phrases: > > * Source side gaps are effectively free and don't really degrade decoding > time. > * Target side gaps are fine for smaller beam sizes (e.g., < 200). > * When using large beams, our current implementation slows down > dramatically. For example, with a stack size of 500, I think it was sometimes > taking over an hour to translate some sentences. > > While discontinuous phrases can moderately increase the BLEU score, but we > get a bigger increase by just using very large beam sizes. > > Dan > > > > On Sun, Nov 3, 2013 at 8:34 PM, Kenneth Heafield > <mo...@kheafield.com<mailto:mo...@kheafield.com>> wrote: > Hi, > > I'll throw in the anecdote that gappy phrases are currently not in use > at Stanford. My predecessor told me that it took a lot longer and only > improved BLEU slightly on Chinese-English. But it's also possible that > something didn't get passed down correctly from Michel to my predecessor > to me. . . > > Kenneth > > On 11/03/13 14:18, Read, James C wrote: > > My understanding is that they used a similar approach as the grammar > > extraction to extract the gappy phrases. Would it be a massive undertaking > > to get Moses to support this? > > > > James > > ________________________________________ > > From: Barry Haddow > > [bhad...@staffmail.ed.ac.uk<mailto:bhad...@staffmail.ed.ac.uk>] > > Sent: 30 October 2013 09:26 > > To: Read, James C > > Cc: moses-support@mit.edu<mailto:moses-support@mit.edu> > > Subject: Re: [Moses-support] gappy phrases > > > > No, but it does support hiero and syntax models. > > > > On 29/10/13 22:23, Read, James C wrote: > >> Hi, > >> > >> does anybody know if Moses supports gappy phrases > >> http://www-nlp.stanford.edu/pubs/naacl10-discontinuous_phrases.pdf > >> > >> James > >> > >> _______________________________________________ > >> Moses-support mailing list > >> Moses-support@mit.edu<mailto:Moses-support@mit.edu> > >> http://mailman.mit.edu/mailman/listinfo/moses-support > >> > > > > > > -- > > The University of Edinburgh is a charitable body, registered in > > Scotland, with registration number SC005336. > > > > > > _______________________________________________ > > Moses-support mailing list > > Moses-support@mit.edu<mailto:Moses-support@mit.edu> > > http://mailman.mit.edu/mailman/listinfo/moses-support > > > _______________________________________________ > Moses-support mailing list > Moses-support@mit.edu<mailto:Moses-support@mit.edu> > http://mailman.mit.edu/mailman/listinfo/moses-support > > > _______________________________________________ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support > -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. _______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
