Re: [Moses-support] How to change phrase representation

2011-06-15 Thread Ben Gottesman
- Forwarded message -- > From: Miles Osborne > To: Anna c > Date: Mon, 13 Jun 2011 18:50:07 +0100 > Subject: Re: [Moses-support] How to change phrase representation > the simplest approach would be to use another character to join words > together. the tokeniser thi

Re: [Moses-support] How to change phrase representation

2011-06-13 Thread Miles Osborne
s have been separated and it appears as "the ~ man". Should > I change the tokenizer.perl to ignore the '~' or should I skip that steps? > Or it is correct in that way? > > Thank you very much! > Best regards, > Anna > > > > >> Date: Fri, 10 J

Re: [Moses-support] How to change phrase representation

2011-06-13 Thread Anna c
, 10 Jun 2011 10:48:07 +0100 > Subject: Re: [Moses-support] How to change phrase representation > From: pko...@inf.ed.ac.uk > To: annac...@hotmail.com > CC: moses-support@mit.edu > > Hi, > > I am not entirely sure if I fully understand your question, > but let me try to

Re: [Moses-support] How to change phrase representation

2011-06-10 Thread Philipp Koehn
Hi, I am not entirely sure if I fully understand your question, but let me try to answer. the phrase-based model implementation considers tokens separated by a white space as a word. It does also learn translation entries for sequences of words ("phrases"). If you want to group words into larger

[Moses-support] How to change phrase representation

2011-06-10 Thread Anna c
Hi! I'm doing a master's degree and I need some help with one of my subjects. I've already installed GIZA++ and Moses correctly, and made the step by step guide of the web, checking that everything was ok. But I'm a newbie in this and I'm a bit lost. What I have to do is to change the represent