You're right, there were 2 different translation models for phrase-based and syntax decoding in the old version. The phrase-based model didn't check for [ ] characters.
The new Moses use only 1 translation model which always checks for [ ]. It will be easier for you to escape the characters, rather than back port the ini file Sent while bumping into things > On 21 Dec 2013, at 09:18, Rajen Chatterjee <[email protected]> > wrote: > > Hi, > You are right there is [ character in the phrase table. But the problem is > I am running same language pair with same train and test set on both, old > moses version and the new version. I am getting decoding output in the old > moses version (in which '[' character is present in the phrase table) but I > am not getting decoding output in the new moses. > As you say '[' character is a problem then why it is not giving error > when decoding with old moses? > > Thanks > > >> On Fri, Dec 20, 2013 at 3:54 PM, Hieu Hoang <[email protected]> wrote: >> from the line number, that's likely that there is a [ character in your >> phrase table. Moses interpret words with [ ] as non-terminals. >> >> I think the error would happen whatever version of Moses you are using. >> >> >> You should escape these characters. Moses' tokenizer converts >> [ --> [ >> ] --> ] >> >>> On 20/12/2013 05:49, Rajen Chatterjee wrote: >> >>> I am getting this error during decoding using the new moses: >>> >>> Start loading text SCFG phrase table. Moses format : [34.000] seconds >>> Reading >>> /home/rajen/Public/SMT/experiments/acl-14-TAG/results/pb-cross-valid/en-kK1/moses_data/model/phrase-table.gz >>> ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 >>> ***************Check nextPos != string::npos failed in moses/Phrase.cpp:214 >>> >>> >>> So I thought let me try decoding using old mosesdecoder >>> >>> >>>> On Thu, Dec 19, 2013 at 5:31 PM, Hieu Hoang <[email protected]> wrote: >>>> There's no script to do that. >>>> >>>> Is there a reason you need to use the old decoder? >>>> >>>> >>>> On 19 December 2013 16:40, Rajen Chatterjee <[email protected]> >>>> wrote: >>>>> Hello, >>>>> There is a script "scripts/training/convert-moses-ini-to-v2.perl" >>>>> which converts an old format of moses.ini to new format, but I want vice >>>>> versa i.e. from new format to old format. How can I achieve this? >>>>> >>>>> >>>>> -- >>>>> -Regards, >>>>> Rajen Chatterjee. >>>>> >>>>> _______________________________________________ >>>>> Moses-support mailing list >>>>> [email protected] >>>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>> >>>> >>>> >>>> -- >>>> Hieu Hoang >>>> Research Associate >>>> University of Edinburgh >>>> http://www.hoang.co.uk/hieu >>> >>> >>> >>> -- >>> -Regards, >>> Rajen Chatterjee. > > > > -- > -Regards, > Rajen Chatterjee.
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
