Yes, but my dev set is also factored. It is at the same format with training set. There is no difference at all.
2016-12-06 12:15 GMT+02:00 Sašo Kuntaric <saso.kunta...@gmail.com>: > Please see my reply to another thread below. I believe you need your > source part of the tuning set factored as well. > > On 30/06/2016 21:44, Sašo Kuntaric wrote: > > Hi all, > > I would like to ask one more question. When you say that my reference only > has the surface form, are you talking about the "tuning corpus", which in > the case of my command > > ~/mosesdecoder/scripts/training/mert-moses.pl > ~/working/IT_corpus/TMX/txt/factored_corpus/singles/tuning_corpus.tagged.clean.en > ~/working/IT_corpus/TMX/txt/factored_corpus/singles/tuning_ > corpus.tagged.clean.sl ~/mosesdecoder/bin/moses > ~/working/IT_corpus/TMX/txt/factored_corpus/singles/test/model/moses.ini > --mertdir ~/mosesdecoder/bin/ --decoder-flags="-threads all" > > are tuning_corpus.tagged.clean.en and tuning_corpus.tagged.clean.sl? Can > tuning be done with files that only contains surface forms? > > it's usual that the reference tuning data does not have factors, even if > there are factors in the phrase table. After all, you don't care if the > output surface form is correct but the other factors are wrong. > > Will the results be compatible with tuning done with a factored tuning > corpus? > > yes > > Best regards, > > Sašo > > 2016-12-06 10:18 GMT+01:00 Hasan Sait ARSLAN <hasan.sait.ars...@gmail.com> > : > >> Hi, >> >> I have a factored dataset. It involves 4 factors, >> factor1|factor2|factor3|factor4. I have trained my model with such a >> dataset. >> >> Now when I want to tune my model, I encounter with the following error: >> >> >> >> >> *Exception: moses/Word.cpp:159 in void >> Moses::Word::CreateFromString(Moses::FactorDirection, const >> std::vector<long unsigned int>&, const StringPiece&, bool, bool) threw >> util::Exception because `!isNonTerminal && i < factorOrder.size()'.Too few >> factors in string '-|-|Punc|Punc* >> The details of the error is in mert.txt file, which is attached to this >> e-mail. >> >> Thanks, >> >> Kind Regards, >> Hasan Sait Arslan >> >> _______________________________________________ >> Moses-support mailing list >> Moses-support@mit.edu >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > > > -- > lp, > > Sašo >
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
