Re: [Moses-support] Incremental retraining
Hi Hieu, I am at the last step of the incremental training. 1. I have produced the alignment file for the incremental data. 2. I then just append the new-alignment file and the incremental data to the original data and alignment file. 3. Furthermore I create the memory mapped suffix array phrase table(mmsapt). When I am using the new mmsapt information during decoding I am getting the following error ( which was fine before adding the incremental data) Created input-output object : [0.086] seconds this is a test sentence Translating line 0 in thread id 139739320297216 Translating: this is a test sentence binary file loaded, default OFF_T: -1 Line 0: Initialize search took 0.064 seconds total Alignment range error at sentence 53994! 4/7 6/5 Alignment range error at sentence 54530! 17/19 18/18 Alignment range error at sentence 50292! 0/13 9/9 Alignment range error at sentence 50120! 25/36 31/31 Alignment range error at sentence 55089! 11/27 19/19 terminate called recursively terminate called after throwing an instance of 'terminate called recursively terminate called recursively util::Exception' terminate called recursively Aborted I am not sure if I am doing anything wrong here? Thanks and regards, sandipan On 8 September 2014 10:11, Sandipan Dandapat wrote: > Hi, > This worked. > Thanks and regards, > sandipan > > On 7 September 2014 16:09, Hieu Hoang wrote: > >> sorry, i meant >> >> >> On 7 September 2014 16:08, Hieu Hoang wrote: >> >>> you HAVE to change both >>> num-features=7 >>> AND >>> [weight] >>> PT0= 0.1 0.2 0.3 0.4 0.5 0.6 0.7 >>> >>> >>> On 7 September 2014 16:06, Sandipan Dandapat >> > wrote: >>> Hi Hieu, Even I tried with '7' and it fails with the error message Exception: moses/ScoreComponentCollection.cpp:248 in void Moses::ScoreComponentCollection::Assign(const Moses::FeatureFunction*, const std::vector&) threw util::Exception'. Feature function PT0 specified 7 dense scores or weights. Actually has 4 In contrast, when I am using binarised pharse table, I use num-features=4 and this works fine. I am attaching the Moses.ini file in case I am doing anything wrong there. Thanks and regards, sandipan On 7 September 2014 15:46, Hieu Hoang wrote: > maybe's it's 7 scores > > > On 7 September 2014 14:59, Sandipan Dandapat < > sandipandanda...@gmail.com> wrote: > >> Hi Hieu, >> I also tried the same but generates the error below: >> >> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void >> Moses::Mmsapt::Load() threw util::Exception because >> `this->m_feature_names.size() != this->m_numScoreComponents'. >> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values >> provided by Phrase table (7) does not match number specified in Moses >> config file (4)! >> >> Thanks and regards, >> sandipan >> >> >> On 6 September 2014 09:50, Hieu Hoang wrote: >> >>> I'm not sure how many scores there are in the phrase table >>>PhraseDictionaryBitextSampling >>> It may be 4. In which case you must specify >>> >>> [feature] >>> PhraseDictionaryBitextSampling name=PT0 num-features=4 ... >>> >>> [weight] >>> PT0= 0.1 0.2 0.3 0.4 >>> >>> >>> On 05/09/14 14:12, Sandipan Dandapat wrote: >>> >>> Hi, >>> During incremental retraining I specified the following line in >>> moses .ini >>> PhraseDictionaryBitextSampling name=PT0 output-factor=0 >>> num-features=9 >>> path=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en >>> L2=pl >>> pfwd=g pbwd=g smooth=0 sample=1000 workers=1 >>> >>> this generates the error: >>> Feature function PT0 specified 9 dense scores or weights. Actually >>> has 0. >>> >>> which is solved when num-features is changed to '0' >>> but generates the error below: >>> >>> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual >>> void Moses::Mmsapt::Load() threw util::Exception because >>> `this->m_feature_names.size() != this->m_numScoreComponents'. >>> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature >>> values provided by Phrase table (7) does not match number specified in >>> Moses config file (0)! >>> Changing it to 7 also does not help. >>> >>> I have tried with >>> Mmsapt name=PT0 output-factor=0 num-features=0 >>> base=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en >>> L2=pl >>> >>> but does not work. >>> What I need to do at this stage of retraining using moses? >>> >>> Thanks and regards, >>> sandipan >>> >>> >>> ___ >>> Moses-support mailing >>> listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support >>> >>> >>> >
Re: [Moses-support] Incremental retraining
Hi, This worked. Thanks and regards, sandipan On 7 September 2014 16:09, Hieu Hoang wrote: > sorry, i meant > > > On 7 September 2014 16:08, Hieu Hoang wrote: > >> you HAVE to change both >> num-features=7 >> AND >> [weight] >> PT0= 0.1 0.2 0.3 0.4 0.5 0.6 0.7 >> >> >> On 7 September 2014 16:06, Sandipan Dandapat >> wrote: >> >>> Hi Hieu, >>> Even I tried with '7' and it fails with the error message >>> >>> Exception: moses/ScoreComponentCollection.cpp:248 in void >>> Moses::ScoreComponentCollection::Assign(const Moses::FeatureFunction*, >>> const std::vector&) threw util::Exception'. >>> Feature function PT0 specified 7 dense scores or weights. Actually has 4 >>> >>> In contrast, when I am using binarised pharse table, I use >>> num-features=4 and this works fine. I am attaching the Moses.ini file in >>> case I am doing anything wrong there. >>> >>> Thanks and regards, >>> sandipan >>> >>> >>> On 7 September 2014 15:46, Hieu Hoang wrote: >>> maybe's it's 7 scores On 7 September 2014 14:59, Sandipan Dandapat < sandipandanda...@gmail.com> wrote: > Hi Hieu, > I also tried the same but generates the error below: > > Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void > Moses::Mmsapt::Load() threw util::Exception because > `this->m_feature_names.size() != this->m_numScoreComponents'. > At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values > provided by Phrase table (7) does not match number specified in Moses > config file (4)! > > Thanks and regards, > sandipan > > > On 6 September 2014 09:50, Hieu Hoang wrote: > >> I'm not sure how many scores there are in the phrase table >>PhraseDictionaryBitextSampling >> It may be 4. In which case you must specify >> >> [feature] >> PhraseDictionaryBitextSampling name=PT0 num-features=4 ... >> >> [weight] >> PT0= 0.1 0.2 0.3 0.4 >> >> >> On 05/09/14 14:12, Sandipan Dandapat wrote: >> >> Hi, >> During incremental retraining I specified the following line in >> moses .ini >> PhraseDictionaryBitextSampling name=PT0 output-factor=0 >> num-features=9 >> path=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl >> pfwd=g pbwd=g smooth=0 sample=1000 workers=1 >> >> this generates the error: >> Feature function PT0 specified 9 dense scores or weights. Actually >> has 0. >> >> which is solved when num-features is changed to '0' >> but generates the error below: >> >> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void >> Moses::Mmsapt::Load() threw util::Exception because >> `this->m_feature_names.size() != this->m_numScoreComponents'. >> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values >> provided by Phrase table (7) does not match number specified in Moses >> config file (0)! >> Changing it to 7 also does not help. >> >> I have tried with >> Mmsapt name=PT0 output-factor=0 num-features=0 >> base=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl >> >> but does not work. >> What I need to do at this stage of retraining using moses? >> >> Thanks and regards, >> sandipan >> >> >> ___ >> Moses-support mailing >> listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support >> >> >> >> ___ >> Moses-support mailing list >> Moses-support@mit.edu >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > -- Hieu Hoang Research Associate University of Edinburgh http://www.hoang.co.uk/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support >>> >> >> >> -- >> Hieu Hoang >> Research Associate >> University of Edinburgh >> http://www.hoang.co.uk/hieu >> >> > > > -- > Hieu Hoang > Research Associate > University of Edinburgh > http://www.hoang.co.uk/hieu > > > ___ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support > > ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Incremental retraining
you HAVE to change both num-features=4 AND [weight] PT0= 0.1 0.2 0.3 0.4 0.5 0.6 0.7 On 7 September 2014 16:06, Sandipan Dandapat wrote: > Hi Hieu, > Even I tried with '7' and it fails with the error message > > Exception: moses/ScoreComponentCollection.cpp:248 in void > Moses::ScoreComponentCollection::Assign(const Moses::FeatureFunction*, > const std::vector&) threw util::Exception'. > Feature function PT0 specified 7 dense scores or weights. Actually has 4 > > In contrast, when I am using binarised pharse table, I use num-features=4 > and this works fine. I am attaching the Moses.ini file in case I am doing > anything wrong there. > > Thanks and regards, > sandipan > > > On 7 September 2014 15:46, Hieu Hoang wrote: > >> maybe's it's 7 scores >> >> >> On 7 September 2014 14:59, Sandipan Dandapat >> wrote: >> >>> Hi Hieu, >>> I also tried the same but generates the error below: >>> >>> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void >>> Moses::Mmsapt::Load() threw util::Exception because >>> `this->m_feature_names.size() != this->m_numScoreComponents'. >>> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values >>> provided by Phrase table (7) does not match number specified in Moses >>> config file (4)! >>> >>> Thanks and regards, >>> sandipan >>> >>> >>> On 6 September 2014 09:50, Hieu Hoang wrote: >>> I'm not sure how many scores there are in the phrase table PhraseDictionaryBitextSampling It may be 4. In which case you must specify [feature] PhraseDictionaryBitextSampling name=PT0 num-features=4 ... [weight] PT0= 0.1 0.2 0.3 0.4 On 05/09/14 14:12, Sandipan Dandapat wrote: Hi, During incremental retraining I specified the following line in moses .ini PhraseDictionaryBitextSampling name=PT0 output-factor=0 num-features=9 path=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl pfwd=g pbwd=g smooth=0 sample=1000 workers=1 this generates the error: Feature function PT0 specified 9 dense scores or weights. Actually has 0. which is solved when num-features is changed to '0' but generates the error below: Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void Moses::Mmsapt::Load() threw util::Exception because `this->m_feature_names.size() != this->m_numScoreComponents'. At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values provided by Phrase table (7) does not match number specified in Moses config file (0)! Changing it to 7 also does not help. I have tried with Mmsapt name=PT0 output-factor=0 num-features=0 base=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl but does not work. What I need to do at this stage of retraining using moses? Thanks and regards, sandipan ___ Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support >>> >> >> >> -- >> Hieu Hoang >> Research Associate >> University of Edinburgh >> http://www.hoang.co.uk/hieu >> >> >> ___ >> Moses-support mailing list >> Moses-support@mit.edu >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > -- Hieu Hoang Research Associate University of Edinburgh http://www.hoang.co.uk/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Incremental retraining
sorry, i meant On 7 September 2014 16:08, Hieu Hoang wrote: > you HAVE to change both > num-features=7 > AND > [weight] > PT0= 0.1 0.2 0.3 0.4 0.5 0.6 0.7 > > > On 7 September 2014 16:06, Sandipan Dandapat > wrote: > >> Hi Hieu, >> Even I tried with '7' and it fails with the error message >> >> Exception: moses/ScoreComponentCollection.cpp:248 in void >> Moses::ScoreComponentCollection::Assign(const Moses::FeatureFunction*, >> const std::vector&) threw util::Exception'. >> Feature function PT0 specified 7 dense scores or weights. Actually has 4 >> >> In contrast, when I am using binarised pharse table, I use num-features=4 >> and this works fine. I am attaching the Moses.ini file in case I am doing >> anything wrong there. >> >> Thanks and regards, >> sandipan >> >> >> On 7 September 2014 15:46, Hieu Hoang wrote: >> >>> maybe's it's 7 scores >>> >>> >>> On 7 September 2014 14:59, Sandipan Dandapat >> > wrote: >>> Hi Hieu, I also tried the same but generates the error below: Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void Moses::Mmsapt::Load() threw util::Exception because `this->m_feature_names.size() != this->m_numScoreComponents'. At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values provided by Phrase table (7) does not match number specified in Moses config file (4)! Thanks and regards, sandipan On 6 September 2014 09:50, Hieu Hoang wrote: > I'm not sure how many scores there are in the phrase table >PhraseDictionaryBitextSampling > It may be 4. In which case you must specify > > [feature] > PhraseDictionaryBitextSampling name=PT0 num-features=4 ... > > [weight] > PT0= 0.1 0.2 0.3 0.4 > > > On 05/09/14 14:12, Sandipan Dandapat wrote: > > Hi, > During incremental retraining I specified the following line in moses > .ini > PhraseDictionaryBitextSampling name=PT0 output-factor=0 num-features=9 > path=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl > pfwd=g pbwd=g smooth=0 sample=1000 workers=1 > > this generates the error: > Feature function PT0 specified 9 dense scores or weights. Actually has > 0. > > which is solved when num-features is changed to '0' > but generates the error below: > > Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void > Moses::Mmsapt::Load() threw util::Exception because > `this->m_feature_names.size() != this->m_numScoreComponents'. > At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values > provided by Phrase table (7) does not match number specified in Moses > config file (0)! > Changing it to 7 also does not help. > > I have tried with > Mmsapt name=PT0 output-factor=0 num-features=0 > base=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl > > but does not work. > What I need to do at this stage of retraining using moses? > > Thanks and regards, > sandipan > > > ___ > Moses-support mailing > listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support > > > > ___ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support > > >>> >>> >>> -- >>> Hieu Hoang >>> Research Associate >>> University of Edinburgh >>> http://www.hoang.co.uk/hieu >>> >>> >>> ___ >>> Moses-support mailing list >>> Moses-support@mit.edu >>> http://mailman.mit.edu/mailman/listinfo/moses-support >>> >>> >> > > > -- > Hieu Hoang > Research Associate > University of Edinburgh > http://www.hoang.co.uk/hieu > > -- Hieu Hoang Research Associate University of Edinburgh http://www.hoang.co.uk/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Incremental retraining
Hi Hieu, Even I tried with '7' and it fails with the error message Exception: moses/ScoreComponentCollection.cpp:248 in void Moses::ScoreComponentCollection::Assign(const Moses::FeatureFunction*, const std::vector&) threw util::Exception'. Feature function PT0 specified 7 dense scores or weights. Actually has 4 In contrast, when I am using binarised pharse table, I use num-features=4 and this works fine. I am attaching the Moses.ini file in case I am doing anything wrong there. Thanks and regards, sandipan On 7 September 2014 15:46, Hieu Hoang wrote: > maybe's it's 7 scores > > > On 7 September 2014 14:59, Sandipan Dandapat > wrote: > >> Hi Hieu, >> I also tried the same but generates the error below: >> >> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void >> Moses::Mmsapt::Load() threw util::Exception because >> `this->m_feature_names.size() != this->m_numScoreComponents'. >> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values >> provided by Phrase table (7) does not match number specified in Moses >> config file (4)! >> >> Thanks and regards, >> sandipan >> >> >> On 6 September 2014 09:50, Hieu Hoang wrote: >> >>> I'm not sure how many scores there are in the phrase table >>>PhraseDictionaryBitextSampling >>> It may be 4. In which case you must specify >>> >>> [feature] >>> PhraseDictionaryBitextSampling name=PT0 num-features=4 ... >>> >>> [weight] >>> PT0= 0.1 0.2 0.3 0.4 >>> >>> >>> On 05/09/14 14:12, Sandipan Dandapat wrote: >>> >>> Hi, >>> During incremental retraining I specified the following line in moses >>> .ini >>> PhraseDictionaryBitextSampling name=PT0 output-factor=0 num-features=9 >>> path=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl >>> pfwd=g pbwd=g smooth=0 sample=1000 workers=1 >>> >>> this generates the error: >>> Feature function PT0 specified 9 dense scores or weights. Actually has 0. >>> >>> which is solved when num-features is changed to '0' >>> but generates the error below: >>> >>> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void >>> Moses::Mmsapt::Load() threw util::Exception because >>> `this->m_feature_names.size() != this->m_numScoreComponents'. >>> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values >>> provided by Phrase table (7) does not match number specified in Moses >>> config file (0)! >>> Changing it to 7 also does not help. >>> >>> I have tried with >>> Mmsapt name=PT0 output-factor=0 num-features=0 >>> base=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl >>> >>> but does not work. >>> What I need to do at this stage of retraining using moses? >>> >>> Thanks and regards, >>> sandipan >>> >>> >>> ___ >>> Moses-support mailing >>> listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support >>> >>> >>> >>> ___ >>> Moses-support mailing list >>> Moses-support@mit.edu >>> http://mailman.mit.edu/mailman/listinfo/moses-support >>> >>> >> > > > -- > Hieu Hoang > Research Associate > University of Edinburgh > http://www.hoang.co.uk/hieu > > > ___ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support > > moses.ini Description: Binary data ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Incremental retraining
maybe's it's 7 scores On 7 September 2014 14:59, Sandipan Dandapat wrote: > Hi Hieu, > I also tried the same but generates the error below: > > Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void > Moses::Mmsapt::Load() threw util::Exception because > `this->m_feature_names.size() != this->m_numScoreComponents'. > At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values > provided by Phrase table (7) does not match number specified in Moses > config file (4)! > > Thanks and regards, > sandipan > > > On 6 September 2014 09:50, Hieu Hoang wrote: > >> I'm not sure how many scores there are in the phrase table >>PhraseDictionaryBitextSampling >> It may be 4. In which case you must specify >> >> [feature] >> PhraseDictionaryBitextSampling name=PT0 num-features=4 ... >> >> [weight] >> PT0= 0.1 0.2 0.3 0.4 >> >> >> On 05/09/14 14:12, Sandipan Dandapat wrote: >> >> Hi, >> During incremental retraining I specified the following line in moses >> .ini >> PhraseDictionaryBitextSampling name=PT0 output-factor=0 num-features=9 >> path=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl >> pfwd=g pbwd=g smooth=0 sample=1000 workers=1 >> >> this generates the error: >> Feature function PT0 specified 9 dense scores or weights. Actually has 0. >> >> which is solved when num-features is changed to '0' >> but generates the error below: >> >> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void >> Moses::Mmsapt::Load() threw util::Exception because >> `this->m_feature_names.size() != this->m_numScoreComponents'. >> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values >> provided by Phrase table (7) does not match number specified in Moses >> config file (0)! >> Changing it to 7 also does not help. >> >> I have tried with >> Mmsapt name=PT0 output-factor=0 num-features=0 >> base=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl >> >> but does not work. >> What I need to do at this stage of retraining using moses? >> >> Thanks and regards, >> sandipan >> >> >> ___ >> Moses-support mailing >> listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support >> >> >> >> ___ >> Moses-support mailing list >> Moses-support@mit.edu >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > -- Hieu Hoang Research Associate University of Edinburgh http://www.hoang.co.uk/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Incremental retraining
Hi Hieu, I also tried the same but generates the error below: Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void Moses::Mmsapt::Load() threw util::Exception because `this->m_feature_names.size() != this->m_numScoreComponents'. At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values provided by Phrase table (7) does not match number specified in Moses config file (4)! Thanks and regards, sandipan On 6 September 2014 09:50, Hieu Hoang wrote: > I'm not sure how many scores there are in the phrase table >PhraseDictionaryBitextSampling > It may be 4. In which case you must specify > > [feature] > PhraseDictionaryBitextSampling name=PT0 num-features=4 ... > > [weight] > PT0= 0.1 0.2 0.3 0.4 > > > On 05/09/14 14:12, Sandipan Dandapat wrote: > > Hi, > During incremental retraining I specified the following line in moses .ini > PhraseDictionaryBitextSampling name=PT0 output-factor=0 num-features=9 > path=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl > pfwd=g pbwd=g smooth=0 sample=1000 workers=1 > > this generates the error: > Feature function PT0 specified 9 dense scores or weights. Actually has 0. > > which is solved when num-features is changed to '0' > but generates the error below: > > Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void > Moses::Mmsapt::Load() threw util::Exception because > `this->m_feature_names.size() != this->m_numScoreComponents'. > At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values > provided by Phrase table (7) does not match number specified in Moses > config file (0)! > Changing it to 7 also does not help. > > I have tried with > Mmsapt name=PT0 output-factor=0 num-features=0 > base=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl > > but does not work. > What I need to do at this stage of retraining using moses? > > Thanks and regards, > sandipan > > > ___ > Moses-support mailing > listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support > > > > ___ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support > > ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Incremental retraining
I'm not sure how many scores there are in the phrase table PhraseDictionaryBitextSampling It may be 4. In which case you must specify [feature] PhraseDictionaryBitextSampling name=PT0 num-features=4 ... [weight] PT0= 0.1 0.2 0.3 0.4 On 05/09/14 14:12, Sandipan Dandapat wrote: Hi, During incremental retraining I specified the following line in moses .ini PhraseDictionaryBitextSampling name=PT0 output-factor=0 num-features=9 path=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl pfwd=g pbwd=g smooth=0 sample=1000 workers=1 this generates the error: Feature function PT0 specified 9 dense scores or weights. Actually has 0. which is solved when num-features is changed to '0' but generates the error below: Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void Moses::Mmsapt::Load() threw util::Exception because `this->m_feature_names.size() != this->m_numScoreComponents'. At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values provided by Phrase table (7) does not match number specified in Moses config file (0)! Changing it to 7 also does not help. I have tried with Mmsapt name=PT0 output-factor=0 num-features=0 base=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl but does not work. What I need to do at this stage of retraining using moses? Thanks and regards, sandipan ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
[Moses-support] Incremental retraining
Hi, During incremental retraining I specified the following line in moses.ini PhraseDictionaryBitextSampling name=PT0 output-factor=0 num-features=9 path=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl pfwd=g pbwd=g smooth=0 sample=1000 workers=1 this generates the error: Feature function PT0 specified 9 dense scores or weights. Actually has 0. which is solved when num-features is changed to '0' but generates the error below: Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void Moses::Mmsapt::Load() threw util::Exception because `this->m_feature_names.size() != this->m_numScoreComponents'. At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values provided by Phrase table (7) does not match number specified in Moses config file (0)! Changing it to 7 also does not help. I have tried with Mmsapt name=PT0 output-factor=0 num-features=0 base=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl but does not work. What I need to do at this stage of retraining using moses? Thanks and regards, sandipan ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
