Re: [Moses-support] How to convert new moses.ini format of to old format

2013-12-21 Thread Rajen Chatterjee
Hi, You are right there is [ character in the phrase table. But the problem is I am running same language pair with same train and test set on both, old moses version and the new version. I am getting decoding output in the old moses version (in which '[' character is present in the phrase

Re: [Moses-support] How to convert new moses.ini format of to old format

2013-12-21 Thread Hieu Hoang
You're right, there were 2 different translation models for phrase-based and syntax decoding in the old version. The phrase-based model didn't check for [ ] characters. The new Moses use only 1 translation model which always checks for [ ]. It will be easier for you to escape the characters,

[Moses-support] about testing on part of training dataset

2013-12-21 Thread nadeem khan
Hi  Can anyone please tell me about why we got low BLEU score on a testset we get from training set for sparse resourced languages like Indian languages. I tested a Hindi system on both, means original testset and a testset extracted from Training data, just to get how things goes with testing

Re: [Moses-support] about testing on part of training dataset

2013-12-21 Thread Miles Osborne
SMT systems such as Moses do not guarantee that they can reproduce the training set. For example, phrases might be pruned due to frequencies being too low, not all words might be aligned, the decoder might discard the true translation during etc etc. This doesn't really have much to do with

Re: [Moses-support] How to convert new moses.ini format of to old format

2013-12-21 Thread Rajen Chatterjee
ok thanks a lot. On Sat, Dec 21, 2013 at 2:02 PM, Hieu Hoang hieuho...@gmail.com wrote: You're right, there were 2 different translation models for phrase-based and syntax decoding in the old version. The phrase-based model didn't check for [ ] characters. The new Moses use only 1

Re: [Moses-support] about testing on part of training dataset

2013-12-21 Thread Prasanth K
Hi Nadeem, Miles is right. I think I can add some details of experiments which show the same thing you have observed. There have been large scale experiments doing what you are trying to see: evaluating the translation quality on data that has been used to train the system. The link to one of

[Moses-support] How to use MOSES multi-threaded

2013-12-21 Thread Asad A.Malik
Hi All, In the manual there i mentioned that using command --decoder-flags=-threads 4 we can use MOSES multi-threaded. But I am getting following message. PS. I have C2D system. I think I'll use 2 instead of 4 in the given command   Regards  Asad A.Malik Multithread error Description: Binary

[Moses-support] 1st CFP: COLING 2014 - Dublin, Ireland

2013-12-21 Thread Seong-Bae Park
Apologies for multiple postings -- 1st (Preliminary) Call for Papers - Coling 2014 The 25th International Conference on Computational Linguistics August 23 - 29,

Re: [Moses-support] How to use MOSES multi-threaded

2013-12-21 Thread Philipp Koehn
Hi, try placing --decoder-flags -threads 4 before the output redirect . -phi On Sat, Dec 21, 2013 at 8:49 PM, Asad A.Malik asad_12...@yahoo.com wrote: Hi All, In the manual there i mentioned that using command --decoder-flags=-threads 4 we can use MOSES multi-threaded. But I am getting