Re: [Moses-support] error in mosesdecoder tuning

2016-11-02 Thread Tom Hoar
and empty phrase tables. Have you ever create a smaller model to validate your corpus preparation? On 11/2/2016 10:32 PM, moses-support-requ...@mit.edu wrote: Date: Wed, 2 Nov 2016 17:32:48 +0200 From: Hasan Sait ARSLAN<hasan.sait.ars...@gmail.com> Subject: Re: [Moses-support]

Re: [Moses-support] error in mosesdecoder tuning

2016-11-02 Thread Barry Haddow
Hi Hasan This is full of messages about incorrect alignments. It looks like something went wrong at an earlier stage. I would start again from the beginning with a small data set, in order to debug your setup, cheers - Barry On 02/11/16 15:32, Hasan Sait ARSLAN wrote: Hi Barry, I have

Re: [Moses-support] error in mosesdecoder tuning

2016-11-02 Thread Hasan Sait ARSLAN
Hi Barry, I have rerun training starting from step 5, and I kept log file. I have checked log file, and it doesn't show any bug about creating phrase-table, but phrase-table is still not being created. I am attaching log file, could you please check it, and show me where is the problem? Thanks,​

Re: [Moses-support] error in mosesdecoder tuning

2016-11-02 Thread Barry Haddow
Adding -first-step 5 -last-step 5 will just run step 5 (phrase extraction) On 02/11/16 12:01, Hasan Sait ARSLAN wrote: For instance, could you show me an example? Thanks, 2016-11-02 13:57 GMT+02:00 Barry Haddow >: Hi Hasan

Re: [Moses-support] error in mosesdecoder tuning

2016-11-02 Thread Hasan Sait ARSLAN
For instance, could you show me an example? Thanks, 2016-11-02 13:57 GMT+02:00 Barry Haddow : > Hi Hasan > > You can use the first-step and last-step arguments to run steps manually. > > cheers - Barry > > > On 02/11/16 11:46, Hasan Sait ARSLAN wrote: > > Sorry, > >

Re: [Moses-support] error in mosesdecoder tuning

2016-11-02 Thread Barry Haddow
Hi Hasan You can use the first-step and last-step arguments to run steps manually. cheers - Barry On 02/11/16 11:46, Hasan Sait ARSLAN wrote: Sorry, as I see my model folder, I can say that Lexical translation part also went well. so, the only steps I have to run manually are' * 5

Re: [Moses-support] error in mosesdecoder tuning

2016-11-02 Thread Barry Haddow
Hi Hasan It's not really possible to debug without a log file, so I think that unfortunately you should start again. I suggest you start with a much smaller corpus to try to debug your setup. If you use 100,000 sentences it should train within hours. cheers - Barry On 02/11/16 11:13,

Re: [Moses-support] error in mosesdecoder tuning

2016-11-02 Thread Hasan Sait ARSLAN
Hi Barry, I don't have any idea about where it is saved. Cheers, 2016-11-02 12:55 GMT+02:00 Barry Haddow : > Hi Hasan > > If your phrase table is empty, that would explain why tuning didn't work. > Something went wrong earlier in the process. Could you post your log

Re: [Moses-support] error in mosesdecoder tuning

2016-11-02 Thread Barry Haddow
Hi Hasan If your phrase table is empty, that would explain why tuning didn't work. Something went wrong earlier in the process. Could you post your log file from train_model.perl, cheers - Barry On 02/11/16 10:45, Hasan Sait ARSLAN wrote: Now currently I have a bigger problem. I have

Re: [Moses-support] error in mosesdecoder tuning

2016-11-02 Thread Hasan Sait ARSLAN
Now currently I have a bigger problem. I have trained my data for 5 days, and the folder "train" is 39 G, but there is no any phrases saved on phrase table. It is annoying. What should I do now? I hope I won't need to rerun everything from the scratch 2016-11-02 12:26 GMT+02:00 Barry Haddow

Re: [Moses-support] error in mosesdecoder tuning

2016-11-02 Thread Barry Haddow
Hi Hasan The error message should be written into filterphrases.err, inside your working directory, cheers - Barry On 02/11/16 10:02, Hasan Sait ARSLAN wrote: Hi Hieu, I did in the way, you want. Plus, I am sure the path and file names are correctly spelt. But still, I get the same

Re: [Moses-support] error in mosesdecoder tuning

2016-11-02 Thread Hasan Sait ARSLAN
Hi Hieu, I did in the way, you want. Plus, I am sure the path and file names are correctly spelt. But still, I get the same error. 2016-11-01 21:41 GMT+02:00 Hasan Sait ARSLAN : > Thank you Hieu, I will do it, and give you feedback about it. > > Kind Regards, > >

Re: [Moses-support] error in mosesdecoder tuning

2016-11-01 Thread Hasan Sait ARSLAN
Thank you Hieu, I will do it, and give you feedback about it. Kind Regards, 2016-11-01 21:37 GMT+02:00 Hieu Hoang : > the command you execute looks ok. the problem is likely to be with your > using tuning data. > > You should look at your tuning data, make sure you've spelt

Re: [Moses-support] error in mosesdecoder tuning

2016-11-01 Thread Hieu Hoang
the command you execute looks ok. the problem is likely to be with your using tuning data. You should look at your tuning data, make sure you've spelt the path and filename correctly, use a very small subset (eg. start with 1 parallel sentence) and increase the number of sentences until you

[Moses-support] error in mosesdecoder tuning

2016-11-01 Thread Hasan Sait ARSLAN
Hello, I have trained dataset for 5 days, and for 2-3 days I am dealing with the bug in tuning, but still couldn't solve the problem. I use the following command to run: */home/sait/mosesdecoder/scripts/training/mert-moses.pl