Barry, you're right, TUNING_filter.1.STDERR: Using SCRIPTS_ROOTDIR: /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts (9) create moses.ini @ Tue May 14 22:22:19 CEST 2013 Executing: mkdir -p /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.1 Considering factor 0 Considering factor 0 filtering /cygdrive/c/Users/<user>/Desktop/moses/experiment/model/phrase-table.1 -> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.1/phrase-table.0-0.1.1... No phrases found in /cygdrive/c/Users/<user>/Desktop/moses/experiment/model/phrase-table.1! at /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/filter-model-given-input.pl line 271.
And that's correct, because 1) there's no phrase-table.1 2) phrase-table.1.gz is empty. I've gone through the other STDERR files but I don't know what I'm looking for. The only one that stood out was one with a huge amount of exclamation marks, TRAINING_build-lex-trans.1.STDERR: Using SCRIPTS_ROOTDIR: /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts (4) generate lexical translation table 0-0 @ Tue May 14 22:12:54 CEST 2013 Use of uninitialized value $_BASELINE_CORPUS in concatenation (.) or string at /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/train-model.perl line 1250. Use of uninitialized value $_BASELINE_CORPUS in concatenation (.) or string at /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/train-model.perl line 1250. (/cygdrive/c/Users/<user>/Desktop/moses/experiment/training/corpus.1.fr,/cygdrive/c/Users/<user>/Desktop/moses/experiment/training/corpus.1.en,/cygdrive/c/Users/<user>/Desktop/moses/experiment/model/lex.1) !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Saved: /cygdrive/c/Users/<user>/Desktop/moses/experiment/model/lex.1.f2e and /cygdrive/c/Users/<user>/Desktop/moses/experiment/model/lex.1.e2f But the resulting file, lex.1.e2f is not empty, it is 15118kb. What should I be looking for? Kind regards, Diana On 5/15/2013 8:32 AM, Barry Haddow wrote: > Hi Diana > > It sounds like the TUNING_filter step failed, so you need to look at > its STDERR file, > > cheers - Barry > > On 15/05/13 06:41, A.E.M. Koenraadt wrote: >> Clear and re-run didn't help. >> What can I do to fix this? >> >> Kind regards, >> Diana >> >> On 5/14/2013 8:10 PM, A.E.M. Koenraadt wrote: >>> Hi Barry, >>> >>> the directory tuning/filtered.2 contains the empty file >>> phrase-table.0-0.1.1 and a moses.ini which I've attached here. The >>> folder contains no other files. >>> >>> I've cleared the entire experiment directory and am running the >>> steps from scratch again. Not sure if it'll help, but we're probably >>> in a different time zone anyway so it won't matter ;) >>> >>> Thanks for your help and quick replies so far!! >>> >>> Kind regards, >>> Diana >>> >>> >>> On 5/14/2013 9:46 AM, Barry Haddow wrote: >>>> Hi Diana >>>> >>>> This time the existence check that fails is in the decoder itself, >>>> ie in C++, as opposed to in perl. So it's probably not the same >>>> problem. >>>> >>>> It could be that TUNING:filter failed. Can you check the logs for >>>> that? What is in the directory >>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.2 ? >>>> >>>> cheers - Barry >>>> >>>> >>>> >>>> On 14/05/13 07:06, A.E.M. Koenraadt wrote: >>>>> Hi Barry, >>>>> >>>>> This has indeed solved the problem I had. >>>>> However, a new problem occurs, in the tuning step. All other steps >>>>> pass now, so I think and hope this is the final hurdle. >>>>> >>>>> Attached you may find the graph again. >>>>> >>>>> In the log: >>>>> >>>>> number of steps doable or running: 1 at Mon, May 13, 2013 11:05:32 PM >>>>> doable: TUNING:tune >>>>> executing >>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/2/TUNING_tune.2 >>>>> via sh (1 active) >>>>> step TUNING:tune crashed >>>>> number of steps doable or running: 0 at Mon, May 13, 2013 11:05:41 PM >>>>> >>>>> In steps/2/TUNING_tune.2.STDERR: >>>>> >>>>> Using SCRIPTS_ROOTDIR: >>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts >>>>> Asking moses for feature names and values from >>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.filtered.ini.2 >>>>> Executing: /cygdrive/c/Users/<user>/Desktop/moses/cygwin/bin/moses >>>>> -threads 4 -v 0 -config >>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.filtered.ini.2 >>>>> >>>>> -inputtype 0 -show-weights > ./features.list >>>>> ERROR:File >>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.2/reordering-table.2.wbe-msd-bidirectional-fe >>>>> >>>>> does not exist >>>>> Exit code: 1 >>>>> Failed to run moses with the config >>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.filtered.ini.2 >>>>> >>>>> at >>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/mert-moses.pl >>>>> >>>>> line 1169. >>>>> cp: cannot stat >>>>> `/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/tmp.2/moses.ini': >>>>> >>>>> No such file or directory >>>>> >>>>> Again, the specified file indeed doesn't exist.. I'm unfortunately >>>>> not able to investigate this in detail myself at the moment. Could >>>>> it be a similar problem in mert-moses.pl? >>>>> >>>>> Kind regards, >>>>> Diana >>>>> >>>>> On 5/13/2013 9:21 PM, A.E.M. Koenraadt wrote: >>>>>> Hi Barry, >>>>>> >>>>>> thank you for your quick reply. Yes, I replaced my user name with >>>>>> <user> for my e-mail to this list. The path does exist, so I >>>>>> replaced the single occurrence of "if ! -s $filename" in >>>>>> train-model.perl by "if ! -e $filename" like you said. The new >>>>>> test is running right now, I'll report back when I have some new >>>>>> results! I hope this brings me one step closer to finishing the >>>>>> baseline system :) >>>>>> >>>>>> Kind regards, >>>>>> Diana >>>>>> >>>>>> On 5/13/2013 10:37 AM, Barry Haddow wrote: >>>>>>> Hi Diana >>>>>>> >>>>>>> Training is failing because the existence check for >>>>>>> >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment >>>>>>> >>>>>>> is failing. Is this the actual path that Moses is looking for, >>>>>>> or did you replace your user name with <user> in order to mail >>>>>>> support? >>>>>>> >>>>>>> If the path that it is looking for indeed exists, it could be >>>>>>> because train-model.perl is using >>>>>>> >>>>>>> if ! -s $filename # exists and has non-zero length >>>>>>> >>>>>>> instead of >>>>>>> >>>>>>> if ! -e $filename # exists >>>>>>> >>>>>>> and the results differ between Linux and cygwin. >>>>>>> >>>>>>> Could you try replacing the "-s" with a "-e" and see if it works? >>>>>>> >>>>>>> cheers - Barry >>>>>>> >>>>>>> >>>>>>> >>>>>>> On 12/05/13 20:29, A.E.M. Koenraadt wrote: >>>>>>>> Hi all, >>>>>>>> >>>>>>>> I've been trying to get EMS (experiment.perl) working, at least >>>>>>>> for the Baseline system >>>>>>>> (http://www.statmt.org/moses/?n=moses.baseline). I started >>>>>>>> using EMS because I ran into some problems and had hoped that >>>>>>>> using EMS and the sample config would relieve me from supplying >>>>>>>> too many commandline arguments. It has helped me so far. >>>>>>>> >>>>>>>> Unfortunately, I run into errors for the 'evaluation' and >>>>>>>> 'tuning' steps. I'm not yet familiar with the details of each >>>>>>>> step, so I'm hoping I can find some help here with these errors >>>>>>>> because I couldn't find it online so far. >>>>>>>> >>>>>>>> I'm running Cygwin under Win7 and when executing the baseline >>>>>>>> example, I have the following errors. >>>>>>>> >>>>>>>> In the log: >>>>>>>> >>>>>>>> number of steps doable or running: 3 at Sun, May 12, 2013 >>>>>>>> 8:21:08 PM >>>>>>>> doable: TRAINING:create-config >>>>>>>> doable: EVALUATION:newstest2010:filter >>>>>>>> doable: TUNING:filter >>>>>>>> executing >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/1/TRAINING_create-config.1 >>>>>>>> >>>>>>>> via sh (1 active) >>>>>>>> executing >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/1/EVALUATION_newstest2010_filter.1 >>>>>>>> >>>>>>>> via sh (2 active) >>>>>>>> step EVALUATION:newstest2010:filter crashed >>>>>>>> number of steps doable or running: 1 at Sun, May 12, 2013 >>>>>>>> 8:21:23 PM >>>>>>>> doable: TUNING:filter >>>>>>>> executing >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/1/TUNING_filter.1 >>>>>>>> >>>>>>>> via sh (1 active) >>>>>>>> step TUNING:filter crashed >>>>>>>> number of steps doable or running: 0 at Sun, May 12, 2013 >>>>>>>> 8:21:33 PM >>>>>>>> >>>>>>>> In steps/1/EVALUATION_newstest2010_filter.1.STDERR >>>>>>>> >>>>>>>> Using SCRIPTS_ROOTDIR: >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts >>>>>>>> ERROR: Language model file not found or empty: >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment at >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/train-model.perl >>>>>>>> >>>>>>>> line 440. >>>>>>>> Executing: mkdir -p >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.filtered.1 >>>>>>>> Can't read >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.moses.table.ini.1 >>>>>>>> >>>>>>>> at >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/filter-model-given-input.pl >>>>>>>> >>>>>>>> line 89. >>>>>>>> rm: cannot remove >>>>>>>> `/cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.moses.table.ini.1': >>>>>>>> >>>>>>>> No such file or directory >>>>>>>> >>>>>>>> In steps/1/TUNING_filter.1.STDERR >>>>>>>> >>>>>>>> Using SCRIPTS_ROOTDIR: >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts >>>>>>>> ERROR: Language model file not found or empty: >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment at >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/train-model.perl >>>>>>>> >>>>>>>> line 440. >>>>>>>> Executing: mkdir -p >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.1 >>>>>>>> Can't read >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.table.ini.1 >>>>>>>> >>>>>>>> at >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/filter-model-given-input.pl >>>>>>>> >>>>>>>> line 89. >>>>>>>> rm: cannot remove >>>>>>>> `/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.table.ini.1': >>>>>>>> >>>>>>>> No such file or directory >>>>>>>> >>>>>>>> The files it seems to concern (although I'm not sure given that >>>>>>>> they occur after the 'not found or empty' notification) >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.moses.table.ini.1 >>>>>>>> >>>>>>>> and >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.table.ini.1 >>>>>>>> >>>>>>>> indeed don't exist... >>>>>>>> >>>>>>>> Attached also the current graph.1.png. >>>>>>>> >>>>>>>> I've been able to fix other issues so far with the help of >>>>>>>> messages on this support mailinglist, so I'm hoping someone can >>>>>>>> help me fix this as well so that I can run the baseline example. >>>>>>>> >>>>>>>> Thank you kindly in advance. >>>>>>>> >>>>>>>> Diana Koenraadt >>>>>>>> >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Moses-support mailing list >>>>>>>> [email protected] >>>>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>>>>> >>>>>>> >>>>>> >>>>> >>>> >>>> >>> >> >> > _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
