Hi Diana It sounds like the TUNING_filter step failed, so you need to look at its STDERR file,
cheers - Barry On 15/05/13 06:41, A.E.M. Koenraadt wrote: > Clear and re-run didn't help. > What can I do to fix this? > > Kind regards, > Diana > > On 5/14/2013 8:10 PM, A.E.M. Koenraadt wrote: >> Hi Barry, >> >> the directory tuning/filtered.2 contains the empty file >> phrase-table.0-0.1.1 and a moses.ini which I've attached here. The >> folder contains no other files. >> >> I've cleared the entire experiment directory and am running the steps >> from scratch again. Not sure if it'll help, but we're probably in a >> different time zone anyway so it won't matter ;) >> >> Thanks for your help and quick replies so far!! >> >> Kind regards, >> Diana >> >> >> On 5/14/2013 9:46 AM, Barry Haddow wrote: >>> Hi Diana >>> >>> This time the existence check that fails is in the decoder itself, >>> ie in C++, as opposed to in perl. So it's probably not the same >>> problem. >>> >>> It could be that TUNING:filter failed. Can you check the logs for >>> that? What is in the directory >>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.2 ? >>> >>> cheers - Barry >>> >>> >>> >>> On 14/05/13 07:06, A.E.M. Koenraadt wrote: >>>> Hi Barry, >>>> >>>> This has indeed solved the problem I had. >>>> However, a new problem occurs, in the tuning step. All other steps >>>> pass now, so I think and hope this is the final hurdle. >>>> >>>> Attached you may find the graph again. >>>> >>>> In the log: >>>> >>>> number of steps doable or running: 1 at Mon, May 13, 2013 11:05:32 PM >>>> doable: TUNING:tune >>>> executing >>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/2/TUNING_tune.2 >>>> via sh (1 active) >>>> step TUNING:tune crashed >>>> number of steps doable or running: 0 at Mon, May 13, 2013 11:05:41 PM >>>> >>>> In steps/2/TUNING_tune.2.STDERR: >>>> >>>> Using SCRIPTS_ROOTDIR: >>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts >>>> Asking moses for feature names and values from >>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.filtered.ini.2 >>>> Executing: /cygdrive/c/Users/<user>/Desktop/moses/cygwin/bin/moses >>>> -threads 4 -v 0 -config >>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.filtered.ini.2 >>>> >>>> -inputtype 0 -show-weights > ./features.list >>>> ERROR:File >>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.2/reordering-table.2.wbe-msd-bidirectional-fe >>>> >>>> does not exist >>>> Exit code: 1 >>>> Failed to run moses with the config >>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.filtered.ini.2 >>>> >>>> at >>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/mert-moses.pl >>>> >>>> line 1169. >>>> cp: cannot stat >>>> `/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/tmp.2/moses.ini': >>>> >>>> No such file or directory >>>> >>>> Again, the specified file indeed doesn't exist.. I'm unfortunately >>>> not able to investigate this in detail myself at the moment. Could >>>> it be a similar problem in mert-moses.pl? >>>> >>>> Kind regards, >>>> Diana >>>> >>>> On 5/13/2013 9:21 PM, A.E.M. Koenraadt wrote: >>>>> Hi Barry, >>>>> >>>>> thank you for your quick reply. Yes, I replaced my user name with >>>>> <user> for my e-mail to this list. The path does exist, so I >>>>> replaced the single occurrence of "if ! -s $filename" in >>>>> train-model.perl by "if ! -e $filename" like you said. The new >>>>> test is running right now, I'll report back when I have some new >>>>> results! I hope this brings me one step closer to finishing the >>>>> baseline system :) >>>>> >>>>> Kind regards, >>>>> Diana >>>>> >>>>> On 5/13/2013 10:37 AM, Barry Haddow wrote: >>>>>> Hi Diana >>>>>> >>>>>> Training is failing because the existence check for >>>>>> >>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment >>>>>> >>>>>> is failing. Is this the actual path that Moses is looking for, or >>>>>> did you replace your user name with <user> in order to mail support? >>>>>> >>>>>> If the path that it is looking for indeed exists, it could be >>>>>> because train-model.perl is using >>>>>> >>>>>> if ! -s $filename # exists and has non-zero length >>>>>> >>>>>> instead of >>>>>> >>>>>> if ! -e $filename # exists >>>>>> >>>>>> and the results differ between Linux and cygwin. >>>>>> >>>>>> Could you try replacing the "-s" with a "-e" and see if it works? >>>>>> >>>>>> cheers - Barry >>>>>> >>>>>> >>>>>> >>>>>> On 12/05/13 20:29, A.E.M. Koenraadt wrote: >>>>>>> Hi all, >>>>>>> >>>>>>> I've been trying to get EMS (experiment.perl) working, at least >>>>>>> for the Baseline system >>>>>>> (http://www.statmt.org/moses/?n=moses.baseline). I started using >>>>>>> EMS because I ran into some problems and had hoped that using >>>>>>> EMS and the sample config would relieve me from supplying too >>>>>>> many commandline arguments. It has helped me so far. >>>>>>> >>>>>>> Unfortunately, I run into errors for the 'evaluation' and >>>>>>> 'tuning' steps. I'm not yet familiar with the details of each >>>>>>> step, so I'm hoping I can find some help here with these errors >>>>>>> because I couldn't find it online so far. >>>>>>> >>>>>>> I'm running Cygwin under Win7 and when executing the baseline >>>>>>> example, I have the following errors. >>>>>>> >>>>>>> In the log: >>>>>>> >>>>>>> number of steps doable or running: 3 at Sun, May 12, 2013 >>>>>>> 8:21:08 PM >>>>>>> doable: TRAINING:create-config >>>>>>> doable: EVALUATION:newstest2010:filter >>>>>>> doable: TUNING:filter >>>>>>> executing >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/1/TRAINING_create-config.1 >>>>>>> >>>>>>> via sh (1 active) >>>>>>> executing >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/1/EVALUATION_newstest2010_filter.1 >>>>>>> >>>>>>> via sh (2 active) >>>>>>> step EVALUATION:newstest2010:filter crashed >>>>>>> number of steps doable or running: 1 at Sun, May 12, 2013 >>>>>>> 8:21:23 PM >>>>>>> doable: TUNING:filter >>>>>>> executing >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/1/TUNING_filter.1 >>>>>>> >>>>>>> via sh (1 active) >>>>>>> step TUNING:filter crashed >>>>>>> number of steps doable or running: 0 at Sun, May 12, 2013 >>>>>>> 8:21:33 PM >>>>>>> >>>>>>> In steps/1/EVALUATION_newstest2010_filter.1.STDERR >>>>>>> >>>>>>> Using SCRIPTS_ROOTDIR: >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts >>>>>>> ERROR: Language model file not found or empty: >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment at >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/train-model.perl >>>>>>> >>>>>>> line 440. >>>>>>> Executing: mkdir -p >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.filtered.1 >>>>>>> Can't read >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.moses.table.ini.1 >>>>>>> >>>>>>> at >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/filter-model-given-input.pl >>>>>>> >>>>>>> line 89. >>>>>>> rm: cannot remove >>>>>>> `/cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.moses.table.ini.1': >>>>>>> >>>>>>> No such file or directory >>>>>>> >>>>>>> In steps/1/TUNING_filter.1.STDERR >>>>>>> >>>>>>> Using SCRIPTS_ROOTDIR: >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts >>>>>>> ERROR: Language model file not found or empty: >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment at >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/train-model.perl >>>>>>> >>>>>>> line 440. >>>>>>> Executing: mkdir -p >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.1 >>>>>>> Can't read >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.table.ini.1 >>>>>>> >>>>>>> at >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/filter-model-given-input.pl >>>>>>> >>>>>>> line 89. >>>>>>> rm: cannot remove >>>>>>> `/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.table.ini.1': >>>>>>> >>>>>>> No such file or directory >>>>>>> >>>>>>> The files it seems to concern (although I'm not sure given that >>>>>>> they occur after the 'not found or empty' notification) >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.moses.table.ini.1 >>>>>>> >>>>>>> and >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.table.ini.1 >>>>>>> >>>>>>> indeed don't exist... >>>>>>> >>>>>>> Attached also the current graph.1.png. >>>>>>> >>>>>>> I've been able to fix other issues so far with the help of >>>>>>> messages on this support mailinglist, so I'm hoping someone can >>>>>>> help me fix this as well so that I can run the baseline example. >>>>>>> >>>>>>> Thank you kindly in advance. >>>>>>> >>>>>>> Diana Koenraadt >>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Moses-support mailing list >>>>>>> [email protected] >>>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>>>> >>>>>> >>>>> >>>> >>> >>> >> > > _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
