Hi Barry,
the directory tuning/filtered.2 contains the empty file
phrase-table.0-0.1.1 and a moses.ini which I've attached here. The
folder contains no other files.
I've cleared the entire experiment directory and am running the steps
from scratch again. Not sure if it'll help, but we're probably in a
different time zone anyway so it won't matter ;)
Thanks for your help and quick replies so far!!
Kind regards,
Diana
On 5/14/2013 9:46 AM, Barry Haddow wrote:
Hi Diana
This time the existence check that fails is in the decoder itself, ie
in C++, as opposed to in perl. So it's probably not the same problem.
It could be that TUNING:filter failed. Can you check the logs for
that? What is in the directory
/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.2 ?
cheers - Barry
On 14/05/13 07:06, A.E.M. Koenraadt wrote:
Hi Barry,
This has indeed solved the problem I had.
However, a new problem occurs, in the tuning step. All other steps
pass now, so I think and hope this is the final hurdle.
Attached you may find the graph again.
In the log:
number of steps doable or running: 1 at Mon, May 13, 2013 11:05:32 PM
doable: TUNING:tune
executing
/cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/2/TUNING_tune.2
via sh (1 active)
step TUNING:tune crashed
number of steps doable or running: 0 at Mon, May 13, 2013 11:05:41 PM
In steps/2/TUNING_tune.2.STDERR:
Using SCRIPTS_ROOTDIR:
/cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts
Asking moses for feature names and values from
/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.filtered.ini.2
Executing: /cygdrive/c/Users/<user>/Desktop/moses/cygwin/bin/moses
-threads 4 -v 0 -config
/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.filtered.ini.2
-inputtype 0 -show-weights > ./features.list
ERROR:File
/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.2/reordering-table.2.wbe-msd-bidirectional-fe
does not exist
Exit code: 1
Failed to run moses with the config
/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.filtered.ini.2
at
/cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/mert-moses.pl
line 1169.
cp: cannot stat
`/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/tmp.2/moses.ini':
No such file or directory
Again, the specified file indeed doesn't exist.. I'm unfortunately
not able to investigate this in detail myself at the moment. Could it
be a similar problem in mert-moses.pl?
Kind regards,
Diana
On 5/13/2013 9:21 PM, A.E.M. Koenraadt wrote:
Hi Barry,
thank you for your quick reply. Yes, I replaced my user name with
<user> for my e-mail to this list. The path does exist, so I
replaced the single occurrence of "if ! -s $filename" in
train-model.perl by "if ! -e $filename" like you said. The new test
is running right now, I'll report back when I have some new results!
I hope this brings me one step closer to finishing the baseline
system :)
Kind regards,
Diana
On 5/13/2013 10:37 AM, Barry Haddow wrote:
Hi Diana
Training is failing because the existence check for
/cygdrive/c/Users/<user>/Desktop/moses/experiment
is failing. Is this the actual path that Moses is looking for, or
did you replace your user name with <user> in order to mail support?
If the path that it is looking for indeed exists, it could be
because train-model.perl is using
if ! -s $filename # exists and has non-zero length
instead of
if ! -e $filename # exists
and the results differ between Linux and cygwin.
Could you try replacing the "-s" with a "-e" and see if it works?
cheers - Barry
On 12/05/13 20:29, A.E.M. Koenraadt wrote:
Hi all,
I've been trying to get EMS (experiment.perl) working, at least
for the Baseline system
(http://www.statmt.org/moses/?n=moses.baseline). I started using
EMS because I ran into some problems and had hoped that using EMS
and the sample config would relieve me from supplying too many
commandline arguments. It has helped me so far.
Unfortunately, I run into errors for the 'evaluation' and 'tuning'
steps. I'm not yet familiar with the details of each step, so I'm
hoping I can find some help here with these errors because I
couldn't find it online so far.
I'm running Cygwin under Win7 and when executing the baseline
example, I have the following errors.
In the log:
number of steps doable or running: 3 at Sun, May 12, 2013 8:21:08 PM
doable: TRAINING:create-config
doable: EVALUATION:newstest2010:filter
doable: TUNING:filter
executing
/cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/1/TRAINING_create-config.1
via sh (1 active)
executing
/cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/1/EVALUATION_newstest2010_filter.1
via sh (2 active)
step EVALUATION:newstest2010:filter crashed
number of steps doable or running: 1 at Sun, May 12, 2013 8:21:23 PM
doable: TUNING:filter
executing
/cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/1/TUNING_filter.1
via sh (1 active)
step TUNING:filter crashed
number of steps doable or running: 0 at Sun, May 12, 2013 8:21:33 PM
In steps/1/EVALUATION_newstest2010_filter.1.STDERR
Using SCRIPTS_ROOTDIR:
/cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts
ERROR: Language model file not found or empty:
/cygdrive/c/Users/<user>/Desktop/moses/experiment at
/cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/train-model.perl
line 440.
Executing: mkdir -p
/cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.filtered.1
Can't read
/cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.moses.table.ini.1
at
/cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/filter-model-given-input.pl
line 89.
rm: cannot remove
`/cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.moses.table.ini.1':
No such file or directory
In steps/1/TUNING_filter.1.STDERR
Using SCRIPTS_ROOTDIR:
/cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts
ERROR: Language model file not found or empty:
/cygdrive/c/Users/<user>/Desktop/moses/experiment at
/cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/train-model.perl
line 440.
Executing: mkdir -p
/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.1
Can't read
/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.table.ini.1
at
/cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/filter-model-given-input.pl
line 89.
rm: cannot remove
`/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.table.ini.1':
No such file or directory
The files it seems to concern (although I'm not sure given that
they occur after the 'not found or empty' notification)
/cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.moses.table.ini.1
and
/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.table.ini.1
indeed don't exist...
Attached also the current graph.1.png.
I've been able to fix other issues so far with the help of
messages on this support mailinglist, so I'm hoping someone can
help me fix this as well so that I can run the baseline example.
Thank you kindly in advance.
Diana Koenraadt
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
#########################
### MOSES CONFIG FILE ###
#########################
# input factors
[input-factors]
0
# mapping steps
[mapping]
0 T 0
# translation tables: table type (hierarchical(0), textual (0), binary (1)),
source-factors, target-factors, number of scores, file
# OLD FORMAT is still handled for back-compatibility
# OLD FORMAT translation tables: source-factors, target-factors, number of
scores, file
# OLD FORMAT a binary table type (1) is assumed
[ttable-file]
1 0 0 5
/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.2/phrase-table.0-0.1.1
# no generation models, no generation-file section
# language models: type(srilm/irstlm), factors, order, file
[lmodel-file]
0 0 3 /cygdrive/c/Users/<user>/Desktop/moses/experiment
# limit on how many phrase translations e for each phrase f are loaded
# 0 = all elements loaded
[ttable-limit]
20
# distortion (reordering) files
[distortion-file]
0-0 wbe-msd-bidirectional-fe-allff 6
/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.2/reordering-table.2.wbe-msd-bidirectional-fe
# distortion (reordering) weight
[weight-d]
0.3
0.3
0.3
0.3
0.3
0.3
0.3
# language model weights
[weight-l]
0.5000
# translation model weights
[weight-t]
0.20
0.20
0.20
0.20
0.20
# no generation models, no weight-generation section
# word penalty
[weight-w]
-1
[distortion-limit]
6
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
