it looks like you're using Mac OSX. You must make sure that the GNU
version of sort and split, not the BSD version. Moses has been tested on
OSX using MacPorts to install sort and split so you should install MacPorts
https://www.macports.org/
On 20/08/2017 13:22, Aileen Joan Vicente wrote:
Hi! I ran training.perl, succeeded but found an empty phrase table.
I googled around to look for answer and some guy advised to check
the logs. I wonder if the problem is caused by this error in Step 5.
Please help.
Using SCRIPTS_ROOTDIR: /Users/dcs/Moses/tools/mosesdecoder/scripts
using gzip
(5) extract phrases @ Sun Aug 20 19:26:48 PHT 2017
MAX 7 0 0
/Users/dcs/Moses/tools/mosesdecoder/scripts/generic/extract-parallel.perl
4 split "sort "
/Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract
/Users/dcs/Desktop/Corpus/training/corpus/mycorpus.en
/Users/dcs/Desktop/Corpus/training/corpus/mycorpus.cbk
/Users/dcs/Desktop/Corpus/training/model/aligned.grow-diag-final
/Users/dcs/Desktop/Corpus/training/model/extract 7 --GZOutput
Executing:
/Users/dcs/Moses/tools/mosesdecoder/scripts/generic/extract-parallel.perl
4 split "sort "
/Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract
/Users/dcs/Desktop/Corpus/training/corpus/mycorpus.en
/Users/dcs/Desktop/Corpus/training/corpus/mycorpus.cbk
/Users/dcs/Desktop/Corpus/training/model/aligned.grow-diag-final
/Users/dcs/Desktop/Corpus/training/model/extract 7 --GZOutput
Started Sun Aug 20 19:26:48 2017
using gzip
split: illegal option -- -
usage: split [-a sufflen] [-b byte_count] [-l line_count] [-p pattern]
[file [prefix]]
isBSDSplit=1
Executing: mkdir -p
/Users/dcs/Desktop/Corpus/training/model/tmp.798; ls -l
/Users/dcs/Desktop/Corpus/training/model/tmp.798
total=2942 line-per-split=736
split -l 736 -a 7
/Users/dcs/Desktop/Corpus/training/corpus/mycorpus.en
/Users/dcs/Desktop/Corpus/training/model/tmp.798/target.split -l
736 -a 7 /Users/dcs/Desktop/Corpus/training/corpus/mycorpus.cbk
/Users/dcs/Desktop/Corpus/training/model/tmp.798/source.split -l
736 -a 7
/Users/dcs/Desktop/Corpus/training/model/aligned.grow-diag-final
/Users/dcs/Desktop/Corpus/training/model/tmp.798/align.sh:
/Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract: No such
file or directory
sh: /Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract: No
such file or directory
sh: /Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract: No
such file or directory
sh: /Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract: No
such file or directory
merging extract / extract.inv
gunzip -c
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.gz
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.gz
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.gz
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.gz
| LC_ALL=C sort -T
/Users/dcs/Desktop/Corpus/training/model/tmp.798 2>> /dev/stderr |
gzip -c > /Users/dcs/Desktop/Corpus/training/model/extract.sorted.gz
2>> /dev/stderr
gunzip -c
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.inv.gz
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.inv.gz
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.inv.gz
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.inv.gz
| LC_ALL=C sort -T
/Users/dcs/Desktop/Corpus/training/model/tmp.798 2>> /dev/stderr |
gzip -c >
/Users/dcs/Desktop/Corpus/training/model/extract.inv.sorted.gz 2>>
/dev/stderr
gunzip: can't stat:
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.inv.gz
(/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.inv.gz.gz):
No such file or directory
gunzip: can't stat:
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.inv.gz
(/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.inv.gz.gz):
No such file or directory
gunzip: can't stat:
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.inv.gz
(/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.inv.gz.gz):
No such file or directory
gunzip: can't stat:
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.inv.gz
(/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.inv.gz.gz):
No such file or directory
gunzip: can't stat:
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.gz
(/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.gz.gz):
No such file or directory
gunzip: can't stat:
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.gz
(/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.gz.gz):
No such file or directory
gunzip: can't stat:
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.gz
(/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.gz.gz):
No such file or directory
gunzip: can't stat:
/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.gz
(/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.gz.gz):
No such file or directory
Finished Sun Aug 20 19:26:48 2017
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
--
Hieu Hoang
http://moses-smt.org/
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
