Hi
I am not sure why I am getting this error. Can someone help me out?
I am sending part of the Moses training messages.
/doren/Workspace/mosesdecoder/scripts/generic/extract-parallel.perl 4 split
"sort " /doren/Workspace/mosesdecoder/scripts/../bin/extract
/doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN
/doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract
7 orientation --model hier-mslr --GZOutput
Executing:
/doren/Workspace/mosesdecoder/scripts/generic/extract-parallel.perl 4 split
"sort " /doren/Workspace/mosesdecoder/scripts/../bin/extract
/doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN
/doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract
7 orientation --model hier-mslr --GZOutput
MAX 7 1 0
Started Tue Sep 8 15:21:49 2015
which: no pigz in
(/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin)
using gzip
Usage: split [OPTION]... [INPUT [PREFIX]]
Output fixed-size pieces of INPUT to PREFIXaa, PREFIXab, ...; default
size is 1000 lines, and default PREFIX is `x'. With no INPUT, or when INPUT
is -, read standard input.
Mandatory arguments to long options are mandatory for short options too.
-a, --suffix-length=N use suffixes of length N (default 2)
-b, --bytes=SIZE put SIZE bytes per output file
-C, --line-bytes=SIZE put at most SIZE bytes of lines per output file
-d, --numeric-suffixes use numeric suffixes instead of alphabetic
-l, --lines=NUMBER put NUMBER lines per output file
--verbose print a diagnostic just before each
output file is opened
--help display this help and exit
--version output version information and exit
SIZE may be (or may be an integer optionally followed by) one of following:
KB 1000, K 1024, MB 1000*1000, M 1024*1024, and so on for G, T, P, E, Z, Y.
Report split bugs to bug-coreut...@gnu.org
GNU coreutils home page: <http://www.gnu.org/software/coreutils/>
General help using GNU software: <http://www.gnu.org/gethelp/>
Report split translation bugs to <http://translationproject.org/team/>
For complete documentation, run: info coreutils 'split invocation'
isBSDSplit=0
Executing: mkdir -p
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970;
ls -l
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970
total=20000 line-per-split=5001
split -d -l 5001 -a 7
/doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/target.split
-d -l 5001 -a 7
/doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/source.split
-d -l 5001 -a 7
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/align.sh:
/dev/stderr: Not a directory
sh: /dev/stderr: Not a directory
sh: /dev/stderr: Not a directory
sh: /dev/stderr: Not a directory
merging extract / extract.inv
gunzip -c
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.gz
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.gz
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.gz
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.gz
| LC_ALL=C sort -T
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970
2>> /dev/stderr | gzip -c >
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz
2>> /dev/stderr
gunzip -c
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.inv.gz
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.inv.gz
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.inv.gz
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.inv.gz
| LC_ALL=C sort -T
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970
2>> /dev/stderr | gzip -c >
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz
2>> /dev/stderr
sh: /dev/stderr: Not a directory
gzip:
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.gz:
No such file or directory
sh: /dev/stderr: Not a directory
sh: /dev/stderr: Not a directory
sh: /dev/stderr: Not a directory
gzip:
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.inv.gz:
No such file or directory
gzip: gzip:
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.gz:
No such file or directory
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.inv.gz:
No such file or directory
gzip:
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.gz:
No such file or directory
gzip:
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.inv.gz:
No such file or directory
gzip:
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.gz:
No such file or directory
gzip:
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.inv.gz:
No such file or directory
Finished Tue Sep 8 15:21:50 2015
(6) score phrases @ Tue Sep 8 15:21:50 CDT 2015
(6.1) creating table half
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e
@ Tue Sep 8 15:21:50 CDT 2015
/doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
"sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz
0
Executing:
/doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
"sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz
0
(6.1) creating table half
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f
@ Tue Sep 8 15:21:50 CDT 2015
/doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
"sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
--Inverse 1
Executing:
/doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
"sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
--Inverse 1
which: no pigz in
(/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin)
which: no pigz in
(/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin)
using gzip
Started Tue Sep 8 15:21:50 2015
using gzip
Started Tue Sep 8 15:21:50 2015
gzip:
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz:
unexpected end of file
gzip:
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz:
unexpected end of file
/doren/Workspace/mosesdecoder/scripts/../bin/score
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/extract.0.gz
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/phrase-table.half.0000000.gz
--Inverse 2>> /dev/stderr
/doren/Workspace/mosesdecoder/scripts/../bin/score
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/extract.0.gz
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz
2>> /dev/stderr
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/
run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.0.sh:
line 1: /dev/stderr: Not a directory
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/
run.0.sh: line 1: /dev/stderr: Not a directory
mv
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gzmv:
cannot stat
`/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz':
No such file or directory
gunzip -c
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/phrase-table.half.*.gz
2>> /dev/stderr| LC_ALL=C sort -T
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018
| gzip -c >
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
2>> /dev/stderr sh: /dev/stderr: Not a directory
sh: /dev/stderr: Not a directory
Exit code: 1
ERROR: Scoring of phrases failed at
/doren/Workspace/mosesdecoder/scripts/training/train-model.perl line 1773.
Exit code: 1
ERROR: Scoring of phrases failed at
/doren/Workspace/mosesdecoder/scripts/training/train-model.perl line 1773.
(6.6) consolidating the two halves @ Tue Sep 8 15:21:50 CDT 2015
Executing: /doren/Workspace/mosesdecoder/scripts/../bin/consolidate
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
/dev/stdout | gzip -c >
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.gz
Consolidate v2.0 written by Philipp Koehn
consolidating direct and indirect rule tables
terminate called after throwing an instance of 'std::runtime_error'
what(): Could not open
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz.
Executing: rm -f
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.*
(7) learn reordering model @ Tue Sep 8 15:21:51 CDT 2015
(7.1) [no factors] learn reordering model @ Tue Sep 8 15:21:51 CDT 2015
(7.2) building tables @ Tue Sep 8 15:21:51 CDT 2015
Executing:
/doren/Workspace/mosesdecoder/scripts/../bin/lexical-reordering-score
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz
0.5
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/reordering-table.
--model "hier mslr hier-mslr-bidirectional-fe"
Lexical Reordering Scorer
scores lexical reordering models of several types (hierarchical,
phrase-based and word-based-extraction
terminate called after throwing an instance of 'util::ErrnoException'
what(): util/file.cc:68 in int util::OpenReadOrThrow(const char*) threw
ErrnoException because `-1 == (ret = open(name, 00))'.
No such file or directory while opening
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz
ERROR: Execution of:
/doren/Workspace/mosesdecoder/scripts/../bin/lexical-reordering-score
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz
0.5
/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/reordering-table.
--model "hier mslr hier-mslr-bidirectional-fe"
died with signal 6, without coredump
823.89user 55.26system 3:53.03elapsed 377%CPU (0avgtext+0avgdata
629344maxresident)k
27176inputs+273160outputs (28major+2115194minor)pagefaults 0swaps
Best Regards
Thoudam Doren Singh
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
