Confirmed on Ubuntu 12.04 as well. Hieu Hoang seems to have added this bit to the server, so maybe he knows more than I do. I usually dabble in phrase-based decoding only, so this is uncharted territory for me. I'll try to look into it, but it may take a little while as I can do so only in my spare time.
- Uli On Wed, Jan 27, 2016 at 3:12 PM, Martin Baumgärtner < martin.baumgaert...@star-group.net> wrote: > Hi all, > > I'm using a system with current CentOS 7, Boost 1.60.0 and moses from git > master (SHA: 42b8b89d54a5c670f02a16426a92cc1d0fb97754). > > While playing with basic hierarchical models I found the following > (probably buggy) behaviour: > > 1.) INITIALIZE ... > > % wget "http://www.statmt.org/moses/download/sample-models.tgz"; > <http://www.statmt.org/moses/download/sample-models.tgz> && tar xfz > sample-models.tgz && cd sample-models > > > 2.) TRANSLATE WITHOUT SERVER ... (ok) > > % echo 'dies ist ein haus' | moses -f string-to-tree/moses.ini > > Defined parameters (per moses.ini or switch): > config: string-to-tree/moses.ini > cube-pruning-pop-limit: 1000 > feature: KENLM name=LM factor=0 order=3 num-features=1 > path=lm/europarl.srilm.gz WordPenalty UnknownWordPenalty > PhraseDictionaryMemory input-factor=0 output-factor=0 > path=string-to-tree/rule-table num-features=1 table-limit=20 > input-factors: 0 > inputtype: 3 > mapping: 0 T 0 > max-chart-span: 20 1000 > non-terminals: X S > search-algorithm: 3 > translation-details: translation-details.log > weight: WordPenalty0= 0 LM= 0.5 PhraseDictionaryMemory0= 0.5 > line=KENLM name=LM factor=0 order=3 num-features=1 > path=lm/europarl.srilm.gz > Loading the LM will be faster if you build a binary file. > Reading lm/europarl.srilm.gz > > ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 > **The ARPA file is missing <unk>. Substituting log10 probability -100.000. > > ************************************************************************************************** > FeatureFunction: LM start: 0 end: 0 > line=WordPenalty > FeatureFunction: WordPenalty0 start: 1 end: 1 > line=UnknownWordPenalty > FeatureFunction: UnknownWordPenalty0 start: 2 end: 2 > line=PhraseDictionaryMemory input-factor=0 output-factor=0 > path=string-to-tree/rule-table num-features=1 table-limit=20 > FeatureFunction: PhraseDictionaryMemory0 start: 3 end: 3 > Loading LM > Loading WordPenalty0 > Loading UnknownWordPenalty0 > Loading PhraseDictionaryMemory0 > Start loading text phrase table. Moses format : [0.795] seconds > Reading string-to-tree/rule-table > > ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 > > **************************************************************************************************** > max-chart-span: 20 > Created input-output object : [0.796] seconds > Line 0: Initialize search took 0.000 seconds total > Translating: <s> das ist ein haus </s> ||| [0,0]=X (1) [0,1]=X (1) > [0,2]=X (1) [0,3]=X (1) [0,4]=X (1) [0,5]=X (1) [1,1]=X (1) [1,2]=X (1) > [1,3]=X (1) [1,4]=X (1) [1,5]=X (1) [2,2]=X (1) [2,3]=X (1) [2,4]=X (1) > [2,5]=X (1) [3,3]=X (1) [3,4]=X (1) [3,5]=X (1) [4,4]=X (1) [4,5]=X (1) > [5,5]=X (1) > > 0 1 2 3 4 5 > 0 3 2 2 1 0 > 0 0 0 2 0 > 0 0 4 0 > 0 8 0 > 0 0 > 1 > BEST TRANSLATION: 31 TOP -> <s> S </s> :1-1 : term=: nonterm=1-1 : > c=-3.206 core=(-6.413,-2.000,0.000,0.000) [0..5] 15 [total=-12.332] > core=(-22.361,-6.000,0.000,-2.303) > this is a house > Line 0: Additional reporting took 0.000 seconds total > Line 0: Translation took 0.001 seconds total > Translation took 0.010 seconds > Name:moses VmPeak:79168 kB VmRSS:7392 kB RSSMax:35916 kB > user:0.783 sys:0.022 CPU:0.805 real:0.799 > > > 3.) SET UP XMLRPC FILE ... > > % echo '<?xml version="1.0" encoding="UTF-8"?> > <methodCall> > <methodName>translate</methodName> > <params><param><value> > <struct> > <member> > <name>text</name> > <value> > <string>dies ist ein haus .</string> > </value> > </member> > </struct></value></param> > </params> > </methodCall> > ' > rpc.xml > > > 4.) START MOSES SERVER ... > > % moses --server --config string-to-tree/moses.ini & > > Defined parameters (per moses.ini or switch): > config: string-to-tree/moses.ini > cube-pruning-pop-limit: 1000 > feature: KENLM name=LM factor=0 order=3 num-features=1 > path=lm/europarl.srilm.gz WordPenalty UnknownWordPenalty > PhraseDictionaryMemory input-factor=0 output-factor=0 > path=string-to-tree/rule-table num-features=1 table-limit=20 > input-factors: 0 > inputtype: 3 > mapping: 0 T 0 > max-chart-span: 20 1000 > non-terminals: X S > search-algorithm: 3 > server: > translation-details: translation-details.log > weight: WordPenalty0= 0 LM= 0.5 PhraseDictionaryMemory0= 0.5 > line=KENLM name=LM factor=0 order=3 num-features=1 > path=lm/europarl.srilm.gz > Loading the LM will be faster if you build a binary file. > Reading lm/europarl.srilm.gz > > ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 > **The ARPA file is missing <unk>. Substituting log10 probability -100.000. > > ************************************************************************************************** > FeatureFunction: LM start: 0 end: 0 > line=WordPenalty > FeatureFunction: WordPenalty0 start: 1 end: 1 > line=UnknownWordPenalty > FeatureFunction: UnknownWordPenalty0 start: 2 end: 2 > line=PhraseDictionaryMemory input-factor=0 output-factor=0 > path=string-to-tree/rule-table num-features=1 table-limit=20 > FeatureFunction: PhraseDictionaryMemory0 start: 3 end: 3 > Loading LM > Loading WordPenalty0 > Loading UnknownWordPenalty0 > Loading PhraseDictionaryMemory0 > Start loading text phrase table. Moses format : [0.817] seconds > Reading string-to-tree/rule-table > > ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 > > **************************************************************************************************** > max-chart-span: 20 > RUN SERVER at pid 0 > [moses/server/Server.cpp:49] Listening on port 8080 > > > 5.) TRANSLATE WITH SERVER ... (not ok) > > % curl --data @rpc.xml '192.168.178.14:8080/RPC2' > > [moses/server/TranslationRequest.cpp:317] Input: dies ist ein haus . > Translating: <s> dies ist ein haus . </s> > 0 1 2 3 4 5 6 > 0 1 2 2 1 1 0 > 0 0 0 0 0 0 > 0 0 0 0 0 > 0 0 0 0 > 0 0 0 > 0 0 > 0 > *** Segmentation fault > Register dump: > > RAX: 0000000000000006 RBX: 0000000000000000 RCX: 0000000000000001 > RDX: 00000000028fe000 RSI: 00007f7ae25fe5d0 RDI: 00000000025ffaa0 > RBP: 00007f7ae25fe940 R8 : 00000000028fe000 R9 : 00007f7ae4d24f90 > R10: 00007f7ae4d3f960 R11: 0000000000000000 R12: 0000000000000000 > R13: 00007f7ae25fe5d0 R14: 0000000000000000 R15: 00000000028ec268 > RSP: 00007f7ae25fe540 > > RIP: 0000000000571c70 EFLAGS: 00010206 > > CS: 0033 FS: 0000 GS: 0000 > > Trap: 0000000e Error: 00000004 OldMask: 00000000 CR2: 00000000 > > FPUCW: 0000037f FPUSW: 00000000 TAG: 00000000 > RIP: 00000000 RDP: 00000000 > > ST(0) 0000 0000000000000000 ST(1) 0000 0000000000000000 > ST(2) 0000 0000000000000000 ST(3) 0000 0000000000000000 > ST(4) 0000 0000000000000000 ST(5) 0000 0000000000000000 > ST(6) 0000 0000000000000000 ST(7) 0000 0000000000000000 > mxcsr: 1fa4 > XMM0: 000000000000000000000000ff0000ff XMM1: > 000000000000000000000000ff0000ff > XMM2: 000000000000000000000000ff0000ff XMM3: > 000000000000000000000000ff0000ff > XMM4: 000000000000000000000000ff0000ff XMM5: > 000000000000000000000000ff0000ff > XMM6: 000000000000000000000000ff0000ff XMM7: > 000000000000000000000000ff0000ff > XMM8: 000000000000000000000000ff0000ff XMM9: > 000000000000000000000000ff0000ff > XMM10: 000000000000000000000000ff0000ff XMM11: > 000000000000000000000000ff0000ff > XMM12: 000000000000000000000000ff0000ff XMM13: > 000000000000000000000000ff0000ff > XMM14: 000000000000000000000000ff0000ff XMM15: > 000000000000000000000000ff0000ff > > Backtrace: > /home/maba/bin/moses[0x571c70] > /home/maba/bin/moses[0x503c48] > /home/maba/bin/moses[0x504031] > /home/maba/bin/moses[0x501a21] > /home/maba/bin/moses[0x564309] > /home/maba/bin/moses[0x7deec9] > /usr/lib64/libpthread.so.0(+0x7dc5)[0x7f7ae430cdc5] > /usr/lib64/libc.so.6(clone+0x6d)[0x7f7ae403a21d] > > Memory map: > > 00400000-00945000 r-xp 00000000 fd:02 5162546 > /home/maba/bin/moses > 00b45000-00b46000 r--p 00545000 fd:02 5162546 > /home/maba/bin/moses > 00b46000-00b48000 rw-p 00546000 fd:02 5162546 > /home/maba/bin/moses > 00b48000-00b4d000 rw-p 00000000 00:00 0 > 01df3000-02bf6000 rw-p 00000000 00:00 0 > [heap] > 7f7adadf1000-7f7adadf2000 ---p 00000000 00:00 0 > 7f7adadf2000-7f7adb5f2000 rw-p 00000000 00:00 0 > [stack:34973] > 7f7adb5f2000-7f7adb5f3000 ---p 00000000 00:00 0 > 7f7adb5f3000-7f7adbdf3000 rw-p 00000000 00:00 0 > [stack:34972] > 7f7adbdf3000-7f7adbdf4000 ---p 00000000 00:00 0 > 7f7adbdf4000-7f7adc5f4000 rw-p 00000000 00:00 0 > [stack:34971] > 7f7adc5f4000-7f7adc5f5000 ---p 00000000 00:00 0 > 7f7adc5f5000-7f7adcdf5000 rw-p 00000000 00:00 0 > [stack:34970] > 7f7adcdf5000-7f7adcdf6000 ---p 00000000 00:00 0 > 7f7adcdf6000-7f7add5f6000 rw-p 00000000 00:00 0 > [stack:34969] > 7f7add5f6000-7f7add5f7000 ---p 00000000 00:00 0 > 7f7add5f7000-7f7adddf7000 rw-p 00000000 00:00 0 > [stack:34968] > 7f7adddf7000-7f7adddf8000 ---p 00000000 00:00 0 > 7f7adddf8000-7f7ade5f8000 rw-p 00000000 00:00 0 > [stack:34967] > 7f7ade5f8000-7f7ade5f9000 ---p 00000000 00:00 0 > 7f7ade5f9000-7f7adedf9000 rw-p 00000000 00:00 0 > [stack:34966] > 7f7adedf9000-7f7adedfa000 ---p 00000000 00:00 0 > 7f7adedfa000-7f7adf5fa000 rw-p 00000000 00:00 0 > [stack:34965] > 7f7adf5fa000-7f7adf5fb000 ---p 00000000 00:00 0 > 7f7adf5fb000-7f7adfdfb000 rw-p 00000000 00:00 0 > [stack:34964] > 7f7adfdfb000-7f7adfdfc000 ---p 00000000 00:00 0 > 7f7adfdfc000-7f7ae05fc000 rw-p 00000000 00:00 0 > [stack:34963] > 7f7ae05fc000-7f7ae05fd000 ---p 00000000 00:00 0 > 7f7ae05fd000-7f7ae0dfd000 rw-p 00000000 00:00 0 > [stack:34962] > 7f7ae0dfd000-7f7ae0dfe000 ---p 00000000 00:00 0 > 7f7ae0dfe000-7f7ae15fe000 rw-p 00000000 00:00 0 > [stack:34961] > 7f7ae15fe000-7f7ae15ff000 ---p 00000000 00:00 0 > 7f7ae15ff000-7f7ae1dff000 rw-p 00000000 00:00 0 > [stack:34960] > 7f7ae1dff000-7f7ae1e00000 ---p 00000000 00:00 0 > 7f7ae1e00000-7f7ae2600000 rw-p 00000000 00:00 0 > [stack:34959] > 7f7ae2600000-7f7ae3f2d000 rw-p 00000000 00:00 0 > 7f7ae3f44000-7f7ae40fa000 r-xp 00000000 fd:01 201327759 > /usr/lib64/libc-2.17.so > 7f7ae40fa000-7f7ae42fa000 ---p 001b6000 fd:01 201327759 > /usr/lib64/libc-2.17.so > 7f7ae42fa000-7f7ae42fe000 r--p 001b6000 fd:01 201327759 > /usr/lib64/libc-2.17.so > 7f7ae42fe000-7f7ae4300000 rw-p 001ba000 fd:01 201327759 > /usr/lib64/libc-2.17.so > 7f7ae4300000-7f7ae4305000 rw-p 00000000 00:00 0 > 7f7ae4305000-7f7ae431b000 r-xp 00000000 fd:01 202647953 > /usr/lib64/libpthread-2.17.so > 7f7ae431b000-7f7ae451b000 ---p 00016000 fd:01 202647953 > /usr/lib64/libpthread-2.17.so > 7f7ae451b000-7f7ae451c000 r--p 00016000 fd:01 202647953 > /usr/lib64/libpthread-2.17.so > 7f7ae451c000-7f7ae451d000 rw-p 00017000 fd:01 202647953 > /usr/lib64/libpthread-2.17.so > 7f7ae451d000-7f7ae4521000 rw-p 00000000 00:00 0 > 7f7ae4521000-7f7ae4536000 r-xp 00000000 fd:01 219147257 > /usr/lib64/libgcc_s-4.8.5-20150702.so.1 > 7f7ae4536000-7f7ae4735000 ---p 00015000 fd:01 219147257 > /usr/lib64/libgcc_s-4.8.5-20150702.so.1 > 7f7ae4735000-7f7ae4736000 r--p 00014000 fd:01 219147257 > /usr/lib64/libgcc_s-4.8.5-20150702.so.1 > 7f7ae4736000-7f7ae4737000 rw-p 00015000 fd:01 219147257 > /usr/lib64/libgcc_s-4.8.5-20150702.so.1 > 7f7ae4737000-7f7ae4838000 r-xp 00000000 fd:01 201328059 > /usr/lib64/libm-2.17.so > 7f7ae4838000-7f7ae4a37000 ---p 00101000 fd:01 201328059 > /usr/lib64/libm-2.17.so > 7f7ae4a37000-7f7ae4a38000 r--p 00100000 fd:01 201328059 > /usr/lib64/libm-2.17.so > 7f7ae4a38000-7f7ae4a39000 rw-p 00101000 fd:01 201328059 > /usr/lib64/libm-2.17.so > 7f7ae4a39000-7f7ae4b22000 r-xp 00000000 fd:01 201328136 > /usr/lib64/libstdc++.so.6.0.19 > 7f7ae4b22000-7f7ae4d22000 ---p 000e9000 fd:01 201328136 > /usr/lib64/libstdc++.so.6.0.19 > 7f7ae4d22000-7f7ae4d2a000 r--p 000e9000 fd:01 201328136 > /usr/lib64/libstdc++.so.6.0.19 > 7f7ae4d2a000-7f7ae4d2c000 rw-p 000f1000 fd:01 201328136 > /usr/lib64/libstdc++.so.6.0.19 > 7f7ae4d2c000-7f7ae4d41000 rw-p 00000000 00:00 0 > 7f7ae4d41000-7f7ae4d48000 r-xp 00000000 fd:01 202647957 > /usr/lib64/librt-2.17.so > 7f7ae4d48000-7f7ae4f47000 ---p 00007000 fd:01 202647957 > /usr/lib64/librt-2.17.so > 7f7ae4f47000-7f7ae4f48000 r--p 00006000 fd:01 202647957 > /usr/lib64/librt-2.17.so > 7f7ae4f48000-7f7ae4f49000 rw-p 00007000 fd:01 202647957 > /usr/lib64/librt-2.17.so > 7f7ae4f49000-7f7ae4f4d000 r-xp 00000000 fd:01 201327752 > /usr/lib64/libSegFault.so > 7f7ae4f4d000-7f7ae514c000 ---p 00004000 fd:01 201327752 > /usr/lib64/libSegFault.so > 7f7ae514c000-7f7ae514d000 r--p 00003000 fd:01 201327752 > /usr/lib64/libSegFault.so > 7f7ae514d000-7f7ae514e000 rw-p 00004000 fd:01 201327752 > /usr/lib64/libSegFault.so > 7f7ae514e000-7f7ae5174000 r-xp 00000000 fd:01 202808298 > /usr/lib64/libtcmalloc_minimal.so.4.2.6 > 7f7ae5174000-7f7ae5374000 ---p 00026000 fd:01 202808298 > /usr/lib64/libtcmalloc_minimal.so.4.2.6 > 7f7ae5374000-7f7ae5375000 r--p 00026000 fd:01 202808298 > /usr/lib64/libtcmalloc_minimal.so.4.2.6 > 7f7ae5375000-7f7ae5376000 rw-p 00027000 fd:01 202808298 > /usr/lib64/libtcmalloc_minimal.so.4.2.6 > 7f7ae5376000-7f7ae539c000 rw-p 00000000 00:00 0 > 7f7ae539c000-7f7ae53ab000 r-xp 00000000 fd:01 201360080 > /usr/lib64/libbz2.so.1.0.6 > 7f7ae53ab000-7f7ae55aa000 ---p 0000f000 fd:01 201360080 > /usr/lib64/libbz2.so.1.0.6 > 7f7ae55aa000-7f7ae55ab000 r--p 0000e000 fd:01 201360080 > /usr/lib64/libbz2.so.1.0.6 > 7f7ae55ab000-7f7ae55ac000 rw-p 0000f000 fd:01 201360080 > /usr/lib64/libbz2.so.1.0.6 > 7f7ae55ac000-7f7ae55c1000 r-xp 00000000 fd:01 201327745 > /usr/lib64/libz.so.1.2.7 > 7f7ae55c1000-7f7ae57c0000 ---p 00015000 fd:01 201327745 > /usr/lib64/libz.so.1.2.7 > 7f7ae57c0000-7f7ae57c1000 r--p 00014000 fd:01 201327745 > /usr/lib64/libz.so.1.2.7 > 7f7ae57c1000-7f7ae57c2000 rw-p 00015000 fd:01 201327745 > /usr/lib64/libz.so.1.2.7 > 7f7ae57c2000-7f7ae57e3000 r-xp 00000000 fd:01 201327775 > /usr/lib64/ld-2.17.so > 7f7ae59b9000-7f7ae59ba000 ---p 00000000 00:00 0 > 7f7ae59ba000-7f7ae59e3000 rw-p 00000000 00:00 0 > [stack:36125] > 7f7ae59e3000-7f7ae59e4000 r--p 00021000 fd:01 201327775 > /usr/lib64/ld-2.17.so > 7f7ae59e4000-7f7ae59e5000 rw-p 00022000 fd:01 201327775 > /usr/lib64/ld-2.17.so > 7f7ae59e5000-7f7ae59e6000 rw-p 00000000 00:00 0 > 7ffc55ee1000-7ffc55f03000 rw-p 00000000 00:00 0 > [stack] > 7ffc55fb5000-7ffc55fb7000 r-xp 00000000 00:00 0 > [vdso] > ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 > [vsyscall] > [2] 34958 segmentation fault /home/maba/bin/moses --server --config > string-to-tree/moses.ini > > > Any idea what's been going wrong? Thanks in advance. > > Cheers, > Martin > > -- > > > *STAR Group* <http://www.star-group.net> > <http://www.star-group.net/> > *Martin Baumgärtner* > > > STAR Language Technology & Solutions GmbH > Umberto-Nobile-Straße 19 | 71063 Sindelfingen | Germany > Tel. +49 70 31-4 10 92-0 <martin.baumgaert...@star-group.net> > martin.baumgaert...@star-group.net > Fax +49 70 31-4 10 92-70 www.star-group.net > Geschäftsführer: Oliver Rau, Bernd Barth > Handelsregister Stuttgart HRB 245654 | St.-Nr. 56098/11677 > > > > _______________________________________________ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support > > -- Ulrich Germann Senior Researcher School of Informatics University of Edinburgh
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
