Re: [Moses-support] mgiza install
Hi Hieu, The symptom was an error message from tar (from memory now, sorry, I should've captured it) -- but something like "unexpected EOF in archive". This was from running "tar -zxf" I believe the underlying cause was .gz related because if I tried to gunzip first, the error message was that the file was not in gzip format, which suggested a download problem from Filezilla. But it downloaded and unpacked fine from Filezilla on my host machine, so given a few courses of action (diagnose download problem / update gzip / try Ubuntu VM) I chose to try Ubuntu and got much further. However, still some problem in training, including not finding the 'training' scripts dir, and not making a 'giza.[$TGT-$SRC|$SRC-$TGT]' dir (?) -- any guidance much appreciated. Andrew On 11 August 2016 at 09:06, Hieu Hoang wrote: > Thanks. What was the problem with gunzip on fedora? > > Prob a good idea to make future VM on Ubuntu since that's what everyone > seem to use these days > > On 9 Aug 2016 16:27, "Andrew Caines" wrote: > >> Hi Hieu, >> >> Thank you for suggesting the Linux VMs. I encountered an issue with the >> Fedora one with gunzip and so switched to the Ubuntu one, in which gunzip >> works fine (i.e. for unpacking downloaded corpora). Not your doing I know, >> but perhaps worth updating and repackaging the Fedora VM? >> >> Secondly there were a couple of edits needed to get the mgiza scripts >> running. Should I send them to you here or on GitHub? >> >> Finally, I encountered a bus error in plain2snt-hasvcb.py when training >> and some subsequent path errors -- specifically, could not find "giza. >> $TGT-$SRC" or "giza.$SRC-$TGT" (should this be 2 more mkdirs in >> force-align-moses.sh?) and could not find "$SCRIPT_DIR/training" which >> indeed seems to be missing from mgizapp unless I've not looked carefully >> enough. >> >> As always, happy to be corrected if I'm doing anything wrong. >> Andrew >> >> >> On 26 July 2016 at 22:42, Hieu Hoang wrote: >> >>> that's a weird error. This looks the same as this: >>> >>>https://gcc.gnu.org/bugzilla/show_bug.cgi?id=65306 >>> >>> sounds like you're digging yourself a bigger hole. >>> >>> my suggestion if you must use OSX, especially for teaching - use a Linux >>> virtual machine. We even make 1 available for download with everything >>> installed: >>> >>>http://www.statmt.org/moses/RELEASE-3.0/vm/fedora%2021%2064-bit.ova >>> >>> On 26/07/2016 16:15, Andrew Caines wrote: >>> >>> Hello, >>> I encountered an error in running 'make' with mgiza: >>> >>> [ 10%] Building CXX object src/CMakeFiles/mgiza_lib.dir/F >>> orwardBackward.cpp.o >>> >>> /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:989:suffix >>> or operands invalid for `movq' >>> >>> /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:993:suffix >>> or operands invalid for `movq' >>> >>> /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:1011:suffix >>> or operands invalid for `movq' >>> >>> /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:1467:suffix >>> or operands invalid for `movq' >>> >>> /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:2527:suffix >>> or operands invalid for `movq' >>> >>> make[2]: *** [src/CMakeFiles/mgiza_lib.dir/ForwardBackward.cpp.o] Error >>> 1 >>> I'm on Mac OS X 10.11.5 (El Capitan). I appreciate that OS X is untested >>> compared to Linux, but it'd be great to get this set up, for purposes of >>> teaching & collaboration in DH. >>> >>> thanks in advance, Andrew >>> >>> >>> ___ >>> Moses-support mailing >>> listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support >>> >>> >>> >> ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] mgiza install
Thanks. What was the problem with gunzip on fedora? Prob a good idea to make future VM on Ubuntu since that's what everyone seem to use these days On 9 Aug 2016 16:27, "Andrew Caines" wrote: > Hi Hieu, > > Thank you for suggesting the Linux VMs. I encountered an issue with the > Fedora one with gunzip and so switched to the Ubuntu one, in which gunzip > works fine (i.e. for unpacking downloaded corpora). Not your doing I know, > but perhaps worth updating and repackaging the Fedora VM? > > Secondly there were a couple of edits needed to get the mgiza scripts > running. Should I send them to you here or on GitHub? > > Finally, I encountered a bus error in plain2snt-hasvcb.py when training > and some subsequent path errors -- specifically, could not find "giza.$TGT > -$SRC" or "giza.$SRC-$TGT" (should this be 2 more mkdirs in > force-align-moses.sh?) and could not find "$SCRIPT_DIR/training" which > indeed seems to be missing from mgizapp unless I've not looked carefully > enough. > > As always, happy to be corrected if I'm doing anything wrong. > Andrew > > > On 26 July 2016 at 22:42, Hieu Hoang wrote: > >> that's a weird error. This looks the same as this: >> >>https://gcc.gnu.org/bugzilla/show_bug.cgi?id=65306 >> >> sounds like you're digging yourself a bigger hole. >> >> my suggestion if you must use OSX, especially for teaching - use a Linux >> virtual machine. We even make 1 available for download with everything >> installed: >> >>http://www.statmt.org/moses/RELEASE-3.0/vm/fedora%2021%2064-bit.ova >> >> On 26/07/2016 16:15, Andrew Caines wrote: >> >> Hello, >> I encountered an error in running 'make' with mgiza: >> >> [ 10%] Building CXX object src/CMakeFiles/mgiza_lib.dir/F >> orwardBackward.cpp.o >> >> /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:989:suffix >> or operands invalid for `movq' >> >> /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:993:suffix >> or operands invalid for `movq' >> >> /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:1011:suffix >> or operands invalid for `movq' >> >> /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:1467:suffix >> or operands invalid for `movq' >> >> /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:2527:suffix >> or operands invalid for `movq' >> >> make[2]: *** [src/CMakeFiles/mgiza_lib.dir/ForwardBackward.cpp.o] Error 1 >> I'm on Mac OS X 10.11.5 (El Capitan). I appreciate that OS X is untested >> compared to Linux, but it'd be great to get this set up, for purposes of >> teaching & collaboration in DH. >> >> thanks in advance, Andrew >> >> >> ___ >> Moses-support mailing >> listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support >> >> >> > ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] mgiza install
Hi Hieu, Thank you for suggesting the Linux VMs. I encountered an issue with the Fedora one with gunzip and so switched to the Ubuntu one, in which gunzip works fine (i.e. for unpacking downloaded corpora). Not your doing I know, but perhaps worth updating and repackaging the Fedora VM? Secondly there were a couple of edits needed to get the mgiza scripts running. Should I send them to you here or on GitHub? Finally, I encountered a bus error in plain2snt-hasvcb.py when training and some subsequent path errors -- specifically, could not find "giza.$TGT-$SRC" or "giza.$SRC-$TGT" (should this be 2 more mkdirs in force-align-moses.sh?) and could not find "$SCRIPT_DIR/training" which indeed seems to be missing from mgizapp unless I've not looked carefully enough. As always, happy to be corrected if I'm doing anything wrong. Andrew On 26 July 2016 at 22:42, Hieu Hoang wrote: > that's a weird error. This looks the same as this: > >https://gcc.gnu.org/bugzilla/show_bug.cgi?id=65306 > > sounds like you're digging yourself a bigger hole. > > my suggestion if you must use OSX, especially for teaching - use a Linux > virtual machine. We even make 1 available for download with everything > installed: > >http://www.statmt.org/moses/RELEASE-3.0/vm/fedora%2021%2064-bit.ova > > On 26/07/2016 16:15, Andrew Caines wrote: > > Hello, > I encountered an error in running 'make' with mgiza: > > [ 10%] Building CXX object src/CMakeFiles/mgiza_lib.dir/F > orwardBackward.cpp.o > > /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:989:suffix > or operands invalid for `movq' > > /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:993:suffix > or operands invalid for `movq' > > /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:1011:suffix > or operands invalid for `movq' > > /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:1467:suffix > or operands invalid for `movq' > > /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:2527:suffix > or operands invalid for `movq' > > make[2]: *** [src/CMakeFiles/mgiza_lib.dir/ForwardBackward.cpp.o] Error 1 > I'm on Mac OS X 10.11.5 (El Capitan). I appreciate that OS X is untested > compared to Linux, but it'd be great to get this set up, for purposes of > teaching & collaboration in DH. > > thanks in advance, Andrew > > > ___ > Moses-support mailing > listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support > > > ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] mgiza install
that's a weird error. This looks the same as this: https://gcc.gnu.org/bugzilla/show_bug.cgi?id=65306 sounds like you're digging yourself a bigger hole. my suggestion if you must use OSX, especially for teaching - use a Linux virtual machine. We even make 1 available for download with everything installed: http://www.statmt.org/moses/RELEASE-3.0/vm/fedora%2021%2064-bit.ova On 26/07/2016 16:15, Andrew Caines wrote: Hello, I encountered an error in running 'make' with mgiza: [ 10%] Building CXX object src/CMakeFiles/mgiza_lib.dir/ForwardBackward.cpp.o /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:989:suffix or operands invalid for `movq' /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:993:suffix or operands invalid for `movq' /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:1011:suffix or operands invalid for `movq' /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:1467:suffix or operands invalid for `movq' /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:2527:suffix or operands invalid for `movq' make[2]: *** [src/CMakeFiles/mgiza_lib.dir/ForwardBackward.cpp.o] Error 1 I'm on Mac OS X 10.11.5 (El Capitan). I appreciate that OS X is untested compared to Linux, but it'd be great to get this set up, for purposes of teaching & collaboration in DH. thanks in advance, Andrew ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
[Moses-support] mgiza install
Hello, I encountered an error in running 'make' with mgiza: [ 10%] Building CXX object src/CMakeFiles/mgiza_lib.dir/ ForwardBackward.cpp.o /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:989:suffix or operands invalid for `movq' /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:993:suffix or operands invalid for `movq' /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:1011:suffix or operands invalid for `movq' /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:1467:suffix or operands invalid for `movq' /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:2527:suffix or operands invalid for `movq' make[2]: *** [src/CMakeFiles/mgiza_lib.dir/ForwardBackward.cpp.o] Error 1 I'm on Mac OS X 10.11.5 (El Capitan). I appreciate that OS X is untested compared to Linux, but it'd be great to get this set up, for purposes of teaching & collaboration in DH. thanks in advance, Andrew ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] mgiza install
Sending you this as a reminder for when you're ready. Tom On 7/20/2016 11:01 PM, moses-support-requ...@mit.edu wrote: Date: Wed, 20 Jul 2016 16:35:27 +0100 From: Hieu Hoang Subject: Re: [Moses-support] mgiza install To: Andrew Caines Cc: moses-support In CMakeList.txt line 39, delete -lrt This is also a problem when compiling moses. I hack it by creating an empty rt library with the code in mosesdecoder/contrib/rt and copying it into /usr/lib To be honest, there will be other problems when running moses on osx, not just compiling. Moses & most MT programs are mostly developed Linux people so many of the programs and scripts are untested on OSX. There are niggly differences between OSX and Linux such as sort, split, zcat etc. You are better off getting some experience using them on Linux and then switch to OSX once you know everything works. And I'm talking from my experience as a Mac user Hieu Hoang http://www.hoang.co.uk/hieu On 20 July 2016 at 14:44, Andrew Caines wrote: >Hello, > >I've encountered a problem installing mgiza, downloaded from GitHub. >https://github.com/moses-smt/mgiza > >'cmake .' runs fine. > >'make' exits with the following message: > [ 51%] Linking CXX executable ../bin/d4norm > ld: library not found for -lrt > clang: error: linker command failed with exit code 1 (use -v to see >invocation) > make[2]: *** [bin/d4norm] Error 1 > >I'm on Mac OS X 10.11.5 (El Capitan). Any advice much appreciated. > >Andrew > >___ >Moses-support mailing list >Moses-support@mit.edu >http://mailman.mit.edu/mailman/listinfo/moses-support > > ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] mgiza install
Thank you Hieu, I will switch to Linux when I can. For the time being with OSX I removed "-lrt" from CMakeList.txt and encountered a new error in '$ make' -- [ 10%] Building CXX object src/CMakeFiles/mgiza_lib.dir/ForwardBackward.cpp.o /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:989:suffix or operands invalid for `movq' /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:993:suffix or operands invalid for `movq' /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:1011:suffix or operands invalid for `movq' /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:1467:suffix or operands invalid for `movq' /var/folders/p8/8d4g5v_53t3glcsclzx5cc8hgn/T//cckNoVZn.s:2527:suffix or operands invalid for `movq' make[2]: *** [src/CMakeFiles/mgiza_lib.dir/ForwardBackward.cpp.o] Error 1 On 20 July 2016 at 16:35, Hieu Hoang wrote: > In CMakeList.txt line 39, delete -lrt > > This is also a problem when compiling moses. I hack it by creating an > empty rt library with the code in >mosesdecoder/contrib/rt > and copying it into /usr/lib > > To be honest, there will be other problems when running moses on osx, not > just compiling. Moses & most MT programs are mostly developed Linux people > so many of the programs and scripts are untested on OSX. There are niggly > differences between OSX and Linux such as sort, split, zcat etc. > > You are better off getting some experience using them on Linux and then > switch to OSX once you know everything works. And I'm talking from my > experience as a Mac user > > > Hieu Hoang > http://www.hoang.co.uk/hieu > > On 20 July 2016 at 14:44, Andrew Caines wrote: > >> Hello, >> >> I've encountered a problem installing mgiza, downloaded from GitHub. >> https://github.com/moses-smt/mgiza >> >> 'cmake .' runs fine. >> >> 'make' exits with the following message: >> [ 51%] Linking CXX executable ../bin/d4norm >> ld: library not found for -lrt >> clang: error: linker command failed with exit code 1 (use -v to see >> invocation) >> make[2]: *** [bin/d4norm] Error 1 >> >> I'm on Mac OS X 10.11.5 (El Capitan). Any advice much appreciated. >> >> Andrew >> >> ___ >> Moses-support mailing list >> Moses-support@mit.edu >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] mgiza install
In CMakeList.txt line 39, delete -lrt This is also a problem when compiling moses. I hack it by creating an empty rt library with the code in mosesdecoder/contrib/rt and copying it into /usr/lib To be honest, there will be other problems when running moses on osx, not just compiling. Moses & most MT programs are mostly developed Linux people so many of the programs and scripts are untested on OSX. There are niggly differences between OSX and Linux such as sort, split, zcat etc. You are better off getting some experience using them on Linux and then switch to OSX once you know everything works. And I'm talking from my experience as a Mac user Hieu Hoang http://www.hoang.co.uk/hieu On 20 July 2016 at 14:44, Andrew Caines wrote: > Hello, > > I've encountered a problem installing mgiza, downloaded from GitHub. > https://github.com/moses-smt/mgiza > > 'cmake .' runs fine. > > 'make' exits with the following message: > [ 51%] Linking CXX executable ../bin/d4norm > ld: library not found for -lrt > clang: error: linker command failed with exit code 1 (use -v to see > invocation) > make[2]: *** [bin/d4norm] Error 1 > > I'm on Mac OS X 10.11.5 (El Capitan). Any advice much appreciated. > > Andrew > > ___ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support > > ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
[Moses-support] mgiza install
Hello, I've encountered a problem installing mgiza, downloaded from GitHub. https://github.com/moses-smt/mgiza 'cmake .' runs fine. 'make' exits with the following message: [ 51%] Linking CXX executable ../bin/d4norm ld: library not found for -lrt clang: error: linker command failed with exit code 1 (use -v to see invocation) make[2]: *** [bin/d4norm] Error 1 I'm on Mac OS X 10.11.5 (El Capitan). Any advice much appreciated. Andrew ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
