Re: [Moses-support] Missing /usr/lib64/lib64/libboost_thread-mt.so.5 for multithreaded GIZA

[Sergey A.]

Hi Barry,

Thank you for the swift response. I do need *mgiza*, this is why this
thread was created. I compiled it, but apparently didn't copy the needed
files to the Moses directory. Which files are missing from the */tools/*
directory?

Thanks.

Sergey

2016-03-19 17:01 GMT+02:00 Barry Haddow :

> Hi Sergey
>
> It's looking for mgiza, which you don't have. Either install mgiza into
> your tools directory, or remove the mgiza arguments from your
> train-model.perl command line.
>
> cheers - Barry
>
>
> On 19/03/16 13:56, Sergey A. wrote:
>
> Hello Hieu Hoang.
>
> Thank you for your suggestion, everything worked!!! Now to the next
> problem, I'm trying to use it in the training of the translation system,
> I've copied the bins and the script from the mgiza compiled, but it
> doesn't work (specifying the *--external-bin-dir* didn't work as well):
>
> * $ ~/mosesdecoder/scripts/training/train-model.perl -root-dir train -corpus 
> corpus/train.tags.he-en.clean -f he -e en -alignment grow-diag-final-and 
> -reordering msd-bidirectional-fe -lm 
> 0:3:/home/altshus/he-en/lm/train.blm.en:8 -external-bin-dir 
> ~/mosesdecoder/tools -cores 12 -mgiza-cpus 12 -mgiza 2>&1 *
> Use of implicit split to @_ is deprecated at 
> /home/altshus/mosesdecoder/scripts/training/train-model.perl line 2103.
> Using SCRIPTS_ROOTDIR: /home/altshus/mosesdecoder/scripts
> Using multi-thread GIZA
> using gzip
> Use of uninitialized value $GIZA in -x at 
> /home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.
> ERROR: Cannot find mkcls, GIZA++/mgiza, & snt2cooc.out/snt2cooc in 
> /home/altshus/mosesdecoder/tools.
> You MUST specify the parameter -external-bin-dir at 
> /home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.
>
>
> * $ ll /home/altshus/mosesdecoder/tools *
> total 1996
> -rwxr-xr-x. 1 altshus altshus 1103791 Mar  5 19:14 GIZA++
> -rwxr-xr-x. 1 altshus altshus3291 Mar 19 15:41 merge_alignment.py
> -rwxr-xr-x. 1 altshus altshus  277836 Mar 19 15:42 *mkcls*
> -rwxr-xr-x. 1 altshus altshus   43595 Mar 19 15:42 plain2snt
> -rwxr-xr-x. 1 altshus altshus   42358 Mar 19 15:42 snt2cooc
> -rwxr-xr-x. 1 altshus altshus  439934 Mar  5 19:14 snt2cooc.out
> -rwxr-xr-x. 1 altshus altshus   30883 Mar 19 15:42 snt2coocrmp
> -rwxr-xr-x. 1 altshus altshus   35005 Mar 19 15:42 snt2plain
> -rwxr-xr-x. 1 altshus altshus   50385 Mar 19 15:42 symal
>
>
> Should I open a separate topic for it, or is it okay to ask in this thread?
>
> Thanks.
>
> Sergey Altshuller
>
> 2016-03-10 17:19 GMT+02:00 Hieu Hoang < 
> hieuho...@gmail.com>:
>
>> not sure, to be honest.
>>
>> If you tire of fighting cmake/make problems, you can try
>>./manual-compile/compile.sh
>> It has it's own problems, but it's problems that you can see and fix
>> yourself
>>
>> Hieu Hoang
>> <http://www.hoang.co.uk/hieu>http://www.hoang.co.uk/hieu
>>
>> On 9 March 2016 at 18:20, Sergey A. < 
>> www.se...@gmail.com> wrote:
>>
>>> Hi and thank you for your time. I also just cloned it from the path
>>> you've provided, and ran these commands, from the mgizapp directory inside
>>> the repo. I'm getting this:
>>>
>>> [ 94%] Building CXX object src/CMakeFiles/mgiza_lib.dir/vocab.cpp.o
>>> Linking CXX static library ../lib/libmgiza.a
>>> [ 94%] Built target mgiza_lib
>>> Scanning dependencies of target d4norm
>>> Scanning dependencies of target hmmnorm
>>> Scanning dependencies of target mgiza
>>> make[2]: *** No rule to make target
>>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/d4norm'.  Stop.
>>> make[2]: *** Waiting for unfinished jobs
>>> make[2]: *** No rule to make target
>>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/hmmnorm'.  Stop.
>>> make[2]: *** Waiting for unfinished jobs
>>> [ 96%] make[2]: *** No rule to make target
>>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/mgiza'.  Stop.
>>> make[2]: *** Waiting for unfinished jobs
>>> [ 98%] [100%] Building CXX object src/CMakeFiles/d4norm.dir/d4norm.cxx.o
>>> Building CXX object src/CMakeFiles/hmmnorm.dir/hmmnorm.cxx.o
>>> Building CXX object src/CMakeFiles/mgiza.dir/main.cpp.o
>>> make[1]: *** [src/CMakeFiles/hmmnorm.dir/all] Error 2
>>> make[1]: *** Waiting for unfinished jobs
>>> make[1]: *** [src/CMakeFiles/d4norm.dir/all] Error 2
>>> make[1]: *** [src/CMakeFiles/mgiza.dir/all] Error 2
>>> make: *** [all] Error 2
>>>
>&g

Re: [Moses-support] Missing /usr/lib64/lib64/libboost_thread-mt.so.5 for multithreaded GIZA

[Sergey A.]

Hello Hieu Hoang.

Thank you for your suggestion, everything worked!!! Now to the next
problem, I'm trying to use it in the training of the translation system,
I've copied the bins and the script from the mgiza compiled, but it doesn't
work (specifying the *--external-bin-dir* didn't work as well):

* $ ~/mosesdecoder/scripts/training/train-model.perl -root-dir train
-corpus corpus/train.tags.he-en.clean -f he -e en -alignment
grow-diag-final-and -reordering msd-bidirectional-fe -lm
0:3:/home/altshus/he-en/lm/train.blm.en:8 -external-bin-dir
~/mosesdecoder/tools -cores 12 -mgiza-cpus 12 -mgiza 2>&1 *
Use of implicit split to @_ is deprecated at
/home/altshus/mosesdecoder/scripts/training/train-model.perl line
2103.
Using SCRIPTS_ROOTDIR: /home/altshus/mosesdecoder/scripts
Using multi-thread GIZA
using gzip
Use of uninitialized value $GIZA in -x at
/home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.
ERROR: Cannot find mkcls, GIZA++/mgiza, & snt2cooc.out/snt2cooc in
/home/altshus/mosesdecoder/tools.
You MUST specify the parameter -external-bin-dir at
/home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.


* $ ll /home/altshus/mosesdecoder/tools *
total 1996
-rwxr-xr-x. 1 altshus altshus 1103791 Mar  5 19:14 GIZA++
-rwxr-xr-x. 1 altshus altshus3291 Mar 19 15:41 merge_alignment.py
-rwxr-xr-x. 1 altshus altshus  277836 Mar 19 15:42 *mkcls*
-rwxr-xr-x. 1 altshus altshus   43595 Mar 19 15:42 plain2snt
-rwxr-xr-x. 1 altshus altshus   42358 Mar 19 15:42 snt2cooc
-rwxr-xr-x. 1 altshus altshus  439934 Mar  5 19:14 snt2cooc.out
-rwxr-xr-x. 1 altshus altshus   30883 Mar 19 15:42 snt2coocrmp
-rwxr-xr-x. 1 altshus altshus   35005 Mar 19 15:42 snt2plain
-rwxr-xr-x. 1 altshus altshus   50385 Mar 19 15:42 symal


Should I open a separate topic for it, or is it okay to ask in this thread?

Thanks.

Sergey Altshuller

2016-03-10 17:19 GMT+02:00 Hieu Hoang :

> not sure, to be honest.
>
> If you tire of fighting cmake/make problems, you can try
>./manual-compile/compile.sh
> It has it's own problems, but it's problems that you can see and fix
> yourself
>
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
> On 9 March 2016 at 18:20, Sergey A.  wrote:
>
>> Hi and thank you for your time. I also just cloned it from the path
>> you've provided, and ran these commands, from the mgizapp directory inside
>> the repo. I'm getting this:
>>
>> [ 94%] Building CXX object src/CMakeFiles/mgiza_lib.dir/vocab.cpp.o
>> Linking CXX static library ../lib/libmgiza.a
>> [ 94%] Built target mgiza_lib
>> Scanning dependencies of target d4norm
>> Scanning dependencies of target hmmnorm
>> Scanning dependencies of target mgiza
>> make[2]: *** No rule to make target
>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/d4norm'.  Stop.
>> make[2]: *** Waiting for unfinished jobs
>> make[2]: *** No rule to make target
>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/hmmnorm'.  Stop.
>> make[2]: *** Waiting for unfinished jobs
>> [ 96%] make[2]: *** No rule to make target
>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/mgiza'.  Stop.
>> make[2]: *** Waiting for unfinished jobs
>> [ 98%] [100%] Building CXX object src/CMakeFiles/d4norm.dir/d4norm.cxx.o
>> Building CXX object src/CMakeFiles/hmmnorm.dir/hmmnorm.cxx.o
>> Building CXX object src/CMakeFiles/mgiza.dir/main.cpp.o
>> make[1]: *** [src/CMakeFiles/hmmnorm.dir/all] Error 2
>> make[1]: *** Waiting for unfinished jobs
>> make[1]: *** [src/CMakeFiles/d4norm.dir/all] Error 2
>> make[1]: *** [src/CMakeFiles/mgiza.dir/all] Error 2
>> make: *** [all] Error 2
>>
>>
>> 2016-03-07 11:33 GMT+02:00 Hieu Hoang :
>>
>>> where did you get the code for mgiza from and what was the exact
>>> commands you used to compile?
>>>
>>> I just tested mgiza compilation with the code from
>>>https://github.com/moses-smt/mgiza
>>> using the commands
>>>cmake .
>>>cmake .
>>>make -j4
>>> It seems to compile ok
>>>
>>>
>>> On 06/03/2016 20:02, Sergey A. wrote:
>>>
>>> Hello.
>>>
>>> I'm trying to compile mgiza
>>> <http://www.statmt.org/moses/?n=Moses.ExternalTools#ntoc3>, but getting
>>> the below error. What am I doing wrong? Note that I don't have root access
>>> on the machine, so if libraries needed I'd like to know how to download and
>>> use them without installing on the server. BTW, I couldn't find anything in
>>> the archives
>>> <http://www.google.com/coop/cse?cx=0062554493931500

[Moses-support] Missing /usr/lib64/lib64/libboost_thread-mt.so.5 for multithreaded GIZA

[Sergey A.]

Hello.

I'm trying to compile mgiza
, but getting the
below error. What am I doing wrong? Note that I don't have root access on
the machine, so if libraries needed I'd like to know how to download and
use them without installing on the server. BTW, I couldn't find anything in
the archives
.

make[2]: *** No rule to make target
`/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/hmmnorm'.
Stop.
make[2]: *** Waiting for unfinished jobs
make[2]: *** No rule to make target
`/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/d4norm'.
Stop.
make[2]: *** Waiting for unfinished jobs
make[2]: *** No rule to make target
`/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/mgiza'.
Stop.
make[2]: *** Waiting for unfinished jobs
[ 96%] [ 98%] [100%] Building CXX object
src/CMakeFiles/hmmnorm.dir/hmmnorm.cxx.o
Building CXX object src/CMakeFiles/d4norm.dir/d4norm.cxx.o
Building CXX object src/CMakeFiles/mgiza.dir/main.cpp.o
make[1]: *** [src/CMakeFiles/hmmnorm.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs
make[1]: *** [src/CMakeFiles/d4norm.dir/all] Error 2
make[1]: *** [src/CMakeFiles/mgiza.dir/all] Error 2make: *** [all] Error 2


Thanks in advance, I'll really appreciate any help here.

Sergey
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support