Re: [Moses-support] Compilation problem

[Kenneth Heafield]

It's still linking against system-installed Boost:

/usr/lib/gcc/x86_64-linux-gnu/4.8/../../../../lib/libboost_thread.a(thread.o)

So neither of these files exists:

/home/pratikm/installs/build-boost-1.55.0/lib64/libboost_thread.a
/home/pratikm/installs/build-boost-1.55.0/lib/libboost_thread.a

Which means you haven't compiled boost statically and correctly.

https://kheafield.com/code/kenlm/dependencies/

On 03/18/2016 04:45 AM, Pratik Mehta wrote:
> Thanks for the tip! However, I've recompiled moses and boost with the
> same gcc now. Still fails:
> 
> Command: ./bjam --with-boost=/home/pratikm/installs/build-boost-1.55.0 -j8
> Message:
> ...failed updating 102 targets...
> ...skipped 25 targets...
> ...updated 794 targets...
> The build failed.  If you need support, run:
>   /usr/bin/bjam --with-boost=/home/pratikm/installs/build-boost-1.55.0
> -j8 --debug-configuration -d2 |gzip >build.log.gz
> 
> I've attached the new build.log as well. 
> 
> On Tue, Mar 15, 2016 at 3:38 PM, Kenneth Heafield  > wrote:
> 
> Smells like boost was compiled with a different version of gcc than the
> one you're using to compile Moses, which can occasionally cause
> problems.
> 
> On 03/15/2016 09:46 AM, Pratik Mehta wrote:
> > Hello,
> > I tried to compile Moses with the following command:
> > ./bjam -j4
> >
> > The process ended with the following message:
> > ...failed updating 58 targets...
> > ...skipped 69 targets...
> > ...updated 794 targets...
> > The build failed.  If you need support, run:
> >   /usr/bin/bjam -j4 --debug-configuration -d2 |gzip >build.log.gz
> >
> > I have attached the build.log.gz file here. What went wrong?
> >
> > --
> > Regards,
> > Pratik.
> >
> >
> >
> > ___
> > Moses-support mailing list
> > Moses-support@mit.edu 
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
> ___
> Moses-support mailing list
> Moses-support@mit.edu 
> http://mailman.mit.edu/mailman/listinfo/moses-support
> 
> 
> 
> 
> -- 
> Regards,
> Pratik Mehta
> 
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] problem with Language Model

[Philipp Koehn]

Hi,

the best way to use the second language model is to integrate it into the
system and tune a weight for it.

There are many ways to further improve the system. Try some of the more
advanced features such as operation sequence model or neural language model.

-phi

On Thu, Mar 17, 2016 at 10:08 AM, Alapan Kuila  wrote:

> Hi
>
> I am trying to enhance my quality of moses output using some other
> Language model.First I designed a translation system using one Language
> model. After generating output I am trying to check my translation quality
> using another language model and trying to improve the quality of the
> translation from the suggestion of second language model. Should I rely on
> this second Language model? Or which other factor should I use to improve
> quality of translation. Because only to rely on Language model (which may
> not be of same domain) often creates malfunctioning.
>
> thanks,
>
> Alapan
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Compilation problem

[Pratik Mehta]

Thanks for the tip! However, I've recompiled moses and boost with the same
gcc now. Still fails:

Command: ./bjam --with-boost=/home/pratikm/installs/build-boost-1.55.0 -j8
Message:
...failed updating 102 targets...
...skipped 25 targets...
...updated 794 targets...
The build failed.  If you need support, run:
  /usr/bin/bjam --with-boost=/home/pratikm/installs/build-boost-1.55.0 -j8
--debug-configuration -d2 |gzip >build.log.gz

I've attached the new build.log as well.

On Tue, Mar 15, 2016 at 3:38 PM, Kenneth Heafield 
wrote:

> Smells like boost was compiled with a different version of gcc than the
> one you're using to compile Moses, which can occasionally cause problems.
>
> On 03/15/2016 09:46 AM, Pratik Mehta wrote:
> > Hello,
> > I tried to compile Moses with the following command:
> > ./bjam -j4
> >
> > The process ended with the following message:
> > ...failed updating 58 targets...
> > ...skipped 69 targets...
> > ...updated 794 targets...
> > The build failed.  If you need support, run:
> >   /usr/bin/bjam -j4 --debug-configuration -d2 |gzip >build.log.gz
> >
> > I have attached the build.log.gz file here. What went wrong?
> >
> > --
> > Regards,
> > Pratik.
> >
> >
> >
> > ___
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>



-- 
Regards,
Pratik Mehta


build.log.gz
Description: GNU Zip compressed data
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] ERROR: Lexical reordering scoring failed at /home/berry/mosesdecoder/scripts/training/train-model.perl line 1922.

[BIRENDRA CHAUHAN SINGH]

on running below command for training the baseline model.I have attached
the output result file below.It shows all the error.

nohup nice ~/mosesdecoder/scripts/training/train-model.perl -root-dir train \
 -corpus ~/corpus/news-commentary-v8.fr-en.clean \
 -f fr -e en -alignment grow-diag-final-and -reordering msd-bidirectional-fe \
 -lm 0:3:$HOME/lm/news-commentary-v8.fr-en.blm.en:8  \
 -external-bin-dir ~/mosesdecoder/tools >& training.out &

Am getting erros like :

gzip: gzip: /home/berry/working/train/model/tmp.25178/extract.000.inv.gz:
No such file or directory
/home/berry/working/train/model/tmp.25178/extract.000.gz: No such
file or directory

ERROR: Scoring of phrases failed at
/home/berry/mosesdecoder/scripts/training/train-model.perl line 1784.

/home/berry/mosesdecoder/scripts/../bin/consolidate: error while
loading shared libraries: libboost_serialization.so.1.59.0: cannot
open shared object file: No such file or directory

ERROR: Lexical reordering scoring failed at
/home/berry/mosesdecoder/scripts/training/train-model.perl line 1922.


training.out
Description: Binary data
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] BilingualNPLM: A target phrase with no alignments detected!

[Nikolay Bogoychev]

Hey Jeremy,

The error you should get should be:   "A target phrase with no alignments
detected! " << targetPhrase << "Check if there is something wrong with your
phrase table."); which should also include the targetPhrase in question.
My guess is that you use PhraseDictionaryCompact as your phrase table which
in some cases is known to produce target phrases without alignments. My
first suggestion would be check your phrase table and see if that target
phrase has alignments.  If the target phrase has alignments then it is
probably lost during the the phrase table binarization. I would suggest
that you use a different phrase table or set EMS to use a single thread,
which should help avoid the problem.

Cheers,

Nick

On Wed, Mar 16, 2016 at 2:49 PM, Jeremy Gwinnup  wrote:

> Hi,
>
> I’m attempting to use a BilingualNPLM (trained per the recipe on the moses
> website) in decoding - I get ‘A target phrase with no alignments detected!’
> error. All data used in training the model were products of a training run
> in EMS. I’m using the recommended NPLM settings with the exception of
> setting the input embedding to 750.
>
> Any ideas as to if I need to train differently?
>
> Thanks!
> -Jeremy
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] help

[Lane Schwartz]

Can you show the exact command you're running? That script accepts data on
standard input, so if you're not giving anything on standard input, it
won't produce any output.

On Mon, Mar 14, 2016 at 11:40 PM, Parul gupta  wrote:

> Sir i created scripts/share/nonbreaking_prefix.hi but when i'm running
> the command ..it's showing
>
> Tokenizer Version 1.1
> Language: hi
> Number of threads: 1
>
> and no file has been created of hindi tokenized file.
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


-- 
When a place gets crowded enough to require ID's, social collapse is not
far away.  It is time to go elsewhere.  The best thing about space travel
is that it made it possible to go elsewhere.
-- R.A. Heinlein, "Time Enough For Love"
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Missing /usr/lib64/lib64/libboost_thread-mt.so.5 for multithreaded GIZA

[Barry Haddow]

Hi Sergey

Just the executable, which will be either mgiza or mgizapp

cheers - Barry

On 19/03/16 15:07, Sergey A. wrote:

Hi Barry,

Thank you for the swift response. I do need *mgiza*, this is why this 
thread was created. I compiled it, but apparently didn't copy the 
needed files to the Moses directory. Which files are missing from the 
*/tools/* directory?


Thanks.

Sergey

2016-03-19 17:01 GMT+02:00 Barry Haddow >:


Hi Sergey

It's looking for mgiza, which you don't have. Either install mgiza
into your tools directory, or remove the mgiza arguments from your
train-model.perl command line.

cheers - Barry


On 19/03/16 13:56, Sergey A. wrote:

Hello Hieu Hoang.

Thank you for your suggestion, everything worked!!! Now to the
next problem, I'm trying to use it in the training of the
translation system, I've copied the bins and the script from the
mgiza compiled, but//it doesn't work (specifying the
*--external-bin-dir* didn't work as well):

*$ ~/mosesdecoder/scripts/training/train-model.perl -root-dir
train -corpus corpus/train.tags.he-en.clean -f he -e en
-alignment grow-diag-final-and -reordering msd-bidirectional-fe
-lm 0:3:/home/altshus/he-en/lm/train.blm.en:8 -external-bin-dir
~/mosesdecoder/tools -cores 12 -mgiza-cpus 12 -mgiza 2>&1 *
Use of implicit split to @_ is deprecated at 
/home/altshus/mosesdecoder/scripts/training/train-model.perl line 2103.
Using SCRIPTS_ROOTDIR: /home/altshus/mosesdecoder/scripts
Using multi-thread GIZA
using gzip
Use of uninitialized value $GIZA in -x at 
/home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.
ERROR:Cannot find mkcls, GIZA++/mgiza, & snt2cooc.out/snt2cooc 
in/home/altshus/mosesdecoder/tools.
You MUST specify the parameter -external-bin-dir at 
/home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.

*$ ll /home/altshus/mosesdecoder/tools *
total 1996
-rwxr-xr-x. 1 altshus altshus 1103791 Mar  5 19:14 GIZA++
-rwxr-xr-x. 1 altshus altshus3291 Mar 19 15:41 merge_alignment.py
-rwxr-xr-x. 1 altshus altshus  277836 Mar 19 15:42*mkcls*
-rwxr-xr-x. 1 altshus altshus   43595 Mar 19 15:42 plain2snt
-rwxr-xr-x. 1 altshus altshus   42358 Mar 19 15:42 snt2cooc
-rwxr-xr-x. 1 altshus altshus  439934 Mar  5 19:14 snt2cooc.out
-rwxr-xr-x. 1 altshus altshus   30883 Mar 19 15:42 snt2coocrmp
-rwxr-xr-x. 1 altshus altshus   35005 Mar 19 15:42 snt2plain
-rwxr-xr-x. 1 altshus altshus   50385 Mar 19 15:42 symal

Should I open a separate topic for it, or is it okay to ask in
this thread?

Thanks.

Sergey Altshuller

2016-03-10 17:19 GMT+02:00 Hieu Hoang >:

not sure, to be honest.

If you tire of fighting cmake/make problems, you can try
   ./manual-compile/compile.sh
It has it's own problems, but it's problems that you can see
and fix yourself

Hieu Hoang
http://www.hoang.co.uk/hieu

On 9 March 2016 at 18:20, Sergey A. > wrote:

Hi and thank you for your time. I also just cloned it
from the path you've provided, and ran these commands,
from the mgizapp directory inside the repo. I'm getting this:

[ 94%] Building CXX object
src/CMakeFiles/mgiza_lib.dir/vocab.cpp.o
Linking CXX static library ../lib/libmgiza.a
[ 94%] Built target mgiza_lib
Scanning dependencies of target d4norm
Scanning dependencies of target hmmnorm
Scanning dependencies of target mgiza
make[2]: *** No rule to make target
`/usr/lib64/lib64/libboost_thread-mt.so.5', needed by
`bin/d4norm'. Stop.
make[2]: *** Waiting for unfinished jobs
make[2]: *** No rule to make target
`/usr/lib64/lib64/libboost_thread-mt.so.5', needed by
`bin/hmmnorm'. Stop.
make[2]: *** Waiting for unfinished jobs
[ 96%] make[2]: *** No rule to make target
`/usr/lib64/lib64/libboost_thread-mt.so.5', needed by
`bin/mgiza'.  Stop.
make[2]: *** Waiting for unfinished jobs
[ 98%] [100%] Building CXX object
src/CMakeFiles/d4norm.dir/d4norm.cxx.o
Building CXX object src/CMakeFiles/hmmnorm.dir/hmmnorm.cxx.o
Building CXX object src/CMakeFiles/mgiza.dir/main.cpp.o
make[1]: *** [src/CMakeFiles/hmmnorm.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs
make[1]: *** [src/CMakeFiles/d4norm.dir/all] Error 2
make[1]: *** [src/CMakeFiles/mgiza.dir/all] Error 2
make: *** [all] Error 2


2016-03-07 11:33 GMT+02:00 Hieu Hoang
 

Re: [Moses-support] Missing /usr/lib64/lib64/libboost_thread-mt.so.5 for multithreaded GIZA

[Sergey A.]

Hi Barry,

Thank you for the swift response. I do need *mgiza*, this is why this
thread was created. I compiled it, but apparently didn't copy the needed
files to the Moses directory. Which files are missing from the */tools/*
directory?

Thanks.

Sergey

2016-03-19 17:01 GMT+02:00 Barry Haddow :

> Hi Sergey
>
> It's looking for mgiza, which you don't have. Either install mgiza into
> your tools directory, or remove the mgiza arguments from your
> train-model.perl command line.
>
> cheers - Barry
>
>
> On 19/03/16 13:56, Sergey A. wrote:
>
> Hello Hieu Hoang.
>
> Thank you for your suggestion, everything worked!!! Now to the next
> problem, I'm trying to use it in the training of the translation system,
> I've copied the bins and the script from the mgiza compiled, but it
> doesn't work (specifying the *--external-bin-dir* didn't work as well):
>
> * $ ~/mosesdecoder/scripts/training/train-model.perl -root-dir train -corpus 
> corpus/train.tags.he-en.clean -f he -e en -alignment grow-diag-final-and 
> -reordering msd-bidirectional-fe -lm 
> 0:3:/home/altshus/he-en/lm/train.blm.en:8 -external-bin-dir 
> ~/mosesdecoder/tools -cores 12 -mgiza-cpus 12 -mgiza 2>&1 *
> Use of implicit split to @_ is deprecated at 
> /home/altshus/mosesdecoder/scripts/training/train-model.perl line 2103.
> Using SCRIPTS_ROOTDIR: /home/altshus/mosesdecoder/scripts
> Using multi-thread GIZA
> using gzip
> Use of uninitialized value $GIZA in -x at 
> /home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.
> ERROR: Cannot find mkcls, GIZA++/mgiza, & snt2cooc.out/snt2cooc in 
> /home/altshus/mosesdecoder/tools.
> You MUST specify the parameter -external-bin-dir at 
> /home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.
>
>
> * $ ll /home/altshus/mosesdecoder/tools *
> total 1996
> -rwxr-xr-x. 1 altshus altshus 1103791 Mar  5 19:14 GIZA++
> -rwxr-xr-x. 1 altshus altshus3291 Mar 19 15:41 merge_alignment.py
> -rwxr-xr-x. 1 altshus altshus  277836 Mar 19 15:42 *mkcls*
> -rwxr-xr-x. 1 altshus altshus   43595 Mar 19 15:42 plain2snt
> -rwxr-xr-x. 1 altshus altshus   42358 Mar 19 15:42 snt2cooc
> -rwxr-xr-x. 1 altshus altshus  439934 Mar  5 19:14 snt2cooc.out
> -rwxr-xr-x. 1 altshus altshus   30883 Mar 19 15:42 snt2coocrmp
> -rwxr-xr-x. 1 altshus altshus   35005 Mar 19 15:42 snt2plain
> -rwxr-xr-x. 1 altshus altshus   50385 Mar 19 15:42 symal
>
>
> Should I open a separate topic for it, or is it okay to ask in this thread?
>
> Thanks.
>
> Sergey Altshuller
>
> 2016-03-10 17:19 GMT+02:00 Hieu Hoang < 
> hieuho...@gmail.com>:
>
>> not sure, to be honest.
>>
>> If you tire of fighting cmake/make problems, you can try
>>./manual-compile/compile.sh
>> It has it's own problems, but it's problems that you can see and fix
>> yourself
>>
>> Hieu Hoang
>> http://www.hoang.co.uk/hieu
>>
>> On 9 March 2016 at 18:20, Sergey A. < 
>> www.se...@gmail.com> wrote:
>>
>>> Hi and thank you for your time. I also just cloned it from the path
>>> you've provided, and ran these commands, from the mgizapp directory inside
>>> the repo. I'm getting this:
>>>
>>> [ 94%] Building CXX object src/CMakeFiles/mgiza_lib.dir/vocab.cpp.o
>>> Linking CXX static library ../lib/libmgiza.a
>>> [ 94%] Built target mgiza_lib
>>> Scanning dependencies of target d4norm
>>> Scanning dependencies of target hmmnorm
>>> Scanning dependencies of target mgiza
>>> make[2]: *** No rule to make target
>>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/d4norm'.  Stop.
>>> make[2]: *** Waiting for unfinished jobs
>>> make[2]: *** No rule to make target
>>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/hmmnorm'.  Stop.
>>> make[2]: *** Waiting for unfinished jobs
>>> [ 96%] make[2]: *** No rule to make target
>>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/mgiza'.  Stop.
>>> make[2]: *** Waiting for unfinished jobs
>>> [ 98%] [100%] Building CXX object src/CMakeFiles/d4norm.dir/d4norm.cxx.o
>>> Building CXX object src/CMakeFiles/hmmnorm.dir/hmmnorm.cxx.o
>>> Building CXX object src/CMakeFiles/mgiza.dir/main.cpp.o
>>> make[1]: *** [src/CMakeFiles/hmmnorm.dir/all] Error 2
>>> make[1]: *** Waiting for unfinished jobs
>>> make[1]: *** [src/CMakeFiles/d4norm.dir/all] Error 2
>>> make[1]: *** [src/CMakeFiles/mgiza.dir/all] Error 2
>>> make: *** [all] Error 2
>>>
>>>
>>> 2016-03-07 11:33 GMT+02:00 Hieu Hoang < 
>>> hieuho...@gmail.com>:
>>>
 where did you get the code for mgiza from and what was the exact
 commands you used to compile?

 I just tested mgiza compilation with the code from

 https://github.com/moses-smt/mgiza
 using the commands
cmake .
cmake .
make -j4
 It seems to compile ok


 On 06/03/2016 20:02, Sergey A. wrote:

 Hello.

 I'm trying to compile 

Re: [Moses-support] Missing /usr/lib64/lib64/libboost_thread-mt.so.5 for multithreaded GIZA

[Barry Haddow]

Hi Sergey

It's looking for mgiza, which you don't have. Either install mgiza into 
your tools directory, or remove the mgiza arguments from your 
train-model.perl command line.


cheers - Barry

On 19/03/16 13:56, Sergey A. wrote:

Hello Hieu Hoang.

Thank you for your suggestion, everything worked!!! Now to the next 
problem, I'm trying to use it in the training of the translation 
system, I've copied the bins and the script from the mgiza compiled, 
but//it doesn't work (specifying the *--external-bin-dir* didn't work 
as well):


*$ ~/mosesdecoder/scripts/training/train-model.perl -root-dir train 
-corpus corpus/train.tags.he-en.clean -f he -e en -alignment 
grow-diag-final-and -reordering msd-bidirectional-fe -lm 
0:3:/home/altshus/he-en/lm/train.blm.en:8 -external-bin-dir 
~/mosesdecoder/tools -cores 12 -mgiza-cpus 12 -mgiza 2>&1 *

Use of implicit split to @_ is deprecated at 
/home/altshus/mosesdecoder/scripts/training/train-model.perl line 2103.
Using SCRIPTS_ROOTDIR: /home/altshus/mosesdecoder/scripts
Using multi-thread GIZA
using gzip
Use of uninitialized value $GIZA in -x at 
/home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.
ERROR:Cannot find mkcls, GIZA++/mgiza, & snt2cooc.out/snt2cooc 
in/home/altshus/mosesdecoder/tools.
You MUST specify the parameter -external-bin-dir at 
/home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.

*$ ll /home/altshus/mosesdecoder/tools *
total 1996
-rwxr-xr-x. 1 altshus altshus 1103791 Mar  5 19:14 GIZA++
-rwxr-xr-x. 1 altshus altshus3291 Mar 19 15:41 merge_alignment.py
-rwxr-xr-x. 1 altshus altshus  277836 Mar 19 15:42*mkcls*
-rwxr-xr-x. 1 altshus altshus   43595 Mar 19 15:42 plain2snt
-rwxr-xr-x. 1 altshus altshus   42358 Mar 19 15:42 snt2cooc
-rwxr-xr-x. 1 altshus altshus  439934 Mar  5 19:14 snt2cooc.out
-rwxr-xr-x. 1 altshus altshus   30883 Mar 19 15:42 snt2coocrmp
-rwxr-xr-x. 1 altshus altshus   35005 Mar 19 15:42 snt2plain
-rwxr-xr-x. 1 altshus altshus   50385 Mar 19 15:42 symal

Should I open a separate topic for it, or is it okay to ask in this 
thread?


Thanks.

Sergey Altshuller

2016-03-10 17:19 GMT+02:00 Hieu Hoang >:


not sure, to be honest.

If you tire of fighting cmake/make problems, you can try
   ./manual-compile/compile.sh
It has it's own problems, but it's problems that you can see and
fix yourself

Hieu Hoang
http://www.hoang.co.uk/hieu

On 9 March 2016 at 18:20, Sergey A. > wrote:

Hi and thank you for your time. I also just cloned it from the
path you've provided, and ran these commands, from the mgizapp
directory inside the repo. I'm getting this:

[ 94%] Building CXX object
src/CMakeFiles/mgiza_lib.dir/vocab.cpp.o
Linking CXX static library ../lib/libmgiza.a
[ 94%] Built target mgiza_lib
Scanning dependencies of target d4norm
Scanning dependencies of target hmmnorm
Scanning dependencies of target mgiza
make[2]: *** No rule to make target
`/usr/lib64/lib64/libboost_thread-mt.so.5', needed by
`bin/d4norm'.  Stop.
make[2]: *** Waiting for unfinished jobs
make[2]: *** No rule to make target
`/usr/lib64/lib64/libboost_thread-mt.so.5', needed by
`bin/hmmnorm'.  Stop.
make[2]: *** Waiting for unfinished jobs
[ 96%] make[2]: *** No rule to make target
`/usr/lib64/lib64/libboost_thread-mt.so.5', needed by
`bin/mgiza'.  Stop.
make[2]: *** Waiting for unfinished jobs
[ 98%] [100%] Building CXX object
src/CMakeFiles/d4norm.dir/d4norm.cxx.o
Building CXX object src/CMakeFiles/hmmnorm.dir/hmmnorm.cxx.o
Building CXX object src/CMakeFiles/mgiza.dir/main.cpp.o
make[1]: *** [src/CMakeFiles/hmmnorm.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs
make[1]: *** [src/CMakeFiles/d4norm.dir/all] Error 2
make[1]: *** [src/CMakeFiles/mgiza.dir/all] Error 2
make: *** [all] Error 2


2016-03-07 11:33 GMT+02:00 Hieu Hoang >:

where did you get the code for mgiza from and what was the
exact commands you used to compile?

I just tested mgiza compilation with the code from
https://github.com/moses-smt/mgiza
using the commands
   cmake .
   cmake .
   make -j4
It seems to compile ok


On 06/03/2016 20:02, Sergey A. wrote:

Hello.

I'm trying to compile mgiza
,
but getting the below error. What am I doing wrong? Note
that I don't have root access on the machine, so if
libraries needed I'd like to know how to download 

Re: [Moses-support] Missing /usr/lib64/lib64/libboost_thread-mt.so.5 for multithreaded GIZA

[Sergey A.]

Hello Hieu Hoang.

Thank you for your suggestion, everything worked!!! Now to the next
problem, I'm trying to use it in the training of the translation system,
I've copied the bins and the script from the mgiza compiled, but it doesn't
work (specifying the *--external-bin-dir* didn't work as well):

* $ ~/mosesdecoder/scripts/training/train-model.perl -root-dir train
-corpus corpus/train.tags.he-en.clean -f he -e en -alignment
grow-diag-final-and -reordering msd-bidirectional-fe -lm
0:3:/home/altshus/he-en/lm/train.blm.en:8 -external-bin-dir
~/mosesdecoder/tools -cores 12 -mgiza-cpus 12 -mgiza 2>&1 *
Use of implicit split to @_ is deprecated at
/home/altshus/mosesdecoder/scripts/training/train-model.perl line
2103.
Using SCRIPTS_ROOTDIR: /home/altshus/mosesdecoder/scripts
Using multi-thread GIZA
using gzip
Use of uninitialized value $GIZA in -x at
/home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.
ERROR: Cannot find mkcls, GIZA++/mgiza, & snt2cooc.out/snt2cooc in
/home/altshus/mosesdecoder/tools.
You MUST specify the parameter -external-bin-dir at
/home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.


* $ ll /home/altshus/mosesdecoder/tools *
total 1996
-rwxr-xr-x. 1 altshus altshus 1103791 Mar  5 19:14 GIZA++
-rwxr-xr-x. 1 altshus altshus3291 Mar 19 15:41 merge_alignment.py
-rwxr-xr-x. 1 altshus altshus  277836 Mar 19 15:42 *mkcls*
-rwxr-xr-x. 1 altshus altshus   43595 Mar 19 15:42 plain2snt
-rwxr-xr-x. 1 altshus altshus   42358 Mar 19 15:42 snt2cooc
-rwxr-xr-x. 1 altshus altshus  439934 Mar  5 19:14 snt2cooc.out
-rwxr-xr-x. 1 altshus altshus   30883 Mar 19 15:42 snt2coocrmp
-rwxr-xr-x. 1 altshus altshus   35005 Mar 19 15:42 snt2plain
-rwxr-xr-x. 1 altshus altshus   50385 Mar 19 15:42 symal


Should I open a separate topic for it, or is it okay to ask in this thread?

Thanks.

Sergey Altshuller

2016-03-10 17:19 GMT+02:00 Hieu Hoang :

> not sure, to be honest.
>
> If you tire of fighting cmake/make problems, you can try
>./manual-compile/compile.sh
> It has it's own problems, but it's problems that you can see and fix
> yourself
>
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
> On 9 March 2016 at 18:20, Sergey A.  wrote:
>
>> Hi and thank you for your time. I also just cloned it from the path
>> you've provided, and ran these commands, from the mgizapp directory inside
>> the repo. I'm getting this:
>>
>> [ 94%] Building CXX object src/CMakeFiles/mgiza_lib.dir/vocab.cpp.o
>> Linking CXX static library ../lib/libmgiza.a
>> [ 94%] Built target mgiza_lib
>> Scanning dependencies of target d4norm
>> Scanning dependencies of target hmmnorm
>> Scanning dependencies of target mgiza
>> make[2]: *** No rule to make target
>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/d4norm'.  Stop.
>> make[2]: *** Waiting for unfinished jobs
>> make[2]: *** No rule to make target
>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/hmmnorm'.  Stop.
>> make[2]: *** Waiting for unfinished jobs
>> [ 96%] make[2]: *** No rule to make target
>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/mgiza'.  Stop.
>> make[2]: *** Waiting for unfinished jobs
>> [ 98%] [100%] Building CXX object src/CMakeFiles/d4norm.dir/d4norm.cxx.o
>> Building CXX object src/CMakeFiles/hmmnorm.dir/hmmnorm.cxx.o
>> Building CXX object src/CMakeFiles/mgiza.dir/main.cpp.o
>> make[1]: *** [src/CMakeFiles/hmmnorm.dir/all] Error 2
>> make[1]: *** Waiting for unfinished jobs
>> make[1]: *** [src/CMakeFiles/d4norm.dir/all] Error 2
>> make[1]: *** [src/CMakeFiles/mgiza.dir/all] Error 2
>> make: *** [all] Error 2
>>
>>
>> 2016-03-07 11:33 GMT+02:00 Hieu Hoang :
>>
>>> where did you get the code for mgiza from and what was the exact
>>> commands you used to compile?
>>>
>>> I just tested mgiza compilation with the code from
>>>https://github.com/moses-smt/mgiza
>>> using the commands
>>>cmake .
>>>cmake .
>>>make -j4
>>> It seems to compile ok
>>>
>>>
>>> On 06/03/2016 20:02, Sergey A. wrote:
>>>
>>> Hello.
>>>
>>> I'm trying to compile mgiza
>>> , but getting
>>> the below error. What am I doing wrong? Note that I don't have root access
>>> on the machine, so if libraries needed I'd like to know how to download and
>>> use them without installing on the server. BTW, I couldn't find anything in
>>> the archives
>>> .
>>>
>>> make[2]: *** No rule to make target 
>>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/hmmnorm'.  Stop.
>>> make[2]: *** Waiting for unfinished jobs
>>> make[2]: *** No rule to make target 
>>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/d4norm'.  Stop.
>>> make[2]: *** Waiting for unfinished jobs
>>> make[2]: *** No rule to make target 
>>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/mgiza'.  Stop.

[Moses-support] Two errors when running Moses

[Ebraheem Sulaiman]

*Dear best support team, ever :) ..*

*I managed to do everything by the book - almost :)  - but when I try to
run Moses I get this error in the middle of loading text phrase table: "
Killed ".*

*I ignored this and binarised the model. When I run Moses I get this error
" Loading table into memory...Exception: vector::_M_range_check: __n (which
is 1) >= this->size() (which is 1)"*

*I've attached everything: Full errors, list of files with sizes and *.ini
files ..*

*Thanks for the help in advance..*

*Ibrahim*


ERROR1
Description: Binary data


ERROR2
Description: Binary data


moses.ini(binarise)
Description: Binary data


moses.ini
Description: Binary data


Commands
Description: Binary data
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] help

[Parul gupta]

Sir i created scripts/share/nonbreaking_prefix.hi but when i'm running the
command ..it's showing

Tokenizer Version 1.1
Language: hi
Number of threads: 1

and no file has been created of hindi tokenized file.
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] problem while testing moses

[Hieu Hoang]

   --with-cmph=/home/hieu/workspace/cmph-2.0
not
   --with-cmph=~/home/hieu/workspace/cmph-2.0

On 16/03/2016 20:39, sofiane bouzaher wrote:

Hi, sorry
here is the command we use to compile moses
./bjam --with-boost=/home/hieu/workspace/boost_1_57_0 
--with-cmph=~/home/hieu/workspace/cmph-2.0 -j8


2016-03-11 3:02 GMT+01:00 Hieu Hoang >:


What was the exact command you used to compile moses? ie. ./bjam 

It doesn't look like the cmph library was linked to moses so the
compact phrase-table wasn't compiled.


On 10/03/2016 21:33, sofiane bouzaher wrote:

Hi,we are trying use the moses toolkit for a Rapid
Construction of Supervised Word Sense Disambiguation System
for Lesser-resourced Languages (arabic) we use the virtual
machine (ubuntu 14.04 32-bit.ova 30-Jan-2015 16:41 7.2G), we
we have compiled moses withs cmph2.0 and boost_ 1_57_0  as
recommanded alla steps passed succufully, but when we try to
run Moses with compact phrase table using
"/home/hieu/workspace/github/mosesdecoder/bin/moses -f
/home/hieu/working/binarised-model/moses.ini" we get this error

hieu@hieu-VirtualBox:~$
/home/hieu/workspace/github/mosesdecoder/bin/moses -f
/home/hieu/working/binarised-model/moses.ini
Defined parameters (per moses.ini or switch):
config: /home/hieu/working/binarised-model/moses.ini
distortion-limit: 6
feature: UnknownWordPenalty WordPenalty PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4
path=/home/hieu/working/binarised-model/phrase-table.minphr
input-factor=0 output-factor=0 LexicalReordering
name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0
output-factor=0
path=/home/hieu/working/binarised-model/reordering-table.minlexr
Distortion KENLM lazyken=0 name=LM0 factor=0
path=/home/hieu/lm/news-commentary-v8.fr-en.blm.en order=3
input-factors: 0
mapping: 0 T 0
weight: UnknownWordPenalty0= 1 WordPenalty0= -1
PhrasePenalty0= 0.2 TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3 Distortion0= 0.3
LM0= 0.5
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryCompact name=TranslationModel0
num-features=4
path=/home/hieu/working/binarised-model/phrase-table.minphr
input-factor=0 output-factor=0
Exception: moses/FF/Factory.cpp:321 in void
Moses::FeatureRegistry::Construct(const string&, const
string&) threw UnknownFeatureException because `i ==
registry_.end()'.
Feature name PhraseDictionaryCompact is not registered.


we need help please ,
 and also an idea for the possibility to use of arabic language ?

the moses.ini file :
#
### MOSES CONFIG FILE ###
#

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0

[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4
path=/home/hieu/working/binarised-model/phrase-table.minphr
input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0
output-factor=0
path=/home/hieu/working/binarised-model/reordering-table.minlexr
Distortion
KENLM lazyken=0 name=LM0 factor=0
path=/home/hieu/lm/news-commentary-v8.fr-en.blm.en order=3

# dense weights for feature functions
[weight]
UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3
LM0= 0.5





___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] BilingualNPLM: A target phrase with no alignments detected!

[Jeremy Gwinnup]

Nick,

That was the issue - I was using a ProbingPT. I switched back to 
PhraseDictionaryMemory and it’s now running fine.

Thanks!

> On Mar 16, 2016, at 12:21 PM, Nikolay Bogoychev  wrote:
> 
> Hey Jeremy,
> 
> The error you should get should be:   "A target phrase with no alignments 
> detected! " << targetPhrase << "Check if there is something wrong with your 
> phrase table.");
> which should also include the targetPhrase in question.  My guess is that you 
> use PhraseDictionaryCompact as your phrase table which in some cases is known 
> to produce target phrases without alignments. My first suggestion would be 
> check your phrase table and see if that target phrase has alignments.  If the 
> target phrase has alignments then it is probably lost during the the phrase 
> table binarization. I would suggest that you use a different phrase table or 
> set EMS to use a single thread, which should help avoid the problem.
> 
> Cheers,
> 
> Nick
> 
> On Wed, Mar 16, 2016 at 2:49 PM, Jeremy Gwinnup  > wrote:
> Hi,
> 
> I’m attempting to use a BilingualNPLM (trained per the recipe on the moses 
> website) in decoding - I get ‘A target phrase with no alignments detected!’ 
> error. All data used in training the model were products of a training run in 
> EMS. I’m using the recommended NPLM settings with the exception of setting 
> the input embedding to 750.
> 
> Any ideas as to if I need to train differently?
> 
> Thanks!
> -Jeremy
> ___
> Moses-support mailing list
> Moses-support@mit.edu 
> http://mailman.mit.edu/mailman/listinfo/moses-support 
> 
> 

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support