Re: [Moses-support] Fwd: Moses Installation

2016-07-04 Thread Irene Nandutu
Thanks.
Am preparing the data for the translation system under tokenization it
gives this ourput and can go 24+ minus stopping yet the data is only 20kb

irene@irene-HP-650-Notebook-PC:~/mosesdecoder/scripts/tokenizer$
./tokenizer.perl -l en
~/mosesdecoder/corpus/training/news-commentary-v8.fr-en.en
~/mosesdecoder/corpus/news-commentary-v8.fr-en.tok.en
Tokenizer Version 1.1
Language: en
Number of threads: 1

Any insights please


Irene Nandutu
+256781595675
Twitter 

Google+ 

On Mon, Jul 4, 2016 at 11:40 PM, Sašo Kuntaric 
wrote:

> Hi Irene,
>
> The command you posted is for training a translation model ... the error
> states that you didn't tell Moses which corpus you wanna use for the model
> and where it is.
>
> Best regards,
>
> Sašo
>
> 2016-07-04 20:43 GMT+02:00 Irene Nandutu :
>
>> Hi all, am seeking support
>> Am installing moses and am using thes link
>> http://www.statmt.org/moses/?n=moses.baseline.
>> All the steps were fine but when i came to run the training, i wanted to
>> to tell the training script where GIZA++ was installed using the
>> -external-bin-dir argument.
>>
>> Here is the output in the commandline:
>>
>> irene@irene-HP-650-Notebook-PC:~/mosesdecoder/scripts/training$
>> ./train-model.perl -external-bin-dir $HOME/mosesdecoder/tools
>> Using SCRIPTS_ROOTDIR: /home/irene/mosesdecoder/scripts
>> Using single-thread GIZA
>> using gzip
>> ERROR: use --corpus to specify corpus at ./train-model.perl line 499.
>> irene@irene-HP-650-Notebook-PC:~/mosesdecoder/scripts/training$
>>
>> I will be grateful for any help and advice.
>> Thanks
>>
>> Irene Nandutu
>> +256781595675
>> Twitter 
>>
>> Google+ 
>>
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
>
> --
> lp,
>
> Sašo
>
>
>
> --
> lp,
>
> Sašo
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


[Moses-support] Fwd: Moses Installation

2016-07-04 Thread Sašo Kuntaric
Hi Irene,

The command you posted is for training a translation model ... the error
states that you didn't tell Moses which corpus you wanna use for the model
and where it is.

Best regards,

Sašo

2016-07-04 20:43 GMT+02:00 Irene Nandutu :

> Hi all, am seeking support
> Am installing moses and am using thes link
> http://www.statmt.org/moses/?n=moses.baseline.
> All the steps were fine but when i came to run the training, i wanted to
> to tell the training script where GIZA++ was installed using the
> -external-bin-dir argument.
>
> Here is the output in the commandline:
>
> irene@irene-HP-650-Notebook-PC:~/mosesdecoder/scripts/training$
> ./train-model.perl -external-bin-dir $HOME/mosesdecoder/tools
> Using SCRIPTS_ROOTDIR: /home/irene/mosesdecoder/scripts
> Using single-thread GIZA
> using gzip
> ERROR: use --corpus to specify corpus at ./train-model.perl line 499.
> irene@irene-HP-650-Notebook-PC:~/mosesdecoder/scripts/training$
>
> I will be grateful for any help and advice.
> Thanks
>
> Irene Nandutu
> +256781595675
> Twitter 
>
> Google+ 
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


-- 
lp,

Sašo



-- 
lp,

Sašo
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Tuning giving zero weights in Factored Based SMT

2016-07-04 Thread Sašo Kuntaric
Hi Saumitra,

Had the same issue a few days ago. What worked in my case was that I used a
tagged source side of the corpus and an untagged translated side of the
tuning corpus. The other thing I changed was the language model I used, so
you might want to experiment with those two things and see if you get a
resolution.

Best regards,

Sašo

2016-07-04 2:03 GMT+02:00 Saumitra Yadav :

> Hi,
> I'm trying Factored Based SMT (punjabi to english, with pos tag as factor
> and translation factor 0,1-0) and while tuning i get BEST at 2: 0 0 0 0 0 0
> 0 0 ==> 0 as weights. Is there a reason for this?
> Regards,
> Saumitra Yadav
> MS CSE
> IIIT-Hyderabad
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


-- 
lp,

Sašo
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


[Moses-support] Moses Installation

2016-07-04 Thread Irene Nandutu
Hi all, am seeking support
Am installing moses and am using thes link
http://www.statmt.org/moses/?n=moses.baseline.
All the steps were fine but when i came to run the training, i wanted to to
tell the training script where GIZA++ was installed using the
-external-bin-dir argument.

Here is the output in the commandline:

irene@irene-HP-650-Notebook-PC:~/mosesdecoder/scripts/training$
./train-model.perl -external-bin-dir $HOME/mosesdecoder/tools
Using SCRIPTS_ROOTDIR: /home/irene/mosesdecoder/scripts
Using single-thread GIZA
using gzip
ERROR: use --corpus to specify corpus at ./train-model.perl line 499.
irene@irene-HP-650-Notebook-PC:~/mosesdecoder/scripts/training$

I will be grateful for any help and advice.
Thanks

Irene Nandutu
+256781595675
Twitter 

Google+ 
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] error while running "./bjam"

2016-07-04 Thread Hieu Hoang

the BackwardTest unit test has problems on some operating systems.

if the executable bin/moses has been created and there are no other 
problems, it should be fine. Ignore it


On 04/07/2016 16:12, samane shahmohamadi wrote:

Hi
I got error while running "./bjam" on mosesdecoder directory
the output has been attached


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


[Moses-support] error while running "./bjam"

2016-07-04 Thread samane shahmohamadi
Hi
I got error while running "./bjam" on mosesdecoder directory
the output has been attached


build.log.gz
Description: GNU Zip compressed data
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] problem with compiling moses on ubuntu 14.04

2016-07-04 Thread Kenneth Heafield
Are you using both IRSTLM and SRILM?  I doubt it.  The error appears to
be due to IRSTLM version mismatches; simplest option is to remove
--with-irstlm.

Kenneth

On 07/04/2016 11:33 AM, samane shahmohamadi wrote:
> hi all
> I got error while running this command
> 
> ./bjam --with-srilm=/home/faraday/Desktop/NLPProject/moses/srilm-1.7.1
> --with-irstlm=/home/faraday/Desktop/NLPProject/moses/irstlm-master
> --with-giza=/home/faraday/Desktop/NLPProject/moses/tools -j2
> 
> and I attached the output file
> 
> please help
> 
> 
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
> 
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


[Moses-support] problem with compiling moses on ubuntu 14.04

2016-07-04 Thread samane shahmohamadi
hi all
I got error while running this command

./bjam --with-srilm=/home/faraday/Desktop/NLPProject/moses/srilm-1.7.1
--with-irstlm=/home/faraday/Desktop/NLPProject/moses/irstlm-master
--with-giza=/home/faraday/Desktop/NLPProject/moses/tools -j2

and I attached the output file

please help


build.log.gz
Description: GNU Zip compressed data
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


[Moses-support] Truecaser vs. Lowercase

2016-07-04 Thread Gmehlin Floran
Hi,

I see from this page (http://www.statmt.org/moses/?n=Moses.Baseline) that we 
should train a truecaser before training the translation model.

However, in the page "Preparing training data" 
(http://www.statmt.org/moses/?n=FactoredTraining.PrepareTraining), it is said 
to lowercase the data and nothing is mentioned about the truecaser.

Can you please explain me which is best to do ?
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support