Re: [Moses-support] (no subject)

[tsegay kiros]

On Thu, May 31, 2018 at 11:01 AM, tsegay kiros  wrote:

>
>
> On Mon, May 28, 2018 at 12:32 PM, tsegay kiros  wrote:
>
>> tse...@gmail.com
>>
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>


build.log.gz
Description: application/gzip
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[tsegay kiros]

On Mon, May 28, 2018 at 12:32 PM, tsegay kiros  wrote:

> tse...@gmail.com
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


build.log.gz
Description: application/gzip
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[G/her G/libanos]

hello there
how is every thing going on I hope it would be nice

I an focused which alignment of IBM is used in the Moses since I want to
write my documentation

On Tue, May 2, 2017 at 10:58 AM, G/her G/libanos  wrote:

> hello there
>
>
>
> I am doing well and your contribution is high
>
>
>
> my adviser asks me to align the training system using phrase rather than
> word based using Giza++
>
>
>
> what package can I use to do phrase based alignment
>
>
>
> thanks...
>
> On Thu, Apr 13, 2017 at 1:37 AM, G/her G/libanos 
> wrote:
>
>> hello there 
>>
>> how is every thing
>>
>>
>>
>> I want to uses the m4loc to split the corpus into train, testing and
>> tuning randomly
>>
>> but I didn't get how to apply it.
>>
>>
>>
>> the idea get from this paper
>>
>> Phoneme-based English-Amharic Statistical Machine Translation
>>
>>
>> thanks..
>>
>>
>>
>> On Mon, Mar 27, 2017 at 3:42 AM, G/her G/libanos 
>> wrote:
>>
>>> hello there...
>>>
>>> I want to ask you some thing
>>>
>>> 1. in language modeling for the monolingual data using IRSLM what value
>>> n of the N-gram is more value?
>>>
>>> 2. in the training of the parallel corpus how I can isolate the testing
>>> and tuning data randomly from the total corpus, since choosing myself is
>>> not recommended?
>>>
>>>
>>> thanks
>>>
>>>
>>> G/her from bahirdar university
>>>
>>> On Sat, Mar 11, 2017 at 1:06 AM, G/her G/libanos 
>>> wrote:
>>>
 hello there I would like thanks your contribution in my work...
 now I have one problem to create web-based translation system
 when I check using the Netcat by following the manual in the
 https://github.com/moses-smt/mosesdecoder/tree/master/contri
 b/iSenWeb/Introduction
 it display these result and the web site doesn't work

 thanks...

 On Sat, Feb 25, 2017 at 1:09 PM, Mathias Müller  wrote:

> Hi,
>
> Did you perhaps forget the leading "/" in the file path to an existing
> installation of XML-RPC?
>
> Regards
> Mathias
>
>
>
> On Sat, Feb 25, 2017 at 10:46 AM, G/her G/libanos 
> wrote:
>
>> hello there I am doing on the Moses server but on installing the
>> xmlrpc create an error
>> what I can do
>>
>> thanks for every thing you doing all
>>
>> On Wed, Feb 8, 2017 at 3:07 AM, Marwa Refaie 
>> wrote:
>>
>>> For web server dig little on those links I think could help
>>>
>>> http://www.statmt.org/moses/?n=Moses.WebTranslation
>>>
>>> https://github.com/moses-smt/mosesdecoder/tree/master/contri
>>> b/iSenWeb/Introduction
>>>
>>> *Marwa N Refaie*
>>> On 7 Feb 2017, at 21:05, G/her G/libanos 
>>> wrote:

 the Moses decoder works for our system on Ubuntu using terminal
 but we want to make user interactive whether in the form of web
 page or application based
 could you help me any information to done that
 10qu...

 On Mon, Dec 12, 2016 at 8:43 AM, G/her G/libanos <
 geriz...@gmail.com> wrote:

> we create the translation model and we need to uses the window
> application using
> http://www.statmt.org/moses/?n=Moses.Packages
> but when we import our model into the mainWindow application it
> create an error
> what we can do.
> since it works for EN into  Fr
> 10qu for ...
>
> On Mon, Dec 12, 2016 at 7:17 PM, G/her G/libanos <
> geriz...@gmail.com> wrote:
>
>> hello there...
>> First of all I would like to thanks for your response for the
>> previous comments on the question I rise
>>
>> next my system trained by 1000 parallel sentence and I try to
>> calculate the Bleu score of the translation system using the vedio 
>> on TAUS
>> and I got this one
>>
>> On Fri, Dec 9, 2016 at 5:17 PM, G/her G/libanos <
>> geriz...@gmail.com> wrote:
>>
>>>
>>> hello there
>>> 1. we done our work using baseline and the system work for the
>>> train data
>>> but we need to localized the source code in the tokinization to
>>> leave abrivated word ወ/ሮ as in english Adm. as 
>>> Notbreaking_prefix.en that
>>> is use the dot(.)
>>>
>>> 2. where we to change the code in c++ or in the perl part of the
>>> codes
>>>
>>>
>>>
>>> 3. we need to uses the translation system in window, since the
>>> end users are not expert in ubuntu and we see the how to change the 
>>> window
>>>  see the Moses GUI and which part of the our file will be load to 
>>> the model
>>> only or all the 

Re: [Moses-support] (no subject)

[G/her G/libanos]

hello there



I am doing well and your contribution is high



my adviser asks me to align the training system using phrase rather than
word based using Giza++



what package can I use to do phrase based alignment



thanks...

On Thu, Apr 13, 2017 at 1:37 AM, G/her G/libanos  wrote:

> hello there 
>
> how is every thing
>
>
>
> I want to uses the m4loc to split the corpus into train, testing and
> tuning randomly
>
> but I didn't get how to apply it.
>
>
>
> the idea get from this paper
>
> Phoneme-based English-Amharic Statistical Machine Translation
>
>
> thanks..
>
>
>
> On Mon, Mar 27, 2017 at 3:42 AM, G/her G/libanos 
> wrote:
>
>> hello there...
>>
>> I want to ask you some thing
>>
>> 1. in language modeling for the monolingual data using IRSLM what value n
>> of the N-gram is more value?
>>
>> 2. in the training of the parallel corpus how I can isolate the testing
>> and tuning data randomly from the total corpus, since choosing myself is
>> not recommended?
>>
>>
>> thanks
>>
>>
>> G/her from bahirdar university
>>
>> On Sat, Mar 11, 2017 at 1:06 AM, G/her G/libanos 
>> wrote:
>>
>>> hello there I would like thanks your contribution in my work...
>>> now I have one problem to create web-based translation system
>>> when I check using the Netcat by following the manual in the
>>> https://github.com/moses-smt/mosesdecoder/tree/master/contri
>>> b/iSenWeb/Introduction
>>> it display these result and the web site doesn't work
>>>
>>> thanks...
>>>
>>> On Sat, Feb 25, 2017 at 1:09 PM, Mathias Müller 
>>> wrote:
>>>
 Hi,

 Did you perhaps forget the leading "/" in the file path to an existing
 installation of XML-RPC?

 Regards
 Mathias



 On Sat, Feb 25, 2017 at 10:46 AM, G/her G/libanos 
 wrote:

> hello there I am doing on the Moses server but on installing the
> xmlrpc create an error
> what I can do
>
> thanks for every thing you doing all
>
> On Wed, Feb 8, 2017 at 3:07 AM, Marwa Refaie 
> wrote:
>
>> For web server dig little on those links I think could help
>>
>> http://www.statmt.org/moses/?n=Moses.WebTranslation
>>
>> https://github.com/moses-smt/mosesdecoder/tree/master/contri
>> b/iSenWeb/Introduction
>>
>> *Marwa N Refaie*
>> On 7 Feb 2017, at 21:05, G/her G/libanos  wrote:
>>>
>>> the Moses decoder works for our system on Ubuntu using terminal
>>> but we want to make user interactive whether in the form of web page
>>> or application based
>>> could you help me any information to done that
>>> 10qu...
>>>
>>> On Mon, Dec 12, 2016 at 8:43 AM, G/her G/libanos >> > wrote:
>>>
 we create the translation model and we need to uses the window
 application using
 http://www.statmt.org/moses/?n=Moses.Packages
 but when we import our model into the mainWindow application it
 create an error
 what we can do.
 since it works for EN into  Fr
 10qu for ...

 On Mon, Dec 12, 2016 at 7:17 PM, G/her G/libanos <
 geriz...@gmail.com> wrote:

> hello there...
> First of all I would like to thanks for your response for the
> previous comments on the question I rise
>
> next my system trained by 1000 parallel sentence and I try to
> calculate the Bleu score of the translation system using the vedio on 
> TAUS
> and I got this one
>
> On Fri, Dec 9, 2016 at 5:17 PM, G/her G/libanos <
> geriz...@gmail.com> wrote:
>
>>
>> hello there
>> 1. we done our work using baseline and the system work for the
>> train data
>> but we need to localized the source code in the tokinization to
>> leave abrivated word ወ/ሮ as in english Adm. as Notbreaking_prefix.en 
>> that
>> is use the dot(.)
>>
>> 2. where we to change the code in c++ or in the perl part of the
>> codes
>>
>>
>>
>> 3. we need to uses the translation system in window, since the
>> end users are not expert in ubuntu and we see the how to change the 
>> window
>>  see the Moses GUI and which part of the our file will be load to 
>> the model
>> only or all the train including the train data and can we modify the 
>> GUI of
>> the Moses.
>>
>>
>>
>> 10qs for every thing
>>
>
>
>
> --
>
> ...education is door of one's life...
>



 --

 ...education is door of one's life...

>>>
>>>

Re: [Moses-support] (no subject)

[G/her G/libanos]

hello there 

how is every thing



I want to uses the m4loc to split the corpus into train, testing and tuning
randomly

but I didn't get how to apply it.



the idea get from this paper

Phoneme-based English-Amharic Statistical Machine Translation


thanks..



On Mon, Mar 27, 2017 at 3:42 AM, G/her G/libanos  wrote:

> hello there...
>
> I want to ask you some thing
>
> 1. in language modeling for the monolingual data using IRSLM what value n
> of the N-gram is more value?
>
> 2. in the training of the parallel corpus how I can isolate the testing
> and tuning data randomly from the total corpus, since choosing myself is
> not recommended?
>
>
> thanks
>
>
> G/her from bahirdar university
>
> On Sat, Mar 11, 2017 at 1:06 AM, G/her G/libanos 
> wrote:
>
>> hello there I would like thanks your contribution in my work...
>> now I have one problem to create web-based translation system
>> when I check using the Netcat by following the manual in the
>> https://github.com/moses-smt/mosesdecoder/tree/master/contri
>> b/iSenWeb/Introduction
>> it display these result and the web site doesn't work
>>
>> thanks...
>>
>> On Sat, Feb 25, 2017 at 1:09 PM, Mathias Müller 
>> wrote:
>>
>>> Hi,
>>>
>>> Did you perhaps forget the leading "/" in the file path to an existing
>>> installation of XML-RPC?
>>>
>>> Regards
>>> Mathias
>>>
>>>
>>>
>>> On Sat, Feb 25, 2017 at 10:46 AM, G/her G/libanos 
>>> wrote:
>>>
 hello there I am doing on the Moses server but on installing the xmlrpc
 create an error
 what I can do

 thanks for every thing you doing all

 On Wed, Feb 8, 2017 at 3:07 AM, Marwa Refaie 
 wrote:

> For web server dig little on those links I think could help
>
> http://www.statmt.org/moses/?n=Moses.WebTranslation
>
> https://github.com/moses-smt/mosesdecoder/tree/master/contri
> b/iSenWeb/Introduction
>
> *Marwa N Refaie*
> On 7 Feb 2017, at 21:05, G/her G/libanos  wrote:
>>
>> the Moses decoder works for our system on Ubuntu using terminal
>> but we want to make user interactive whether in the form of web page
>> or application based
>> could you help me any information to done that
>> 10qu...
>>
>> On Mon, Dec 12, 2016 at 8:43 AM, G/her G/libanos 
>> wrote:
>>
>>> we create the translation model and we need to uses the window
>>> application using
>>> http://www.statmt.org/moses/?n=Moses.Packages
>>> but when we import our model into the mainWindow application it
>>> create an error
>>> what we can do.
>>> since it works for EN into  Fr
>>> 10qu for ...
>>>
>>> On Mon, Dec 12, 2016 at 7:17 PM, G/her G/libanos >> > wrote:
>>>
 hello there...
 First of all I would like to thanks for your response for the
 previous comments on the question I rise

 next my system trained by 1000 parallel sentence and I try to
 calculate the Bleu score of the translation system using the vedio on 
 TAUS
 and I got this one

 On Fri, Dec 9, 2016 at 5:17 PM, G/her G/libanos  wrote:

>
> hello there
> 1. we done our work using baseline and the system work for the
> train data
> but we need to localized the source code in the tokinization to
> leave abrivated word ወ/ሮ as in english Adm. as Notbreaking_prefix.en 
> that
> is use the dot(.)
>
> 2. where we to change the code in c++ or in the perl part of the
> codes
>
>
>
> 3. we need to uses the translation system in window, since the end
> users are not expert in ubuntu and we see the how to change the 
> window  see
> the Moses GUI and which part of the our file will be load to the 
> model only
> or all the train including the train data and can we modify the GUI 
> of the
> Moses.
>
>
>
> 10qs for every thing
>



 --

 ...education is door of one's life...

>>>
>>>
>>>
>>> --
>>>
>>> ...education is door of one's life...
>>>
>>
>>
>>


 --

 ...education is door of one's life...

 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support


>>>
>>
>>
>> --
>>
>> ...education is door of one's life...
>>
>
>
>
> --
>
> ...education is door of one's life...
>



-- 

...education is door of one's life...

Re: [Moses-support] (no subject)

[G/her G/libanos]

hello there...

I want to ask you some thing

1. in language modeling for the monolingual data using IRSLM what value n
of the N-gram is more value?

2. in the training of the parallel corpus how I can isolate the testing and
tuning data randomly from the total corpus, since choosing myself is not
recommended?


thanks


G/her from bahirdar university

On Sat, Mar 11, 2017 at 1:06 AM, G/her G/libanos  wrote:

> hello there I would like thanks your contribution in my work...
> now I have one problem to create web-based translation system
> when I check using the Netcat by following the manual in the
> https://github.com/moses-smt/mosesdecoder/tree/master/contri
> b/iSenWeb/Introduction
> it display these result and the web site doesn't work
>
> thanks...
>
> On Sat, Feb 25, 2017 at 1:09 PM, Mathias Müller 
> wrote:
>
>> Hi,
>>
>> Did you perhaps forget the leading "/" in the file path to an existing
>> installation of XML-RPC?
>>
>> Regards
>> Mathias
>>
>>
>>
>> On Sat, Feb 25, 2017 at 10:46 AM, G/her G/libanos 
>> wrote:
>>
>>> hello there I am doing on the Moses server but on installing the xmlrpc
>>> create an error
>>> what I can do
>>>
>>> thanks for every thing you doing all
>>>
>>> On Wed, Feb 8, 2017 at 3:07 AM, Marwa Refaie 
>>> wrote:
>>>
 For web server dig little on those links I think could help

 http://www.statmt.org/moses/?n=Moses.WebTranslation

 https://github.com/moses-smt/mosesdecoder/tree/master/contri
 b/iSenWeb/Introduction

 *Marwa N Refaie*
 On 7 Feb 2017, at 21:05, G/her G/libanos  wrote:
>
> the Moses decoder works for our system on Ubuntu using terminal
> but we want to make user interactive whether in the form of web page
> or application based
> could you help me any information to done that
> 10qu...
>
> On Mon, Dec 12, 2016 at 8:43 AM, G/her G/libanos 
> wrote:
>
>> we create the translation model and we need to uses the window
>> application using
>> http://www.statmt.org/moses/?n=Moses.Packages
>> but when we import our model into the mainWindow application it
>> create an error
>> what we can do.
>> since it works for EN into  Fr
>> 10qu for ...
>>
>> On Mon, Dec 12, 2016 at 7:17 PM, G/her G/libanos 
>> wrote:
>>
>>> hello there...
>>> First of all I would like to thanks for your response for the
>>> previous comments on the question I rise
>>>
>>> next my system trained by 1000 parallel sentence and I try to
>>> calculate the Bleu score of the translation system using the vedio on 
>>> TAUS
>>> and I got this one
>>>
>>> On Fri, Dec 9, 2016 at 5:17 PM, G/her G/libanos 
>>> wrote:
>>>

 hello there
 1. we done our work using baseline and the system work for the
 train data
 but we need to localized the source code in the tokinization to
 leave abrivated word ወ/ሮ as in english Adm. as Notbreaking_prefix.en 
 that
 is use the dot(.)

 2. where we to change the code in c++ or in the perl part of the
 codes



 3. we need to uses the translation system in window, since the end
 users are not expert in ubuntu and we see the how to change the window 
  see
 the Moses GUI and which part of the our file will be load to the model 
 only
 or all the train including the train data and can we modify the GUI of 
 the
 Moses.



 10qs for every thing

>>>
>>>
>>>
>>> --
>>>
>>> ...education is door of one's life...
>>>
>>
>>
>>
>> --
>>
>> ...education is door of one's life...
>>
>
>
>
>>>
>>>
>>> --
>>>
>>> ...education is door of one's life...
>>>
>>> ___
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>
>
>
> --
>
> ...education is door of one's life...
>



-- 

...education is door of one's life...
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[G/her G/libanos]

hello there I would like thanks your contribution in my work...
now I have one problem to create web-based translation system
when I check using the Netcat by following the manual in the
https://github.com/moses-smt/mosesdecoder/tree/master/
contrib/iSenWeb/Introduction
it display these result and the web site doesn't work

thanks...

On Sat, Feb 25, 2017 at 1:09 PM, Mathias Müller 
wrote:

> Hi,
>
> Did you perhaps forget the leading "/" in the file path to an existing
> installation of XML-RPC?
>
> Regards
> Mathias
>
>
>
> On Sat, Feb 25, 2017 at 10:46 AM, G/her G/libanos 
> wrote:
>
>> hello there I am doing on the Moses server but on installing the xmlrpc
>> create an error
>> what I can do
>>
>> thanks for every thing you doing all
>>
>> On Wed, Feb 8, 2017 at 3:07 AM, Marwa Refaie 
>> wrote:
>>
>>> For web server dig little on those links I think could help
>>>
>>> http://www.statmt.org/moses/?n=Moses.WebTranslation
>>>
>>> https://github.com/moses-smt/mosesdecoder/tree/master/contri
>>> b/iSenWeb/Introduction
>>>
>>> *Marwa N Refaie*
>>> On 7 Feb 2017, at 21:05, G/her G/libanos  wrote:

 the Moses decoder works for our system on Ubuntu using terminal
 but we want to make user interactive whether in the form of web page or
 application based
 could you help me any information to done that
 10qu...

 On Mon, Dec 12, 2016 at 8:43 AM, G/her G/libanos 
 wrote:

> we create the translation model and we need to uses the window
> application using
> http://www.statmt.org/moses/?n=Moses.Packages
> but when we import our model into the mainWindow application it create
> an error
> what we can do.
> since it works for EN into  Fr
> 10qu for ...
>
> On Mon, Dec 12, 2016 at 7:17 PM, G/her G/libanos 
> wrote:
>
>> hello there...
>> First of all I would like to thanks for your response for the
>> previous comments on the question I rise
>>
>> next my system trained by 1000 parallel sentence and I try to
>> calculate the Bleu score of the translation system using the vedio on 
>> TAUS
>> and I got this one
>>
>> On Fri, Dec 9, 2016 at 5:17 PM, G/her G/libanos 
>> wrote:
>>
>>>
>>> hello there
>>> 1. we done our work using baseline and the system work for the train
>>> data
>>> but we need to localized the source code in the tokinization to
>>> leave abrivated word ወ/ሮ as in english Adm. as Notbreaking_prefix.en 
>>> that
>>> is use the dot(.)
>>>
>>> 2. where we to change the code in c++ or in the perl part of the
>>> codes
>>>
>>>
>>>
>>> 3. we need to uses the translation system in window, since the end
>>> users are not expert in ubuntu and we see the how to change the window  
>>> see
>>> the Moses GUI and which part of the our file will be load to the model 
>>> only
>>> or all the train including the train data and can we modify the GUI of 
>>> the
>>> Moses.
>>>
>>>
>>>
>>> 10qs for every thing
>>>
>>
>>
>>
>> --
>>
>> ...education is door of one's life...
>>
>
>
>
> --
>
> ...education is door of one's life...
>



>>
>>
>> --
>>
>> ...education is door of one's life...
>>
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>


-- 

...education is door of one's life...
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Mathias Müller]

Hi,

Did you perhaps forget the leading "/" in the file path to an existing
installation of XML-RPC?

Regards
Mathias



On Sat, Feb 25, 2017 at 10:46 AM, G/her G/libanos 
wrote:

> hello there I am doing on the Moses server but on installing the xmlrpc
> create an error
> what I can do
>
> thanks for every thing you doing all
>
> On Wed, Feb 8, 2017 at 3:07 AM, Marwa Refaie 
> wrote:
>
>> For web server dig little on those links I think could help
>>
>> http://www.statmt.org/moses/?n=Moses.WebTranslation
>>
>> https://github.com/moses-smt/mosesdecoder/tree/master/contri
>> b/iSenWeb/Introduction
>>
>> *Marwa N Refaie*
>> On 7 Feb 2017, at 21:05, G/her G/libanos  wrote:
>>>
>>> the Moses decoder works for our system on Ubuntu using terminal
>>> but we want to make user interactive whether in the form of web page or
>>> application based
>>> could you help me any information to done that
>>> 10qu...
>>>
>>> On Mon, Dec 12, 2016 at 8:43 AM, G/her G/libanos 
>>> wrote:
>>>
 we create the translation model and we need to uses the window
 application using
 http://www.statmt.org/moses/?n=Moses.Packages
 but when we import our model into the mainWindow application it create
 an error
 what we can do.
 since it works for EN into  Fr
 10qu for ...

 On Mon, Dec 12, 2016 at 7:17 PM, G/her G/libanos 
 wrote:

> hello there...
> First of all I would like to thanks for your response for the previous
> comments on the question I rise
>
> next my system trained by 1000 parallel sentence and I try to
> calculate the Bleu score of the translation system using the vedio on TAUS
> and I got this one
>
> On Fri, Dec 9, 2016 at 5:17 PM, G/her G/libanos 
> wrote:
>
>>
>> hello there
>> 1. we done our work using baseline and the system work for the train
>> data
>> but we need to localized the source code in the tokinization to leave
>> abrivated word ወ/ሮ as in english Adm. as Notbreaking_prefix.en that is 
>> use
>> the dot(.)
>>
>> 2. where we to change the code in c++ or in the perl part of the codes
>>
>>
>>
>> 3. we need to uses the translation system in window, since the end
>> users are not expert in ubuntu and we see the how to change the window  
>> see
>> the Moses GUI and which part of the our file will be load to the model 
>> only
>> or all the train including the train data and can we modify the GUI of 
>> the
>> Moses.
>>
>>
>>
>> 10qs for every thing
>>
>
>
>
> --
>
> ...education is door of one's life...
>



 --

 ...education is door of one's life...

>>>
>>>
>>>
>
>
> --
>
> ...education is door of one's life...
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[G/her G/libanos]

hello there I am doing on the Moses server but on installing the xmlrpc
create an error
what I can do

thanks for every thing you doing all

On Wed, Feb 8, 2017 at 3:07 AM, Marwa Refaie  wrote:

> For web server dig little on those links I think could help
>
> http://www.statmt.org/moses/?n=Moses.WebTranslation
>
> https://github.com/moses-smt/mosesdecoder/tree/master/
> contrib/iSenWeb/Introduction
>
> *Marwa N Refaie*
> On 7 Feb 2017, at 21:05, G/her G/libanos  wrote:
>>
>> the Moses decoder works for our system on Ubuntu using terminal
>> but we want to make user interactive whether in the form of web page or
>> application based
>> could you help me any information to done that
>> 10qu...
>>
>> On Mon, Dec 12, 2016 at 8:43 AM, G/her G/libanos 
>> wrote:
>>
>>> we create the translation model and we need to uses the window
>>> application using
>>> http://www.statmt.org/moses/?n=Moses.Packages
>>> but when we import our model into the mainWindow application it create
>>> an error
>>> what we can do.
>>> since it works for EN into  Fr
>>> 10qu for ...
>>>
>>> On Mon, Dec 12, 2016 at 7:17 PM, G/her G/libanos 
>>> wrote:
>>>
 hello there...
 First of all I would like to thanks for your response for the previous
 comments on the question I rise

 next my system trained by 1000 parallel sentence and I try to calculate
 the Bleu score of the translation system using the vedio on TAUS  and I got
 this one

 On Fri, Dec 9, 2016 at 5:17 PM, G/her G/libanos 
 wrote:

>
> hello there
> 1. we done our work using baseline and the system work for the train
> data
> but we need to localized the source code in the tokinization to leave
> abrivated word ወ/ሮ as in english Adm. as Notbreaking_prefix.en that is use
> the dot(.)
>
> 2. where we to change the code in c++ or in the perl part of the codes
>
>
>
> 3. we need to uses the translation system in window, since the end
> users are not expert in ubuntu and we see the how to change the window  
> see
> the Moses GUI and which part of the our file will be load to the model 
> only
> or all the train including the train data and can we modify the GUI of the
> Moses.
>
>
>
> 10qs for every thing
>



 --

 ...education is door of one's life...

>>>
>>>
>>>
>>> --
>>>
>>> ...education is door of one's life...
>>>
>>
>>
>>


-- 

...education is door of one's life...
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Marwa Refaie]

For web server dig little on those links I think could help

http://www.statmt.org/moses/?n=Moses.WebTranslation

https://github.com/moses-smt/mosesdecoder/tree/master/contrib/iSenWeb/Introduction

Marwa N Refaie
On 7 Feb 2017, at 21:05, G/her G/libanos 
> wrote:
the Moses decoder works for our system on Ubuntu using terminal
but we want to make user interactive whether in the form of web page or 
application based
could you help me any information to done that
10qu...

On Mon, Dec 12, 2016 at 8:43 AM, G/her G/libanos 
> wrote:
we create the translation model and we need to uses the window application using
http://www.statmt.org/moses/?n=Moses.Packages
but when we import our model into the mainWindow application it create an error
what we can do.
since it works for EN into  Fr
10qu for ...

On Mon, Dec 12, 2016 at 7:17 PM, G/her G/libanos 
> wrote:
hello there...
First of all I would like to thanks for your response for the previous comments 
on the question I rise

next my system trained by 1000 parallel sentence and I try to calculate the 
Bleu score of the translation system using the vedio on TAUS  and I got this one

On Fri, Dec 9, 2016 at 5:17 PM, G/her G/libanos 
> wrote:

hello there
1. we done our work using baseline and the system work for the train data
but we need to localized the source code in the tokinization to leave abrivated 
word ወ/ሮ as in english Adm. as Notbreaking_prefix.en that is use the dot(.)

2. where we to change the code in c++ or in the perl part of the codes



3. we need to uses the translation system in window, since the end users are 
not expert in ubuntu and we see the how to change the window  see the Moses GUI 
and which part of the our file will be load to the model only or all the train 
including the train data and can we modify the GUI of the Moses.



10qs for every thing



--

...education is door of one's life...



--

...education is door of one's life...


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Hieu Hoang]

You should use the moses server. More details here

   http://www.statmt.org/moses/?n=Advanced.Moses#ntoc1


On 07/02/2017 19:03, G/her G/libanos wrote:

the Moses decoder works for our system on Ubuntu using terminal
but we want to make user interactive whether in the form of web page 
or application based

could you help me any information to done that
10qu...

On Mon, Dec 12, 2016 at 8:43 AM, G/her G/libanos > wrote:


we create the translation model and we need to uses the window
application using
http://www.statmt.org/moses/?n=Moses.Packages

but when we import our model into the mainWindow application it
create an error
what we can do.
since it works for EN into  Fr
10qu for ...

On Mon, Dec 12, 2016 at 7:17 PM, G/her G/libanos
> wrote:

hello there...
First of all I would like to thanks for your response for the
previous comments on the question I rise

next my system trained by 1000 parallel sentence and I try to
calculate the Bleu score of the translation system using the
vedio on TAUS  and I got this one

On Fri, Dec 9, 2016 at 5:17 PM, G/her G/libanos
> wrote:


hello there
1. we done our work using baseline and the system work for
the train data
but we need to localized the source code in the
tokinization to leave abrivated word ወ/ሮ as in english
Adm. as Notbreaking_prefix.en that is use the dot(.)

2. where we to change the code in c++ or in the perl part
of the codes



3. we need to uses the translation system in window, since
the end users are not expert in ubuntu and we see the how
to change the window  see the Moses GUI and which part of
the our file will be load to the model only or all the
train including the train data and can we modify the GUI
of the Moses.



10qs for every thing




-- 


...education is door of one's life...




-- 


...education is door of one's life...




--

...education is door of one's life...


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


--
Hieu Hoang
http://moses-smt.org/

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[G/her G/libanos]

the Moses decoder works for our system on Ubuntu using terminal
but we want to make user interactive whether in the form of web page or
application based
could you help me any information to done that
10qu...

On Mon, Dec 12, 2016 at 8:43 AM, G/her G/libanos  wrote:

> we create the translation model and we need to uses the window application
> using
> http://www.statmt.org/moses/?n=Moses.Packages
> but when we import our model into the mainWindow application it create an
> error
> what we can do.
> since it works for EN into  Fr
> 10qu for ...
>
> On Mon, Dec 12, 2016 at 7:17 PM, G/her G/libanos 
> wrote:
>
>> hello there...
>> First of all I would like to thanks for your response for the previous
>> comments on the question I rise
>>
>> next my system trained by 1000 parallel sentence and I try to calculate
>> the Bleu score of the translation system using the vedio on TAUS  and I got
>> this one
>>
>> On Fri, Dec 9, 2016 at 5:17 PM, G/her G/libanos 
>> wrote:
>>
>>>
>>> hello there
>>> 1. we done our work using baseline and the system work for the train data
>>> but we need to localized the source code in the tokinization to leave
>>> abrivated word ወ/ሮ as in english Adm. as Notbreaking_prefix.en that is use
>>> the dot(.)
>>>
>>> 2. where we to change the code in c++ or in the perl part of the codes
>>>
>>>
>>>
>>> 3. we need to uses the translation system in window, since the end users
>>> are not expert in ubuntu and we see the how to change the window  see the
>>> Moses GUI and which part of the our file will be load to the model only or
>>> all the train including the train data and can we modify the GUI of the
>>> Moses.
>>>
>>>
>>>
>>> 10qs for every thing
>>>
>>
>>
>>
>> --
>>
>> ...education is door of one's life...
>>
>
>
>
> --
>
> ...education is door of one's life...
>



-- 

...education is door of one's life...
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Asteway]

Hi G/her,

Look for the XMLRPC plugin and add it to your installation directory. It
allows moses-server - web client integration.
I think the default moses installation already contains it. Otherwise, add
it using --with-xmlrpc extension. Don't look for a Windows application..
Windows is shit anyways.

you might need to install the xmlrpc library as well.. libxmlrpc-c3,
libxmlrpc-c3-dev


On Mon, Dec 12, 2016 at 7:43 PM, G/her G/libanos  wrote:

> we create the translation model and we need to uses the window application
> using
> http://www.statmt.org/moses/?n=Moses.Packages
> but when we import our model into the mainWindow application it create an
> error
> what we can do.
> since it works for EN into  Fr
> 10qu for ...
>
> On Mon, Dec 12, 2016 at 7:17 PM, G/her G/libanos 
> wrote:
>
>> hello there...
>> First of all I would like to thanks for your response for the previous
>> comments on the question I rise
>>
>> next my system trained by 1000 parallel sentence and I try to calculate
>> the Bleu score of the translation system using the vedio on TAUS  and I got
>> this one
>>
>> On Fri, Dec 9, 2016 at 5:17 PM, G/her G/libanos 
>> wrote:
>>
>>>
>>> hello there
>>> 1. we done our work using baseline and the system work for the train data
>>> but we need to localized the source code in the tokinization to leave
>>> abrivated word ወ/ሮ as in english Adm. as Notbreaking_prefix.en that is use
>>> the dot(.)
>>>
>>> 2. where we to change the code in c++ or in the perl part of the codes
>>>
>>>
>>>
>>> 3. we need to uses the translation system in window, since the end users
>>> are not expert in ubuntu and we see the how to change the window  see the
>>> Moses GUI and which part of the our file will be load to the model only or
>>> all the train including the train data and can we modify the GUI of the
>>> Moses.
>>>
>>>
>>>
>>> 10qs for every thing
>>>
>>
>>
>>
>> --
>>
>> ...education is door of one's life...
>>
>
>
>
> --
>
> ...education is door of one's life...
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


-- 
Asteway Negash
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[G/her G/libanos]

we create the translation model and we need to uses the window application
using
http://www.statmt.org/moses/?n=Moses.Packages
but when we import our model into the mainWindow application it create an
error
what we can do.
since it works for EN into  Fr
10qu for ...

On Mon, Dec 12, 2016 at 7:17 PM, G/her G/libanos  wrote:

> hello there...
> First of all I would like to thanks for your response for the previous
> comments on the question I rise
>
> next my system trained by 1000 parallel sentence and I try to calculate
> the Bleu score of the translation system using the vedio on TAUS  and I got
> this one
>
> On Fri, Dec 9, 2016 at 5:17 PM, G/her G/libanos 
> wrote:
>
>>
>> hello there
>> 1. we done our work using baseline and the system work for the train data
>> but we need to localized the source code in the tokinization to leave
>> abrivated word ወ/ሮ as in english Adm. as Notbreaking_prefix.en that is use
>> the dot(.)
>>
>> 2. where we to change the code in c++ or in the perl part of the codes
>>
>>
>>
>> 3. we need to uses the translation system in window, since the end users
>> are not expert in ubuntu and we see the how to change the window  see the
>> Moses GUI and which part of the our file will be load to the model only or
>> all the train including the train data and can we modify the GUI of the
>> Moses.
>>
>>
>>
>> 10qs for every thing
>>
>
>
>
> --
>
> ...education is door of one's life...
>



-- 

...education is door of one's life...
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Asteway]

Hi G/her,

It means you're not running the command in the right dir. Or the file does
not have the correct permission. Please be sure of the location of
train-model.perl and that it has the correct executable permission. I'll
give you details once I am back to my desk.

On Saturday, December 3, 2016, G/her G/libanos  wrote:

> hi...
> this is G/her
> when I try to train it creates this error for the
>
> train-model.perl -external-bin-dir $HOME/mosesdecoder/tools
>
>
>
> On Fri, Nov 25, 2016 at 4:25 PM, G/her G/libanos  > wrote:
>
>> hello there
>>
>> I am doing my research on local Ethiopian language Amharic-Tigrigna
>>
>> but when I try to tokenize the Tigrigna corpus it doesn't know the
>> language Tigrigna
>> thnaks for ur help
>>
>
>
>
> --
>
> ...education is door of one's life...
>


-- 
Sent from Nexus 7
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[G/her G/libanos]

hi...
this is G/her
when I try to train it creates this error for the

train-model.perl -external-bin-dir $HOME/mosesdecoder/tools



On Fri, Nov 25, 2016 at 4:25 PM, G/her G/libanos  wrote:

> hello there
>
> I am doing my research on local Ethiopian language Amharic-Tigrigna
>
> but when I try to tokenize the Tigrigna corpus it doesn't know the
> language Tigrigna
> thnaks for ur help
>



-- 

...education is door of one's life...
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Asteway]

Hi Gebregziabher,

You'll need to create a script of your own to "tokenize" ge'ez languages
since ge'ez punctuation are different from that of English.

for eg.
sed 's/።/ ።/g' < corpus.tg > corpus.tok.tg


On Fri, Nov 25, 2016 at 4:25 PM, G/her G/libanos  wrote:

> hello there
>
> I am doing my research on local Ethiopian language Amharic-Tigrigna
>
> but when I try to tokenize the Tigrigna corpus it doesn't know the
> language Tigrigna
> thnaks for ur help
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


-- 
Asteway Negash
IVS Technology Consulting
Manager, Lead Technical Consultant​
mobile: +251911369618

skype: asteway_neg
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Sanjanashree Palanivel]

Why do i get " Use of uninitialized value in string eq at
/home/mosesdecoder/scripts/Transliteration/clean.pl line 139, <$IN> line
1."  while training transliteration model ... what is wrong

On Fri, May 6, 2016 at 4:20 PM, Sanjanashree Palanivel <
sanjanash...@gmail.com> wrote:

> I installed mgiza, and copied those binary subfolder in  the same folder
> where i got giza++ binary files and also merge_alignment.py file. but still
> i get error, in this case I am getting an error stating
>
> Training Transliteration Module - Start
> Fri May  6 16:16:04 IST 2016
> Creating Model
> Extracting 1-1 Alignments
> Cleaning the list for Miner
> Source is Latin
> will run Transliteration module
> Three preprocessing steps to do:
>  1) Delete Symbol  2) Delete Latin from non-Latin langauge  3)
> Character Frequency based filtering
> STARTING 1 and 2 ...
> Use of uninitialized value in string eq at
> /home/sanjana/Documents/SMT/mosesdecoder/scripts/Transliteration/clean.pl
> line 139, <$IN> line 1.
> Use of uninitialized value $wrds[1] in numeric lt (<) at
> /home/sanjana/Documents/SMT/mosesdecoder/scripts/Transliteration/clean.pl
> line 143, <$IN> line 1.
> Use of uninitialized value $retur in numeric eq (==) at
> /home/sanjana/Documents/SMT/mosesdecoder/scripts/Transliteration/clean.pl
> line 61, <$IN> line 1.
> DONE 1 and 2
> STARTING 3) Preprocessing for Character filtering...
> Use of uninitialized value $keys[0] in hash element at
> /home/sanjana/Documents/SMT/mosesdecoder/scripts/Transliteration/clean.pl
> line 197.
> Use of uninitialized value $bestsrcfreq in multiplication (*) at
> /home/sanjana/Documents/SMT/mosesdecoder/scripts/Transliteration/clean.pl
> line 198.
> Use of uninitialized value $keys[0] in hash element at
> /home/sanjana/Documents/SMT/mosesdecoder/scripts/Transliteration/clean.pl
> line 227.
> Use of uninitialized value $besttrgfreq in multiplication (*) at
> /home/sanjana/Documents/SMT/mosesdecoder/scripts/Transliteration/clean.pl
> line 228.
> DONE 3
> Extracting Transliteration Pairs
> Constructing Graph
> Computing Probs : iteration 1
> Computing Probs : iteration 2
> Computing Probs : iteration 3
> Computing Probs : iteration 4
> Computing Probs : iteration 5
> Computing Probs : iteration 6
> Computing Probs : iteration 7
> Computing Probs : iteration 8
> Computing Probs : iteration 9
> Computing Probs : iteration 10
> Finished...
> Selecting Transliteration Pairs with threshold 0.5
> Name "main::hash" used only once: possible typo at
> /home/sanjana/Documents/SMT/mosesdecoder/scripts/Transliteration/
> threshold.pl line 26.
> Preparing Corpus
> Align Corpus
> Using SCRIPTS_ROOTDIR: /home/sanjana/Documents/SMT/mosesdecoder/scripts
> Using multi-thread GIZA
> using gzip
> (1) preparing corpus @ Fri May  6 16:16:05 IST 2016
> Executing: mkdir -p
> /home/sanjana/Documents/SMT/Transliteration/training/prepared
> (1.0) selecting factors @ Fri May  6 16:16:05 IST 2016
> (1.1) running mkcls  @ Fri May  6 16:16:05 IST 2016
> /home/sanjana/Documents/SMT/mosesdecoder/tools/mkcls -c50 -n2
> -p/home/sanjana/Documents/SMT/Transliteration/training/corpus.en
> -V/home/sanjana/Documents/SMT/Transliteration/training/prepared/en.vcb.classes
> opt
> Executing: /home/sanjana/Documents/SMT/mosesdecoder/tools/mkcls -c50 -n2
> -p/home/sanjana/Documents/SMT/Transliteration/training/corpus.en
> -V/home/sanjana/Documents/SMT/Transliteration/training/prepared/en.vcb.classes
> opt
> ERROR: Execution of: /home/sanjana/Documents/SMT/mosesdecoder/tools/mkcls
> -c50 -n2 -p/home/sanjana/Documents/SMT/Transliteration/training/corpus.en
> -V/home/sanjana/Documents/SMT/Transliteration/training/prepared/en.vcb.classes
> opt
>
>
> On Fri, May 6, 2016 at 4:09 PM, Nadir Durrani 
> wrote:
>
>> You need to check if you have mgiza and its required components in the
>> external bin directory. Here's the git
>>
>> https://github.com/moses-smt/mgiza
>>
>> Have you ever trained a Moses SMT system? Here are the instructions.
>>
>> http://www.statmt.org/moses/?n=Development.GetStarted
>>
>>
>>
>> On Fri, May 6, 2016 at 11:36 AM, Sanjanashree Palanivel <
>> sanjanash...@gmail.com> wrote:
>>
>>> Dear nadir,
>>>
>>>How the input should be given to train transliteration, Is
>>> just raw parallel corpus enough?
>>>
>>>When I try running this script
>>>
>>> /home/sanjana/Documents/SMT/mosesdecoder/scripts/Transliteration/
 train-transliteration-module.pl --corpus-f DATA/ICON15/H_train.en
 --corpus-e DATA/ICON15/H_train.hi --alignment
 /home/sanjana/Documents/SMT/ICON15/Health/BL/En_H/model/aligned.grow-diag-final-and
 --moses-src-dir /home/sanjana/Documents/SMT/mosesdecoder --external-bin-dir
 /home/sanjana/Documents/SMT/mosesdecoder/tools --input-extension en
 --output-extension hi --srilm-dir
 /home/sanjana/Documents/SMT/srilm-1.7.1/bin/i686-m64 --out-dir
 /home/sanjana/Documents/SMT/Transliteration

>>>
>>> But Giza is not running i guess, 

Re: [Moses-support] (no subject)

[Philipp Koehn]

Hi,

it's probably a good idea to use the full path instead of "-root-dir
train". But what is in "training.out"? That should give some clues. Are any
files created?

-phi

On Wed, Mar 9, 2016 at 11:57 PM, BIRENDRA CHAUHAN SINGH <
birendrachauh...@gmail.com> wrote:

> on running this command:
>
> mkdir ~/working
>  cd ~/working
>  nohup nice ~/mosesdecoder/scripts/training/train-model.perl -root-dir train \
>  -corpus ~/corpus/news-commentary-v8.fr-en.clean \
>  -f fr -e en -alignment grow-diag-final-and -reordering msd-bidirectional-fe \
>  -lm 0:3:$HOME/lm/news-commentary-v8.fr-en.blm.en:8  \
>  -external-bin-dir ~/mosesdecoder/tools >& training.out &
>
>
> output:
> [1] 2217
> and this output comes within a sec.It does not take hours to train.I think
> its not do training may be due to some reasons.and not directory 
> ~/working/train/model
> is formed.
> So there is no moses.ini file formed.
>
> Can any one tell me what is happenging and why?
> Thanks.
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Rico Sennrich]

Hello Sanjanasri,

Basically, you can forget all results that you obtained without tuning. 
They are not a meaningful indicator of the quality of NPLM. If you add a 
new language model, the weight of the other language models, translation 
models etc. needs to be balanced accordingly, and that is what tuning does.


If you do tuning every time you add/remove/change a model, you can 
modify your moses.ini any way you want, and you do not need to specify 
all models during training. But again, don't make conclusions without 
tuning for each modified moses.ini. I know this will slow down your 
experiments, but that's the only way to produce new knowlege.


setting num_hidden to zero is a bit of a hack, because NPLM normally has 
two hidden layers (and num_hidden gives the size of the first hidden 
layer). If we want to use NPLM in decoding, we only want one hidden 
layer for speed, hence num_hidden=0 [output_embedding_dimension is the 
size of the remaining hidden layer]. The vocabulary size thing was a 
guess. I don't know what the best vocabulary size would be for you, but 
I tend to recommend smaller vocabularies if you have less data.


best wishes,
Rico


On 05/10/15 17:14, Sanjanashree Palanivel wrote:

Dear Rico,

Thanks a lot.  I will increase the number of hidden layers, 
currently the parameter num_hidden is fixed as Zero. I did not tune 
the system just working with baseline. Will do tuning too. But, why 
smaller vocabulary size, what is the reason?. It should be my mistake, 
the testset may not be an disjoint set i guess.I will check. I got two 
more doubts. Please clarify.



 1) Can I use two or more LMs (specifically NPLMs with different 
vocabulary size)  in moses.ini file or should i use LMs that are used 
in training phase. Ex: Can I use SRILM or RANDLM directly to moses.ini 
file without specifying in training phase.


 2) I just did little tinkering in moses.ini file for English-Hindi MT 
System to understand the influence of LM. I trained the system with 
KENLM of order 3. But, in *.ini file, the replaced the lm to 5-order 
KENLM binary file. Let me name the *.ini file as dummy 5-KENLM. The 
Bleu of Score of dummy 5-KENLM (14.72) is higher than the 3-order 
KENLM (12.53) , though the Bleu score is lesser than the model 
actually trained with 5-KENLM (17.43).  I understand, what i modified 
in *.ini does not make any sense. But, I wish to know,  why score is 
higher for dummy 5-KENLM than 3-KENLM.




On Mon, Oct 5, 2015 at 7:07 PM, Rico Sennrich > wrote:


Hi Sanjanasri,

1) your corpus is very small, and you may have to use more
iterations of NPLM training and smaller vocabulary sizes. Just to
double-check, are you tuning your systems? MERT (or PRO or MIRA)
should normally ensure that adding a model doesn't make BLEU go down.

2) I'm not sure which perplexity is for which model, but lower
perplexity is better, so this makes sense.

3) a perplexity of 3 is *extremely* low. Do you have overlap
between your test set and your training set? This would be an
unrealistic test setting, and would explain why KenLM does so much
better (because backoff n-gram models are good at memorizing things).

best wishes,
Rico



On 05.10.2015 09:27, Sanjanashree Palanivel wrote:

Dear Rico,

 I tried using KENLM and NPLM for three language
pairs. And I came across series of questions . I am listing it
one by one. It would be great if you could guide me.


1) I did testing for NPLM with different vocabulary sizes and
training epochs. But, the bleu score, I gained from NPLM
integrated with KENLM is smaller than the one I trained with
KENLM. In all the three language pairs I get a standard
difference of three.

Eg: English to Hindi (KENLM-17.43, NPLM+KENLM-14.27)
  Tamil to Hindi (KENLM-16.66,NPLM+KENLM-13.53)
   Marathi to Hindi (KENLM-29.42,NPLM+KENLM-25.76)

 The sentence count is 103502. unigram count is 89919. I gave
vocabulary size as 89000,89700,89850 with validation size
200,200,100 respectively and with different learning rate and
epocs. However, I am getting Bleu score of NPLM and KENLM is lesser.


2)The Bleu score of the model having perplexity about 385 has
higher Bleu score than the one having pp around 564 .  Is this
rite model. I mean the model with lower perplexity seems to give
better Bleu score. Where am I doing worng.


3) I used query script for KENLM model. I found perplexity to
3.4xx. But, the Bleu score of KENLM alone in decoding phase gives
Blue of 16.66 for English to HIndi MT. But, when combined with
NPLM I get only 13.53.

On Sun, Sep 20, 2015 at 8:07 PM, Sanjanashree Palanivel
> wrote:

Dear Rico,

Thanks a lot for your excellent guidance.

On Sat, Sep 

Re: [Moses-support] (no subject)

[Rico Sennrich]

Hi Sanjanasri,

1) your corpus is very small, and you may have to use more iterations of 
NPLM training and smaller vocabulary sizes. Just to double-check, are 
you tuning your systems? MERT (or PRO or MIRA) should normally ensure 
that adding a model doesn't make BLEU go down.


2) I'm not sure which perplexity is for which model, but lower 
perplexity is better, so this makes sense.


3) a perplexity of 3 is *extremely* low. Do you have overlap between 
your test set and your training set? This would be an unrealistic test 
setting, and would explain why KenLM does so much better (because 
backoff n-gram models are good at memorizing things).


best wishes,
Rico


On 05.10.2015 09:27, Sanjanashree Palanivel wrote:

Dear Rico,

 I tried using KENLM and NPLM for three language 
pairs. And I came across series of questions . I am listing it one by 
one. It would be great if you could guide me.



1) I did testing for NPLM with different vocabulary sizes and training 
epochs. But, the bleu score, I gained from NPLM integrated with KENLM 
is smaller than the one I trained with KENLM. In all the three 
language pairs I get a standard difference of three.


Eg: English to Hindi (KENLM-17.43, NPLM+KENLM-14.27)
  Tamil to Hindi (KENLM-16.66,NPLM+KENLM-13.53)
   Marathi to Hindi (KENLM-29.42,NPLM+KENLM-25.76)

 The sentence count is 103502. unigram count is 89919. I gave 
vocabulary size as 89000,89700,89850 with validation size 200,200,100 
respectively and with different learning rate and epocs. However, I am 
getting Bleu score of NPLM and KENLM is lesser.



2)The Bleu score of the model having perplexity about 385 has higher 
Bleu score than the one having pp around 564 .  Is this rite model. I 
mean the model with lower perplexity seems to give better Bleu score. 
Where am I doing worng.



3) I used query script for KENLM model. I found perplexity to 3.4xx. 
But, the Bleu score of KENLM alone in decoding phase gives Blue of 
16.66 for English to HIndi MT. But, when combined with NPLM I get only 
13.53.


On Sun, Sep 20, 2015 at 8:07 PM, Sanjanashree Palanivel 
> wrote:


Dear Rico,

Thanks a lot for your excellent guidance.

On Sat, Sep 19, 2015 at 9:10 PM, Rico Sennrich
> wrote:

Hi Sanjanasri,

we have seen improvements in BLEU from having both KENLM and
NPLM in our system. Things can go wrong during training though
(e.g. a bad choice of hyperparameters (vocabulary size, number
of training epochs)). I recommend using a development set
during NPLM training, and comparing perplexity scores with
those obtained from KENLM.

maybe somebody else can help you with the phrase table
normalization. NPLM doesn't have binarization.

best wishes,
Rico


On 19/09/15 08:11, Sanjanashree Palanivel wrote:

Dear Rico,

I did necessary changes and I trained language
model succesfully. The language model of nplm gives me lesser
BLEU score when compared to KENLM. But, when I used two
models together accuracy is greater than the one I got in
NPLM alone but lesser than KENLM. I am just trying to tune it
by changing the parameters. So far the accuracy is getting
improved but not close to KENLM accuracy.  Is that worthy to
do because its taking quite a long time to train.

 I also tried to binarize the phrase table following this
http://www.statmt.org/moses/?n=Advanced.RuleTables#ntoc3, and
compilation with moses is done succesfully. But. when i run
processPhraseTableMin -threads 3 -in train/model/phrase-table.gz
-nscores 4 -out binarised-model/phrase-table
I am getting segmentation fault. I dont know what is worng. Is there 
something todo with threads
Also how to binarize nplm model

On Fri, Sep 18, 2015 at 11:27 AM, Sanjanashree Palanivel
> wrote:

Dear Rico,

 Thanks a lot. Will do the necessary changes


On Thu, Sep 17, 2015 at 1:54 PM, Rico Sennrich
> wrote:

Hi Sanjanasri,

if you first compiled moses without the option
'--with-nplm', and then add the option later, the
build system isn't smart enough to know which files
it needs to recompile. if you change one of the
compile options, use the option '-a' to force
recompilation from scratch.

best wishes,
Rico




On 16/09/15 06:30, Sanjanashree Palanivel wrote:

Dear Rico,


I did the following steps


 

Re: [Moses-support] (no subject)

[Rico Sennrich]

Hi Sanjanasri,

we have seen improvements in BLEU from having both KENLM and NPLM in our 
system. Things can go wrong during training though (e.g. a bad choice of 
hyperparameters (vocabulary size, number of training epochs)). I 
recommend using a development set during NPLM training, and comparing 
perplexity scores with those obtained from KENLM.


maybe somebody else can help you with the phrase table normalization. 
NPLM doesn't have binarization.


best wishes,
Rico

On 19/09/15 08:11, Sanjanashree Palanivel wrote:

Dear Rico,

I did necessary changes and I trained language model 
succesfully. The language model of nplm gives me lesser BLEU score 
when compared to KENLM. But, when I used two models together accuracy 
is greater than the one I got in NPLM alone but lesser than KENLM. I 
am just trying to tune it by changing the parameters. So far the 
accuracy is getting improved but not close to KENLM accuracy.  Is that 
worthy to do because its taking quite a long time to train.


 I also tried to binarize the phrase table following this 
http://www.statmt.org/moses/?n=Advanced.RuleTables#ntoc3, and 
compilation with moses is done succesfully. But. when i run

processPhraseTableMin -threads 3 -in train/model/phrase-table.gz
-nscores 4 -out binarised-model/phrase-table
I am getting segmentation fault. I dont know what is worng. Is there something 
todo with threads
Also how to binarize nplm model

On Fri, Sep 18, 2015 at 11:27 AM, Sanjanashree Palanivel 
> wrote:


Dear Rico,

 Thanks a lot. Will do the necessary changes


On Thu, Sep 17, 2015 at 1:54 PM, Rico Sennrich
> wrote:

Hi Sanjanasri,

if you first compiled moses without the option '--with-nplm',
and then add the option later, the build system isn't smart
enough to know which files it needs to recompile. if you
change one of the compile options, use the option '-a' to
force recompilation from scratch.

best wishes,
Rico




On 16/09/15 06:30, Sanjanashree Palanivel wrote:

Dear Rico,


   I did the following steps


1. Installed NPLM and trained a language model
2. I compiled it with Moses with the command ./bjam
--with-nplm=path/to/nplm

  ./bjam
--with-nplm=/home/sanjana/Documents/SMT/NPLM/nplm
Tip: install tcmalloc for faster threading.  See
BUILD-INSTRUCTIONS.txt for more information.
warning: No toolsets are configured.
warning: Configuring default toolset "gcc".
warning: If the default is wrong, your build may not work
correctly.
warning: Use the "toolset=x" option to override our
guess.
warning: For more configuration options, please consult
warning:

http://boost.org/boost-build2/doc/html/bbv2/advanced/configuration.html
NOT BUILDING MOSES SERVER!
Performing configuration checks

- Shared Boost : yes (cached)
- Static Boost : yes (cached)
...patience...
...patience...
...found 4823 targets...
SUCCESS

3. I added the the following lines to the moses.ini file 


 NeuralLM factor=0 name=LM1 order=5
path=/path/to/nplmmodel
LM1= 0.5

Then i did testing. and end up with the error


On Tue, Sep 15, 2015 at 8:43 PM, Rico Sennrich
> wrote:

Hi Sanjanasri,

this error occurs when Moses was compiled without the
option '--with-nplm'.

best wishes,
Rico



On 15.09.2015 15 :08, Sanjanashree
Palanivel wrote:

Dear Rico,

I updated moses and NPLM has been compiled
succesfully with moses. However, when I perform decoding
I am getting an error.

Defined parameters (per moses.ini or switch):
config:

/home/sanjana/Documents/SMT/ICON15/Health/BL/Ta_H/model/moses.ini

distortion-limit: 6
feature: UnknownWordPenalty WordPenalty
PhrasePenalty PhraseDictionaryMemory
name=TranslationModel0 num-features=4

path=/home/sanjana/Documents/SMT/ICON15/Health/BL/Ta_H/model/phrase-table.gz
input-factor=0 output-factor=0 Distortion KENLM
lazyken=0 name=LM0 factor=0
path=/home/sanjana/Documents/SMT/LM/Hindi/monolin80k.hi1.bin
order=3 NeuralLM factor=0 name=LM1 order=3

Re: [Moses-support] (no subject)

[Rico Sennrich]

Hi Sanjanasri,

if you first compiled moses without the option '--with-nplm', and then 
add the option later, the build system isn't smart enough to know which 
files it needs to recompile. if you change one of the compile options, 
use the option '-a' to force recompilation from scratch.


best wishes,
Rico



On 16/09/15 06:30, Sanjanashree Palanivel wrote:

Dear Rico,


   I did the following steps


1. Installed NPLM and trained a language model
2. I compiled it with Moses with the command ./bjam
--with-nplm=path/to/nplm

./bjam --with-nplm=/home/sanjana/Documents/SMT/NPLM/nplm
Tip: install tcmalloc for faster threading.  See
BUILD-INSTRUCTIONS.txt for more information.
warning: No toolsets are configured.
warning: Configuring default toolset "gcc".
warning: If the default is wrong, your build may not work correctly.
warning: Use the "toolset=x" option to override our guess.
warning: For more configuration options, please consult
warning:
http://boost.org/boost-build2/doc/html/bbv2/advanced/configuration.html
NOT BUILDING MOSES SERVER!
Performing configuration checks

- Shared Boost : yes (cached)
- Static Boost : yes (cached)
...patience...
...patience...
...found 4823 targets...
SUCCESS

3. I added the the following lines to the moses.ini file 


 NeuralLM factor=0 name=LM1 order=5 path=/path/to/nplmmodel
LM1= 0.5

Then i did testing. and end up with the error


On Tue, Sep 15, 2015 at 8:43 PM, Rico Sennrich > wrote:


Hi Sanjanasri,

this error occurs when Moses was compiled without the option
'--with-nplm'.

best wishes,
Rico



On 15.09.2015 15 :08, Sanjanashree Palanivel
wrote:

Dear Rico,

I updated moses and NPLM has been compiled
succesfully with moses. However, when I perform decoding I am
getting an error.

Defined parameters (per moses.ini or switch):
config:
/home/sanjana/Documents/SMT/ICON15/Health/BL/Ta_H/model/moses.ini

distortion-limit: 6
feature: UnknownWordPenalty WordPenalty PhrasePenalty
PhraseDictionaryMemory name=TranslationModel0 num-features=4

path=/home/sanjana/Documents/SMT/ICON15/Health/BL/Ta_H/model/phrase-table.gz
input-factor=0 output-factor=0 Distortion KENLM lazyken=0
name=LM0 factor=0
path=/home/sanjana/Documents/SMT/LM/Hindi/monolin80k.hi1.bin
order=3 NeuralLM factor=0 name=LM1 order=3
path=/home/sanjana/Documents/SMT/LM/Hindi/hin_out.txt
input-factors: 0
mapping: 0 T 0
weight: Distortion0= 0.136328 LM0= 0.135599 LM1= 0.5
WordPenalty0= -0.488892 PhrasePenalty0= 0.0826147
TranslationModel0= 0.0104273 0.0663914 0.0254094 0.0543384
UnknownWordPenalty0= 1
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryMemory name=TranslationModel0
num-features=4

path=/home/sanjana/Documents/SMT/ICON15/Health/BL/Ta_H/model/phrase-table.gz
input-factor=0 output-factor=0
FeatureFunction: TranslationModel0 start: 3 end: 6
line=Distortion
FeatureFunction: Distortion0 start: 7 end: 7
line=KENLM lazyken=0 name=LM0 factor=0
path=/home/sanjana/Documents/SMT/LM/Hindi/monolin80k.hi1.bin
order=3
FeatureFunction: LM0 start: 8 end: 8
line=NeuralLM factor=0 name=LM1 order=3
path=/home/sanjana/Documents/SMT/LM/Hindi/hin_out.txt
Exception: moses/FF/Factory.cpp:349 in void
Moses::FeatureRegistry::Construct(const string&, const
string&) threw UnknownFeatureException because `i ==
registry_.end()'.
Feature name NeuralLM is not registered.


I added following 2 lines in my moses file

 NeuralLM factor=0 name=LM1 order=5 path=/path/to/nplmmodel
LM1= 0.5



On Tue, Sep 15, 2015 at 5:06 PM, Sanjanashree Palanivel
> wrote:

Thank you for your earnest response. I will update moses and
I will try

On Tue, Sep 15, 2015 at 4:22 PM, Rico Sennrich
> wrote:

Hello Sanjanasri,

this looks like a version mismatch between Moses and
NPLM. Specifically, you're using an older Moses commit
that is only compatible with nplm 0.2 (or specifically,
Kenneth's fork at https://github.com/kpu/nplm ).

If you use the latest Moses version from
https://github.com/moses-smt/mosesdecoder 

Re: [Moses-support] (no subject)

[Rico Sennrich]

Hi Sanjanasri,

this error occurs when Moses was compiled without the option '--with-nplm'.

best wishes,
Rico


On 15.09.2015 15:08, Sanjanashree Palanivel wrote:

Dear Rico,

I updated moses and NPLM has been compiled succesfully 
with moses. However, when I perform decoding I am getting an error.


Defined parameters (per moses.ini or switch):
config:
/home/sanjana/Documents/SMT/ICON15/Health/BL/Ta_H/model/moses.ini
distortion-limit: 6
feature: UnknownWordPenalty WordPenalty PhrasePenalty
PhraseDictionaryMemory name=TranslationModel0 num-features=4
path=/home/sanjana/Documents/SMT/ICON15/Health/BL/Ta_H/model/phrase-table.gz
input-factor=0 output-factor=0 Distortion KENLM lazyken=0 name=LM0
factor=0
path=/home/sanjana/Documents/SMT/LM/Hindi/monolin80k.hi1.bin
order=3 NeuralLM factor=0 name=LM1 order=3
path=/home/sanjana/Documents/SMT/LM/Hindi/hin_out.txt
input-factors: 0
mapping: 0 T 0
weight: Distortion0= 0.136328 LM0= 0.135599 LM1= 0.5
WordPenalty0= -0.488892 PhrasePenalty0= 0.0826147
TranslationModel0= 0.0104273 0.0663914 0.0254094 0.0543384
UnknownWordPenalty0= 1
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryMemory name=TranslationModel0 num-features=4
path=/home/sanjana/Documents/SMT/ICON15/Health/BL/Ta_H/model/phrase-table.gz
input-factor=0 output-factor=0
FeatureFunction: TranslationModel0 start: 3 end: 6
line=Distortion
FeatureFunction: Distortion0 start: 7 end: 7
line=KENLM lazyken=0 name=LM0 factor=0
path=/home/sanjana/Documents/SMT/LM/Hindi/monolin80k.hi1.bin order=3
FeatureFunction: LM0 start: 8 end: 8
line=NeuralLM factor=0 name=LM1 order=3
path=/home/sanjana/Documents/SMT/LM/Hindi/hin_out.txt
Exception: moses/FF/Factory.cpp:349 in void
Moses::FeatureRegistry::Construct(const string&, const string&)
threw UnknownFeatureException because `i == registry_.end()'.
Feature name NeuralLM is not registered.


I added following 2 lines in my moses file

 NeuralLM factor=0 name=LM1 order=5 path=/path/to/nplmmodel
LM1= 0.5



On Tue, Sep 15, 2015 at 5:06 PM, Sanjanashree Palanivel 
> wrote:


Thank you for your earnest response. I will update moses and I
will try

On Tue, Sep 15, 2015 at 4:22 PM, Rico Sennrich
> wrote:

Hello Sanjanasri,

this looks like a version mismatch between Moses and NPLM.
Specifically, you're using an older Moses commit that is only
compatible with nplm 0.2 (or specifically, Kenneth's fork at
https://github.com/kpu/nplm ).

If you use the latest Moses version from
https://github.com/moses-smt/mosesdecoder , and the latest
nplm version from https://github.com/moses-smt/nplm , it
should work.

best wishes,
Rico


On 15.09.2015 08 :24, Sanjanashree
Palanivel wrote:


Dear all,

I tried building language model using NPLM.
Llanguage model was build succesfully, but, when I tried to
compile NPLM with Moses using "./bjam
--with-nplm=path/to/nplm" I am getting an error. I am using
boost 1.55. I am attaching the log file for reference.  I
dont know where I went wrong. Any help would be appreciated.


-- 
Thanks and regards,


Sanjanasri J.P


___
Moses-support mailing list
Moses-support@mit.edu 
http://mailman.mit.edu/mailman/listinfo/moses-support



___
Moses-support mailing list
Moses-support@mit.edu 
http://mailman.mit.edu/mailman/listinfo/moses-support




-- 
Thanks and regards,


Sanjanasri J.P




--
Thanks and regards,

Sanjanasri J.P


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Rico Sennrich]

Hello Sanjanasri,

this looks like a version mismatch between Moses and NPLM. Specifically, 
you're using an older Moses commit that is only compatible with nplm 0.2 
(or specifically, Kenneth's fork at https://github.com/kpu/nplm ).


If you use the latest Moses version from 
https://github.com/moses-smt/mosesdecoder , and the latest nplm version 
from https://github.com/moses-smt/nplm , it should work.


best wishes,
Rico

On 15.09.2015 08:24, Sanjanashree Palanivel wrote:


Dear all,

I tried building language model using NPLM. Llanguage 
model was build succesfully, but, when I tried to compile NPLM with 
Moses using "./bjam --with-nplm=path/to/nplm" I am getting an error. I 
am using boost 1.55. I am attaching the log file for reference.  I 
dont know where I went wrong. Any help would be appreciated.



--
Thanks and regards,

Sanjanasri J.P


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Lane Schwartz]

I think that Hieu has an Eclipse project.

On Thu, Feb 26, 2015 at 7:00 PM, Tom Hoar
tah...@precisiontranslationtools.com wrote:
 Not to my knowledge. Your contribution of one would be welcome.

 On 02/27/2015 07:27 AM, Winston Yuen wrote:

 Is there Xcode or Eclipse project for Moses? I try to find it online but
 cannot find it.


 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support



 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support




-- 
When a place gets crowded enough to require ID's, social collapse is not
far away.  It is time to go elsewhere.  The best thing about space travel
is that it made it possible to go elsewhere.
-- R.A. Heinlein, Time Enough For Love
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Hieu Hoang]

are you sure your version of IRSTLM is 5.80.06? Is there a reason you 
need to use IRSTLM, as opposed to KENLM, which is built into Moses?

On 01/01/15 14:11, Dawit Mulugeta wrote:
 : ‘irstlm’ is not a 

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Hieu Hoang]

I'm getting a different error when compiling irstlm5.80.06 with the 
latest moses from github.
   moses/LM/IRST.cpp:60:21: error: invalid use of incomplete type 
‘class lmContainer’

   if (m_lmtb) m_lmtb-reset_mmap();

Using irstlm5.80.03 works fine
   http://sourceforge.net/projects/irstlm/files/irstlm/irstlm-5.80/


On 24/11/14 12:50, Daramola Olaife wrote:

After installing irstlm, I tried linking it to moses with
./bjam --with-irstlm=/home/olaife/irstlm-5.80.06 -j8
but it was giving me error.


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Philipp Koehn]

Hi,

it is true that metrics like BLEU that only count words as correct when
they are identically
and do not give partial credit to morphological variants are more
appropriate for English
and other less inflected languages. Scores for English are typically
higher, which does
reflect to some degree that translating into a morphologically poorer
language is easier,
and partially an artifact of the metric.

There have been several attempts of equipping metrics with morphological
awareness.
See the metrics task at WMT2014 for the latest research on this:
http://www.statmt.org/wmt14/program.html

-phi


On Tue, Jun 17, 2014 at 4:09 AM, Kalyani Baruah kajubarua...@gmail.com
wrote:


 ​Hiee Good day everyone.. English words have only one connection because
 they dont have any inflection is not it, am i correct.and using BLEU and
 WER,PER gives a vast difference why is it so. ​

 Regards,



 *Kalyanee Kanchan Baruah*
 Institute of Science and Technology,
 Gauhati University,Guwahati,India
 Phone- +91-9706242124

 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Philipp Koehn]

Hi,

one recently proposed successful strategy is to first translate the
source sentences in the parallel corpus with the rule-based system (in
this case Apertium) and then build a statistical system from the
rule-based output to the correct translation in the parallel corpus.

This is referred to as statistical post-editing.

Simard, Michel and Ueffing, Nicola and Isabelle, Pierre and Kuhn,
Roland(2007): Rule-Based Translation with Statistical Phrase-Based
Post-Editing, Proceedings of the Second Workshop on Statistical
Machine Translation.
http://www.aclweb.org/anthology/W/W07/W07-2028.pdf

-phi

On Fri, Mar 14, 2014 at 2:39 AM, Kalyani Baruah kajubarua...@gmail.com wrote:

 hii, I want to make a system by joining moses and apertium tool .is it
 possible to combine them into a hybrid machine.



 Regards,



 Kalyanee Kanchan Baruah
 Institute of Science and Technology,
 Gauhati University,Guwahati,India
 Phone- +91-9706242124

 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Thomas Meyer]

Hi,

Ah, in that case it can actually cause problems: your training data should
always be formatted in the same way as your dev/test data.

2 possibilities:

- re-tokenize training data with the actual tokenizer script to have the
same mark-up (then retrain your system)
- re-tokenize your dev/test data with the same (possibly older) tokenizer
script as was used for your training data (then run tuning/decoding)

HTH,
Thomas


On 21 February 2014 14:49, cyrine.na...@univ-lorraine.fr 
cyrine.na...@gmail.com wrote:

 Thank you Thomas,

 So, i keep the text with these Special characters, it will not cause
 problems? beacuse the training corpus is without these characters but only
 the development and test corpus are like this.

 Thank you :)

 Bets


 2014-02-21 14:40 GMT+01:00 Thomas Meyer ithurts...@gmail.com:



 Hi,

 That is not a 'problem' but XML 
 entitieshttp://en.wikipedia.org/wiki/List_of_XML_and_HTML_character_entity_references
  mark-up
 for special characters. You don't have to worry about this, as the
 tokenizer script does it for all characters in a consistent way.

 Best,
 Thomas


 On 21 February 2014 14:20, cyrine.na...@univ-lorraine.fr 
 cyrine.na...@gmail.com wrote:


 Hello all,

 I have a problem with the tokenizer.pl script. i get as a result a text
 ith some special punctuation , like this for example :

 EU apos;s Luxembourg-based statistical office reported

 The input file is a .txt file

 Is there any solution for this problem

 Thank you in advance


 Bests
 --
 *Cyrine*

 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support





 --

 *Cyrine NASRIPh.D. Student in Computer Science*

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[cyrine.na...@univ-lorraine.fr]

Ok,

Thank you

Bests

Cyrine


2014-02-21 14:55 GMT+01:00 Thomas Meyer ithurts...@gmail.com:

 Hi,

 Ah, in that case it can actually cause problems: your training data should
 always be formatted in the same way as your dev/test data.

 2 possibilities:

 - re-tokenize training data with the actual tokenizer script to have the
 same mark-up (then retrain your system)
 - re-tokenize your dev/test data with the same (possibly older) tokenizer
 script as was used for your training data (then run tuning/decoding)

 HTH,
 Thomas


 On 21 February 2014 14:49, cyrine.na...@univ-lorraine.fr 
 cyrine.na...@gmail.com wrote:

 Thank you Thomas,

 So, i keep the text with these Special characters, it will not cause
 problems? beacuse the training corpus is without these characters but only
 the development and test corpus are like this.

 Thank you :)

 Bets


 2014-02-21 14:40 GMT+01:00 Thomas Meyer ithurts...@gmail.com:



 Hi,

 That is not a 'problem' but XML 
 entitieshttp://en.wikipedia.org/wiki/List_of_XML_and_HTML_character_entity_references
  mark-up
 for special characters. You don't have to worry about this, as the
 tokenizer script does it for all characters in a consistent way.

 Best,
 Thomas


 On 21 February 2014 14:20, cyrine.na...@univ-lorraine.fr 
 cyrine.na...@gmail.com wrote:


 Hello all,

 I have a problem with the tokenizer.pl script. i get as a result a
 text ith some special punctuation , like this for example :

 EU apos;s Luxembourg-based statistical office reported

 The input file is a .txt file

 Is there any solution for this problem

 Thank you in advance


 Bests
 --
 *Cyrine*

 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support





 --

 *Cyrine NASRIPh.D. Student in Computer Science*





-- 

*Cyrine NASRIPh.D. Student in Computer Science*
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Hieu Hoang]

These are some things you can try:
  1. collect more data
  2. collect more data, of the same genre as your test set
  3. use hierachical model
  4. create a better tokenizer for your language
  5. replace names, numbers and dates with placeholders.

If your data has lots of names, numbers and dates and you want to do (5),
please let me know and I can help you



On 13 February 2014 09:49, Kalyani Baruah kajubarua...@gmail.com wrote:


 hiie what are the advanced features in moses. i have tried uptil
 calclation using bleu score. Now what next. Can we make it more efficient.


 Regards,



 *Kalyanee Kanchan Baruah*
  Institute of Science and Technology,
 Gauhati University,Guwahati,India
 Phone- +91-9706242124

 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support




-- 
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Philipp Koehn]

Hi,

you can try many different model configurations, but yes, having more
training data will certainly help.

It will be helpful for you you explore a bit more how each translations
was formed and why the translation decisions were made by digging
deeper into the models and the decoding process.

-phi


On Thu, Jan 30, 2014 at 12:57 PM, Kalyani Baruah kajubarua...@gmail.comwrote:

 Hi, i want to increase my translation systems accuracy as short sentence
 are some what accurate but not long sentences. Shall i increase my corpus.
 is there any other process.

 Regards,




 *Kalyanee Kanchan Baruah*
  Institute of Science and Technology,
 Gauhati University,Guwahati,India
 Phone- +91-9706242124

 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[ULStudent:GIOVANNI.GALLO]

Hi all,

Thank you for your support.

Actually, I was following the instructions on the manual step by step, so I 
haven't installed IRSTLM yet (I was planning to do so on a later stage). Can 
that be an issue?
Thanks.


GG


Da: moses-support-boun...@mit.edu moses-support-boun...@mit.edu per conto di 
Hieu Hoang hieu.ho...@ed.ac.uk
Inviato: domenica 26 gennaio 2014 10:48
A: weihua wang
Cc: moses-support
Oggetto: Re: [Moses-support] (no subject)

Did IRSTLM compile ok? Also, the latest IRSTLM is 5.80.03, which you can 
download from here:
http://sourceforge.net/projects/irstlm/

Here's some instructions on compiling IRSTLM:
   http://www.statmt.org/moses/?n=FactoredTraining.BuildingLanguageModel#ntoc4



On 26 January 2014 07:37, weihua wang 
wangweihu...@gmail.commailto:wangweihu...@gmail.com wrote:
Hello,there are some question when I build moses.

The command used
./bjam -j2 --with-irstlm=/home/wwh-ub/wwh/irstlm-5.80.01 
--with-giza=/home/wwh-ub/wwh/giza-pp



___
Moses-support mailing list
Moses-support@mit.edumailto:Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support




--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Hieu Hoang]

IRSTLM is optional. See 'Getting Started' page for details
   http://www.statmt.org/moses/?n=Development.GetStarted


On 26 January 2014 11:46, ULStudent:GIOVANNI.GALLO 
12064...@studentmail.ul.ie wrote:

  Hi all,

  Thank you for your support.

  Actually, I was following the instructions on the manual step by step,
 so I haven't installed IRSTLM yet (I was planning to do so on a later
 stage). Can that be an issue?
 Thanks.

 GG
  --
 *Da:* moses-support-boun...@mit.edu moses-support-boun...@mit.edu per
 conto di Hieu Hoang hieu.ho...@ed.ac.uk
 *Inviato:* domenica 26 gennaio 2014 10:48
 *A:* weihua wang
 *Cc:* moses-support
 *Oggetto:* Re: [Moses-support] (no subject)

   Did IRSTLM compile ok? Also, the latest IRSTLM is 5.80.03, which you
 can download from here:
 http://sourceforge.net/projects/irstlm/

 Here's some instructions on compiling IRSTLM:

 http://www.statmt.org/moses/?n=FactoredTraining.BuildingLanguageModel#ntoc4



 On 26 January 2014 07:37, weihua wang wangweihu...@gmail.com wrote:

 Hello,there are some question when I build moses.

 The command used
 ./bjam -j2 --with-irstlm=/home/wwh-ub/wwh/irstlm-5.80.01
 --with-giza=/home/wwh-ub/wwh/giza-pp



 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support




 --
 Hieu Hoang
 Research Associate
 University of Edinburgh
 http://www.hoang.co.uk/hieu




-- 
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Philipp Koehn]

Hi,

TAUS put together a basic slide presentation:
https://www.taus.net/press-releases/free-open-source-machine-translation-tutorial-is-made-available-by-taus

-phi

On Tue, Dec 10, 2013 at 11:27 AM, Kalyani Baruah kajubarua...@gmail.com wrote:
 hii
 Can you provide me with a ppt(power point presntation ) regarding
 statistical translation using moses toolkit






 Regards,


 Kalyanee Kanchan Baruah
 Department of Information Technology,
 Institute of Science and Technology,
 Gauhati University,Guwahati,India
 Phone- +91-9706242124

 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Philipp Koehn]

Hi,

the purpose of the language model is to encourage fluent output and
the purpose of the translation model is to encourage similarity between
input and output.

-phi

On Mon, Dec 9, 2013 at 8:37 AM, Kalyani Baruah kajubarua...@gmail.com wrote:
 hii,




 What is the work of language model(IRSTLM) and translation model(GIZA++) in
 brief..




 Regards,


 Kalyanee Kanchan Baruah
 Department of Information Technology,
 Institute of Science and Technology,
 Gauhati University,Guwahati,India
 Phone- +91-9706242124

 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Kalyani Baruah]

thanks

Regards,


*Kalyanee Kanchan Baruah*
Department of Information Technology,
Institute of Science and Technology,
Gauhati University,Guwahati,India
Phone- +91-9706242124


On Mon, Dec 9, 2013 at 4:21 AM, Philipp Koehn pko...@inf.ed.ac.uk wrote:

 Hi,

 the purpose of the language model is to encourage fluent output and
 the purpose of the translation model is to encourage similarity between
 input and output.

 -phi

 On Mon, Dec 9, 2013 at 8:37 AM, Kalyani Baruah kajubarua...@gmail.com
 wrote:
  hii,
 
 
 
 
  What is the work of language model(IRSTLM) and translation model(GIZA++)
 in
  brief..
 
 
 
 
  Regards,
 
 
  Kalyanee Kanchan Baruah
  Department of Information Technology,
  Institute of Science and Technology,
  Gauhati University,Guwahati,India
  Phone- +91-9706242124
 
  ___
  Moses-support mailing list
  Moses-support@mit.edu
  http://mailman.mit.edu/mailman/listinfo/moses-support
 

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Hieu Hoang]

that's strange. I'm using ubuntu and it's working for me. You may hace to
look around on the internet for a fix.

the EMS will still run even when these errors occur, but it would be nice
to fix them and see the images


On 3 December 2013 03:44, amir haghighi amir.haghighi...@gmail.com wrote:

 hello all,

 I want to run EMS on my ubuntu system but it got the following error:

 /graph.0.png' @ error/convert.c/ConvertImageCommand/3127.
 convert: no decode delegate for this image format
 `/tmp/magick-22773fbzHNDTaMj071' @ error/constitute.c/ReadImage/552.
 convert: Postscript delegate failed `steps/0/graph.0.ps': No such file or
 directory @ error/ps.c/ReadPSImage/837.
 convert: no images defined `steps/0/graph.0.png' @
 error/convert.c/ConvertImageCommand/3127.

 I have already installed Imagemagick on mu system.



 Regards
 Amir



 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support




-- 
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Hieu Hoang]

ok, i've added it back

https://github.com/moses-smt/mosesdecoder/commit/21c51194fab91f8e79409545db98642cbac9b505
let me know if it works for you

On 12 March 2013 19:05, Greg Hanneman ghanne...@gmail.com wrote:

 Hi Hieu,

 Sorry about the delay in writing back -- I've had a busy last few days.

 Yes, I think it would be great to have the -print-alignment-info flag
 re-implemented.  We could in theory get the alignment information from a
 separate output file, but it would be much more convenient to have it as an
 extra field next to the one-best translation, as before.  Would you be able
 to let me know when the flag is re-instated so I could check out the right
 version of the code?

 Thanks a lot!
 Greg.



 On 7 March 2013 02:14, Hieu Hoang hieuho...@gmail.com wrote:

  ah, i didn't misread your email.

 i deleted both
   -use-alignment-info
   -print-alignment-info
 but -print-alignment-info wasn't redundant.

 I can reimplement
   -print-alignment-info
 if you can't get the info from using
   -alignment-output-file [file]



 On 07/03/2013 00:23, Hieu Hoang wrote:

 hi greg

 printing word alignment is still a feature. In fact it's been cleaned up,
 optimized, debugged, and now on by default. It works for both pb, and
 hiero/syntax models.

 The 2 arguments are
   -print-alignment-info-in-n-best [0 or 1]
 and
   -alignment-output-file [file]

 The arg ( -print-alignment-info) was removed it was redundant.

 If you intend to use it, double check that your phrase table contains it.

 Also, double check that your binary phrase table contains word alignment.
 In the phrase-based case, there should be files called
*.wa

 On 06/03/2013 23:55, Greg Hanneman wrote:

 Hi Hieu,

 I was wondering if I could ask a question about the flags in Moses used
 for getting word-to-word alignments out along with the translation.  With
 the pre-November versions, we were using the -use-alignment-info and
 -print-alignment-info flags to get word alignments as an extra column in
 the output, like this:

 We are selling a hard drive .
 我们 的 销售 硬盘 驱动 器 。  ||| 0-0 2-2 4-3 5-4 5-5 6-6

 These flags don't seem to exist in newer versions of Moses, and I
 couldn't find anything equivalent in the decoder's help message.  Is it the
 case now that word alignments can only be written out to a totally separate
 file (-alignment-output-file FILE) or in an n-best list format with some
 additional columns (-n-best-list - 1 -print-alignment-info-in-n-best)?
 Or is there a new cocktail of flags that I can use?  I'd like to replicate
 the same output format as before, if possible.

 Relatedly, I think the documentation on statmt.org is a little
 inconsistent or maybe only partially updated.  Cf.
 http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc3 , which
 disallows --print-alignment-info, and
 http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc9 , which
 still suggests using it.

 Thanks in advance for any help you can provide!
 Greg.






 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support




-- 
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Greg Hanneman]

Hi Hieu,

Sorry about the delay in writing back -- I've had a busy last few days.

Yes, I think it would be great to have the -print-alignment-info flag
re-implemented.  We could in theory get the alignment information from a
separate output file, but it would be much more convenient to have it as an
extra field next to the one-best translation, as before.  Would you be able
to let me know when the flag is re-instated so I could check out the right
version of the code?

Thanks a lot!
Greg.


On 7 March 2013 02:14, Hieu Hoang hieuho...@gmail.com wrote:

  ah, i didn't misread your email.

 i deleted both
   -use-alignment-info
   -print-alignment-info
 but -print-alignment-info wasn't redundant.

 I can reimplement
   -print-alignment-info
 if you can't get the info from using
   -alignment-output-file [file]



 On 07/03/2013 00:23, Hieu Hoang wrote:

 hi greg

 printing word alignment is still a feature. In fact it's been cleaned up,
 optimized, debugged, and now on by default. It works for both pb, and
 hiero/syntax models.

 The 2 arguments are
   -print-alignment-info-in-n-best [0 or 1]
 and
   -alignment-output-file [file]

 The arg ( -print-alignment-info) was removed it was redundant.

 If you intend to use it, double check that your phrase table contains it.

 Also, double check that your binary phrase table contains word alignment.
 In the phrase-based case, there should be files called
*.wa

 On 06/03/2013 23:55, Greg Hanneman wrote:

 Hi Hieu,

 I was wondering if I could ask a question about the flags in Moses used
 for getting word-to-word alignments out along with the translation.  With
 the pre-November versions, we were using the -use-alignment-info and
 -print-alignment-info flags to get word alignments as an extra column in
 the output, like this:

 We are selling a hard drive .
 我们 的 销售 硬盘 驱动 器 。  ||| 0-0 2-2 4-3 5-4 5-5 6-6

 These flags don't seem to exist in newer versions of Moses, and I couldn't
 find anything equivalent in the decoder's help message.  Is it the case now
 that word alignments can only be written out to a totally separate file
 (-alignment-output-file FILE) or in an n-best list format with some
 additional columns (-n-best-list - 1 -print-alignment-info-in-n-best)?
 Or is there a new cocktail of flags that I can use?  I'd like to replicate
 the same output format as before, if possible.

 Relatedly, I think the documentation on statmt.org is a little
 inconsistent or maybe only partially updated.  Cf.
 http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc3 , which
 disallows --print-alignment-info, and
 http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc9 , which still
 suggests using it.

 Thanks in advance for any help you can provide!
 Greg.





___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Hieu Hoang]

hi greg

printing word alignment is still a feature. In fact it's been cleaned 
up, optimized, debugged, and now on by default. It works for both pb, 
and hiero/syntax models.


The 2 arguments are
  -print-alignment-info-in-n-best [0 or 1]
and
  -alignment-output-file [file]

The arg ( -print-alignment-info) was removed it was redundant.

If you intend to use it, double check that your phrase table contains it.

Also, double check that your binary phrase table contains word 
alignment. In the phrase-based case, there should be files called

   *.wa

On 06/03/2013 23:55, Greg Hanneman wrote:

Hi Hieu,

I was wondering if I could ask a question about the flags in Moses 
used for getting word-to-word alignments out along with the 
translation.  With the pre-November versions, we were using the 
-use-alignment-info and -print-alignment-info flags to get word 
alignments as an extra column in the output, like this:


We are selling a hard drive .
我们 的 销售 硬盘 驱动 器 。  ||| 0-0 2-2 4-3 5-4 5-5 6-6

These flags don't seem to exist in newer versions of Moses, and I 
couldn't find anything equivalent in the decoder's help message. Is it 
the case now that word alignments can only be written out to a totally 
separate file (-alignment-output-file FILE) or in an n-best list 
format with some additional columns (-n-best-list - 1 
-print-alignment-info-in-n-best)?  Or is there a new cocktail of 
flags that I can use?  I'd like to replicate the same output format as 
before, if possible.


Relatedly, I think the documentation on statmt.org http://statmt.org 
is a little inconsistent or maybe only partially updated.  Cf. 
http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc3 , which 
disallows --print-alignment-info, and 
http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc9 , which 
still suggests using it.


Thanks in advance for any help you can provide!
Greg.




___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Hieu Hoang]

ah, i didn't misread your email.

i deleted both
  -use-alignment-info
  -print-alignment-info
but -print-alignment-info wasn't redundant.

I can reimplement
  -print-alignment-info
if you can't get the info from using
  -alignment-output-file [file]


On 07/03/2013 00:23, Hieu Hoang wrote:

hi greg

printing word alignment is still a feature. In fact it's been cleaned 
up, optimized, debugged, and now on by default. It works for both pb, 
and hiero/syntax models.


The 2 arguments are
  -print-alignment-info-in-n-best [0 or 1]
and
  -alignment-output-file [file]

The arg ( -print-alignment-info) was removed it was redundant.

If you intend to use it, double check that your phrase table contains it.

Also, double check that your binary phrase table contains word 
alignment. In the phrase-based case, there should be files called

   *.wa

On 06/03/2013 23:55, Greg Hanneman wrote:

Hi Hieu,

I was wondering if I could ask a question about the flags in Moses 
used for getting word-to-word alignments out along with the 
translation.  With the pre-November versions, we were using the 
-use-alignment-info and -print-alignment-info flags to get word 
alignments as an extra column in the output, like this:


We are selling a hard drive .
我们 的 销售 硬盘 驱动 器 。  ||| 0-0 2-2 4-3 5-4 5-5 6-6

These flags don't seem to exist in newer versions of Moses, and I 
couldn't find anything equivalent in the decoder's help message.  Is 
it the case now that word alignments can only be written out to a 
totally separate file (-alignment-output-file FILE) or in an n-best 
list format with some additional columns (-n-best-list - 1 
-print-alignment-info-in-n-best)?  Or is there a new cocktail of 
flags that I can use?  I'd like to replicate the same output format 
as before, if possible.


Relatedly, I think the documentation on statmt.org 
http://statmt.org is a little inconsistent or maybe only partially 
updated.  Cf. 
http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc3 , which 
disallows --print-alignment-info, and 
http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc9 , which 
still suggests using it.


Thanks in advance for any help you can provide!
Greg.






___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Eleni Teshome]

It is possible to design an interface, right? is there an application for
designing the interface to be used in ubuntu 11.04...please help...i would
appreciate any kind of response...thank you!!

On Sun, Dec 23, 2012 at 9:14 AM, Eleni Teshome tesh.el...@gmail.com wrote:

 Dear all,
 i've been using ubuntu platform..and using moses to translate from my
 native language to english and the vice versa and it seemed to work
 finenow i wanted to make an interface for the translation
 purpose...could you please guide  me through on how to do it? thanking you
 in advance

 regards,
 Eleni

 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Hieu Hoang]

if you want to create a server so that you can write client gui programs 
to connect to it, look in

   contrib/server
there is also sample java clients and a web server client in there too

On 24/12/2012 12:29, Eleni Teshome wrote:
It is possible to design an interface, right? is there an application 
for designing the interface to be used in ubuntu 11.04...please 
help...i would appreciate any kind of response...thank you!!


On Sun, Dec 23, 2012 at 9:14 AM, Eleni Teshome tesh.el...@gmail.com 
mailto:tesh.el...@gmail.com wrote:


Dear all,
i've been using ubuntu platform..and using moses to translate from
my native language to english and the vice versa and it seemed to
work finenow i wanted to make an interface for the translation
purpose...could you please guide  me through on how to do it?
thanking you in advance
regards,
Eleni

___
Moses-support mailing list
Moses-support@mit.edu mailto:Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support




___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Barry Haddow]

Hi Herry

I would strongly recommend that you use the standard boost packages from 
your distribution - I think ubuntu 12.04 is on version 1.46 of boost.


Probably boost is installed in a non-standard location, or in a 
non-standard layout. What happens if you run the following?


g++  -dM -x c++ -E /dev/null -include boost/version.hpp 2/dev/null 
|grep '#define BOOST_'


cheers - Barry

On 24/09/12 10:02, Herry Sujaini wrote:

Hi,
I'm trying to compile Moses on Ubuntu 12.04 (I'm using Boost ver 1.51.0)
I get the following error message : Failed to run bash -c g++  -dM 
-x c++ -E /dev/null -include boost/version.hpp 2/dev/null |grep 
'#define BOOST_' Boost does not seem to be installed or g++ is confused


I don't know why? any ideas?
I used to compile Moses in Ubuntu 11.10  (Boost ver 1.48.0), no 
problem as above.


Regards,

Herry S




___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Kenneth Heafield]

More to the point, what happens without the 2/dev/null ?

When installing Boost on your own, the only supported method is in 
BUILD_INSTRUCTIONS.txt .

Kenneth

On 09/24/12 10:54, Barry Haddow wrote:
 Hi Herry

 I would strongly recommend that you use the standard boost packages from
 your distribution - I think ubuntu 12.04 is on version 1.46 of boost.

 Probably boost is installed in a non-standard location, or in a
 non-standard layout. What happens if you run the following?

 g++ -dM -x c++ -E /dev/null -include boost/version.hpp 2/dev/null |grep
 '#define BOOST_'

 cheers - Barry

 On 24/09/12 10:02, Herry Sujaini wrote:
 Hi,
 I'm trying to compile Moses on Ubuntu 12.04 (I'm using Boost ver 1.51.0)
 I get the following error message : Failed to run bash -c g++ -dM -x
 c++ -E /dev/null -include boost/version.hpp 2/dev/null |grep '#define
 BOOST_' Boost does not seem to be installed or g++ is confused

 I don't know why? any ideas?
 I used to compile Moses in Ubuntu 11.10 (Boost ver 1.48.0), no problem
 as above.

 Regards,

 Herry S




 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support



 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Tom Hoar]

 

Simenesh, 

You might try DoMY CE. You'll find the link here:
http://www.statmt.org/moses/?n=Moses.Packages [1] 

On 2012-09-21 21:14,
Simenesh Tolossa wrote: 

 Dear All, 
 I have been trying to install
moses and i followed all the instructions but i cant seem to get those
files in the bin directory. is there any way you can provide me those
executable files? cant they be posted online or something? its because i
really had a hard time trying to resolve the errors. please help me in
anyway you all can!! Thank you in advance 
 
 Regards, 
 Simenesh



Links:
--
[1] http://www.statmt.org/moses/?n=Moses.Packages
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Hieu Hoang]

hi eleni

a few prblems i see:
   1. don't use relative path, eg
 ~/mosesdecoder/dist
use absolute path, eg.
 /home/eleni/mosesdecoder/dist
2. the latest code doesn't have dist directory anymore. All the 
documentation should have been updated. If you see any documentation 
that still contain 'dist', please tell me and I'll change it.

3. Copy GIZA++, mkcls, snt2cooc to a directory, eg.
 /home/eleni/workspace/bin/training-tools
   Let train-model.perl know where giza++ is with the argument 
-external-bin-dir, eg.
 .../train-model.perl -external-bin-dir 
/home/eleni/workspace/bin/training-tools


On 13/09/2012 16:54, Eleni Teshome wrote:


Dear all,
I started using the site moses baseline and
I got to training the translation system part and when i write the 
command: nohup nice ~/mosesdecoder. ... It creates a training.out file 
that displays; nohup: ignoring input Use of implicit split to @_ is 
deprecated at ~/mosesdecoder/dist/training/train-model.perl line 1761 
Using SCRIPTS_ROOTDIR: ~/mosesdecoder/dist . . . ERROR: Cannot find 
mkcls, GIZA++,  snt2cooc.out/snt2cooc in . You MUST specify the 
parameter -external-bin-dir at 
~/mosesdecoder/dist/training/train-model.perl line 306


Then i went to the training directory and typed the following command: 
train-model.perl -external-bin-dir ~/external-bin-dir And it displayed 
the following; Using SCRIPTS_ROOTDIR: ~/mosedecoder/dist Using 
single-thread GIZA ERROR: use --corpus to specify corpus at 
~/mosesdecoder/dist/training/train-model.perl line 314


Can you please tell me how to specify that giza++ and the other files?



___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support



___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Philipp Koehn]

Hi,

the comment at the beginning on the section on specifying the external
bin dir containing GIZA++, mkcls, etc., is meant to inform that
whenever you run any of the invocations of train-model.perl described
later in the instructions, you must also include this specification.

Running train-model.perl with just the external-bin specification and
nothing else will not do anything useful (the error message you get
informs you that you need to specify a parallel training corpus).

-phi

On Thu, Sep 13, 2012 at 8:54 AM, Eleni Teshome tesh.el...@gmail.com wrote:
 Dear all,
 I started using the site moses baseline and
 I got to training the translation system part and when i write the command:
 nohup nice ~/mosesdecoder. ... It creates a training.out file that displays;
 nohup: ignoring input Use of implicit split to @_ is deprecated at
 ~/mosesdecoder/dist/training/train-model.perl line 1761 Using
 SCRIPTS_ROOTDIR: ~/mosesdecoder/dist . . . ERROR: Cannot find mkcls, GIZA++,
  snt2cooc.out/snt2cooc in . You MUST specify the parameter
 -external-bin-dir at ~/mosesdecoder/dist/training/train-model.perl line 306

 Then i went to the training directory and typed the following command:
 train-model.perl -external-bin-dir ~/external-bin-dir And it displayed the
 following; Using SCRIPTS_ROOTDIR: ~/mosedecoder/dist Using single-thread
 GIZA ERROR: use --corpus to specify corpus at
 ~/mosesdecoder/dist/training/train-model.perl line 314

 Can you please tell me how to specify that giza++ and the other files?


 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Barry Haddow]

Hi Eleni

Did the tokenisation step succeed? What files did it produce?

cheers - Barry

On 31/07/12 15:51, Eleni Teshome wrote:
 Hi,
 I started usin the site http://www.statmt.org/moses/?n =moses.baseline and
 while doing the corpus preparation, in the second step i.e. The true casing
 step, whenever i try to execute the command, the following error happens:
 Could not open '~/corpus/news.commentary-v7.fr-en.tok.en' at
 ~/mosesdecoder/scripts/train-truecaser.perl line 15

 What might be the problem? What can i do to resolve it? I tried the other
 corpus too but it doesn't work. Looking forward to hear from you. Thank you
 in advance.
 On Jul 31, 2012 4:20 PM, Kenneth Heafieldmo...@kheafield.com  wrote:

 Hi,

  Think you meant to write to moses-support@mit.edu.  I have no
 knowledge of the truecaser.

 Kenneth

 On 07/31/12 08:04, Eleni Teshome wrote:

 Hi,
 I started usin the site 
 http://www.statmt.org/moses/?**n=moses.baselinehttp://www.statmt.org/moses/?n=moses.baseline
 and while doing the corpus preparation, in the second step i.e. The true
 casing step, whenever i try to execute the command, the following error
 happens:
 Could not open '~/corpus/news.commentary-v7.**fr-en.tok.en' at
 ~/mosesdecoder/scripts/train-**truecaser.perl line 15

 What might be the problem? What can i do to resolve it? I tried the
 other corpus too but it doesn't work. Looking forward to hear from you.
 Thank you in advance.

 On Jul 31, 2012 2:27 PM, Kenneth Heafieldmo...@kheafield.com
 mailto:mo...@kheafield.com  wrote:

  Hi,

   It could be a test gone haywire.  Somewhat unfortunate fact
  about bjam
  is that it prints output when processes are complete but there's no
 way
  to tell from the output what processes are running.  Could you run top
  then hit c or use ps ax to figure out the command lines of relevant
  process(es) that are running when it gets stuck?  Look for cc1plus,
 as,
  ld, _test etc.

  Kenneth

  On 07/31/12 06:11, ygra...@computing.dcu.ie
  mailto:ygra...@computing.dcu.**ieygra...@computing.dcu.ie  wrote:
 Have a bit of a problem installing the latest moses code from
 github
 (tar.gz download) - the installation doesn't terminate and seems
  to get
 stuck at probing_hashtables_test. I've attached the output. Any
  help much
 apprecitated!
   
   
   
 __**_
 Moses-support mailing list
 Moses-support@mit.edumailto:Moses-support@mit.edu
 
 http://mailman.mit.edu/**mailman/listinfo/moses-supporthttp://mailman.mit.edu/mailman/listinfo/moses-support
  __**_
  Moses-support mailing list
  Moses-support@mit.edumailto:Moses-support@mit.edu
  
 http://mailman.mit.edu/**mailman/listinfo/moses-supporthttp://mailman.mit.edu/mailman/listinfo/moses-support




 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support


-- 
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Barry Haddow]

Hi Eleni

You didn't say which files the tokeniser produced. Check the tokenisation 
command carefully, you may have mis-typed

Cheers - Barry 

Sent from my ZX81

- Reply message -
From: Eleni Teshome tesh.el...@gmail.com
Date: Tue, Jul 31, 2012 16:52
Subject: [Moses-support] (no subject)
To: Barry Haddow bhad...@staffmail.ed.ac.uk

The tokenization step succeeded. It produced two files. One for english and
another for france
On Jul 31, 2012 6:51 PM, Eleni Teshome tesh.el...@gmail.com wrote:

 It couldnt produce any files. It just displays that same error everytime i
 try to run the command
 On Jul 31, 2012 6:35 PM, Barry Haddow bhad...@staffmail.ed.ac.uk
 wrote:

 Hi Eleni

 Did the tokenisation step succeed? What files did it produce?

 cheers - Barry

 On 31/07/12 15:51, Eleni Teshome wrote:

 Hi,
 I started usin the site http://www.statmt.org/moses/?n =moses.baseline
 and
 while doing the corpus preparation, in the second step i.e. The true
 casing
 step, whenever i try to execute the command, the following error happens:
 Could not open '~/corpus/news.commentary-v7.**fr-en.tok.en' at
 ~/mosesdecoder/scripts/train-**truecaser.perl line 15

 What might be the problem? What can i do to resolve it? I tried the other
 corpus too but it doesn't work. Looking forward to hear from you. Thank
 you
 in advance.
 On Jul 31, 2012 4:20 PM, Kenneth Heafieldmo...@kheafield.com  wrote:

  Hi,

  Think you meant to write to moses-support@mit.edu.  I have no
 knowledge of the truecaser.

 Kenneth

 On 07/31/12 08:04, Eleni Teshome wrote:

  Hi,
 I started usin the site http://www.statmt.org/moses/?***
 *n=moses.baseline http://www.statmt.org/moses/?**n=moses.baseline
 http://www.**statmt.org/moses/?n=moses.**baselinehttp://www.statmt.org/moses/?n=moses.baseline
 
 and while doing the corpus preparation, in the second step i.e. The
 true
 casing step, whenever i try to execute the command, the following error
 happens:
 Could not open '~/corpus/news.commentary-v7.fr-en.tok.en' at
 ~/mosesdecoder/scripts/train-truecaser.perl line 15

 What might be the problem? What can i do to resolve it? I tried the
 other corpus too but it doesn't work. Looking forward to hear from you.
 Thank you in advance.

 On Jul 31, 2012 2:27 PM, Kenneth Heafieldmo...@kheafield.com
 mailto:mo...@kheafield.com  wrote:

  Hi,

   It could be a test gone haywire.  Somewhat unfortunate
 fact
  about bjam
  is that it prints output when processes are complete but there's
 no
 way
  to tell from the output what processes are running.  Could you
 run top
  then hit c or use ps ax to figure out the command lines of
 relevant
  process(es) that are running when it gets stuck?  Look for
 cc1plus,
 as,
  ld, _test etc.

  Kenneth

  On 07/31/12 06:11, ygra...@computing.dcu.ie
  mailto:ygra...@computing.dcu.ieygra...@computing.dcu.ie**
  wrote:
 Have a bit of a problem installing the latest moses code from
 github
 (tar.gz download) - the installation doesn't terminate and
 seems
  to get
 stuck at probing_hashtables_test. I've attached the output.
 Any
  help much
 apprecitated!
   
   
   
 ___
 Moses-support mailing list
 
 Moses-support@mit.edumailto:M**oses-supp...@mit.eduMoses-support@mit.edu
 
 
 http://mailman.mit.edu/mailman/listinfo/moses-supporthttp://mailman.mit.edu/**mailman/listinfo/moses-support
 **http://mailman.mit.edu/**mailman/listinfo/moses-supporthttp://mailman.mit.edu/mailman/listinfo/moses-support
 **
  ___
  Moses-support mailing list
  
 Moses-support@mit.edumailto:M**oses-supp...@mit.eduMoses-support@mit.edu
 
  
 http://mailman.mit.edu/mailman/listinfo/moses-supporthttp://mailman.mit.edu/**mailman/listinfo/moses-support
 **http://mailman.mit.edu/**mailman/listinfo/moses-supporthttp://mailman.mit.edu/mailman/listinfo/moses-support
 **




 __**_
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/**mailman/listinfo/moses-supporthttp://mailman.mit.edu/mailman/listinfo/moses-support



 --
 The University of Edinburgh is a charitable body, registered in
 Scotland, with registration number SC005336.


The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Barry Haddow]

Hi Abbasov

It's explained in this paper
http://homepages.inf.ed.ac.uk/pkoehn/publications/phrase2003.pdf

best regards - Barry

On Thursday 17 February 2011 11:18, Abbasov Samir wrote:
 Hi everyone, in phrase-table has five scores, i would know how is
 computed lexical weighting ( lex(e|f) ) ? Please, explain me
 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support

-- 
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Marcello Federico]

better if you ask your advisor.

M.

On Nov 21, 2008, at 7:06 AM, Mekh jaishi wrote:

 can anybody say how can i run giza++ for Natural language procesing.
 Invite your mail contacts to join your friends list with Windows  
 Live Spaces. It's easy! Try it!ATT1.txt

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

[Philipp Koehn]

Hi,

GIZA++ is run by the train-factored-model.perl script, so you do
not need it in isolation. But if you want get some idea how it is
run, please check how the training script does it.

-phi

On Fri, Nov 21, 2008 at 6:06 AM, Mekh jaishi [EMAIL PROTECTED] wrote:

  can anybody say how can i run giza++ for Natural language procesing.
 --
 Invite your mail contacts to join your friends list with Windows Live
 Spaces. It's easy! Try 
 it!http://spaces.live.com/spacesapi.aspx?wx_action=createwx_url=/friends.aspxmkt=en-us

 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support