Re: [Moses-support] Factored models and xml-input

2015-05-21 Thread Marcin Junczys-Dowmunt 
Just for testing, what happens if you remove the second phrase table and 
add a langauge model for factor 1. Usually this kind of setup fails for 
me with xml-input, regardless if add factors to the XML option or not.


W dniu 21.05.2015 o 08:18, Hieu Hoang pisze:

it works for me. My input and ini files are attached

On 21/05/2015 10:05, Standa K wrote:

Yes, I tried that as well, it gives the same error.

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support





___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] When to truecase

2015-05-21 Thread Ergun Bicici 
recaser: builds a Moses model for word translation from lowercased to cased
and also uses a language model. Input to recaser is lowercased.

truecaser: builds a casing model based on the number of times each version
appears in text (e.g. rivet (4/8) Rivet (3) RIVET (1)). Input to truecaser
is as it is and not lowercased.

Therefore, if text is noisy such as Tweets, recaser may perform better.


Best Regards,
Ergun

Ergun Biçici, CNGL, School of Computing, DCU, www.cngl.ie
http://www.computing.dcu.ie/~ebicici/


On Wed, May 20, 2015 at 8:07 PM, Philipp Koehn  wrote:

> Hi,
>
> yes, this is what the RECASER section in EMS enables.
>
> -phi
>
> On Wed, May 20, 2015 at 2:50 PM, Lane Schwartz  wrote:
>
>>  Got it. So then, how was casing handled in the "mbr/mp" column? Was all
>> of the data lowercased, then models trained, then recasing applied after
>> decoding? Or something else?
>>
>> On Wed, May 20, 2015 at 1:30 PM, Philipp Koehn  wrote:
>>
>>> Hi,
>>>
>>>  no, the changes are made incrementally.
>>>
>>>  So the recesed "baseline" is the previous "mbr/mp" column.
>>>
>>>  -phi
>>>
>>> On Wed, May 20, 2015 at 2:01 PM, Lane Schwartz 
>>> wrote:
>>>
  Philipp,

  In Table 2 of the WMT 2009 paper, are the "baseline" and "truecased"
 columns directly comparable? In other words, do the two columns indicate
 identical conditions other than a single variable (how and/or when casing
 was handled)?

  In the baseline condition, how and when was casing handled?

  Thanks,
 Lane


 On Wed, May 20, 2015 at 12:43 PM, Philipp Koehn  wrote:

> Hi,
>
>  see Section 2.2 in our WMT 2009 submission:
> http://www.statmt.org/wmt09/pdf/WMT-0929.pdf
>
>  One practical reason to avoid recasing is the need
> for a second large cased language model.
>
>  But there is of course also the practical issue with
> have a unique truecasing scheme for each data
> condition, handling of headlines, all-caps emphasis,
> etc.
>
>  It would be worth to revisit this issue again under
> different data conditions / language pairs. Both
> options are readily available in EMS.
>
>  Each of the two alternative methods could be
> improved as well. See for instance:
> http://www.aclweb.org/anthology/N06-1001
>
>  -phi
>
>  -phi
>
>
>  On Wed, May 20, 2015 at 12:31 PM, Lane Schwartz 
> wrote:
>
>>   Philipp (and others),
>>
>>  I'm wondering what people's experience is regarding when truecasing
>> is applied.
>>
>>  One option is to truecase the training data, then train your TM and
>> LM using that truecased data. Another option would be to lowercase the
>> data, train TM and LM on the lowercased data, and then perform truecasing
>> after decoding.
>>
>>  I assume that the former gives better results, but the latter
>> approach has an advantage in terms of extensibility (namely if you get 
>> more
>> data and update your truecase model, you don't have to re-train all of 
>> your
>> TMs and LMs).
>>
>>  Does anyone have any insights they would care to share on this?
>>
>>  Thanks,
>> Lane
>>
>>
>>  ___
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>


  --
 When a place gets crowded enough to require ID's, social collapse is not
 far away.  It is time to go elsewhere.  The best thing about space
 travel
 is that it made it possible to go elsewhere.
 -- R.A. Heinlein, "Time Enough For Love"

 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support


>>>
>>
>>
>>  --
>> When a place gets crowded enough to require ID's, social collapse is not
>> far away.  It is time to go elsewhere.  The best thing about space travel
>> is that it made it possible to go elsewhere.
>> -- R.A. Heinlein, "Time Enough For Love"
>>
>
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Error compiling Moses

2015-05-21 Thread Barry Haddow 

Hi Marius

> No such file or directory while opening lm/europarl.srilm.gz

This file is missing. Note that you have a relative path, so you have to 
be in the correct directory,


cheers - Barry

On 21/05/15 12:56, Marius Oliver Gheorghita wrote:

Hi Barry,
Thanks again for the previous help. After compiling I have run Moses 
for the first time and I get this error:


Exception: util/file.cc:68 in int util::OpenReadOrThrow(const char*) 
threw ErrnoException because `-1 == (ret = open(name, 00))'.

No such file or directory while opening lm/europarl.srilm.gz

Can you help me to identify the source of error? Thanks so much.
Cheers,
Marius


*From:* Barry Haddow 
*To:* Marius Oliver Gheorghita ; 
"moses-support@mit.edu" 

*Sent:* Thursday, 21 May 2015, 12:56
*Subject:* Re: [Moses-support] Error compiling Moses

Hi Marius

It looks like you're missing the bz2 package. Try installing 
libbz2-dev (on debian-based systems) or bzip2-devel (rpm-based systems).


You're also using your own boost installation, as opposed to the 
system one. Usually it's easier to use the system one as the correct 
dependencies will be there,


cheers - Barry



On 21/05/15 09:04, Marius Oliver Gheorghita wrote:

Hi,
Please advise about the error that I get when compiling Moses. Thank 
you very much in anticipation,

The exact command that I have executed when get this error is:

./bjam --with-boost=~/home/pangeanic/MariusMoses//boost_1_58_0 -j8

All the best,
Marius Gheorghita


___
Moses-support mailing list
Moses-support@mit.edu  
http://mailman.mit.edu/mailman/listinfo/moses-support



The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.




The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Error compiling Moses

2015-05-21 Thread Barry Haddow 

Hi Marius

It looks like you're missing the bz2 package. Try installing libbz2-dev 
(on debian-based systems) or bzip2-devel (rpm-based systems).


You're also using your own boost installation, as opposed to the system 
one. Usually it's easier to use the system one as the correct 
dependencies will be there,


cheers - Barry

On 21/05/15 09:04, Marius Oliver Gheorghita wrote:

Hi,
Please advise about the error that I get when compiling Moses. Thank 
you very much in anticipation,

The exact command that I have executed when get this error is:

./bjam --with-boost=~/home/pangeanic/MariusMoses//boost_1_58_0 -j8

All the best,
Marius Gheorghita


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] Error compiling Moses

2015-05-21 Thread Marius Oliver Gheorghita 
Hi,Please advise about the error that I get when compiling Moses. Thank you 
very much in anticipation,The exact command that I have executed when get this 
error is:
./bjam --with-boost=~/home/pangeanic/MariusMoses//boost_1_58_0 -j8

All the best,Marius Gheorghita


build.log.gz
Description: GNU Zip compressed data
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support