[Moses-support] continue partial translation

2015-11-24 Thread He He 
Hi there,

I'm trying to do translation conditioned on some already translated prefix
(essentially what -continue-partial-translation was supposed to do). I'm
using -xml-input exclusive to pass in the prefix source and translation.

However, when the prefix becomes long, this doesn't work, e.g.
 英国
の ED & F マン 社  に よる と , 96 / 97 年度 の 東欧 の ビート 生産 は , ウクライナ やロシア の 生産 減少
により 大幅 な 低下 が 予想 さ れ , 厳しい もの に なる> 0 ||| 英国 の ED & F英国 の ED & F マン 社 に
よる と / 96 , 97 年度 の 東欧 の ビート 生産 は ウクライナ , や ロシア の 生産 減少 により substantial
decline was expeted to be tough  ||| LexicalReordering0= -4.48185 -7.01678
-1.48808 -4.3759 -6.89465-0.942918 Distortion0= -12 LM0= -227.918
WordPenalty0= -40 PhrasePenalty0= 36 TransltionModel0= -7.25771 -34.5474
-2.80336 -22.3651 ||| -3322.64"

It just copies the source prefix. I suspect it's because many words now
becomes UNK due to ignoring entries in phrase table that overlaps the
prefix.

Is there a way around this? Thanks a lot in advance!

Best,
He
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] ems: PhraseDictionaryOnDisk binarization

2015-11-24 Thread Nicholas Ruiz 
Hi all,

I'm a bit behind on my moses versions and I'm using EMS for the first time.
I trained a toy model, which gave me a PhraseTableMemory translation table.
I'd like to binarize the phrase table and reordering models. I'm still
operating back in the PhraseTableBinary days, but obviously the codebase
has changed quite a bit since then.

How do I binarize the phrase table as a PhraseDictionaryOnDisk? I had tried
uncommenting the binarize-all setting, but that gave me
a PhraseDictionaryBitextSampling. However, I don't need to do incremental
training -- and the tuning phase is failing anyway. Help would be
appreciated about how to do a simple binarization in EMS.

Thanks!
Nick

zınɹ ʞɔıu
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] Adding feature to moses

2015-11-24 Thread haouarid 
Hi,

I would like to add a word by word translation model to moses as a new
feature. I didn't understand how it is possible to have access to the
source and target words. As it is explained in the documentation,
StringPiece is accessible by Factor class which is accessible by Word
class which is accessible by TargetPhrase which is given as argument in
the evaluation method like EvaluateWithSourceContext. I don't use factors
with my translation model, I just use surface form of words.
How is it possible to read the string source and target words without
using Factors?

Thank you,
Dorra
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] “ '” in the translated text

2015-11-24 Thread 徐同学 
Hi,

There are “ '” in the translated text. I noticed that escaping is 
necessary for the tokenized file during corpus preparation. 
But when the translation is done, how can I change all the “ '” back to 
the normal apostrophe?
Here attaches my translated file. 


outtok-en
Description: Binary data
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Installing Eclipse for moses

2015-11-24 Thread Hieu Hoang 
I always use Eclipse to develop and debug moses.

See this youtube video by Dominik that shows you how to set it up
https://vimeo.com/129306919

On 24/11/2015 11:44, Despina Mouratidi wrote:
> Hello, i am a beginner in Moses (debugging and development) and i was
> wondering if its better to use Moses through Eclipse.
>
>
> Thanks in advance
> Despina
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>

-- 
Hieu Hoang
http://www.hoang.co.uk/hieu

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] different versions of moses yielding different translations

2015-11-24 Thread Hieu Hoang 
There was a change in the underlying datastructure for stacks, it 
changed from std::set (ordered) to boost::unordered_set.

https://github.com/moses-smt/mosesdecoder/commit/6b182ee5e987a5b2823aea7eaaa7ef0457c6a30d
This got some speed gains

1   5   10  15  20  25  30  35  
56 	real4m57.795s 	real1m19.005s 	real0m51.636s 	real0m49.624s 
real0m49.869s 	real0m52.475s 	real0m53.806s 	real 	0m54.957s
13/10 baseline 	user4m41.255s 	user5m45.086s 	user6m34.053s 
user8m12.430s 	user8m10.667s 	user8m16.486s 	user8m10.592s 	user 	8m13.859s


	sys0m16.514s 	sys0m35.494s 	sys0m54.513s 	sys1m10.643s 	sys1m18.449s 
sys1m21.738s 	sys1m23.133s 	sys 	1m25.048s











57 	real4m41.148s 	real1m16.002s 	real0m50.747s 	real0m48.711s 
real0m49.130s 	real0m51.473s 	real0m53.141s 	real 	0m54.513s
(56) + unordered set stack 	user4m23.968s 	user5m30.356s 
user6m26.167s 	user7m39.286s 	user7m56.229s 	user7m52.669s 
user7m56.978s 	user 	7m56.216s


	sys0m17.231s 	sys0m35.063s 	sys0m54.081s 	sys1m10.137s 	sys1m17.194s 
sys1m22.912s 	sys1m25.948s 	sys 	1m26.247s



However, the hypotheses are now added to the stack in a different order 
so there will be slight differences in results


On 24/11/2015 13:53, Vito Mandorino wrote:

Hi,

in some of our tests a recent version of Moses (pulled from github 
last week) and an older one do not give the same translations on the 
same source segment (with the same moses.ini).
Here is the 5-best list for the translation of 'test' with the last 
week version:


0 ||| test  ||| LexicalReordering0= -1.1969 0 0 0 0 0 Distortion0= 0 
LM0= -51.1788 WordPenalty0= -1 PhrasePenalty0= 1 
PhraseDictionaryMultiModel0= -3.03811 -2.5834 -2.08503 -1.83075 ||| 
-1.27754
0 ||| testing  ||| LexicalReordering0= 0 0 0 0 0 0 Distortion0= 0 LM0= 
-35.1495 WordPenalty0= -1 PhrasePenalty0= 1 
PhraseDictionaryMultiModel0= -5.21045 -5.04877 -4.71131 -4.66382 ||| 
-1.70337
0 ||| funds  ||| LexicalReordering0= -3.1355 0 0 0 0 0 Distortion0= 0 
LM0= -11.3753 WordPenalty0= -1 PhrasePenalty0= 1 
PhraseDictionaryMultiModel0= -10.8209 -10.6835 -5.14555 -5.73388 ||| 
-1.77009
0 ||| known as a  ||| LexicalReordering0= -3.1355 0 0 0 0 0 
Distortion0= 0 LM0= -58.8877 WordPenalty0= -3 PhrasePenalty0= 1 
PhraseDictionaryMultiModel0= -4.42285 -11.9339 -5.14555 -18.0392 ||| 
-1.89152
0 ||| as a  ||| LexicalReordering0= -3.1355 0 0 0 0 0 Distortion0= 0 
LM0= -35.5353 WordPenalty0= -2 PhrasePenalty0= 1 
PhraseDictionaryMultiModel0= -9.34698 -11.9339 -5.14555 -9.14874 ||| 
-1.89159


and with the older version of Moses:

0 ||| funds  ||| LexicalReordering0= -3.1355 0 0 0 0 0 Distortion0= 0 
LM0= -11.3753 WordPenalty0= -1 PhrasePenalty0= 1 
PhraseDictionaryMultiModel0= -2.52548 -2.52544 -2.45544 -2.48609 ||| 
-0.815668
0 ||| as a  ||| LexicalReordering0= -3.1355 0 0 0 0 0 Distortion0= 0 
LM0= -35.5353 WordPenalty0= -2 PhrasePenalty0= 1 
PhraseDictionaryMultiModel0= -2.52464 -2.52565 -2.45544 -2.5244 ||| 
-0.953799
0 ||| as  ||| LexicalReordering0= -3.1355 0 0 0 0 0 Distortion0= 0 
LM0= -34.1633 WordPenalty0= -1 PhrasePenalty0= 1 
PhraseDictionaryMultiModel0= -2.5256 -2.52565 -2.45544 -2.48609 ||| 
-1.07254
0 ||| known as a  ||| LexicalReordering0= -3.1355 0 0 0 0 0 
Distortion0= 0 LM0= -58.8877 WordPenalty0= -3 PhrasePenalty0= 1 
PhraseDictionaryMultiModel0= -2.38597 -2.52565 -2.45544 -2.52573 ||| 
-1.07536
0 ||| is known as a  ||| LexicalReordering0= -3.1355 0 0 0 0 0 
Distortion0= 0 LM0= -80.8518 WordPenalty0= -4 PhrasePenalty0= 1 
PhraseDictionaryMultiModel0= -2.37158 -2.52565 -2.45544 -2.52573 ||| 
-1.18753


This looks very strange. The only difference is in the phrase-table 
scores. Do you have any idea of what is going on? The only possibility 
which come to mind is maybe a different handling of the 
PhraseDictionaryMultiModel feature.

The moses.ini is in attachment.

Best regards,

Vito



--
*M**. Vito MANDORINO -- Chief Scientist*

Description : Description : lingua_custodia_final full logo

*/The Translation Trustee/*

*1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23  Mobile : +33 6 84 65 68 89*

*Email :vito.mandor...@linguacustodia.com 
***


*Website :www.linguacustodia.com 
 - www.thetranslationtrustee.com 
*




___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


--
Hieu Hoang
http://www.hoang.co.uk/hieu

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] different versions of moses yielding different translations

2015-11-24 Thread Vito Mandorino 
Hi,

in some of our tests a recent version of Moses (pulled from github last
week) and an older one do not give the same translations on the same source
segment (with the same moses.ini).
Here is the 5-best list for the translation of 'test' with the last week
version:

0 ||| test  ||| LexicalReordering0= -1.1969 0 0 0 0 0 Distortion0= 0 LM0=
-51.1788 WordPenalty0= -1 PhrasePenalty0= 1 PhraseDictionaryMultiModel0=
-3.03811 -2.5834 -2.08503 -1.83075 ||| -1.27754
0 ||| testing  ||| LexicalReordering0= 0 0 0 0 0 0 Distortion0= 0 LM0=
-35.1495 WordPenalty0= -1 PhrasePenalty0= 1 PhraseDictionaryMultiModel0=
-5.21045 -5.04877 -4.71131 -4.66382 ||| -1.70337
0 ||| funds  ||| LexicalReordering0= -3.1355 0 0 0 0 0 Distortion0= 0 LM0=
-11.3753 WordPenalty0= -1 PhrasePenalty0= 1 PhraseDictionaryMultiModel0=
-10.8209 -10.6835 -5.14555 -5.73388 ||| -1.77009
0 ||| known as a  ||| LexicalReordering0= -3.1355 0 0 0 0 0 Distortion0= 0
LM0= -58.8877 WordPenalty0= -3 PhrasePenalty0= 1
PhraseDictionaryMultiModel0= -4.42285 -11.9339 -5.14555 -18.0392 |||
-1.89152
0 ||| as a  ||| LexicalReordering0= -3.1355 0 0 0 0 0 Distortion0= 0 LM0=
-35.5353 WordPenalty0= -2 PhrasePenalty0= 1 PhraseDictionaryMultiModel0=
-9.34698 -11.9339 -5.14555 -9.14874 ||| -1.89159

and with the older version of Moses:

0 ||| funds  ||| LexicalReordering0= -3.1355 0 0 0 0 0 Distortion0= 0 LM0=
-11.3753 WordPenalty0= -1 PhrasePenalty0= 1 PhraseDictionaryMultiModel0=
-2.52548 -2.52544 -2.45544 -2.48609 ||| -0.815668
0 ||| as a  ||| LexicalReordering0= -3.1355 0 0 0 0 0 Distortion0= 0 LM0=
-35.5353 WordPenalty0= -2 PhrasePenalty0= 1 PhraseDictionaryMultiModel0=
-2.52464 -2.52565 -2.45544 -2.5244 ||| -0.953799
0 ||| as  ||| LexicalReordering0= -3.1355 0 0 0 0 0 Distortion0= 0 LM0=
-34.1633 WordPenalty0= -1 PhrasePenalty0= 1 PhraseDictionaryMultiModel0=
-2.5256 -2.52565 -2.45544 -2.48609 ||| -1.07254
0 ||| known as a  ||| LexicalReordering0= -3.1355 0 0 0 0 0 Distortion0= 0
LM0= -58.8877 WordPenalty0= -3 PhrasePenalty0= 1
PhraseDictionaryMultiModel0= -2.38597 -2.52565 -2.45544 -2.52573 |||
-1.07536
0 ||| is known as a  ||| LexicalReordering0= -3.1355 0 0 0 0 0 Distortion0=
0 LM0= -80.8518 WordPenalty0= -4 PhrasePenalty0= 1
PhraseDictionaryMultiModel0= -2.37158 -2.52565 -2.45544 -2.52573 |||
-1.18753

This looks very strange. The only difference is in the phrase-table scores.
Do you have any idea of what is going on? The only possibility which come
to mind is maybe a different handling of the PhraseDictionaryMultiModel
feature.
The moses.ini is in attachment.

Best regards,

Vito



-- 
*M**. Vito MANDORINO -- Chief Scientist*


[image: Description : Description : lingua_custodia_final full logo]

 *The Translation Trustee*

*1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23   Mobile : +33 6 84 65 68 89*

*Email :*  *vito.mandor...@linguacustodia.com
*

*Website :*  *www.linguacustodia.com  -
www.thetranslationtrustee.com  *


moses.ini
Description: Binary data
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Pruning phrase-table

2015-11-24 Thread Barry Haddow 

Hi

To be honest, I have not experimented much with the settings. If the 
filtering does not work for you, it could be that your training data is 
small or out-of-domain, so that the poorly attested phrase pairs are 
actually important.


Can you see from looking at the translations what changes when you 
filter at default settings? (note that the length drops).


Do you really need this kind of pruning? Maybe histogram pruning, and/or 
the compact data structures can reduce the size of your model sufficiently?


cheers - Barry

On 24/11/15 10:19, Sanjanashree Palanivel wrote:

Dear Barry,

I tried it, I got decrease in BLEU Score say from 16.39 to 14.35, 
But the size of PT was greatly reduced. When I tried some positive 
values the BLEU Score varies. The following is a sample table.



Inline image 1

On Tue, Nov 24, 2015 at 3:40 PM, Barry Haddow 
mailto:bhad...@staffmail.ed.ac.uk>> wrote:


Hi

The documentation suggests:


A good setting is |-l a+e -n 30|


Try this first,

cheers - Barry


On 24/11/15 10:00, Sanjanashree Palanivel wrote:


Dear Barry,

Thank you for ur earnest response. I am using sigtest
filter, now. In sigtest filter method, how should I tune a
parameters -l -n.

On Nov 24, 2015 2:44 PM, "Barry Haddow"
mailto:bhad...@staffmail.ed.ac.uk>>
wrote:

Hi

You're better off using the Johnson pruning method
http://www.statmt.org/moses/?n=Advanced.RuleTables#ntoc5 .
The relent code is no longer maintained,

cheers - Barry

On 24/11/15 05:42, Sanjanashree Palanivel wrote:


Dear All,

   I just tried to prune the phrase table using
relent-filter insisde mosesdecoder. I used the command as
mentioned in the moses site
(http://www.statmt.org/moses/?n=Advanced.RuleTables). But, I
am getting the following error "Use of uninitialized value
$_[0] in substitution (s///) at
/usr/share/perl/5.18/File/Basename.pm line 341.
fileparse(): need a valid pathname at

/home/sanjana/Documents/SMT/mosesdecoder/contrib/relent-filter/scripts/calcPruningScores.pl
line 140." . Where am i being worng.


-- 
Thanks and regards,


Sanjanasri J.P


___
Moses-support mailing list
Moses-support@mit.edu  
http://mailman.mit.edu/mailman/listinfo/moses-support



The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.




The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.




--
Thanks and regards,

Sanjanasri J.P


The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] Installing Eclipse for moses

2015-11-24 Thread Despina Mouratidi 
Hello, i am a beginner in Moses (debugging and development) and i was
wondering if its better to use Moses through Eclipse.


Thanks in advance
Despina
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] experiment.perl not working with, config.toy

2015-11-24 Thread Tom Hoar 
Nicholas,

We updated MGIZA++ in the Moses github repository with changes to 
support cross-platform operation on Windows. These were not intended to 
be only for Windows users and should not affect OSX or Linux. If you ran 
across some problems with the updates, please work with Jeroen so it 
works properly on all platforms.

Thanks!
Tom



On 11/24/2015 5:12 PM, moses-support-requ...@mit.edu wrote:
> Date: Tue, 24 Nov 2015 05:06:51 -0500
> From: Nicholas Ruiz
> Subject: Re: [Moses-support] experiment.perl not working with config.toy
> To: Hieu Hoang
> Cc: moses-support
>
> Thanks, Hieu. It turned out that I needed to use an older version on mgiza
> to avoid the static linking. It wasn't feasible in my environment to
> recompile gcc with the proper flags (no root access).
>
> To be fair, your github branch of mgiza does say that it's intended for
> Windows users.:)

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Pruning phrase-table

2015-11-24 Thread Barry Haddow 

Hi

The documentation suggests:


A good setting is |-l a+e -n 30|


Try this first,

cheers - Barry

On 24/11/15 10:00, Sanjanashree Palanivel wrote:


Dear Barry,

Thank you for ur earnest response. I am using sigtest filter, 
now. In sigtest filter method, how should I tune a  parameters -l -n.


On Nov 24, 2015 2:44 PM, "Barry Haddow" > wrote:


Hi

You're better off using the Johnson pruning method
http://www.statmt.org/moses/?n=Advanced.RuleTables#ntoc5 . The
relent code is no longer maintained,

cheers - Barry

On 24/11/15 05:42, Sanjanashree Palanivel wrote:


Dear All,

   I just tried to prune the phrase table using relent-filter
insisde mosesdecoder. I used the command as mentioned in the
moses site (http://www.statmt.org/moses/?n=Advanced.RuleTables).
But, I am getting the following error "Use of uninitialized value
$_[0] in substitution (s///) at
/usr/share/perl/5.18/File/Basename.pm line 341.
fileparse(): need a valid pathname at

/home/sanjana/Documents/SMT/mosesdecoder/contrib/relent-filter/scripts/calcPruningScores.pl
line 140." . Where am i being worng.


-- 
Thanks and regards,


Sanjanasri J.P


___
Moses-support mailing list
Moses-support@mit.edu  
http://mailman.mit.edu/mailman/listinfo/moses-support



The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.



The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] experiment.perl not working with config.toy

2015-11-24 Thread Nicholas Ruiz 
Thanks, Hieu. It turned out that I needed to use an older version on mgiza
to avoid the static linking. It wasn't feasible in my environment to
recompile gcc with the proper flags (no root access).

To be fair, your github branch of mgiza does say that it's intended for
Windows users. :)
On Nov 23, 2015 8:19 PM, "Hieu Hoang"  wrote:

> my training-tools directory contains this:
>
> Hieus:~/workspace/bin/training-tools$ll
> total 2984
> drwxr-xr-x  6 hieu  staff  204 22 Apr  2015 ./
> drwxr-xr-x  3 hieu  staff  102 22 Apr  2015 ../
> -rwxr-xr-x  1 hieu  staff 2070 22 Apr  2015 merge_alignment.py*
> -rwxr-xr-x  1 hieu  staff  1096056 22 Apr  2015 mgiza*
> -rwxr-xr-x  1 hieu  staff   376012 22 Apr  2015 mkcls*
> -rwxr-xr-x  1 hieu  staff48224 22 Apr  2015 snt2cooc*
> Hieus:~/workspace/bin/training-tools$
>
>
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
> On 20 November 2015 at 20:09, Nicholas Ruiz  wrote:
>
>> Hi all,
>>
>> I'm having some issues running config.toy with EMS (experiment.py). I
>> have a vanilla installation of Moses, which compiles successfully, but EMS
>> is giving me a headache with mgiza. I followed the instructions here and
>> here to install Moses and mgiza:
>> http://www.statmt.org/moses/?n=Development.GetStarted
>> http://www.statmt.org/moses/?n=Moses.ExternalTools#ntoc3
>>
>> My moses installation is here:
>> [nruiz@cheetah-h2 training-tools]$ cd
>> /n/w10-nruiz/mosesdecoder/bin/training-tools
>> [nruiz@cheetah-h2 training-tools]$ ls -l
>> total 8
>> -rwxr-xr-x 1 nruiz slt 3291 Nov 20 14:52 merge_alignment.py
>> drwxr-xr-x 2 nruiz slt 4096 Nov 20 14:50 mgizapp
>> [nruiz@cheetah-h2 training-tools]$ ls -l mgizapp/
>> total 4188
>> -rw-r--r-- 1 nruiz slt3848 Nov 20 14:50 alignment.o
>> -rw-r--r-- 1 nruiz slt   11144 Nov 20 14:50 AlignTables.o
>> -rw-r--r-- 1 nruiz slt   57344 Nov 20 14:50 ATables.o
>> 
>>
>> When executing experiment.perl, I get an error in mgiza, complaining that
>> mkcls can't be found. I'm enclosing my minor modification of config.toy for
>> troubleshooting.
>>
>> Here's the command that fails:
>>
>> $ /n/w10-nruiz/mosesdecoder/scripts/training/train-model.perl -mgiza
>> -mgiza-cpus 16 -dont-zip -first-step 2 -last-step 2 -external-bin-dir
>> /n/w10-nruiz/mosesdecoder/bin/training-tools -f fr -e en -alignment
>> grow-diag-final-and -max-phrase-length 5 -reordering msd-bidirectional-fe
>> -score-options '--GoodTuring --MinScore 2:0.0001' -parallel -corpus-dir
>> /n/w10-nruiz/mt/zh-en/experiment/toy/training/prepared.3 -giza-e2f
>> /n/w10-nruiz/mt/zh-en/experiment/toy/training/giza.5 -direction 2
>>
>> Use of implicit split to @_ is deprecated at
>> /n/w10-nruiz/mosesdecoder/scripts/training/train-model.perl line 2091.
>>
>> Using SCRIPTS_ROOTDIR: /n/w10-nruiz/mosesdecoder/scripts
>>
>> Using multi-thread GIZA
>>
>> using gzip
>>
>> ERROR: Cannot find mkcls, GIZA++/mgiza, & snt2cooc.out/snt2cooc in
>> /n/w10-nruiz/mosesdecoder/bin/training-tools.
>>
>> You MUST specify the parameter -external-bin-dir at
>> /n/w10-nruiz/mosesdecoder/scripts/training/train-model.perl line 484.
>> Do you know why train-model.perl is having trouble finding the mgiza
>> executables? Thanks for your help!
>>
>> Thanks,
>> Nick
>>
>> zınɹ ʞɔıu
>>
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Pruning phrase-table

2015-11-24 Thread Barry Haddow 

Hi

You're better off using the Johnson pruning method 
http://www.statmt.org/moses/?n=Advanced.RuleTables#ntoc5 . The relent 
code is no longer maintained,


cheers - Barry

On 24/11/15 05:42, Sanjanashree Palanivel wrote:


Dear All,

   I just tried to prune the phrase table using relent-filter 
insisde mosesdecoder. I used the command as mentioned in the moses 
site (http://www.statmt.org/moses/?n=Advanced.RuleTables). But, I am 
getting the following error "Use of uninitialized value $_[0] in 
substitution (s///) at /usr/share/perl/5.18/File/Basename.pm line 341.
fileparse(): need a valid pathname at 
/home/sanjana/Documents/SMT/mosesdecoder/contrib/relent-filter/scripts/calcPruningScores.pl 
line 140." . Where am i being worng.



--
Thanks and regards,

Sanjanasri J.P


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Moses-support Digest, Vol 109, Issue 50

2015-11-24 Thread Martin Baumgärtner 

Hi Uli,

have you been successful with downloading the sample engine? If you got 
problems with it, please let me know. Please take also into account that 
it's a time limited upload (7 days) ...


Martin


Am 23.11.2015 um 08:21 schrieb moses-support-requ...@mit.edu:

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-requ...@mit.edu

You can reach the person managing the list at
moses-support-ow...@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Moses-support Digest, Vol 109, Issue 45 (Martin Baumg?rtner)


--

Message: 1
Date: Mon, 23 Nov 2015 08:21:25 +0100
From: Martin Baumg?rtner 
Subject: Re: [Moses-support] Moses-support Digest, Vol 109, Issue 45
To: moses-support@mit.edu
Message-ID: <5652be75.7020...@star-group.net>
Content-Type: text/plain; charset="windows-1252"

Hi Uli,

you can download a hopefully tiny enough model [de-en] from here:

 
https://fil.email/20szKB?utm_source=confirmation&utm_medium=email&utm_campaign=Email%20Confirmation&utm_content=free

It's based on the first 5000 lines of the europarl corpus -
http://www.statmt.org/europarl/v7/de-en.tgz + one magic sentence "Dies
ist ein Test." - with 150 tune / 50 test segments randomly extracted.

Extraction: tar xvfj walgn.tar.bz2
   Execution: cd waln_engine ; moses --servermoses.ini &

Use xmlrpc-request (see previous email) or simply modify
mosesdecoder/moses/TranslationRequest.cpp (line 396)

 if (m_withWordAlignInfo) {

=>

 if (1) {

... recompile (mosesdecoder/previous.sh) and then call script
client_test.perl ...

Best,
Martin


Am 19.11.2015 um 18:10 schrieb moses-support-requ...@mit.edu:

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-requ...@mit.edu

You can reach the person managing the list at
moses-support-ow...@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

 1. Re: Server issue with word-align (Martin Baumg?rtner)


--

Message: 1
Date: Thu, 19 Nov 2015 18:10:28 +0100
From: Martin Baumg?rtner
Subject: Re: [Moses-support] Server issue with word-align
To:ugerm...@inf.ed.ac.uk
Cc:"moses-support@mit.edu"  
Message-ID:<564e0284.9050...@star-group.net>
Content-Type: text/plain; charset="utf-8"

Hi Uli,

I'm using the following xmlrpc request:



 translate
 
 
   
 text
 
   dies ist ein Test .
 
   
   
 word-align
 
   1
 
   




For models, .ini etc. I'll send you tomorrow ...

Martin

Am 19.11.2015 um 17:53 schrieb Ulrich Germann:

I can't replicate the crash. Can you send me small (!) models, the
corresponding .ini file, and a json request that demonstrate the
behaviour?

- Uli

On Thu, Nov 19, 2015 at 2:19 PM, Martin Baumg?rtner
mailto:martin.baumgaert...@star-group.net>> wrote:

  Hi all,

  after having pulled the latest version from master [b002fade]
  moses crashes when being called in server mode and requested with
  xmlrpc-c parameter 'word-align':

  > moses --server -f /path/to/moses.ini &

  Then send a request from client using 'word-align' member:

  [...]
  [moses/server/Server.cpp:36] Listening on port 8080

  [moses/server/TranslationRequest.cpp:319] Input: Dies ist ein
  Test .
  Translating: Dies ist ein Test .
  binary file loaded, default OFF_T: -1
  Line 0: Collecting options took 0.020 seconds at
  moses/Manager.cpp:134
  Line 0: Search took 0.042 seconds
  [moses/server/TranslationRequest.cpp:417] SERVER TRANSLATION:
  This is a test .
  terminate called after throwing an instance of 'girerr::error'
what():  Assigning to already instantiated xmlrpc_c::value


  ... which appears to me like a bug.

  Thanks in advance!

  Cheers,
  Martin

  --

  *STAR Group*
  

  *Martin Baumg?rtner*

  STAR Language Technology & Solutions GmbH
  Umberto-Nobile-Stra?e 19 | 71063 Sindelfingen | Germany
  Tel. +49 70 31-4 10 92-0
  
martin.baumgaert...@star-group.net
  <