Hi
To be honest, I have not experimented much with the settings. If the
filtering does not work for you, it could be that your training data is
small or out-of-domain, so that the poorly attested phrase pairs are
actually important.
Can you see from looking at the translations what changes when you
filter at default settings? (note that the length drops).
Do you really need this kind of pruning? Maybe histogram pruning, and/or
the compact data structures can reduce the size of your model sufficiently?
cheers - Barry
On 24/11/15 10:19, Sanjanashree Palanivel wrote:
Dear Barry,
I tried it, I got decrease in BLEU Score say from 16.39 to 14.35,
But the size of PT was greatly reduced. When I tried some positive
values the BLEU Score varies. The following is a sample table.
Inline image 1
On Tue, Nov 24, 2015 at 3:40 PM, Barry Haddow
<bhad...@staffmail.ed.ac.uk <mailto:bhad...@staffmail.ed.ac.uk>> wrote:
Hi
The documentation suggests:
A good setting is |-l a+e -n 30|
Try this first,
cheers - Barry
On 24/11/15 10:00, Sanjanashree Palanivel wrote:
Dear Barry,
Thank you for ur earnest response. I am using sigtest
filter, now. In sigtest filter method, how should I tune a
parameters -l -n.
On Nov 24, 2015 2:44 PM, "Barry Haddow"
<bhad...@staffmail.ed.ac.uk <mailto:bhad...@staffmail.ed.ac.uk>>
wrote:
Hi
You're better off using the Johnson pruning method
http://www.statmt.org/moses/?n=Advanced.RuleTables#ntoc5 .
The relent code is no longer maintained,
cheers - Barry
On 24/11/15 05:42, Sanjanashree Palanivel wrote:
Dear All,
I just tried to prune the phrase table using
relent-filter insisde mosesdecoder. I used the command as
mentioned in the moses site
(http://www.statmt.org/moses/?n=Advanced.RuleTables). But, I
am getting the following error "Use of uninitialized value
$_[0] in substitution (s///) at
/usr/share/perl/5.18/File/Basename.pm line 341.
fileparse(): need a valid pathname at
/home/sanjana/Documents/SMT/mosesdecoder/contrib/relent-filter/scripts/calcPruningScores.pl
line 140." . Where am i being worng.
--
Thanks and regards,
Sanjanasri J.P
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu <mailto:Moses-support@mit.edu>
http://mailman.mit.edu/mailman/listinfo/moses-support
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
--
Thanks and regards,
Sanjanasri J.P
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
