Hi, I have some success pruning phrase-table.0-0 which consists of just one factor.
When pruning a phrase table phrase-table.0,1,2-0,1,2 which consists of three factors surface, lemma and pos then my pruned output is empty. Example of an entry in phrase-table.0,1,2-0,1,2 Council|council|NN or|or|CC ||| consejo|consejo|NCMS000 y|y|CC que|que|CS ||| 0.166667 0.00308919 0.5 0.00180623 2.718 ||| 0-0 1-1 ||| 6 2 1 My current source and target files that are used as input to IndexSA.O32 is the text from the parallel corpus used to get these phrase tables. Example from source file: Please let this not be yet another sector where we subsequently have to lament the lack of enforcement. Does anyone know what mt source and target input should look like to prune a table like phrase-table.0,1,2-0,1,2? Thanks Andrew On Thu, Jul 25, 2013 at 11:35 AM, Andrew Vine <av...@machinalis.com> wrote: > Thanks, will do > > > On Wed, Jul 24, 2013 at 3:46 PM, Hieu Hoang <hieu.ho...@ed.ac.uk> wrote: > >> Probably.... >> >> Try it and let us know >> >> On 23 July 2013 21:44, Andrew Vine <av...@machinalis.com> wrote: >> >>> Hi, >>> >>> I would like to prune some phrase tables following the method described >>> here.. >>> http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc19 >>> >>> Could anyone tell me if I could still use filter-pt to prune even if my >>> phrase table has more than one factor? >>> >>> Many thanks >>> Andrew >>> >>> _______________________________________________ >>> Moses-support mailing list >>> Moses-support@mit.edu >>> http://mailman.mit.edu/mailman/listinfo/moses-support >>> >>> >> >> >> -- >> Hieu Hoang >> Research Associate >> University of Edinburgh >> http://www.hoang.co.uk/hieu >> >> >
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
