[ https://issues.apache.org/jira/browse/JOSHUA-284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15431674#comment-15431674 ]
Matt Post commented on JOSHUA-284: ---------------------------------- This is completed with commit 2041a3f9798036e69cd05432dcbe8604b80d00fd. > Phrase-based decoding changes > ----------------------------- > > Key: JOSHUA-284 > URL: https://issues.apache.org/jira/browse/JOSHUA-284 > Project: Joshua > Issue Type: Bug > Reporter: Matt Post > Assignee: Matt Post > Fix For: 6.1 > > > Joshua's phrase-based decoding creates a lot of complications in the pipeline. > Currently, phrase-based rules are simply left-branching Hiero rules. This > means that, prior to packing or loading, rules have to have a nonterminal > prepended to them. For example, Thrax will extract > [X] ||| yo quiero ||| i want ||| ... > This has to be changed to > [X] ||| [X,1] yo quiero ||| [X,1] yo quiero ||| ... > This means, for one, that phrase tables share a format but are specific to > either the hiero or phrase-based decoder. > Another problem is that the alignments have to be adjusted when packing > grammars from Moses or Thrax format, since a symbol is being added. > Basically, this choice introduces a host of incompatibilities that require > special handling. > A better idea would be to change the phrase-based decoder a bit so that, > instead of using left-branching phrase rules, it made use of proper glue > rules, the same way Hiero does. The advantages are: > - both formalisms would use the same format > - both formalisms would have a glue grammar > - there should be no impact in running time -- This message was sent by Atlassian JIRA (v6.3.4#6332)