Re: [Moses-support] How to print out intermediate confusion networks / lattices?

[Philipp Koehn]

Hi,

yes, that's correct.
There is an implementation of "Lattice MBR".

-phi

On Fri, Mar 24, 2017 at 12:05 PM, Angli Liu 
wrote:

> I see! Does this mean that the default decoding algorithm and
> MBR/consensus decoding are all trying to rerank the n-best list extracted
> from the search graph (in different ways)? If so, does it make sense at all
> to try to develop a search method to directly extract the best path from
> the search graph, i.e., the lattice?
>
> Thanks,
> Angli
>
> On Fri, Mar 24, 2017 at 8:54 AM, Philipp Koehn  wrote:
>
>> Hi,
>>
>> the search graph does not include the MBR objective, since that is
>> computed afterwards, on top of the n-best list extracted from the search
>> graph.
>>
>> You can mix cube pruning and MBR together. As mentioned above, the
>> "decision rule" (MBR vs. max-prob) is applied after search is finished.
>>
>> -phi
>>
>> On Fri, Mar 24, 2017 at 11:50 AM, Angli Liu 
>> wrote:
>>
>>> Thanks!
>>>
>>> Furthermore, does "output-search-graph" output the search graph only
>>> when the default objective (posterior probability) is used, or also when
>>> minimum bayes risk decoding / consensus decoding is used (smoothed BLEU)?
>>>
>>> Also, is cube pruning applicable to minimum bayes risk decoding or
>>> consensus decoding? Namely, should I turn on -search-algorithm 1 when -lmbr
>>> or -con is on?
>>>
>>> Thanks,
>>> Angli
>>>
>>> On Fri, Mar 24, 2017 at 8:00 AM, Philipp Koehn  wrote:
>>>
 Hi,

 the option to output the search graph is called "output-search-graph"

 See http://www.statmt.org/moses/?n=Advanced.Search for details.

 The source code is in $MOSES/moses-cmd and $MOSES/moses

 -phi



 On Thu, Mar 23, 2017 at 6:30 PM, Angli Liu 
 wrote:

> Hi Moses community,
>
> In decoding, is it possible to have Moses output a confusion network
> (CN) or a word lattice (WL), instead of the decoded text for each 
> sentence?
> I'm aware that one parameter of the decoder is "-inputtype", so the
> question is what parameter of the decoder should be used to determine the
> output type (among CN, WL and plain texts)?
>
> Also, where can I exactly find the decoder code (responsible for what
> the binary "moses" does) inside https://github.com/moses-smt/m
> osesdecoder?
>
> Thanks,
> Angli
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>

>>>
>>
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] How to print out intermediate confusion networks / lattices?

[Philipp Koehn]

Hi,

the search graph does not include the MBR objective, since that is computed
afterwards, on top of the n-best list extracted from the search graph.

You can mix cube pruning and MBR together. As mentioned above, the
"decision rule" (MBR vs. max-prob) is applied after search is finished.

-phi

On Fri, Mar 24, 2017 at 11:50 AM, Angli Liu 
wrote:

> Thanks!
>
> Furthermore, does "output-search-graph" output the search graph only when
> the default objective (posterior probability) is used, or also when minimum
> bayes risk decoding / consensus decoding is used (smoothed BLEU)?
>
> Also, is cube pruning applicable to minimum bayes risk decoding or
> consensus decoding? Namely, should I turn on -search-algorithm 1 when -lmbr
> or -con is on?
>
> Thanks,
> Angli
>
> On Fri, Mar 24, 2017 at 8:00 AM, Philipp Koehn  wrote:
>
>> Hi,
>>
>> the option to output the search graph is called "output-search-graph"
>>
>> See http://www.statmt.org/moses/?n=Advanced.Search for details.
>>
>> The source code is in $MOSES/moses-cmd and $MOSES/moses
>>
>> -phi
>>
>>
>>
>> On Thu, Mar 23, 2017 at 6:30 PM, Angli Liu 
>> wrote:
>>
>>> Hi Moses community,
>>>
>>> In decoding, is it possible to have Moses output a confusion network
>>> (CN) or a word lattice (WL), instead of the decoded text for each sentence?
>>> I'm aware that one parameter of the decoder is "-inputtype", so the
>>> question is what parameter of the decoder should be used to determine the
>>> output type (among CN, WL and plain texts)?
>>>
>>> Also, where can I exactly find the decoder code (responsible for what
>>> the binary "moses" does) inside https://github.com/moses-smt/m
>>> osesdecoder?
>>>
>>> Thanks,
>>> Angli
>>>
>>> ___
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] How to print out intermediate confusion networks / lattices?

[Angli Liu]

I see! Does this mean that the default decoding algorithm and MBR/consensus
decoding are all trying to rerank the n-best list extracted from the search
graph (in different ways)? If so, does it make sense at all to try to
develop a search method to directly extract the best path from the search
graph, i.e., the lattice?

Thanks,
Angli

On Fri, Mar 24, 2017 at 8:54 AM, Philipp Koehn  wrote:

> Hi,
>
> the search graph does not include the MBR objective, since that is
> computed afterwards, on top of the n-best list extracted from the search
> graph.
>
> You can mix cube pruning and MBR together. As mentioned above, the
> "decision rule" (MBR vs. max-prob) is applied after search is finished.
>
> -phi
>
> On Fri, Mar 24, 2017 at 11:50 AM, Angli Liu 
> wrote:
>
>> Thanks!
>>
>> Furthermore, does "output-search-graph" output the search graph only when
>> the default objective (posterior probability) is used, or also when minimum
>> bayes risk decoding / consensus decoding is used (smoothed BLEU)?
>>
>> Also, is cube pruning applicable to minimum bayes risk decoding or
>> consensus decoding? Namely, should I turn on -search-algorithm 1 when -lmbr
>> or -con is on?
>>
>> Thanks,
>> Angli
>>
>> On Fri, Mar 24, 2017 at 8:00 AM, Philipp Koehn  wrote:
>>
>>> Hi,
>>>
>>> the option to output the search graph is called "output-search-graph"
>>>
>>> See http://www.statmt.org/moses/?n=Advanced.Search for details.
>>>
>>> The source code is in $MOSES/moses-cmd and $MOSES/moses
>>>
>>> -phi
>>>
>>>
>>>
>>> On Thu, Mar 23, 2017 at 6:30 PM, Angli Liu 
>>> wrote:
>>>
 Hi Moses community,

 In decoding, is it possible to have Moses output a confusion network
 (CN) or a word lattice (WL), instead of the decoded text for each sentence?
 I'm aware that one parameter of the decoder is "-inputtype", so the
 question is what parameter of the decoder should be used to determine the
 output type (among CN, WL and plain texts)?

 Also, where can I exactly find the decoder code (responsible for what
 the binary "moses" does) inside https://github.com/moses-smt/m
 osesdecoder?

 Thanks,
 Angli

 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support


>>>
>>
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] How to print out intermediate confusion networks / lattices?

[Angli Liu]

Thanks!

Furthermore, does "output-search-graph" output the search graph only when
the default objective (posterior probability) is used, or also when minimum
bayes risk decoding / consensus decoding is used (smoothed BLEU)?

Also, is cube pruning applicable to minimum bayes risk decoding or
consensus decoding? Namely, should I turn on -search-algorithm 1 when -lmbr
or -con is on?

Thanks,
Angli

On Fri, Mar 24, 2017 at 8:00 AM, Philipp Koehn  wrote:

> Hi,
>
> the option to output the search graph is called "output-search-graph"
>
> See http://www.statmt.org/moses/?n=Advanced.Search for details.
>
> The source code is in $MOSES/moses-cmd and $MOSES/moses
>
> -phi
>
>
>
> On Thu, Mar 23, 2017 at 6:30 PM, Angli Liu 
> wrote:
>
>> Hi Moses community,
>>
>> In decoding, is it possible to have Moses output a confusion network (CN)
>> or a word lattice (WL), instead of the decoded text for each sentence? I'm
>> aware that one parameter of the decoder is "-inputtype", so the question is
>> what parameter of the decoder should be used to determine the output type
>> (among CN, WL and plain texts)?
>>
>> Also, where can I exactly find the decoder code (responsible for what the
>> binary "moses" does) inside https://github.com/moses-smt/mosesdecoder?
>>
>> Thanks,
>> Angli
>>
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] How to print out intermediate confusion networks / lattices?

[Philipp Koehn]

Hi,

the option to output the search graph is called "output-search-graph"

See http://www.statmt.org/moses/?n=Advanced.Search for details.

The source code is in $MOSES/moses-cmd and $MOSES/moses

-phi



On Thu, Mar 23, 2017 at 6:30 PM, Angli Liu  wrote:

> Hi Moses community,
>
> In decoding, is it possible to have Moses output a confusion network (CN)
> or a word lattice (WL), instead of the decoded text for each sentence? I'm
> aware that one parameter of the decoder is "-inputtype", so the question is
> what parameter of the decoder should be used to determine the output type
> (among CN, WL and plain texts)?
>
> Also, where can I exactly find the decoder code (responsible for what the
> binary "moses" does) inside https://github.com/moses-smt/mosesdecoder?
>
> Thanks,
> Angli
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support