found the problem line, number 24795
   " [X][X] , [X] ||| [ [X][X] [X] ||| 0.000135865 0.00410465 3.36251e-05
0.0001047 ||| 0-0 1-1 ||| 18.4006 74.3493 0.25

you should escape the opening [ character on the target. tokenizer.perl and
escape-special-chars.perl will do this for you


On 22 November 2013 13:54, Fabienne Braune <[email protected]>wrote:

> Hi all,
>
> Sigtest filtering segfaults when I try to filter my rule-table. It looks
> like the line causing the crash is :
>
> [X][X] , [X][X] ! [X] ||| " [X][X] , [X][X] ! [X] ||| 0.01 0.414966 0.01
> 0.21847 ||| 0-0 1-1 2-2 3-3 4-4 ||| 0.0425902 0.0425902 0.0425902
>
> I attached a toy rule-table containing this line and on which sigtest
> crashes (test). Here is also the command line i used to lauch sigtest
> filtering :
>
> cat path-to-rule-table | mosesdecoder/contrib/sigtest-filter/filter-pt -e
> working-dir/train.en -f working-dir/train.de -l a+e -n 30 -h
>
> A strange thing is that when I create a toy table containing only a few
> entries but also the nasty line then everything runs fine. I also attached
> this file (onlycrashing).
>
> Would be great if someone could help me on this, i am out of ideas.
>
> Cheers,
> Fabienne
>
> _______________________________________________
> Moses-support mailing list
> [email protected]
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


-- 
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to