Hi Kunal,
I would suggest you not to edit phrase table, rather clean your
training corpus and retrain the system. If you edit phrases then it may
lead to inconsistent probability score and alignment in the phrase table.
On Mon, Mar 10, 2014 at 4:05 PM, Marcin Junczys-Dowmunt
<junc...@amu.edu.pl>wrote:
> Hi Kunal,
> I am not sure this is causing the segfault, but take a look at the
> alignment. You are removing tokens from the source phrase, before 5, now 3,
> but you leave the alignment untouched which still maps 5 to 5 tokens. You
> would either need to shift and remove the alignment points or get rid of
> the alignment altogether.
> Best,
> Marcin
>
> W dniu 10.03.2014 16:01, Kunal Sachdeva pisze:
>
> Hello all,
> i tried to clean my phrase table my removing some characters from
> phrases, like
>
> ' ' ' ' comments Remain Rolland ||| - - रोम्यां रोलां ने ||| 0.112086
> 2.80203e-05 0.0373621 8.65407e-07 2.718 0.030868 ||| 0-1 0-2 1-2 2-2 4-2
> 3-3 4-3 4-4 ||| 1 3 1
>
> changed to ====>
>
> comments Remain Rolland ||| - - रोम्यां रोलां ने ||| 0.112086 2.80203e-05
> 0.0373621 8.65407e-07 2.718 0.030868 ||| 0-1 0-2 1-2 2-2 4-2 3-3 4-3 4-4
> ||| 1 3 1
>
> so when now i am try to decode a sentence, i get an eroor
>
> Reading /home/seecat/WMT/eng-hin/WMT_new/model/temp1.gz
>
> ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
> *******Segmentation fault (core dumped)
>
> this error doesn't come always, when i try to use it with -v(verbose)
> option.
>
> It will be great, if someone could help me.
>
> Regards,
> Kunal Sachdeva
>
>
> _______________________________________________
> Moses-support mailing
> listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
--
-Regards,
Rajen Chatterjee.
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
