Re: [Moses-support] Generating Segment Level BLEU, NIST and METEOR scores

2015-09-04 Thread Cristina
Hi Liling, Asiya generates the segment scores for any metric it has as part of the analysis: http://nlp.lsi.upc.edu/asiya/ Best, Cristina 2015-09-02 21:47 GMT+02:00 liling tan : > Dear Moses devs/users, > > Is there any script in moses or other MT libraries that can

Re: [Moses-support] [Moses-developers] Generation models with Mmsapt

2015-09-04 Thread Hieu Hoang
ok. I'm still getting segfault in Lex Reordering during loading. If you can provide the ro text file so I can binarize it myself, I can debug it. But not a priority, I can park the issue for another time Hieu Hoang Researcher New York University, Abu Dhabi http://www.hoang.co.uk/hieu On 4

Re: [Moses-support] Generating Segment Level BLEU, NIST and METEOR scores

2015-09-04 Thread Graham Neubig
Hi Liling, All, mt-eval allows for sentence-level calculation of BLEU, NIST, RIBES, and WER: https://github.com/odashi/mteval It doesn't handle METEOR (which is likely too complicated to be properly implemented independently of the main branch), but for the others it's a pretty convenient

Re: [Moses-support] Decoding Speed perfomance - suggestion and question

2015-09-04 Thread Vincent Nguyen
Phrase-table size in GB (.gz) 0.0001 => 18.6 GB => BLEU 29.59 0.001 => 16.4 GB => BLEU 29.67 0.01 => 13.5 GB => BLEU 29.38 I have not been able to test the speed yet because my reference with the first one is in Compact mode and it takes for ever to binarize the 2 others .. Given these

Re: [Moses-support] [Moses-developers] Generation models with Mmsapt

2015-09-04 Thread Michael Denkowski
I added non-binarized versions of all the model files including reordering to the tarball: https://drive.google.com/file/d/0B6trVKD0-obBdEV0dFg5RkN4Yjg/view?usp=sharing . Best, Michael On Fri, Sep 4, 2015 at 7:10 AM, Hieu Hoang wrote: > ok. I'm still getting segfault in