[Moses-support] statistical significance test in moses

Dear all, I need a script for testing the statistical significance using bootstrap re-sampling . I heard that there is a tool in Mmoses toolkit for this. I need some information about it and how to use it. tnx in advance, bests, -- S.Farzi, Ph.D. Student Natural Language Processing

[Moses-support] how to increase reordering diversity of n-best list generated by Moses

Dear All, I am going to increase reordering diversity of n-best list generated by Moses in order to apply my reordering model (a re-ranker system) for improving translation quality. In the first step due to low reordering diversity of the n-best list,i need that the n-best list is included

[Moses-support] extract sentences from search graph file (MOSES)

Dear all, I am trying to extract all translated sentences form output search graph file generated by option -output-search-graph-extended. i wonder if anybody give me a code or tool that do this for me? tnx in advance, -- S.Farzi, Ph.D. Student Natural Language Processing Lab, S

[Moses-support] segmentation fault and register dump

Hi when I am trying to use -lattice-sample option, Moses outputs a segmentation fault and register dump error. any body can help me to solve this problem? tnx -- S.Farzi, Ph.D. Student Natural Language Processing Lab, School of Electrical and Computer Eng., Tehran

[Moses-support] how to generate an n-best list with a larger set of reorderings

Dear all, As you know, in most cases, translations in an n-best list differ only in a few words and their word orders are basically the same. I need an n-best list which contains verity of reorderings for each input sentence. I wonder if anybody tell me how to force Moses to generate such a n-bes

[Moses-support] phrase-extraction

Dear all, I need a tool for extracting phrases of a aligned sentence pairs. tnx in advance -- S.Farzi, Ph.D. Student Natural Language Processing Lab, School of Electrical and Computer Eng., Tehran University Tel: +9821-6111-9719 __

[Moses-support] Constraint decoding

Dear all, I am trying to use constraint decoding with moses, Any body knows how do this? By the way, are there differences between constraint decoding and forced decoding? Any guidance would be highly appreciated. cheers -- S.Farzi, Ph.D. Student Natural Language Processing Lab,

[Moses-support] forced alignment

Hi members, Would u plz tell how to run forced alignment in Moses 2012? tnx -- S.Farzi, Ph.D. Student Natural Language Processing Lab, School of Electrical and Computer Eng., Tehran University Tel: +9821-6111-9719 __

[Moses-support] phrase alignment

Dear all, I have a question about finding the best phrase alignments. The alignments are used by MOSES during the decoding phrase. I have a pair parallel sentences ( a source / a target). I need the best phrase alignment between the source and target sentences. The best phrase alignment is

[Moses-support] filter parallel corpus

Dear all, I am working on a translation task with a very large parallel corpus. Because of computational cost of training such a parallel corpus, i am going to filter it regarding to the test set ( of course , by the filtering, the evaluation must be still fair). I am looking for a solution or

[Moses-support] how to make moses to generate translated candidates with different reordering

Hi members, how to make moses to generate n-best lists which contain the hypotheses with so different reordering . tnx in advance, -- S.Farzi, Ph.D. Student Natural Language Processing Lab, School of Electrical and Computer Eng., Tehran University T

[Moses-support] how to get all used phrases for translation a sentence

Hi members, i need all phrases used by moses decoder during translation, how to get it? tnx -- S.Farzi, Ph.D. Student Natural Language Processing Lab, School of Electrical and Computer Eng., Tehran University Tel: +9821-6111-9719 __

[Moses-support] help me to take a sabbatical

Dear all, I am PhD student which i have been work on hybrid machine translation (syntactical + statistical). l am looking for universities in north america especially canada for a sabbatical at next year. I wonder if any body could introduce me universities, institutions or people or help me to

[Moses-support] EMS error

Dear all, When i try to run moses example for Hierarchical phrase-based with EMS, I faced with below errors. any body can help me ? tnx saeedfarzi@ubuntuSAEED:~/nlp/ex$ /home/saeedfarzi/nlp/moses2012/scripts/ems/experiment.perl -config /home/saeedfarzi/nlp/moses2012/scripts/ems/example/config.hi

[Moses-support] hierarchical phrase-based translations with moses

Dear all, I am looking for a good document about how to train and run moses for hierarchical phrase-based translations . Of-course that the moses manual is good , but i am looking for a more straight-forward document. tnx in advance -- S.Farzi, Ph.D. Student Natural Language Proc

[Moses-support] help me to find and download IWSLT08 and NIST08 datasets

Dear members, I gonna run and test our machine translation system on the well-known datasets (IWSLT08, NIST08) . Unfortunately, I could not find them on the web. I wonder if anybody could help me to find and download. Tnx in advance -- S.Farzi, Ph.D. Student Natural Language Proc

[Moses-support] howto disable distortion model in MoSES

Dear members, I wanna add my reordering model in moses and i need disable distortion model . would you plz tell me how to do this. tnx in advance, -- S.Farzi, Ph.D. Student Natural Language Processing Lab, School of Electrical and Computer Eng., Tehran University

[Moses-support] runing moses in Code::blocks

Hi all list members, I am in trouble with compiling Moses in Code::Blocks, Can anybody help me to run it in Code::Blocks? Code::BLocks can run the Visual steduo projects under Linux but i have some linker errors when i try to compile it . the below error is a sample of several errors that i faced

[Moses-support] problem with train-model

hi There is a problem when i try to train a Persian-English parallel corpus. I am using train-model.perl to train the corpus but i face with the below errors. At the end of training process , all files in Model folder have been created with 28k byte size or 0 size. I use the last version of moses

[Moses-support] running moses (VS.2005) with a large phrase table and lm

Dear all, I am using Moses (VS.2005) with a large phrase table and a language model, but it takes very long time for loading them in to the memory. I am looking for a solution to decrease the loading time. I think , a binary version of phrase table and lm may be a solution, but i do not know if M

[Moses-support] some questions about MOses on VS

Hi all, I am working with the MOses on VS.2005, and I have some questions about the L.M. I know that the MOses under windows does not use SIRLM server. What is the Internal L.M and what are the limitations? Reading the LM is very time consuming task , any body knows that the Internal L.M can read

[Moses-support] finding Best IDE for manipulating Moses source code

Hi all, I am working on MOses source code to add new features. So I am looking for best IDE(Interface Development Environment )( Linux-version) that i can implement, compile and run my source codes easily. tnx -- S.Farzi, Ph.D. Student Natural Language Processing Lab, School of E

[Moses-support] Best IDE for manipulate

Hi all, I am working on MOses source code to add new features. So I am looking for best IDE(Interface Development Environment )( Linux-version) that i can implement, compile and run my source codes easily. tnx -- S.Farzi, Ph.D. Student Natural Language Processing Lab, School of E

Re: [Moses-support] adding new model to MOses

Thank you Marwen, I wanna add some models no just reordering model to MOses. I am looking for some documents about howto add extra models to Moses. I wonder if you could help me. tnx On 8/2/12, Marwen AZOUZI wrote: > On 08/02/2012 11:23 AM, saeed farzi wrote: >> Hi all, >> I

[Moses-support] adding new model to MOses

Hi all, I am going to add new reordering model to MOSES. Could anybody tell me how to add new model to MOSES. Tnx in advance, -- S.Farzi, Ph.D. Student Natural Language Processing Lab, School of Electrical and Computer Eng., Tehran University Tel: +98

[Moses-support] question about bleu

Hi, With help of Moses, I have built a English-Persian SMT. In comparison with Google translate, my BLEU score is less than the Google translator whereas P1, P2,P3 and P4 of my system is more than the Google translate. BP (brevity penalty) of Goolge translate is always 1 whereas my BP is .6 or .7.

[Moses-support] i need ter and analize tool

Hi all, Can anybody introduce me a tool for calculating TER, and a tool for analysizing ouput of moses. -- S.Farzi, Ph.D. Student Natural Language Processing lab, School of Electrical and Computer Eng, Tehran University Tel: +9821-6111-9719 ___

[Moses-support] i have problem with multi-bleu.perl

Guys, I have a problem with using multi-bleu.perl in MS.windows and Linux . multi-bleu.perl is a script in MOSES package that it is used for calculating BLEU score of SMT systems. using multi-bleu.perl in MS.Windows and Linux gives different BLEU points. Is there any body faced with this proble