[Moses-support] Do we gave detokenizer for German?

2017-06-01 Thread dai xin
Hi MT experts, I tokenized German corpus using ~/mosesdecoder/scripts/tokenizer/tokenizer.perl -l de Do we have corresponding detokenizer for German as well? It would be great if you can suggest some tools to do the detokenization for German. Thanks in advance and hoping for reply. Best regar

[Moses-support] How to compile RDLM

2017-04-25 Thread dai xin
Hi all, I did a training with RD and NP language model. When I tried to decode with ~/mosesdecoder/bin/moses -f /path/to/moses.ini the error message came out: Feature name RDLM is not registered. It is somehow strange because I assume that the RDLM is compiled by defaut, or am I wrong and how

[Moses-support] Did anyone tried Edinburgh English-German syntax system for WMT 2015?

2017-04-20 Thread dai xin
Hi, Did anyone have experience of Edinburgh English-German syntax system for WMT 2015 ? The scripts, configs and data can be accessed in https://github.com/rsennrich/wmt2014-scripts . I am doing experiments using the configs described there. But after trying for many times(using both toy-data an

[Moses-support] Questions about EMS filter step in tuning

2017-04-13 Thread dai xin
Hi, I am trying to do experiments in EMS. Every time it crashes in filter. What is filter doing? Can we skip this step? Thanks in advance and hoping for reply Best regards Xin ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu

[Moses-support] error when tuning

2017-04-13 Thread dai xin
Dear Moses experts, I got an error when I am doing tuning. It is from the extractor.sh. It shows Binary write mode is not selected. Anyone has some ideas about that? Thanks in advance and hoping for reply. Best regards Xin extract.err Description: Binary data extractor.sh Description: Bour

[Moses-support] tuning error

2017-04-11 Thread dai xin
Dear experts, when I use EMS to do my experiments, it crashed at tuning/extract. The error massage is in the attachment. Anyone has any ideas about the possible reason why this happen? Thanks in advance for helping. Hoping for some reply. Best regards. Xin extract.err Description: Binary da

[Moses-support] Question about Moses server

2016-08-22 Thread dai xin
Hi all, I am now using Moses server to do pre-translation on Across server. The problem is using Moses server, the segments are translated without tokenization and truecasing. There are huge difference between translating segments with and without tokenization and truecasing. For example, in my

[Moses-support] POS-tag Language Model

2016-06-13 Thread dai xin
Hi, I am trying to do factored training namely with POS tags. I followed instructions of 'Train a model with POS tags' on http://www.statmt.org/moses/?n=Moses.FactoredTutorial#ntoc2 . The data used in the instruction contains a pos.lm which is the Language Model of POS-tag. Dose anyone know how t

[Moses-support] Incremental training using Mgiza

2016-04-04 Thread dai xin
Hi all, I am using Mgiza to do incremental training from EN to DE. I followed the instruction in www.kyloo.net/software/doku.php/mgiza:forcealignment. I stuck at running the Model 4 alignment. In the instruction, the command is ./mgiza giza.en-ch/en-ch.gizacfg -c en-ch.snt -o output/en-ch -s ch.p

[Moses-support] Is there any way to do continues training ?

2016-03-21 Thread dai xin
Hi, is there anyone has experience on doing continues training on Moses? I am now developing a machine translation system in my company based on Moses. For now, I have done model training on company's corpus and used the model to do translation. We have more continues strings which can be used to