[Moses-support] Trouble building Moses

2015-01-06 Thread Matt Munson
When I run ./bjam, Moses does not actually build but, instead, tells me that it fails essentially on every build step and then tells me that it didn't build. See attached build.log.gz file. The server I am installing this on is running Linux 3.2.0-4-amd64 (Debian). -- Matthew Munson

Re: [Moses-support] Using evaluation metrics other than BLEU in tuning

2015-01-06 Thread Christophe Servan
Hi, you can use the switch --sctype with mert (and the extractor) like this: --sctype BLEU You can also specify a combination of metrics (separated with a comma): --sctype TER,BLEU specify the weights: --sctype TER,BLEU --scconfig weights:0.6+0.4 and use it within mert-moses.pl: --mertargs=

Re: [Moses-support] Using evaluation metrics other than BLEU in tuning

2015-01-06 Thread Rajnath Patel
Thanks all for your quick response. Hi Christophe, Is it not possible to use any other metrics other than BLEU and TER, like NIST or METEOR? Please suggest. Thank you. On Tue, Jan 6, 2015 at 3:48 PM, Christophe Servan christophe.ser...@gmail.com wrote: Hi, you can use the switch --sctype

Re: [Moses-support] Using evaluation metrics other than BLEU in tuning

2015-01-06 Thread Christophe Servan
Hi, As far as I know, you can use these metrics BLEU, BLEUDOC, PER, TER, CDER, WER, METEOR. The NIST scorer is not included but you can add it to moses if you wish to. Christophe 2015-01-06 11:35 GMT+01:00 Rajnath Patel patelrajn...@gmail.com: Thanks all for your quick response. Hi

[Moses-support] Training transliteration model outside EMS

2015-01-06 Thread Rajnath Patel
Hi all, I am trying to use instructions given on moses site ( http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc5) to train a transliteration model using parallel bilingual corpus, but unable to train. Actually its not clear to me what exactly 'alignment' switch is suppose to refer? If

Re: [Moses-support] Using evaluation metrics other than BLEU in tuning

2015-01-06 Thread Rajnath Patel
Thank you! Any guideline is available to add new scorer like NIST? If not kindly suggest. On Tue, Jan 6, 2015 at 4:18 PM, Christophe Servan christophe.ser...@gmail.com wrote: Hi, As far as I know, you can use these metrics BLEU, BLEUDOC, PER, TER, CDER, WER, METEOR. The NIST scorer is not

Re: [Moses-support] Training transliteration model outside EMS

2015-01-06 Thread അനൂപ്
Hi Rajnath, This was discussed earlier in the following thread: https://www.mail-archive.com/moses-support%40mit.edu/msg10740.html Ratish compiled this document on using transliteration without EMS based on the discussion:

[Moses-support] Europarl monolingual pipeline

2015-01-06 Thread Kenneth Heafield
Dear Moses, Where does this data come from? http://www.statmt.org/wmt13/training-monolingual-europarl-v7.tgz Specifically, if I wanted non-WMT languages, then I can download Europarl from http://www.statmt.org/europarl/ . There are some tools, like a perl script to strip XML,

Re: [Moses-support] Europarl monolingual pipeline

2015-01-06 Thread Philipp Koehn
Hi, the Perl script that was used to build this corpus is: #!/usr/bin/perl -w use strict; my ($l) = @ARGV; my $data = /home/pkoehn/statmt/data/europarl-v7; my $tools = /home/pkoehn/statmt/data/europarl-v7/tools; my $preprocessor = $tools/split-sentences.perl -q; die(ERROR: no data for

Re: [Moses-support] Training transliteration model outside EMS

2015-01-06 Thread Rajnath Patel
Thank you. The shared document was very useful. Finally I was able to train the transliteration system. For English-Hindi training, I had have to comment line no 60 in ~/mosesdecoder/scripts/Transliteration/clean.pl {#$retur = deleteEnglish($lang1, $lang2, $_); }. On Tue, Jan 6, 2015 at 7:05

Re: [Moses-support] Europarl monolingual pipeline

2015-01-06 Thread Kenneth Heafield
Hi again, Sorry, never mind! We recommend using the last quarter of 2000 for testing (2000-10 until 2000-12) for consistency in reporting research results on this data. Kenneth On 01/06/15 17:20, Kenneth Heafield wrote: Hi, It seems that the WMT release is missing data. For

Re: [Moses-support] Europarl monolingual pipeline

2015-01-06 Thread Philipp Koehn
Hi, this is done on purpose - the Q4 2000 is used for test sets, so it is excluded from the parallel and monolingual training corpora. -phi On Tue, Jan 6, 2015 at 2:20 PM, Kenneth Heafield mo...@kheafield.com wrote: Hi, It seems that the WMT release is missing data. For example, why

[Moses-support] Off-topic - Internship/part-time opportunity in Toronto

2015-01-06 Thread Wei JIANG [PT-COM]
Hello Everyone, I am aware that this could considered off-topic, but just in case you or anyone you know would be interested - I am a project manager, heading a team of multilingual linguists and translators. We plan to build a p2p system, that will enable real-time collaboration on translation

Re: [Moses-support] Europarl monolingual pipeline

2015-01-06 Thread Kenneth Heafield
Hi, It seems that the WMT release is missing data. For example, why does en/ep-10-02.txt line 4 contain 21 September 2000 but this does not appear in the WMT europarl-v7.en file from the WMT site? Kenneth On 01/06/15 14:24, Philipp Koehn wrote: Hi, the Perl script that was used to

[Moses-support] Christophe Servan

2015-01-06 Thread François Brown de Colstoun
Tu le connais ? Il a un CV impressionnant. https://www.linkedin.com/pub/christophe-servan/24/752/875 F Le 06/01/2015 11:48, moses-support-requ...@mit.edu a crit:

Re: [Moses-support] Trouble building Moses

2015-01-06 Thread Hieu Hoang
it seems like there's an issue with 1 of the boost header file. do you know what boost version you have? On 06/01/15 15:14, Matt Munson wrote: When I run ./bjam, Moses does not actually build but, instead, tells me that it fails essentially on every build step and then tells me that it didn't

Re: [Moses-support] ERROR: Lexical reordering scoring failed

2015-01-06 Thread Philipp Koehn
Hi, you are building a hierarchical phrase-based model, so you cannot have a lexicalized reordering model. Remove -reordering msd-bidirectional-fe from your command line. -phi On Mon, Jan 5, 2015 at 12:51 AM, Jon Olds joft...@yahoo.co.uk wrote: Hi, I’m trying to build a hierarchical model