[Moses-support] Truecaser question

2016-09-13 Thread Tomasz Gawryl
Hi guys, I would like to ask you how can I improve Truecaser models. For example this is source sentence: "Delineating Supply Chain and Logistics as a set of standard occupational codes would serve to more appropriately spotlight the workforce needed in this industry." And there is

[Moses-support] Crushed tuning neural model

2016-08-05 Thread Tomasz Gawryl
Hi, I have strange problem while tuning neural model. Tuning crashes with following error: LOG: EXECUTE STEPS number of steps doable or running: 1 at piÄ…, 5 sie 2016, 09:50:58 CEST doable: TUNING:tune executing

[Moses-support] error when building moses with nplm

2016-07-20 Thread Tomasz Gawryl
Hi, I'm trying to compile mosesdecoder with NPLM with INTEL MKL but without success. I did some searches in Google and found similar request but unanswered: http://comments.gmane.org/gmane.comp.nlp.moses.user/11985 I compiled and installed NPLM and MLK without problems. Here is my

[Moses-support] EMS: pruning question

2016-06-28 Thread Tomasz Gawryl
Hi! I have one question about pruning translation table during EMS training. What method is better SALM or based on low scores (described here: http://www.statmt.org/moses/?n=Advanced.RuleTables#ntoc5) ? SALM filtering takes relatively more time than pruning while LM creation. But I'm not

[Moses-support] Tuning crashed

2016-06-08 Thread Tomasz Gawryl
Hi, I have a problem with tuning crashed. It seems that moses.ini is missing in temporary folder but I have no idea why. I attached link to my config file. Please help. Regards Thomas moses@smtserver:~/working/experiments/NGRAM5/steps/2$ more TUNING_tune.2.STDERR Using

[Moses-support] DEBUG_LEVEL:1 Error: lower order count-of-counts cannot be estimated properly

2016-05-20 Thread Tomasz Gawryl
Hi, I'm trying to build 10 ngram's model but my training pipeline ends with error: "Error: lower order count-of-counts cannot be estimated properly". Corpus has 33 mln sentences. I successfully trained much smaller corpus (around 5 mln sentences) using the same config file. Would you suggest me

Re: [Moses-support] Moses-support Digest, Vol 115, Issue 8

2016-05-06 Thread Tomasz Gawryl
Hi, Please forget my post. I found where was the problem. I tried to use advanced version of xmrpc-c (should use stable release). Regards, Tomek Date: Fri, 6 May 2016 15:42:08 +0200 From: "Tomasz Gawryl" <tomasz.gaw...@skrivanek.pl> Subject: [Moses-support] Failed mosesdec

[Moses-support] Failed mosesdecoder compilation with xmlrpc

2016-05-06 Thread Tomasz Gawryl
Hi, I'm trying to compile mosesdecoder with xml-rpc support for mosesserver but without success. I downloaded and installed this library in custom directory and use this command to run compilation process: ./bjam --prefix=/home/moses/src/mosesdecoder -q

[Moses-support] Moses, python_server, matecat_utils, MateCAT - Moses-support Digest, Vol 109, Issue 19

2015-12-09 Thread Tomasz Gawryl
disconnected from its core logic. >> >> Best, >> >> Panos >> >> >> On 12/11/2015 4:02 ??, Barry Haddow wrote: >> > Hi Tomasz >> > >> > The moseserver is just the decoder, so it doesn't do any of the >> > pre- and p

Re: [Moses-support] Moses-support Digest, Vol 109, Issue 19

2015-11-12 Thread Tomasz Gawryl
Hi Ulrich, I have a question about Moses server too. I'm testing it as a wrapper for Across server to check pre-translation possibilities. It generally works but there is one problem. Input segments are translated without tokenization, so every word close to special character (for example `this

[Moses-support] factored tuning time

2015-10-22 Thread Tomasz Gawryl
Hi, I've one question to you about time of factored tuning. How many times longer it takes compared to phrase based tuning? I'm asking because it's 7'th day and it's still tuning (3,3 mln corpus sentences). Phrase based tuning took around 3h for the same corpus. Top shows me that moses uses

Re: [Moses-support] error during tuning step (factored training)

2015-10-12 Thread Tomasz Gawryl
/moses/working/experiments/FACTORED/model/moses.ini.1 /home/moses/working/experiments/FACTORED/model/moses.bin.ini.1 -B inarizer "/home/moses/src/mosesdecoder/bin/CreateOnDiskPt 1 1 4 100 2" -- whats the exact command you used to binarize the phrase-table? On 11/10/2015 17:

[Moses-support] error during tuning step (factored training)

2015-10-11 Thread Tomasz Gawryl
Hi, My factored training ends core dumped during tuning step.: /home/moses/working/experiments/FACTORED/lm/ACROSS=pos.lm.1: line 11: warning: n on-zero probability for in closed-vocabulary LM terminate called after throwing an instance of 'util::Exception' what():

Re: [Moses-support] experiment.perl, processPhraseTableMin and threads option

2015-09-23 Thread Tomasz Gawryl
Hi Philipp, Shame on me, you are right. Thanx for help! Regards, TG From: phko...@gmail.com [mailto:phko...@gmail.com] On Behalf Of Philipp Koehn Sent: Wednesday, September 23, 2015 3:30 PM To: Tomasz Gawryl Cc: moses-support@mit.edu Subject: Re: [Moses-support] experiment.perl

[Moses-support] experiment.perl, processPhraseTableMin and threads option

2015-09-22 Thread Tomasz Gawryl
Hi, I'm trying to add this line to config: ttable-binarizer = "$moses-bin-dir/processPhraseTableMin -threads all" This option is supported by processPhraseTableMin command(https://github.com/moses-smt/mosesdecoder/blob/master/misc/processPh raseTableMin.cpp line 24).

[Moses-support] BLEU score

2015-09-07 Thread Tomasz Gawryl
Hi All! This is my first post here and AT first I want to apologize for my English but I would like to ask you some questions. I finished a full phrase based Moses training of EN-PL (English - Polish) corpus (few million sentences from free sources + half million sentences from commercial tmx).