Re: [Moses-support] When using moses, cpu is are not stable.

2014-01-14 Thread Tom Hoar
With a system as complex as Moses, why would you think the CPU usage would be steady? Each sentence task goes through many stages with different CPU demands which probably map to the variation in each cycle. You can also look first at your threading configuration.

Re: [Moses-support] When using moses, cpu is are not stable.

2014-01-14 Thread Hansung Cho
My server configuration are multiple CPUs 16 core and running thread 16. How do I adjust the moses running thread? I need your help... Thank you 2014/1/14 Tom Hoar tah...@precisiontranslationtools.com With a system as complex as Moses, why would you think the CPU usage would be steady?

Re: [Moses-support] How to Improve the translation

2014-01-14 Thread Hieu Hoang
The easiest way to improve translation is to find more data. The 2nd easiest way is to improve the tokenization of your languages On 11 January 2014 07:29, Asad A.Malik asad_12...@yahoo.com wrote: Hi All, I've developed Urdu to English SMT using MOSES, and it is currently giving me BLEU

[Moses-support] moses.ini config weights

2014-01-14 Thread nadeem khan
Hi all;  I want to know some details about the Moses weights that are generated after training step under moses.ini config file and also we use tuning step to improve those weights.  Where how actually these weights are being used? and how decoder take those weights while translating a input

[Moses-support] Issues when running mosesserver

2014-01-14 Thread Roee Aharoni
Hi! l built moses successfully with mosesserver (with xmlrpc option), and noticed that the mosesserver executable was created at mosesdecoder/bin. Then, I executed the mosesserver process and after a while got the error: Undefined symbol: libxmlrpc_server_abyss_set_handler3 I thought I have a

Re: [Moses-support] moses.ini config weights

2014-01-14 Thread Philipp Koehn
Hi, each possible translation of the input sentence is scored by a few different component models, such as the language model, the direct phrase translation probabiity, etc. Tuning sets weights for these component models based on how important they are to achieve good translations. Tuning is

Re: [Moses-support] When using moses, cpu is are not stable.

2014-01-14 Thread Philipp Koehn
Hi, you can try specifying more threads than the number of CPUs. I have no idea if this speeds things up or causes blockage in your setup. Just try it out and see what happens. -phi On Tue, Jan 14, 2014 at 4:31 AM, Hansung Cho gyu...@gmail.com wrote: My server configuration are multiple CPUs

Re: [Moses-support] Issues when running mosesserver

2014-01-14 Thread Philipp Koehn
Hi, could it be a problem with linked libraries? The XML library is not compiled in, so you may have to point to it: export LD_LIBRARY_PATH=/path/to/xmlrpc/lib:$LD_LIBRARY_PATH -phi On Tue, Jan 14, 2014 at 9:52 AM, Roee Aharoni roee.ahar...@gmail.com wrote: Hi! l built moses successfully

[Moses-support] C++11

2014-01-14 Thread Rico Sennrich
Hi list, I just pushed a commit that uses a C++11 feature (initalizer list). It should work with compilers that are no older than 5 years or so (gcc = 4.4). If you have trouble compiling it (because you're using an older gcc version or another compiler), please speak up. This is basically a test

Re: [Moses-support] When using moses, cpu is are not stable.

2014-01-14 Thread Tom Hoar
To change the threads, run with '-threads x' added to your command line: moses -f /path/to/moses.ini -threads 20 On 01/14/2014 11:41 PM, Philipp Koehn wrote: Hi, you can try specifying

[Moses-support] 2nd CfP: LREC 2014 Workshop on Building and Using Comparable Corpora (7th BUCC)

2014-01-14 Thread Reinhard Rapp
We apologize for multiple postings Please distribute to interested colleagues 2nd Call for Papers 7th WORKSHOP ON BUILDING AND USING COMPARABLE CORPORA Building Resources for Machine Translation Research

[Moses-support] KenLM lazy loading with new ini format

2014-01-14 Thread Marcin Junczys-Dowmunt
Hi List, how can I specify lazy loading for KenLM with the new moses.ini format? Used to be a 9. Best, Marcin ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] KenLM lazy loading with new ini format

2014-01-14 Thread Marcin Junczys-Dowmunt
Got it. KENLM ... lazyken=true/false This is sort of offensive, isn't it? :) W dniu 14.01.2014 23:07, Marcin Junczys-Dowmunt pisze: Hi List, how can I specify lazy loading for KenLM with the new moses.ini format? Used to be a 9. Best, Marcin ___

[Moses-support] Memory leak with large input files?

2014-01-14 Thread Marcin Junczys-Dowmunt
Hi, I think I have noticed some weird behaviour. If a huge input file (millions of sentences) is processed by moses on stdin, memory usage keeps growing and growing. At the beginning usage is about 2GB, after roughly 2 sentences it reaches around 8GB and it keeps growing. However, if I

Re: [Moses-support] KenLM lazy loading with new ini format

2014-01-14 Thread Kenneth Heafield
I'm too lazy to fix it :-P On Tue, Jan 14, 2014 at 5:11 PM, Marcin Junczys-Dowmunt junc...@amu.edu.pl wrote: Got it. KENLM ... lazyken=true/false This is sort of offensive, isn't it? :) W dniu 14.01.2014 23:07, Marcin Junczys-Dowmunt pisze: Hi List, how can I specify lazy loading for

Re: [Moses-support] C++11

2014-01-14 Thread Marcin Junczys-Dowmunt
Hi Rico, Revision d2d508184e35909aa5da901b81bb70f10f7794c7 breaks my compact reordering model, but at runtime and only if you do a clean build without any build artifacts from earlier compilations. It segfaults during loading in a weird low-level place. I can investigate some more if you want

Re: [Moses-support] How to Improve the translation

2014-01-14 Thread Lane Schwartz
See also: Final Report of the 2009 Summer Camp for Applied Language Exploration http://www.cs.jhu.edu/~ccb/publications/scale-2009-report.pdf On Tue, Jan 14, 2014 at 5:23 AM, Hieu Hoang hieu.ho...@ed.ac.uk wrote: The easiest way to improve translation is to find more data. The 2nd easiest way

Re: [Moses-support] How to Improve the translation

2014-01-14 Thread nadeem khan
Hi Hieu; We are not same persons, I just saw this question and then your reply about tokenization and want to know the main purpose of it in SMT and as your said good tokenization for any source language can improve the BLEU score that is why asked this question. Regards Nadeem Khan On