Re: [Moses-support] probingPT with lexicalized reordering and moses2

lexicalized reordering: How do I specify the path to the binarized model in the moses2 config file? Thanks! Jörg ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://moses

Re: [Moses-support] MERT: process n-best list before mert

sounds good. You're always welcome to check it in yourself as long as you look after it. Send me your github username or create a git pull request * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 22 April 2017 at 15:44, Jorg Tiedemann <tiede...@gmail.com>

Re: [Moses-support] Deprecated perl construct

not really sure how to fix it. How about changing defined @{$DOC{$system}{$doc}} to @{$DOC{$system}{$doc}} ? I think my perl (v. 5.24.1 on OSX) suggest that but I'm not sure how to test it as I don't have an experiment set up at the moment * Looking for MT/NLP opportunities * Hieu Hoang

Re: [Moses-support] "-ttable-limit"

for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 15 April 2017 at 11:04, Gary <garyhess...@hotmail.com> wrote: > Hi -- > > > I am getting started with Moses and working through the Moses phrased > based tutorial (http://www.statmt.org/moses/?n=Moses.Tutorial). There i

Re: [Moses-support] Tuning for PT2?

separate reordering model. However, I don't think it would make any difference * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 15 April 2017 at 18:08, Mike Ladwig <mdlad...@gmail.com> wrote: > The moses2 phrase/reordering datastructure created with mosesde

Re: [Moses-support] probingPT with lexical reordering

This tells you a bit more about it: http://www.statmt.org/moses/?n=Site.Moses2#ntoc10 Or look inside the script scripts/generic/binarize4moses2.perl * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 16 April 2017 at 10:28, Jorg Tiedemann <tiede...@gmail.com>

Re: [Moses-support] Tuning for PT2?

Whats pt2? On 15 Apr 2017 1:22 p.m., "Mike Ladwig" wrote: > I've been looking, without success, for any experiences tuning PT2 with > the various controls (num-lex-scores, prune, num-scores, etc.) > > Can anyone share size-speed-quality experiences or suggest good starting >

Re: [Moses-support] Corrupted best100 output when tuning

It looks like there is a phrase that is length 0, hence ' = 1'. Check your data has been cleaned and encoded correctly * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 12 April 2017 at 13:36, Dingyuan Wang <abcdoyle...@gmail.com> wrote: > Dear all, > >

Re: [Moses-support] tuning error

quite difficult to say. It may be that the tuning set is incorrect, eg there isn't the same number of sentences in the source and target language. Check your tuning set * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 11 April 2017 at 14:53, dai xin <wing

Re: [Moses-support] Adding new aligned phrases to the existing phrase table

weights to the [weight] section [weight] PhraseDictionaryMemory0= 0 0 1 0 PhraseDictionaryMemory1= 0 0 1 0 You don't need to use PhraseDictionaryGroup * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 9 April 2017 at 05:21, sriram <sriramchaudh...@gmail.com>

Re: [Moses-support] Moses vs Moses2 in its multi-threading

-table (compact pt for Moses, probing pt for Moses2). I've never tested your setup until now, and you've never tested mine so we're talking at cross purposes. I will add my recent results to the website to make it more complete * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org

Re: [Moses-support] Adding new aligned phrases to the existing phrase table

it, in addition to the existing phrase-table * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 6 April 2017 at 19:14, sriram <sriramchaudh...@gmail.com> wrote: > Hi, > > I have some good aligned phrases collection and I want to add to the > exi

Re: [Moses-support] inconsistent number of probabilities

for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 6 April 2017 at 11:30, Alexander Erdmann <ae1...@nyu.edu> wrote: > For reference, here is the output from the segFault: > > Defined parameters (per moses.ini or switch): > config: /scratch/ae1541/EMNLP/seed

Re: [Moses-support] Moses vs Moses2 in its multi-threading

use the decoder's debugging timing output. If you can share your models, we might be able to find out the reason for the difference in our results. I can provide you with ssh/scp access to my server if you need to. * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 4 April

Re: [Moses-support] Moses vs Moses2 in its multi-threading

. Ie. don't use log, don't use decoding time. * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 16 March 2017 at 15:51, Ivan Zapreev <ivan.zapr...@gmail.com> wrote: > Awesome! Thanks, we will keep in touch. > > On Mar 16, 2017 16:49, "Hieu Hoang&q

Re: [Moses-support] Repeating Non-terminals and Alignment

it in there because the codebase is smaller, newer and easier to read. I'm not sure exactly how you'll do it but the starting point would be moses2/SCFG/Manager.cpp function Decode() and drill down from there * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 29 March

Re: [Moses-support] Error in mteval-v13a.pl

If you find that {Line_Break:Hyphen} works, please consider checking it in. These compatibility issues are difficult to debug alone and depends on the exact perl/OS version you're running. Your fix will add a little to the body of knowledge * Looking for MT/NLP opportunities * Hieu Hoang http

[Moses-support] Fwd: Moses-support post from isabella...@gmail.com requires approval

it into dropbox and sharing the link so others can replicate it too https://www.dropbox.com/s/pn5mu04l1za70y1/example_mosesserver.zip?dl=0 * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ -- Forwarded message -- From: <moses-support-ow...@mit.edu> Da

Re: [Moses-support] Help with some moses features

Hi Maria * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 21 March 2017 at 14:23, Maria Braga <ma...@unbabel.com> wrote: > Hi Hieu, > > I am Maria and work at Unbabel. We've met in Prague at the MT Marathon > last year. > > I am currently working

Re: [Moses-support] Moses compiling error with boost 1.55

for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 17 March 2017 at 14:13, Gongbo Tang <gongbo.t...@lingfil.uu.se> wrote: > Hi, > > I encountered an error when I was running the command: > > bjam -j4 --with-giza=/the-dir-of-giza-pp --with-irstlm=opt/irstlm-5

Re: [Moses-support] Moses vs Moses2 in its multi-threading

* Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 16 March 2017 at 15:23, Ivan Zapreev <ivan.zapr...@gmail.com> wrote: > Dear Hieu, > > Thank you for you time and the clear answers. > > >>> ok, if you are using plain text models, then this

Re: [Moses-support] Moses vs Moses2 in its multi-threading

* Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 16 March 2017 at 14:51, Ivan Zapreev <ivan.zapr...@gmail.com> wrote: > Dear Hieu, > > Well, whether it is 20 or 40 cores is irrelevant as the trend on up to 20 > threads still contradicts the data prov

Re: [Moses-support] Moses vs Moses2 in its multi-threading

* Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 16 March 2017 at 13:16, Ivan Zapreev <ivan.zapr...@gmail.com> wrote: > Dear Hieu, > > Thank you for a prompt and detailed reply! > > >>> So your server has 20 cores (40 hyperthreads) and

Re: [Moses-support] Moses vs Moses2 in its multi-threading

* Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 16 March 2017 at 12:25, Ivan Zapreev <ivan.zapr...@gmail.com> wrote: > Dear All, > > I have a question and perhaps want to draw your attention to the following > fact. The Moses2 webpage http://www.s

Re: [Moses-support] Moses vs Moses2 in its multithreading

lowing > link: > > https://github.com/ivan-zapreev/Basic-Translation-Infrastructure#translation-server-evaluation > > Thank you in advance! > > Kind regards, > > Ivan > -- Hieu Hoang http://moses-smt.org/ ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Please help me to setup moses!

tng...@ictu.edu.vn>_ ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://moses-smt.org/ ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] problem with tuning set stalling

it doesnt seem to be any errors * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 13 March 2017 at 04:56, Alexander Erdmann <ae1...@nyu.edu> wrote: > Hi, > > I'm trying to do pivot translation between Arabic dialects via English. > The Egyptian to E

Re: [Moses-support] Please Help Me !

Hi Anh * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 12 March 2017 at 23:44, Tran Anh <anhuni1...@gmail.com> wrote: > I have done experiments with Factored model. The tuning and testing is > done with source text annotated with the same facto

Re: [Moses-support] Exception: std::bad_alloc on Testing step

2GB is far too small. You probably need 4-8GB minimum * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 12 March 2017 at 18:28, Sơn Nguyễn Văn <bnvan...@gmail.com> wrote: > Hello, > > I installed Moses using Virtual machine ubuntu 14.04 32-b

Re: [Moses-support] mosesserver output empty string for hie models

SALM will compile. It's just old and the Makefile is creaky * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 9 March 2017 at 12:30, Guchun Zhang <gzh...@alphacrc.com> wrote: > Hi Hieu, > > It works now. I didn't manage to make binarize4moses2.perl wo

Re: [Moses-support] mosesserver output empty string for hie models

My hie models are binarised. Should I skip binarisation for such models > from now on? > > Thanks, > Guchun > > On 8 March 2017 at 14:02, Hieu Hoang <hieuho...@gmail.com> wrote: > >> git pull and try again. I've just pushed a fix >>https://github.com/moses-sm

Re: [Moses-support] mosesserver output empty string for hie models

git pull and try again. I've just pushed a fix https://github.com/moses-smt/mosesdecoder/commit/ac3069fb32d87c57ac84d5bac3d07328b5ab71dd * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 8 March 2017 at 12:48, Guchun Zhang <gzh...@alphacrc.com> wrote: > S

Re: [Moses-support] mosesserver output empty string for hie models

what's the exact bjam command you used, and can I please have a look at the compile error * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 8 March 2017 at 11:48, Guchun Zhang <gzh...@alphacrc.com> wrote: > Have to say ​I can't disagree with that.​ > &g

Re: [Moses-support] mosesserver output empty string for hie models

I guess the cost/benefit ratio isn't high enough for commercial users using the server, but you can probably answer that better. Hopefully the faster Moses2 implementation can improve that. If it doesn't compile, please let me know * Looking for MT/NLP opportunities * Hieu Hoang http://moses

Re: [Moses-support] mosesserver output empty string for hie models

code is also much simplier * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 7 March 2017 at 17:46, Guchun Zhang <gzh...@alphacrc.com> wrote: > Hi, > > I pull the repo recently and just noticed that mosesserver outputs empty > strings for hie models. Th

Re: [Moses-support] New compile problems on RHEL 7

ions will make it succeed. http://www.statmt.org/moses/?n=Development.GetStarted I've seen that for some time but never been able to find out why. Also passes regression tests, other than some rounding errors. * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 1 March 2017 at 1

Re: [Moses-support] New compile problems on RHEL 7

4.8.5 20150623 (Red Hat 4.8.5-11) (GCC) ) #1 SMP Wed Oct 19 11:24:13 EDT 2016 compile command: ./bjam -j10 --with-xmlrpc-c=/home/hieu/workspace/xmlrpc-c-1.39.12 --with-cmph=/home/hieu/workspace/cmph-2.0 --with-irstlm=/home/hieu/ workspace/irstlm-5.80.08/trunk Hieu Hoang http://moses-smt.org

Re: [Moses-support] Error Installing Moses

e is some easy way to set > this up. -- Hieu Hoang http://moses-smt.org/ ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Access to Key-Value Pairs in Phrase Table?

Hiya Hieu Hoang http://moses-smt.org/ On 25 February 2017 at 23:22, Shuoyang Ding <mtsd...@gmail.com> wrote: > Hi All, > > In http://www.statmt.org/moses/?n=FactoredTraining.ScorePhrases, it was > mentioned that there is a key-value pair field at the end of each entry of >

Re: [Moses-support] feature function referring headers in phrase-extract?

apologies, ken pointed out why there are multiple definitions. You should be aware of that Hieu Hoang http://moses-smt.org/ On 22 February 2017 at 17:11, Hieu Hoang <hieuho...@gmail.com> wrote: > too complicated imo. Copy what u need into moses/ so you know exactly what > the

Re: [Moses-support] feature function referring headers in phrase-extract?

too complicated imo. Copy what u need into moses/ so you know exactly what the dependencies are. Do what Ken suggested later when it's working Hieu Hoang http://moses-smt.org/ On 22 February 2017 at 17:10, Kenneth Heafield <mo...@kheafield.com> wrote: > Hi, > > phrase-

Re: [Moses-support] Output files of mgiza

://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://moses-smt.org/ ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] (no subject)

-- ...education is door of one's life... ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://moses-smt.org/ ___ Moses-suppo

Re: [Moses-support] Factors Vs OOV counts in Factor based experiments

list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://moses-smt.org/ ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Sought Help in resolving tuning error using mert-moses.pl command

your question - yes, you must run tuning after you create the moses.ini file in the model folder. The decoder failed to run. This could be because it hasn't compiled successfully, or you've mispelt the folder where it's supposed to be Hieu Hoang http://moses-smt.org/ On 3 February 2017 at 13:11

Re: [Moses-support] BLEU score decoding word lattice

yes, the phrase-based decoder supports lattice decoding http://www.statmt.org/moses/?n=Moses.WordLattices Hieu Hoang http://moses-smt.org/ On 1 February 2017 at 23:10, Angli Liu <ang...@cs.washington.edu> wrote: > Hi all, > > Is there a way to do lattice decoding with BLE

Re: [Moses-support] How to compile moses with -fPIC

which debian do you use? Will try and replicate your issue in a VM Hieu Hoang http://moses-smt.org/ On 1 February 2017 at 11:26, Hieu Hoang <hieuho...@gmail.com> wrote: > in the Jamroot file, you can add > > requirements += -fPIC ; > > > Hieu Hoang > http://moses-smt.

Re: [Moses-support] How to compile moses with -fPIC

in the Jamroot file, you can add requirements += -fPIC ; Hieu Hoang http://moses-smt.org/ On 1 February 2017 at 09:27, Dingyuan Wang <abcdoyle...@gmail.com> wrote: > Dear all, > > I would like to compile moses on Debian testing, but there is some > linking problem requir

Re: [Moses-support] Generating the N-best list translations through a baseline system

anslations in target language. Would you please let me know, the exact related script (command) to generate the N-best list translation in the baseline system? I appreciate in advance. Yours Truly, Ben -- Hieu Hoang http://moses-smt.org/ ___ Mos

Re: [Moses-support] fixes to stable release 3 for c++11

i've turned on c++14 in the Jamefile in branch RELEASE-3.0-cpp14 and fixed all the compile errors. I can't verify if fixes introduced any bugs, a few tests failed when using the current regression tests Hieu Hoang http://moses-smt.org/ On 28 January 2017 at 23:20, Hieu Hoang <hie

Re: [Moses-support] fixes to stable release 3 for c++11

hiya Panos I've created a fork of the RELEASE-3.0 branch on github, called RELEASE-3.0-cpp14 If you have the fixes, please check it into there. I can fix it if you give me access to an ArchLinux server or make a VM available, I don't know how to set it up Hieu Hoang http://moses-smt.org

Re: [Moses-support] Feature name PhraseDictionaryCompact is not registered

ature > SyntaxInputWeight SyntaxRHS TargetBigramFeature > TargetConstituentAdjacencyFeature TargetNgramFeature > TargetPreferencesFeature TargetWordInsertionFeature TreeStructureFeature > UnalignedWordCountFeature UnknownWordPenalty WordPenalty > WordTranslationFeature > > Best, &g

Re: [Moses-support] Feature name PhraseDictionaryCompact is not registered

what is the EXACT command you used to run the decoder? Can you please attach your moses.ini file so I can check it. Hieu Hoang http://moses-smt.org/ On 21 January 2017 at 23:00, Hongzheng Li <lihongzheng1...@gmail.com> wrote: > Hi there: > > I'm testing the moses following t

Re: [Moses-support] Error while installing moses

got the error "Build Failed" Also sharing the error logs ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://mos

[Moses-support] c++11

Moses Hieu Hoang http://moses-smt.org/ ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Moses compile failing

oops, not sure what happened there. I just fixed it https://github.com/moses-smt/mosesdecoder/commit/4d13377ce8a42eff71fd1ad57915198d1f681fbc please git pull Hieu Hoang http://moses-smt.org/ On 7 January 2017 at 20:27, Vandan Phadke <one.donero...@gmail.com> wrote: > Hello, > >

Re: [Moses-support] Moses-support post from ankit21.lnm...@gmail.com requires approval

Dunno. It may be that the server-client communication has to be changed so that multiple sentences are handled at the same time. still up for discussion, nothing done about it yet Hieu Hoang http://moses-smt.org/ On 4 January 2017 at 11:28, Ankit Gupta <ankit21.lnm...@gmail.com>

Re: [Moses-support] Moses-support post from ankit21.lnm...@gmail.com requires approval

ent was giving decoding result then only second client machine starts decoding. Can you help me with this problem that why is it not using all core if I am hitting from different clients at the same time. Thanks. On Mon, Jan 2, 2017 at 6:25 PM, Hieu Hoang <hieuho...@gmail.com <mailto:hieuho...@

Re: [Moses-support] Moses-support Digest, Vol 122, Issue 38

there's some gunk in the training data eg. non-printing characters, trailing/prefix spaces, double spaces/tabs, non-utf8. You'll find out as soon as you look at the sentences it refers to Hieu Hoang http://moses-smt.org/ On 30 December 2016 at 16:25, Mike Ladwig <mdlad...@gmail.com>

Re: [Moses-support] Moses-support Digest, Vol 122, Issue 38

ah thanks. I think it's a bug for that edge case - wall at the end of the sentence. Fixed it https://github.com/moses-smt/mosesdecoder/commit/c30b28f43b902e48e399ab5cf6c60f6f62c1fb50 A wall at the end of the sentence shouldn't have any effect right? Hieu Hoang http://moses-smt.org/ On 28

Re: [Moses-support] Newbie questions

If you are new to MT and Moses, please make sure you have read the website and done the tutorials before asking too many questions: http://www.statmt.org/moses/ Hieu Hoang http://moses-smt.org/ <http://www.hoang.co.uk/hieu> On 27 December 2016 at 20:23, Ri ki <mariasm...@gmail.c

Re: [Moses-support] Moses-support Digest, Vol 122, Issue 38

glad to hear it! Hieu Hoang http://moses-smt.org/ <http://www.hoang.co.uk/hieu> On 28 December 2016 at 04:11, Mike Ladwig <mdlad...@gmail.com> wrote: > Wanted to let everyone know I've gotten past my issues. The 2.x moses > didn't mind sentences ending in , but 3.x disapproves

Re: [Moses-support] Moses2 questions

Hiya Can you provide a model, inputs, and your client code so I can reproduce the issues. Hieu Sent while bumping into things On 26 Dec 2016 20:29, "Mike Ladwig" wrote: Hello. I was experimenting a bit with moses2 as a replacement for mosesserver and have a couple of

Re: [Moses-support] Some question about adding features to Moses

On 22/12/2016 05:26, WULongski wrote: Hi, I have two questions: 1、 After reading the adding feature section of the Moses(http://www.statmt.org/moses/?n=Moses.FeatureFunctions), it says "However, new features are usually more complicated. For instance, it requires reading in a file and

Re: [Moses-support] issue while Training Translation Model

the error displayed is: malformed XML you must escape your data (training, tuning, test). If you tokenize with the moses tokenizer, then escaping is done for you. If you use your own tokenizer, then use the moses script: scripts/tokenizer/escape-special-chars.perl ps. keep the size of

Re: [Moses-support] Conversion of phrase model to PhraseDictionaryCompact

there is no limit to the number of words. if you are using the premade models, make sure you are using tuned moses.ini file in tuning/moses.tuned.ini.? Hieu Hoang http://www.hoang.co.uk/hieu On 13 December 2016 at 09:32, Shubham Khandelwal <skhlnm...@gmail.com> wrote: > Thanks

Re: [Moses-support] SegFault using XML Markup

that's the only thing I can think of. It may be that XML doesn't support multiple factors. If you have model files for me to download and replicate the problem, I can let you know for sure Hieu Hoang http://www.hoang.co.uk/hieu On 15 December 2016 at 10:19, Ryan ADLER <ryan.ad...@unodc.

Re: [Moses-support] SegFault using XML Markup

your output has 2 factors so the phrases in the xml should have 2 factors eg 'def' Hieu Hoang http://www.hoang.co.uk/hieu On 15 December 2016 at 07:28, Ryan ADLER <ryan.ad...@unodc.org> wrote: > Dear Hieu, > > Thank you for your reply. Attached, please find the requested &g

Re: [Moses-support] SegFault using XML Markup

can you attach the moses.ini file you use and the exact command you ran Hieu Hoang http://www.hoang.co.uk/hieu On 14 December 2016 at 14:19, Ryan ADLER <ryan.ad...@unodc.org> wrote: > Hi, > > When submitting text with XML markup like: > Some def stuff. > > I am gettin

Re: [Moses-support] Conversion of phrase model to PhraseDictionaryCompact

side word + pos factors 5. Like (2) but using batch-mira to tune 6. Like (2) but using PRO to tune 7. Like (2) but using CreateOnDiskPt to create binary phrase table You can see the BLEU scores in evaluation/report.* Hieu Hoang http://www.hoang.co.uk/hieu On 12 December 2016 at 13:28, Shubham

Re: [Moses-support] Conversion of phrase model to PhraseDictionaryCompact

Hieu Hoang http://www.hoang.co.uk/hieu On 10 December 2016 at 14:06, Shubham Khandelwal <skhlnm...@gmail.com> wrote: > Yes, CreateOnDiskPt command executed without any error. > > There are 5 files in this phrase-table.3.folder: Misc.dat , Source.dat, > TargetColl.dat, Target

Re: [Moses-support] Conversion of phrase model to PhraseDictionaryCompact

strange, did the CreateOnDiskPt command execute ok, ie. with no error? Does this file exist: /home/shubham/models/fr-en/phrase-table.3.folder/Misc.dat If you do cat Misc.dat what does it say? Hieu Hoang http://www.hoang.co.uk/hieu On 10 December 2016 at 11:30, Shubham Khandelwal <skh

Re: [Moses-support] Conversion of phrase model to PhraseDictionaryCompact

This is a hierarchical model. You must binarize with CreateOnDiskPt for this model Hieu Hoang http://www.hoang.co.uk/hieu On 9 December 2016 at 08:18, Shubham Khandelwal <skhlnm...@gmail.com> wrote: > Hello, > > Thanks. It worked now. I have created compact phrase table. &

Re: [Moses-support] Conversion of phrase model to PhraseDictionaryCompact

pre-made models as this will take less space and also it will be very fast during decoding. Thanks. On Fri, Dec 9, 2016 at 12:50 AM, Hieu Hoang <hieuho...@gmail.com <mailto:hieuho...@gmail.com>> wrote: the previous email you referred to says that the directory /bin

Re: [Moses-support] Conversion of phrase model to PhraseDictionaryCompact

* *The previous email exchange also says you should try to add the argument* * -T .* Hieu Hoang http://www.hoang.co.uk/hieu On 8 December 2016 at 15:52, Shubham Khandelwal <skhlnm...@gmail.com> wrote: > Hello, > > This is just the reminder of my previous email. > > Than

Re: [Moses-support] Regarding Decoding Time

have a look at this page http://www.statmt.org/moses/?n=Moses.Optimize Hieu Hoang http://www.hoang.co.uk/hieu On 5 December 2016 at 14:15, Shubham Khandelwal <skhlnm...@gmail.com> wrote: > Hello, > > I have created one translation model (German to English) and converted

Re: [Moses-support] Tuning for factored phrase based systems

Hieu Sent while bumping into things On 1 Dec 2016 07:01, "Angli Liu" wrote: Hi, what's the major difference between the tuning process for a factored phrase based system (i.e., surface+pos data) and a simple baseline phrase based system? Nothing, the tuning just

Re: [Moses-support] Hardware specs and setup effort

Hieu Hoang http://www.hoang.co.uk/hieu On 30 November 2016 at 20:39, Martin Wunderlich <mar...@wunderlich.com> wrote: > Hi all, > > I have already searched the documentation and list archives, but I > haven't been able to retrieve the desired information that way. I have >

Re: [Moses-support] Problems of building Moses with cmph

Hiya It looks like it can compile but not link. Maybe it's getting confused by a previous failed compilation. Trying adding -a to the bjam command to force it to re-compile everything Hieu Hoang http://www.hoang.co.uk/hieu On 26 November 2016 at 21:32, Hongzheng Li <lihongzheng1...@gmail.

Re: [Moses-support] Output Loglinear score with n-best outputs

yep, it's the highest score Hieu Hoang http://www.hoang.co.uk/hieu On 23 November 2016 at 10:31, Vito Mandorino < vito.mandor...@linguacustodia.com> wrote: > I think it's the highest score but I am not completely sure. > > 2016-11-23 11:10 GMT+01:00 Nat Gillin <nat.gil...@gma

Re: [Moses-support] Build failure

Please see my advise about using Moses with OSX https://www.mail-archive.com/moses-support@mit.edu/msg14529.html On 16/11/2016 21:35, Tyler Wilbers wrote: Dear Moses Community— I have to install Moses for a SMT class this semester. I am on using macOS Sierra and installed dependencies with

Re: [Moses-support] Syntax-based Constrained Decoding

. Baltimore, MD 21218 http://cs.jhu.edu/~sding <http://cs.jhu.edu/%7Esding> On Oct 28, 2016, at 9:27 AM, Hieu Hoang <hieuho...@gmail.com <mailto:hieuho...@gmail.com>> wrote: good point. The decoder is set up to translate quickly so there's a few pruning parameters which throws out

Re: [Moses-support] Hyerarchial MOSES Model-Training

scripts, like the script you attached. The scripts it create are found here: http://www.statmt.org/moses/RELEASE-3.0/models/de-en/steps/2/ More details of the EMS here: http://www.statmt.org/moses/?n=FactoredTraining.EMS Hieu Hoang http://www.hoang.co.uk/hieu On 10 November 2016 at 10:56, Guillem

Re: [Moses-support] verbosity moses2 in server mode

I would leave pugi alone, it's an imported library that's liable to be overwritten when a new version comes out. I would prefer that things are implemented as close to Moses as possible to aid porting Hieu Hoang http://www.hoang.co.uk/hieu On 7 November 2016 at 15:33, Vito Mandorino

Re: [Moses-support] verbosity moses2 in server mode

I haven't implemented verbosity and I prob won't as there were some instances when it slowed down decoding significantly. You're welcome to implement it yourself Sent while bumping into things On 7 Nov 2016 9:26 a.m., "Vito Mandorino" wrote: > Hi, > > is

Re: [Moses-support] Can not run with PhraseDictionaryCompact. Bus error

I think there's a bug in the compact phrase table or compact lexicalized reordering model that causes a segfault on OSX. If you're running on OSX, I would use another implementation, eg. the OnDisk or probing pt and the binary lexicalised reordering model Hieu Hoang http://www.hoang.co.uk/hieu

Re: [Moses-support] moses server options different for moses vs. moses2

-requ...@mit.edu wrote: Date: Wed, 2 Nov 2016 14:32:04 -0500 From: Hieu Hoang <hieuho...@gmail.com> <hieuho...@gmail.com> Subject: Re: [Moses-support] moses server options different for moses vs. moses2 To: Martin Baumg?rtner <martin.baumgaert...@star-group.net> <m

Re: [Moses-support] moses server options different for moses vs. moses2

-maxconn --server-keepalive-timeout --server-timeout Currently the default of these params is ok for me, but there had been issues in the past that made it necessary to tweak. Cheers, Martin Am 02.11.2016 um 14:17 schrieb Hieu Hoang: In general, I've added options that I understand and can

Re: [Moses-support] moses server options different for moses vs. moses2

In general, I've added options that I understand and can test. Which specific option are you after? Hieu Hoang http://www.hoang.co.uk/hieu On 2 November 2016 at 06:04, Martin Baumgärtner < martin.baumgaert...@star-group.net> wrote: > Hi all, > > I've seen that there's a differenc

Re: [Moses-support] error in mosesdecoder tuning

the command you execute looks ok. the problem is likely to be with your using tuning data. You should look at your tuning data, make sure you've spelt the path and filename correctly, use a very small subset (eg. start with 1 parallel sentence) and increase the number of sentences until you

Re: [Moses-support] Syntax-based Constrained Decoding

good point. The decoder is set up to translate quickly so there's a few pruning parameters which throws out low scoring rules or hypotheses. These are some of the pruning parameters you'll need to change (there may be more): 1. [feature] PhraseDictionaryWHATEVER table-limit=0 2.

Re: [Moses-support] Unknown Words In Moses

by default, unknown words are copied to the output with no change. you can also add -drop-unknown when running the decoder to no translate unknown words. Or you can pre-process the input and transliterate unknowns. More information here: http://www.statmt.org/moses/?n=Advanced.OOVs

Re: [Moses-support] Build error

apt/sources.list to change all 'jessie' to > 'testing', then apt update && apt dist-upgrade. > > 2016-10-26 19:09, Hieu Hoang: >> i'm not familiar with Debian. How do you install the 'testing' >> configuration? The default gcc on there seems to be 4.9.2 >> >> >>

Re: [Moses-support] Build error

i'm not familiar with Debian. How do you install the 'testing' configuration? The default gcc on there seems to be 4.9.2 On 26/10/2016 10:22, Dingyuan Wang wrote: > Hi, > > Debian "testing" latest, gcc 6.2.0 > > I do want to test out the moses2. > > 2016-1

Re: [Moses-support] Build error

thanks. I'll test it with this configuration and will see if i can fix it On 26/10/2016 10:22, Dingyuan Wang wrote: > Hi, > > Debian "testing" latest, gcc 6.2.0 > > I do want to test out the moses2. > > 2016-10-26 17:17, Hieu Hoang: >> hiya >> >

Re: [Moses-support] Build error

hiya can you tell me which debian version and gcc version you are using. The compile error comes from Moses2. You can disable compilation of Moses2 by adding this argument to the bjam command: bjam --no-xmlrpc-c On 26/10/2016 10:10, Dingyuan Wang wrote: Dear All, I recently

Re: [Moses-support] Hardware requirements and translation throughput?

with 32 cores More details here: https://arxiv.org/abs/1610.04265 Hieu Hoang http://www.hoang.co.uk/hieu On 19 October 2016 at 04:25, John Griffith <griffith12...@gmail.com> wrote: > I know this is an "it depends" question, but what are the hardware > requirements to run

Re: [Moses-support] compile error for moses decoder

good to know. The instructions for Fedora/Redhat/CentOS does say that you have to install bzip2-devel http://www.statmt.org/moses/?n=Development.GetStarted Hieu Hoang http://www.hoang.co.uk/hieu On 18 October 2016 at 14:56, Camelia Ignat <camelia.ig...@gmail.com> wrote: > D

Re: [Moses-support] Constrained decoding

there's now a feature function ConstrainedDecoding which has some parameters so that there can be some unmatched words. You can change it to another approximate matching. Basically, if the feature function returns -infinity, the hypothesis will be deleted immediately On 17/10/2016

Re: [Moses-support] Word Alignment visualization tool

there's 1 in moses, written by Jason Riesa contrib/picaro Hieu Hoang http://www.hoang.co.uk/hieu On 17 October 2016 at 09:39, Nat Gillin <nat.gil...@gmail.com> wrote: > Dear Moses community, > > Are there any online demo or linux-able tool for word alignment > visualizati

<    1   2   3   4   5   6   7   8   9   10   >