Re: [Moses-support] help

my advise though - use Linux instead of MacOSX. The scripts are written for Linux and rarely tested on Mac, you're on you own if there's a problem Hieu Hoang http://statmt.org/hieu On Thu, 16 Apr 2020 at 09:55, Hieu Hoang wrote: > inmert/Jamfile, delete all the unit tests. if necessary, d

Re: [Moses-support] help

inmert/Jamfile, delete all the unit tests. if necessary, delete all unit tests in all Jamfiles you find Hieu Hoang http://statmt.org/hieu On Thu, 16 Apr 2020 at 09:51, Bounyalit Taymany wrote: > Excuse me when I use the command " find . -name "*Test.cpp" | xargs rm " > and I try running bj

Re: [Moses-support] help

Try deleting all the unit test file before running the bjam command again. You can delete the unit test files with the following command find . -name "*Test.cpp" | xargs rm Moses used to compile fine with macOS but macOS's compiler and gcc are slowly diverging. Hieu Hoang http://statmt.org/hie

[Moses-support] help

I used command for install Moses "./bjam --with-boost=~/workspace/temp/boost_1_64_0 -j4" on MacOS Catalina 10.15 but it failed ...failed darwin.compile.c++ mert/bin/darwin-11.0.3/release/link-static/threading-multi/UtilTest.o... ...skipped util_test for lack of UtilTest.o... ...skipped util_test

[Moses-support] Help on transliteration

Hello everyone I want to ask help regarding transliteration. How can I do that in mosses using indic nlp or other if anyone has done this then I kindly ask for their guidance. ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mai

Re: [Moses-support] Help me plz

Hi Zemichael, Can you provide the build command that caused this error? If you are using any arguments with the build command use full paths not relative paths. On Sat, Mar 2, 2019, 10:34 AM Zemichael Berihu wrote: > > ___ > Moses-support mailing list

Re: [Moses-support] Help with some moses features

Hi Maria * Looking for MT/NLP opportunities * Hieu Hoang http://moses-smt.org/ On 21 March 2017 at 14:23, Maria Braga wrote: > Hi Hieu, > > I am Maria and work at Unbabel. We've met in Prague at the MT Marathon > last year. > > I am currently working with the feature weight-overwrite to switch

Re: [Moses-support] help

I don't recommend using moses with Windows, not even with cygwin. Use Linux. Hieu Sent while bumping into things On 29 Jan 2017 23:20, "SõómÃh ." wrote: > Hi , > > i am new to use moses so can anyone help me to install it in windows and > how can i build translation model > > > Regads, > > Ebt

[Moses-support] help

Hi , i am new to use moses so can anyone help me to install it in windows and how can i build translation model Regads, Ebtesam Sent from Outlook ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/

[Moses-support] help in incremental training

Dear All, I just need a clear steps on how to do incremental training in moses, as the illustration in the manual is not cleared enough Thanks ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] help me

https://github.com/moses-smt/mosesdecoder/archive/master.zip On 09/15/16 11:20, Selva Nalladurai wrote: > Hello guys, > > Please provide me with the link, where i can download the > complete moses toolkit > > > >Regards, >

[Moses-support] help me

Hello guys, Please provide me with the link, where i can download the complete moses toolkit Regards, Selva Nalladurai ___ Moses-support mailing

[Moses-support] help regarding evaluation metrices

Hello guys, Can someone provide me with some evaluation metrics for pairwise machine functions in statistical machine translation, other than 1)bleu 2)WER 3)TER 4)METEOR 5)Cosine similarity 6)LEPOR 7)NIST 7)ROUGE -- Regards,

Re: [Moses-support] help me guys

add this to your moses.ini file [n-best-list] nbest.txt 4 distinct or add these arguments when you run moses: -n-best-list nbest.txt 4 distinct On 18/07/2016 07:23, Selva Nalladurai wrote: Hello guys, I would like to know whether we can generate n-be

[Moses-support] help me guys

Hello guys, I would like to know whether we can generate n-best translation list in moses(example: if am translating a phrase"how are you" from english to french, is it possible to generate 4-5 phrases in french with meaning similar to "how are you".

Re: [Moses-support] help regarding languages used for translation

u, 14 Jul 2016 13:02:57 +0530 From: Anoop (?) <mailto:anoop.kunchukut...@gmail.com> Subject: Re: [Moses-support] help regarding languages used for translation To: Selva Nalladurai <mailto:selva...@gmail.com> Cc: moses-support <mailto:moses-support@mit.edu>

Re: [Moses-support] help regarding languages used for translation

Hi Selva, Moses is language-independent, so you can use it for any language pair as long as you have a parallel corpus. That said, you may have to do language specific pre and post-processing. For instance, - Moses does not have tokenizers for Tamil. - Tamil is agglutinative, so you may want to s

[Moses-support] help regarding languages used for translation

Hello Team, I am Selva Nalladurai, doing my ME(masters of engineering) CSE and am from India. I m doing my research in SMT and would like to know whether Moses can be used for translating English to Tamil ( a regional language spoken in our country), can i follow the same steps a

Re: [Moses-support] help

Well, the error means that the file doesn't exist in that directory. You'll need to see if you can debug it from there. On Fri, Mar 25, 2016 at 12:22 AM, Parul gupta wrote: > Yes i'm in the same directory and file is existing in that directory. > > On Fri, Mar 25, 2016 at 2:41 AM, Lane Schwartz

Re: [Moses-support] help

Make sure you're in the correct directory. Make sure the file actually exists in that directory. On Thu, Mar 24, 2016 at 2:52 PM, Parul gupta wrote: > I gave this command as follows: > > parul@ubuntu:~$ ~/mosesdecoder/bin/build_binary \ > >WMT-News.arpa.en \ > >WMT-News.en-hi.blm.hi > >

[Moses-support] help

I gave this command as follows: parul@ubuntu:~$ ~/mosesdecoder/bin/build_binary \ >WMT-News.arpa.en \ >WMT-News.en-hi.blm.hi I'm getting this error as follows: util/file.cc:76 in int util::OpenReadOrThrow(const char*) threw ErrnoException because `-1 == (ret = open(name, 00))'. No such f

Re: [Moses-support] help

Hi, this looks like a successful build. It will not have the server functionality where moses runs as a daemon and responds to tcp/ip requests. -phi On Tue, Mar 22, 2016 at 2:43 AM, Parul gupta wrote: > warning: No toolsets are configured. > warning: Configuring default toolset "gcc". > warni

[Moses-support] help

warning: No toolsets are configured. warning: Configuring default toolset "gcc". warning: If the default is wrong, your build may not work correctly. warning: Use the "toolset=x" option to override our guess. warning: For more configuration options, please consult warning: http://boost.org/boos

Re: [Moses-support] help

Parul, You'll get better responses if you email the list instead of me. Please start a new email thread to the mailing list about this topic. Lane On Mon, Mar 21, 2016 at 12:53 AM, Parul gupta wrote: > This is the command i'm running > > echo ’is this an english sentence’ | /home/parul/mosesd

Re: [Moses-support] help

Can you show the exact command you're running? That script accepts data on standard input, so if you're not giving anything on standard input, it won't produce any output. On Mon, Mar 14, 2016 at 11:40 PM, Parul gupta wrote: > Sir i created scripts/share/nonbreaking_prefix.hi but when i'm runnin

[Moses-support] help

Sir i created scripts/share/nonbreaking_prefix.hi but when i'm running the command ..it's showing Tokenizer Version 1.1 Language: hi Number of threads: 1 and no file has been created of hindi tokenized file. ___ Moses-support mailing list Moses-support@

Re: [Moses-support] help

Is that the exact command you're using? You shouldn't have backslashes before the tildes. Also, what is the error that you're getting? On Thu, Mar 17, 2016 at 5:16 AM, Parul gupta wrote: > ~/mosesdecoder/scripts/training/clean-corpus-n.perl > \~/corpus/WMT-News.true en hi \~/corpus/WMT-News.cle

Re: [Moses-support] Help on pipeline ....

Well in fact, it comes to how to handle xml mark up in text to translate and obviously this is not trivial and no good solution. If I am not mistaken this issue has been tackled in various circumstances : - casmacat project / matecat_util project - web translation in the contrib / web translat

[Moses-support] Help on pipeline ....

I am struggling with a pipeline . Here is the text1.txt file I would like to translate from FR to EN Les banques de la zone euro sont soumises : au ratio de capital lié à la détention d’actifs risqués (nous nous intéressons ici au crédit) ; au ratio de levier, qui détermine le capital règle

Re: [Moses-support] Help

Hi, these are very small corpus sizes to train statistical machine translation system. Typically, folks use at least 100 times as many words. You should be able to track down, why some translations deteriorate - I would expect that coverage increases and you would get better translations. -phi

[Moses-support] Help

Hello please help me, I want to ask, I have can run the translation using Moses. First, I using 1000 words. next I add a document to 2000 words. But, results generated translation worse than the 1000 document words. Can you give advice, what should I do? Best regards, Maria Marpaung  ___

Re: [Moses-support] Help in Moses Incremental Retraing

Hi Ulrich, Sorry for sending the doubts to you directly. I will keep in mind to post my future queries to moses-support. Thanks a lot for the clarification. Let me play with the MERT. Thanks and regards, sandipan On 24 October 2014 01:51, Ulrich Germann wrote: > Hi Sandipan, > > first, please

Re: [Moses-support] Help in Moses Incremental Retraing

Hi Sandipan, first, please post Moses-related questions to moses-support@mit.edu, not individual contributors. second, the current seven features used by Mmsapt / PhraseDictionaryBitextSampling are (for details, see my recent paper on this phrase table implementation: https://www.researchgate.net

Re: [Moses-support] Help

the decoder is waiting for the input. You can type your input in, or provide the decoder with the input file to translate: /moses -f moses.ini -i input-file or /moses -f moses.ini < input-file Don't forget - the input must have been tokenized and cased in the same way as the training

[Moses-support] Help

Hi, I have following your instruction here: http://www.statmt.org/moses/?n=Moses.Baseline and I kind of stuck in the Testing step. I want running a translation, but loading is so long and also the translation not out. My command is this: maria@maria-Aspire-E1-471:~$ /home/maria/mosesdecoder/bin

Re: [Moses-support] Help

hi maria On 23 September 2014 10:49, Maria Marpaung wrote: > Hi, > > I want to ask. > I've Testing step. > Please tell me how make "Set the path of the PhraseDictionary feature to > point to $HOME/working/binarised- model/phrase-table" > In the moses.ini file, there is a line PhraseDictionary

[Moses-support] Help

Hi, I want to ask. I've Testing step. Please tell me how make "Set the path of the PhraseDictionary feature to point to $HOME/working/binarised- model/phrase-table" and "Set the path of the LexicalReordering feature to point to $HOME/working/binarised- model/reordering-table?" Idont know how

Re: [Moses-support] help

Hi Mulu Is it the same as this problem? https://www.mail-archive.com/moses-support@mit.edu/msg10584.html Note that you probably don't need to build Moses with srilm. By default, Moses includes KenLM, which can handle ARPA files, as well as its own compiled format for faster loading. cheers -

[Moses-support] help

I am getting an error "...failed gcc.link /home/.../tools/moses/bin/mosesserver..." during moses installation when using the following command: ./bjam --with-srilm=/home/mulu/moses/tools/srilm/ -a So I do again ./bjam --with-srilm=/home/mulu/moses/tools/srilm/ -a --debug-configuration -d2 |

Re: [Moses-support] Help about Using Giza++ for comparable Corpora

Hi, GIZA++ is designed for parallel sentence pairs, but it is tolerant to some degree of noise. If you feed "comparable" sentence pairs, which I assume you mean to be sentence pairs which are only partially (or not at all) translationally equivalent, then you will hopefully get word alignments for

Re: [Moses-support] help

Hi Maria first I would like to ask (for next time) to write to the IRSTLM mailing list (user-irs...@list.fbk.eu) to any problem related to IRSTLM only Now I am going to reply you privately. Nicola On Jun 20, 2014, at 6:47 AM, Maria Marpaung wrote: > Hello, I need help. > I'm working on m

[Moses-support] help

Hello, I need help. I'm working on my thesis for form translation system using MOSES MT. I came to the Language model Training. I am having some problems. I have followed some of the steps like following the Moses Baseline. including the following: 1. The language model (LM) is used to ensure

[Moses-support] Help about Using Giza++ for comparable Corpora

Hi all I am Master degree Student and I'm New to SMT. I extracted some Comparable sentences and I want to use Giza++ for word alignment.I Think Giza Use EM algorithm for aligning words, However I don't know that I can feed comparable sentences directly to Giza++ or I have combine them with some Par

[Moses-support] Help with installing Moses

Dear Sir, Please find attached build.log.zip file I was asked to send you. I used the command: ./bjam --with-boost=~/boost_1_55_01 -j8 to generate the error. Can you please help me to correct this?   Best Regards, Bassel Ahmad build.log.gz Description: application/gzip ___

[Moses-support] HELP

Hello, While compiling moses i got the following error, ""moses/LM/IRST.cpp:27:25: fatal error: lmContainer.h: No such file or directory"". Also the debug file is attached for your refrence. Please do the needfull Regards Richa Bansal build.log1.gz Description: GNU Zip compressed data __

[Moses-support] Help: Issues while installing Moses and Boost

Hello Sir, I am trying to install moses on Fedora 18 64-bit system. Following are the commands or instructions which I followed from numerous tutorials. ***-Build SRILM-** cd srilm MAKE_PIC=1 export SRILM=$PWD export MACHINE_TYPE=i686-m64 export PATH=${PATH}:$SRILM/bin

Re: [Moses-support] Help. First request to MosesServer very slow

HI Marcos For command-line Moses, it has to output the sentences in the same order as they are input. So if, say, you have 4 threads and provide Moses with a large file of input sentences, it will give 1 sentence to each of the 4 threads. But no output will be produced until sentence 1 is tran

Re: [Moses-support] Help. First request to MosesServer very slow

Hi Marcos, the command line tool behaviour you are describing is actually consistent with what Barry said. You would see this lag before the first couple of translations and later it would disappear. Usually you do not use the command line tool for only 4 sentences, but for a couple of hundreds

Re: [Moses-support] Help. First request to MosesServer very slow

> Hi Marcos > > I think the problem is that the rules (or phrase pairs) are now cached > on a per thread basis. This is good for command-line Moses as it uses a > pool of threads, and having per-thread caches means that there is no > locking on the caches, as there used to be. Barry, I am not

Re: [Moses-support] Help. First request to MosesServer very slow

Thanks a lot for all the replies! Marcin Junczys-Dowmunt writes: > > Hi Marcos, > What you can do, if you want to rule out the compact data structures are > the issue, is load the tables at start-up into memory (if you have > enough memory): Marcin, I have tried what you suggest, but it did

Re: [Moses-support] Help. First request to MosesServer very slow

Hi, The issue is that the xmlrpc library launches a thread for each client connection. Nothing prevents these threads from then contacting a central pool of decoder threads. Kenneth On 03/06/14 11:09, Barry Haddow wrote: > Hi > > I agree that it's a bad design, but I'm not clear if it

Re: [Moses-support] Help. First request to MosesServer very slow

Hi I agree that it's a bad design, but I'm not clear if it can be fixed without changing to a different xmlrpc library cheers - Barry On 06/03/14 18:40, Kenneth Heafield wrote: > Hi, > > In my view, the threading design of the server is a bug. How about a > producer-consumer queue with m

Re: [Moses-support] Help. First request to MosesServer very slow

Hi, In my view, the threading design of the server is a bug. How about a producer-consumer queue with multiple producers (a client connection) and consumers (decoding threads). Each client connection owns a producer-consumer queue as a return channel so that decoder threads can return th

Re: [Moses-support] Help. First request to MosesServer very slow

If this is indeed the problem then not using the compact phrase table might result in even longer delays. The compact phrase table has a low-level cache that is not thread-specific, so xml-rpc probably takes advantage of that. W dniu 06.03.2014 18:30, Barry Haddow pisze: > Hi Marcos > > I think

Re: [Moses-support] Help. First request to MosesServer very slow

Hi Marcos I think the problem is that the rules (or phrase pairs) are now cached on a per thread basis. This is good for command-line Moses as it uses a pool of threads, and having per-thread caches means that there is no locking on the caches, as there used to be. mosesserver, afaik, creates

Re: [Moses-support] Help. First request to MosesServer very slow

Hi Marcos, What you can do, if you want to rule out the compact data structures are the issue, is load the tables at start-up into memory (if you have enough memory): That would be the following additional options to your ini-file: [minphr-memory] 1 [minlexr-memory] 1 However your problem loo

[Moses-support] Help. First request to MosesServer very slow

Hi, I am having an issue with MosesServer. I am using compact phrase and reordering table, and KENLM. The problem is this (I'll explain with an example): - I have one file with 20 very short sentences. I split and tokenize them and send one XMLPRC request per sentence to MosesServer - If I crea

Re: [Moses-support] HELP

Hi Mohadeseh, have you tried to apt-get update # update the apt-get repository with the info in the sources.list file apt-get upgrade # upgrade the system with the packages available in the apt repository apt-get -f install # fix the installation, removing broken packages

[Moses-support] HELP

Hi, I tried to install srilm via srilm_1.5.6-1nlp1~0gutsy1_i386.deb with this command on ubuntu 7.10: #dpkg -i srilm_1.5.6-1nlp1~0gutsy1_i386.deb I see this error in terminal: "(Reading database ... 90886 files and directories currently installed.) Preparing to replace srilm 1.5.6-1nlp1~0gutsy1

Re: [Moses-support] help

Leila Tavakoli writes: > > > Hi, > I need to tune my English-Persian development set, and i use this command:  > > > root ubuntu:/home/msho/Desktop/Shafagh/moses-default/scripts/training# ./mert-moses.pl /mnt/hgfs/H/dev/en/en.txt /mnt/hgfs/H/dev/ref/ /home/msho/Desktop/Shafagh/moses-default/

[Moses-support] help

HI, I want to tune my development set and i want to use -mertdir. so i use mert-moses-new.pl . i use this command: ./mert-moses-new.pl /mnt/hgfs/H/dev/en/en.txt /mnt/hgfs/H/dev/ref/ /home/msho/Desktop/Shafagh/moses-default/bin/moses /mnt/hgfs/H/Train150/model/moses.ini -working-dir /mnt/hgfs/H/Tra

Re: [Moses-support] help

Can you send the error log when you run the Moses binary with this moses.ini file, and include the moses.ini file? The command line would look like this: $ /home/msho/Desktop/Shafagh/moses-default/bin/moses -f /mnt/hgfs/H/Train150/model/moses.ini On 01/30/2014 07:11 PM, Leila Tavakoli wr

[Moses-support] help

Hi, I need to tune my English-Persian development set, and i use this command: root@ubuntu:/home/msho/Desktop/Shafagh/moses-default/scripts/training# ./ mert-moses.pl /mnt/hgfs/H/dev/en/en.txt /mnt/hgfs/H/dev/ref/ /home/msho/Desktop/Shafagh/moses-default/bin/moses /mnt/hgfs/H/Train150/model/moses.

[Moses-support] Help

Hi, I need to tune my English-Persian development set and I use following command: "root@ubuntu:/home/msho/Desktop/Shafagh/moses-default/scripts/training# ./ mert-moses.pl /mnt/hgfs/H/dev/en/en.txt /mnt/hgfs/H/dev/ref/ /home/msho/Desktop/Shafagh/moses-default/bin/moses /mnt/hgfs/H/Train150/model/mo

Re: [Moses-support] Help Needed in Developing Machine Translation System

Hi, we have fairly extensive tutorials on using Moses, especially http://www.statmt.org/moses/?n=Moses.Tutorial You first need to install the software http://www.statmt.org/moses/?n=Development.GetStarted -phi On Mon, Dec 9, 2013 at 4:22 PM, Asad A.Malik wrote: > Hi All, > The reason I am emai

[Moses-support] Help Needed in Developing Machine Translation System

Hi All, The reason I am emailing is that I want help and guidance in developing Machine Translation system.   I am currently enrolled in MS. And for my semester project I have to develop one of the Machine Translation system. I have already taken time in submitting the proposal just because I in

Re: [Moses-support] Help in installing moses

Hi, Try recompiling without spaces in the directory name. If that fixes it, at least we'll know where the issue is. Kenneth On 09/27/13 11:41, subhash ganeshan wrote: > Hello, > Recently while installing moses on my system Ubuntu12.04, I ran > into some installation issues. >

[Moses-support] Help Request

Thank you for helping diagnose the building problem!notice: found boost-build.jam at /usr/share/boost-build/boost-build.jam notice: loading Boost.Build from /usr/share/boost-build/kernel notice: Searching /etc /home/zs /usr/share/boost-build/kernel /usr/share/boost-build /usr/share/boost-build/ker

Re: [Moses-support] help with installing Moses for the first time

I recommend you follow this guide to get started with Moses: http://www.statmt.org/moses/?n=Moses.Baseline Once you understand it, then you need to collect some arabic-english data to create a system On 07/07/2013 22:16, Khetam sh wrote: Dear, I am so interested in using Moses tool on Arabi

Re: [Moses-support] help with Moses installation

Hi Khetam, Maybe you can refer this link: http://www.statmt.org/moses/?n=Moses.Baseline It is very helpful. Best Regards, LANG Jun On Sun, Jul 7, 2013 at 2:19 AM, Khetam sh wrote: > Dear, > > > > I am so interested in using Moses tool on Arabic English Combination, > but I am havi

[Moses-support] help with Moses installation

Dear, I am so interested in using Moses tool on Arabic English Combination, but I am having trouble accessing it, but I would also appreciate some insights into how to use it once I have access. I am wondering if you will help me? Your help would be greatly appreciated. Best Regards, Khe

Re: [Moses-support] Help me!

Hi, The Vietnamese National Project on Vietnamese Language and Speech Processing (VLSP) has been working to compile some resources and fundamental tools, including 10-sentence bilingual English-Vietnamese corpus. You might have to fill a simple form to get that corpus from them: http://vlsp.vi

Re: [Moses-support] Help me!

hi ha if you want to translate english to vietnamese, you need an english-vietnamese corpus. You can find here: http://opus.lingfil.uu.se/ other people on the moses mailing list might have other data they can give you. You can also use pivoting methods and triangulation to translate english

[Moses-support] help me to take a sabbatical

Dear all, I am PhD student which i have been work on hybrid machine translation (syntactical + statistical). l am looking for universities in north america especially canada for a sabbatical at next year. I wonder if any body could introduce me universities, institutions or people or help me to

Re: [Moses-support] Help on Moses Installation

ail.com To: moses-support@mit.edu Subject: [Moses-support] Help on Moses Installation I have been trying to install moses on ubuntu 12.10 by following the instructions on the manual. first i have installed both boost 1.52 and gcc-4.7 and i have downloaded and extracted moses tool. The i have b

Re: [Moses-support] help me to find and download IWSLT08 and NIST08 datasets

Hi, the NIST evaluation sets are distributed through the LDC. The IWSLT evaluation sets are available if you register to participate in their evaluation campaign - I am not sure if they are available otherwise, but you should get in touch with the organizers. -phi On Mon, Apr 15, 2013 at 7:39 A

Re: [Moses-support] Help on Moses Installation

Please follow the directions on http://www.statmt.org/moses/?n=Moses.MailingLists There should be no space after the equals sign. ./bjam --with-irstlm=/home/nadhii/moses/irstlm/ Kenneth On 04/17/13 10:02, Nadhii Dagaga wrote: > I have been trying to install moses on ubuntu 12.10 by following t

[Moses-support] Help on Moses Installation

I have been trying to install moses on ubuntu 12.10 by following the instructions on the manual. first i have installed both boost 1.52 and gcc-4.7 and i have downloaded and extracted moses tool. The i have been trying to install it by using the following command: ./bjam --with-irstlm= /home/nadh

[Moses-support] help me to find and download IWSLT08 and NIST08 datasets

Dear members, I gonna run and test our machine translation system on the well-known datasets (IWSLT08, NIST08) . Unfortunately, I could not find them on the web. I wonder if anybody could help me to find and download. Tnx in advance -- S.Farzi, Ph.D. Student Natural Language Proc

Re: [Moses-support] Help on Language Model Training

Hi, please use full paths for your corpus files. -phi On Sat, Apr 13, 2013 at 1:44 PM, Jabesa Daba wrote: > when i have modified the path and run the following command: > > ~/irstlm/bin/add-start-end.sh < ~/corpus/news-commentary-v7.fr-en.true.en > > news-commentary-v7.fr-en.sb.en > export IR

[Moses-support] Help on Language Model Training

when i have modified the path and run the following command: ~/irstlm/bin/add-start-end.sh < ~/corpus/news-commentary-v7.fr-en.true.en > news-commentary-v7.fr-en.sb.en export IRSTLM=$HOME/irstlm; ~/irstlm/bin/build-lm.sh -i news-commentary-v7.fr-en.sb.en -t ./tmp -p \ -s improved-knes

Re: [Moses-support] Help on Language Model Training

Hi, It looks like you're writing to news-commentary-v7.fr-en.lm.en without a .gz then trying to read news-commentary-v7.fr-en.lm.en.gz . If that doesn't fix it, subscribe to the IRSTLM mailing list at https://list.fbk.eu/sympa/subscribe/user-irstlm and direct your message there. Also

[Moses-support] Help on Language Model Training

when i run the following command: ~/irstlm/bin/add-start-end.sh < ~/corpus/news-commentary-v7.fr-en.true.en > news-commentary-v7.fr-en.sb.en export IRSTLM=$HOME/irstlm; ~/irstlm/bin/build-lm.sh -i news-commentary-v7.fr-en.sb.en -t ./tmp -p \ -s improved-kneser-ney -o news-commentary-v

Re: [Moses-support] Help with the concept

Hi, to use Moses, you will need a very large amount of translated text for training, in the order of millions of words. If you have that, please consult the Moses web site on details on how to train a system. -phi On Sat, Mar 23, 2013 at 5:13 AM, Eleni Teshome wrote: > Dear all, > I wanted to c

[Moses-support] Help with the concept

Dear all, I wanted to calculate the real concept on Moses...I'm translating from English to Amharic (my native language)...Example..given the following sentences Abebe ate beso => አበበ በሶ በላ in which Abebe maps to አበበ, ate maps to በላ, beso maps to በሶ Kebede drunk beso=> ከበደ በሶ ጠጣ in which Kebede m

Re: [Moses-support] help for reusing moses-chart in a different (dependency tree - to - string) MT system

Hi, Hieu Thank you for your quick reply :-). But then, if the decoder can handle any number of non-terminal, it means I still don't understand why the rules I am generating do not seem to be used properly by the decoder. I think I will try to make a minimal example of the problem I have and come

Re: [Moses-support] help for reusing moses-chart in a different (dependency tree - to - string) MT system

hi fabien On 08/11/2012 01:25, Fabien Cromières wrote: Dear Moses community, First, thanks for providing the Research community with such a nice open-source tool. Second, I have some rather involved questions about the moses-chart decoder for syntax-based MT. Hopefully, someone having a goo

[Moses-support] help for reusing moses-chart in a different (dependency tree - to - string) MT system

Dear Moses community, First, thanks for providing the Research community with such a nice open-source tool. Second, I have some rather involved questions about the moses-chart decoder for syntax-based MT. Hopefully, someone having a good familiarity with it can answer me. Thanks in advance!

Re: [Moses-support] Help - Error while running Moses for the WTM 2010

Thanks, I own you the second time, Hieu Hoang! On Sun, Nov 4, 2012 at 3:20 PM, Hieu Hoang wrote: > hi cuong > > i think you're running out of memory when it's trying to run word > alignment. > > You should try and verify this by running the word alignment step by > itself and see if it gives the

Re: [Moses-support] Help - Error while running Moses for the WTM 2010

hi cuong i think you're running out of memory when it's trying to run word alignment. You should try and verify this by running the word alignment step by itself and see if it gives the same error. You should run on another machine with more memory. Or follow this instruction: http://www

[Moses-support] Help - Error while running Moses for the WTM 2010

Hi all, I was stuck with the error suddenly "Killed" when I run Moses on the WMT 2010 Task which contains 22520400 pairs of sentences. The error comes when I run the sentences from line 21298000 to line 21299000: *Exit code: 137* *ERROR at /home/cuongh/STATMT.BIG/scripts/training/train-model.perl l

Re: [Moses-support] Help - Decoding error for training Moses with a very large bilingual corpus

Hi Cuong I think you have a | character in your data. You need to escape this before training. You can use the script *escape-special-chars.perl* *To do this* Hieu Sent from my flying horse On 29 Oct 2012, at 03:21 AM, Cuong Hoang wrote: Hi all, I re-check the problem again. It just happens

Re: [Moses-support] Help - Decoding error for training Moses with a very large bilingual corpus

Hi all, I re-check the problem again. It just happens when I run Moses on a large training corpus. When I run on a smaller training corpus, no problem is happened. I don't think there is any problem of server since I run on a 24-cores and 130G RAM server. Everything is absolutely done including dep

[Moses-support] Help - Decoding error for training Moses with a very large bilingual corpus

Hi all, When i run Moses which trains from a sub-part of WMT10. The bilingual corpus contains nearly 10 million pairs of sentences. Everything's okie. However, I was stuck with the error for the decoding process: *Check factors.size()==m_output.size() failed in moses/src/PDTAimp.h:273* and hence:

[Moses-support] Help with Moses compiling using bjam

Hi, I am using moses for my senior year thesis. After I downloaded the moses code from the web, when I try to compile by doing the following: *./bjam --with-srilm=/Users/anis/demo/tools/srilm --with-irstlm=/Users/anis/demo/tools/irstlm --with-giza=/Users/anis/demo/tools/bin -j2* I get bunch of th

Re: [Moses-support] help

Hi Eleni you should use the full path of the temporary file you are specifying with the parameter "-t" (i.e.something like "-t /full/path/to/tmp" instead of "-t ./tmp") In your command, the parameter "-i" seems not to have any space after it ("-inews-commentary-v7.fr-en.sb.en"

[Moses-support] help

dear all, i've been using the moses baseline site and the commands seem to do just fine but i just couldn't pass the following step: export IRSTLM=/home/eleni/irstlm; ~/irstlm/bin/build-lm.sh -inews-commentary-v7.fr-en.sb.en -t ./tmp -p -s improved-kneser-ney -o news-commentary-v7.fr-en.lm.en when

Re: [Moses-support] help

Hi Mohadeseh If you use the giza option 'nodumps=0' then you should also get the model 1 alignments. Check the GIZA++ help message to be sure. I meant that your Moses version was out-of-date, not your GIZA++ version, cheers - Barry On 13/08/12 11:19, Mohadeseh Sheikhoveisi wrote: > Hi Barry >

Re: [Moses-support] help

Hi Mohadeseh You're using a very old version of Moses, so I'd suggest you update to the latest github version. As to the Giza error, does this answer your question? http://comments.gmane.org/gmane.comp.nlp.moses.user/7231 cheers - Barry cheers - Barry On 12/08/12 09:32, Mohadeseh Sheikhoveisi

[Moses-support] help

Hi, I want to get word-to-word alignment (IBM-Model-1) using giza++ while I run "./train-model.perl -scripts-root-dir /opt/tools/scripts-20120707-0326 -root-dir /home/msho/Parallel-Corpus/Now/ -corpus /home/msho/Parallel-Corpus/clean/Clean-Corpus -f en -e fa -alignment grow-diag-final-and -reorderi

  1   2   >