Re: [Moses-support] ERROR

2024-09-28 Thread Hieu Hoang
you should use experiment.perl rather trying to run every stage of training by hand. http://www2.statmt.org/moses/?n=FactoredTraining.EMS Adapt the basic example config to your own data and machine: https://github.com/moses-smt/mosesdecoder/blob/master/scripts/ems/example/config.basic Hieu

Re: [Moses-support] Moses Build with Boost 1.68.0 Fails

2024-05-24 Thread Hieu Hoang
./bjam -j 6 --with-boost=/home/hihoan/local/workspace/github/boost_1_68_0 Hieu Hoang https://hieuhoang.github.io/ On Fri, 24 May 2024 at 08:21, Andrew Beaton wrote: > Hello, > I'm currently trying to build Moses with Boost 1.68.0 (not the latest > version, but this is for compati

Re: [Moses-support] Error: No such file or directory while opening /home/xyz/working/train/model/extract.o.sorted.gz

2023-01-04 Thread Hieu Hoang
it may be that a previous step failed, eg due to running out of disk space, choking on bad data. Check the logs for the previous steps Hieu Hoang http://statmt.org/hieu On Wed, 4 Jan 2023 at 11:42, Sainik Kumar Mahata wrote: > Dear All, > > I have trained my translation models us

Re: [Moses-support] hierarchical-to-string translation doesn't produce string output

2022-03-17 Thread Hieu Hoang
5 ``` Regards, Oleg On Thu, 17 Mar 2022 21:09:10 -0700 Hieu Hoang wrote: Can I have a look at your moses.ini file. You always need a glue rule phrase take for scfg models to create the final output ... -- Hieu Hoang http://statmt.org/hieu ___ Moses-

Re: [Moses-support] hierarchical-to-string translation doesn't produce string output

2022-03-17 Thread Hieu Hoang
Can I have a look at your moses.ini file. You always need a glue rule phrase take for scfg models to create the final output On Thu, Mar 17, 2022, 8:58 PM Oleg Parashchenko wrote: > Hello, > > I've created and tried a hierarchical model: > > ``` > $ echo 'nhoj' | moses -f model/moses.ini > ... >

Re: [Moses-support] Pure-python decoder for Moses?

2022-01-24 Thread Hieu Hoang
NLTK had something but not sure how good it is https://www.nltk.org/_modules/nltk/translate/phrase_based.html Liling may know more about it Hieu Hoang http://statmt.org/hieu On Mon, 24 Jan 2022 at 09:50, Lane Schwartz wrote: > Pretty sure the answer is no. David Chiang had a Python-ba

[Moses-support] Fwd: MOSES v4.0 binaries is forbidden to download

2021-10-15 Thread Hieu Hoang
fyi Hieu Hoang http://statmt.org/hieu -- Forwarded message - From: Ulrich Germann Date: Fri, 15 Oct 2021 at 14:55 Subject: Re: [Moses-support] MOSES v4.0 binaries is forbidden to download To: Hieu Hoang Cc: Barry Haddow , Kenneth Heafield < kheaf...@inf.ed.ac.uk>, BOG

Re: [Moses-support] Problem installing Moses

2021-06-14 Thread Hieu Hoang
sudo apt-get install libboost-all-dev Hieu Hoang http://statmt.org/hieu On Mon, 14 Jun 2021 at 22:08, Hieu Hoang wrote: > what version of Ubuntu? If it's recent (eg. 20.04, 18.04) then it's easier > to install boost from ubuntu >sudo apt-get install > an

Re: [Moses-support] Problem installing Moses

2021-06-14 Thread Hieu Hoang
what version of Ubuntu? If it's recent (eg. 20.04, 18.04) then it's easier to install boost from ubuntu sudo apt-get install and compile moses simply: ./bjam -j4 Hieu Hoang http://statmt.org/hieu On Mon, 14 Jun 2021 at 21:55, John Kiddik wrote: > Hi, I’m trying to install M

Re: [Moses-support] Language Model Inquiry

2021-04-29 Thread Hieu Hoang
-- Hieu Hoang http://statmt.org/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] reg. moses installation

2021-04-22 Thread Hieu Hoang
Apr 2021 at 17:23, Hieu Hoang <mailto:hieuho...@gmail.com>> wrote: i've just successfully compiled moses-4.0 on ubuntu 20.04 with boost 1.71. there's something wrong with your boost installation On 4/22/2021 3:09 AM, ram anirudh cherukupally wrote: The

Re: [Moses-support] reg. moses installation

2021-04-22 Thread Hieu Hoang
tion using boost 1.71? Do you recommend using boost 1.64  (as exemplified in Moses manual?) Thank you On Thu, Apr 22, 2021 at 1:15 PM Hieu Hoang <mailto:hieuho...@gmail.com>> wrote: there seems to be a problem with the boost library. Is the disk full? Perhaps you should re-inst

Re: [Moses-support] reg. moses installation

2021-04-22 Thread Hieu Hoang
-- Hieu Hoang http://statmt.org/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Failed to install the mosesdecoder after installing mgiza++, irstlm and cmph

2021-03-09 Thread Hieu Hoang
Irstlm and cmph is not compulsory. They are needed for irst on and compressed phrase take, respectively, but kenlm and probing pt are built into Moses and are faster and better Mgiza you will need unless you have another word alignment tool such as giza++ or fastalign On Tue, Mar 9, 2021, 4:57 AM

Re: [Moses-support] Error While Compiling Moses

2021-01-29 Thread Hieu Hoang
vance. Respectfully, Marwa ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://statmt.org/hieu ___ Moses-support mailing list Moses-support@mi

Re: [Moses-support] hierarchical pbmt issue

2020-12-17 Thread Hieu Hoang
40 split "sort" to ...extract-parallel.perl 40 split "sort -T [directory with lots of space]" Hieu Hoang http://statmt.org/hieu On Thu, 17 Dec 2020 at 02:31, Hieu Hoang wrote: > its likely you have run out of disk space during the extraction of the > hierar

Re: [Moses-support] hierarchical pbmt issue

2020-12-17 Thread Hieu Hoang
-table.gz) turns out to be empty. Apparently, gzip is failing in Step 5. But I don't know why, because it appears to work fine with vanilla PBMT. I am sending the training log (stdout), Kindly help me. -- CH Ram Anirudh -- Hieu Hoang http://statmt.org

Re: [Moses-support] MOSES | Baseline | Can't get similar BLEU

2020-10-21 Thread Hieu Hoang
of 23.50 like they do on that Moses webpage, I get quite low BLEU (7.0-ish by memory). Anybody else experience this? Any suggestions? Any other worked training examples with reproducible BLEU on the web? Paul Pallaghy -- Hieu Hoang http://s

Re: [Moses-support] Can't load text phrase table in Ubuntu 19.10 or 20.04

2020-09-30 Thread Hieu Hoang
ses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://statmt.org/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Training The Translation System

2020-09-22 Thread Hieu Hoang
s-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://statmt.org/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Error when installing Moses in MacOS Catalina

2020-08-20 Thread Hieu Hoang
the log file doesn't show the errors. However, there are issues with compiling on MacOS now due to diverging compilers. See my reply to a previous email https://www.mail-archive.com/moses-support@mit.edu/msg16190.html My suggestion - use Linux Hieu Hoang http://statmt.org/hieu On Th

Re: [Moses-support] Failed to get the language model by KenLM

2020-08-07 Thread Hieu Hoang
___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://statmt.org/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Failed Moses 4.0 compilation: Attempt to free invalid pointer

2020-07-20 Thread Hieu Hoang
e you reconfigured it extensively? Or maybe there's a problem with the way you compiled xmlrpc-c lib Hieu Hoang http://statmt.org/hieu On Sun, 19 Jul 2020 at 22:03, ALISTAIR CHEONG LIANG CHUEN HCI < 1615...@student.hci.edu.sg> wrote: > Dear Mr Hoang, > > I specified libssl-

Re: [Moses-support] Failed Moses 4.0 compilation: Attempt to free invalid pointer

2020-07-19 Thread Hieu Hoang
from the errors in build.log.gz, it looks like the compilation neeed the SSL libraries. Try installing libssl-dev I've not seen this error before, please let us know how it goes Hieu Hoang http://statmt.org/hieu On Sun, 19 Jul 2020 at 02:50, ALISTAIR CHEONG LIANG CHUEN HCI &

Re: [Moses-support] Compiling failed with --with-nplm

2020-07-15 Thread Hieu Hoang
ailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://statmt.org/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] GIZA++ word alignment with paragraphs

2020-07-09 Thread Hieu Hoang
Hi john I'm afraid the word alignment tools like Giza++ aren't really designed to be run against paragraph length input. Probably one reason why you're getting bad alignments. I don't know is tweaking the parameters would make it any better, or using any other word alignment tool On Wed, Jul 8,

Re: [Moses-support] Segmentation fault in processPhraseTableMin

2020-06-17 Thread Hieu Hoang
i recommend using probing pt. It's built into moses and faster when multithreading Hieu Hoang http://statmt.org/hieu On Wed, 17 Jun 2020 at 14:23, Kenneth Heafield wrote: > The CMPH software updated formats at some point but nobody changed > Moses. Use a vintage CMPH or have

Re: [Moses-support] [EXT] Re: Error when compiling Moses with xmlrpc-c support

2020-06-02 Thread Hieu Hoang
ogram_options > -lboost_serialization -lboost_thread -lboost_system -ltcmalloc_minimal > -lxmlrpc -lxmlrpc++ -lxmlrpc_abyss -Wl,-Bdynamic -lSegFault -lrt > -Wl,--end-group -pthread > > > > ...failed gcc.link /home/whkuo/mosesdecoder/bin/moses... > > > > Basica

Re: [Moses-support] Error when compiling Moses with xmlrpc-c support

2020-05-29 Thread Hieu Hoang
2 things: 1. From the error message, it seems to need the open ssl library. So I guess you have to install openssl libssl-dev 2. it's --with-cmph not --withcmph Hieu Hoang http://statmt.org/hieu On Fri, 29 May 2020 at 12:03, Hank Kuo wrote: > Hello, > > I am encountering a

Re: [Moses-support] Moses Support Request

2020-05-25 Thread Hieu Hoang
do you need irstlm? If not, don't compile it with moses. I recommend using kenlm instead Hieu Hoang http://statmt.org/hieu On Mon, 25 May 2020 at 15:45, Johnas Solomon wrote: > Greetings! > Kindly request your support. Please also find the log file and screenshot > The last com

Re: [Moses-support] Word Lattice Input

2020-05-14 Thread Hieu Hoang
input feature. Hieu Hoang http://statmt.org/hieu On Wed, 13 May 2020 at 23:00, Moses Visperas wrote: > So I followed the tutorial for the baseline system and I want to try using > a Lattice input. I made a test.plf file which contains 2 sentences > formatted as shown in the manual (6.5.1

Re: [Moses-support] Problem with moses installing and building

2020-05-06 Thread Hieu Hoang
you must use the full path to boost, cmph, nplm, irstlm, not relative paths. Also, only include libraries you need to avoid headaches. This is the command I use bjam -j24 --with-cmph=~/workspace/cmph/cmph-2.0 Hieu Hoang http://statmt.org/hieu On Wed, 6 May 2020 at 10:51, nikhil cherian

Re: [Moses-support] Question about corpora used for pre-trained models of release 4.0

2020-04-16 Thread Hieu Hoang
they're trained on Europarl and tuned on wmt08 news test set, I believe. You can find the exact experimental configuration by looking at the experiment config file, eg http://www.statmt.org/moses/RELEASE-4.0/models/de-en/steps/1/config.1 Hieu Hoang http://statmt.org/hieu On Thu, 1

Re: [Moses-support] help

2020-04-16 Thread Hieu Hoang
my advise though - use Linux instead of MacOSX. The scripts are written for Linux and rarely tested on Mac, you're on you own if there's a problem Hieu Hoang http://statmt.org/hieu On Thu, 16 Apr 2020 at 09:55, Hieu Hoang wrote: > inmert/Jamfile, delete all the unit tests.

Re: [Moses-support] help

2020-04-16 Thread Hieu Hoang
inmert/Jamfile, delete all the unit tests. if necessary, delete all unit tests in all Jamfiles you find Hieu Hoang http://statmt.org/hieu On Thu, 16 Apr 2020 at 09:51, Bounyalit Taymany wrote: > Excuse me when I use the command " find . -name "*Test.cpp" | xargs rm &qu

Re: [Moses-support] help

2020-04-15 Thread Hieu Hoang
Try deleting all the unit test file before running the bjam command again. You can delete the unit test files with the following command find . -name "*Test.cpp" | xargs rm Moses used to compile fine with macOS but macOS's compiler and gcc are slowly diverging. Hieu Hoang ht

Re: [Moses-support] Trouble building in ubuntu 19.10

2020-04-12 Thread Hieu Hoang
it compiled successfully on my ubuntu 19.10. My g++ version is 9.2.1. I installed the boost (v. 1.67) using apt instal. What are your versions Hieu Hoang http://statmt.org/hieu On Sun, 12 Apr 2020 at 01:42, Harold Camacho wrote: > Hello and apologies for bothering. > > I'

Re: [Moses-support] Tokenization

2020-04-12 Thread Hieu Hoang
the moses tokenizer expects the input from standard in Hieu Hoang http://statmt.org/hieu On Sun, 12 Apr 2020 at 10:27, Justin Cunningham wrote: > Hi, > > I’m currently working on a Neural Machine Translator but I am quite new to > it all. I am trying to tokenise my files in Lin

Re: [Moses-support] baseline model run with same setting, with same database twice gives different translation output

2020-03-29 Thread Hieu Hoang
If you mean that you trained twice, it's normal to get slightly different results. The word alignment and running are stocastic On Sun, Mar 29, 2020, 3:49 AM rmogla wrote: > Hi, > I ran Moses baseline method twice with the same settings and with the same > data set, but final translation file g

Re: [Moses-support] where to ask a question? mailing list archive is dead.

2020-03-24 Thread Hieu Hoang
Hieu Hoang http://statmt.org/hieu On Tue, 24 Mar 2020 at 10:30, Artem Shevchenko wrote: > Hello, > > wow, thank you very much for a so rapid reply! > > My idea was first to try with pre-made models to see how good it can be > and whether I would really need to go all the wa

Re: [Moses-support] where to ask a question? mailing list archive is dead.

2020-03-24 Thread Hieu Hoang
good results. If you are new to Moses, you should follow this tutorial to do so http://www.statmt.org/moses/?n=Moses.Baseline Hieu Hoang http://statmt.org/hieu On Tue, 24 Mar 2020 at 09:47, Artem Shevchenko wrote: > Hello, > Search the mailing list archive > <http

Re: [Moses-support] Tuning a factored model -> crash

2020-03-09 Thread Hieu Hoang
Hieu Hoang http://statmt.org/hieu On Mon, 9 Mar 2020 at 10:08, Haukur Páll Jónsson wrote: > Hi all, > > > For the last few weeks, I have been trying to train and tune a factored > model. I have found it difficult to implement and I now seek some > assistance. > >

Re: [Moses-support] Moses Decoder Parameters

2020-02-29 Thread Hieu Hoang
You can change the max phrase length of the decoder by using --max-phrase-length when running the decoder If you are new to Moses, it's best to work through this tutorial http://www.statmt.org/moses/?n=Moses.Baseline Hieu Hoang http://statmt.org/hieu On Fri, 28 Feb 2020 at 19:19,

Re: [Moses-support] Problem downloading cmph file.

2020-01-26 Thread Hieu Hoang
You need to use sudo make install On Sun, Jan 26, 2020, 8:25 AM Nameet Mankar wrote: > May this image help me answer my query can anyone suggest a solution if > you'll encountered same situation > ___ > Moses-support mailing list > Moses-support@mit

Re: [Moses-support] Moses installation failed

2019-12-26 Thread Hieu Hoang
util/Jamfile Hieu Hoang http://statmt.org/hieu On Thu, 26 Dec 2019 at 12:28, Bamba wrote: > Hello, > I am trying to install Moses on ubuntu 18.04, but the installation always > fails. I have already installed boost successfully. Please find attached > the build.log.gz file and the co

Re: [Moses-support] Segmentation fault (core dumped) while translating

2019-12-10 Thread Hieu Hoang
ooii . ik hou van je > Segmentation fault (core dumped) > > > > > > > > ___ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://statmt.org/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Compact phrase table on-disk format changed

2019-12-08 Thread Hieu Hoang
Thanks. I'll bear it in mind for next time On Sun, Dec 8, 2019, 9:19 AM Dingyuan Wang wrote: > The problem is caused by the upgrade of cmph library from 2.0 to 2.0.2. > I don't know which commit of cmph changed its format. > > 2019/12/8 3:46, Hieu Hoang: > > That

Re: [Moses-support] Compact phrase table on-disk format changed

2019-12-07 Thread Hieu Hoang
That's strange, I expected that they would work all versions. Another problem might be the encoding Please let me know what you find On Sat, Dec 7, 2019, 9:15 AM Dingyuan Wang wrote: > Dear all, > > After re-compiling moses binaries, moses can't find all Chinese words > (|UNK|UNK|UNK) in the co

Re: [Moses-support] Moses installation fails

2019-11-26 Thread Hieu Hoang
there may be a problem with the latest version of cmph 2.0.2 so use version 2.0 I have it here if you need it http://statmt.org/hieu/downloads/cmph-2.0.tar.gz The usual commands to build it is ./configure --prefix=$PWD make make install Hieu Hoang http://statmt.org/hieu On Tue

Re: [Moses-support] Moses installation fails

2019-11-26 Thread Hieu Hoang
searching for the word 'error' reveals that the cmph library hasn't been compiled successfully. Hieu Hoang http://statmt.org/hieu On Tue, 26 Nov 2019 at 21:19, Bamba wrote: > Hello, > I am trying to install Moses on ubuntu 18.04, but the installation always > fails.

Re: [Moses-support] mert-moses using parallel mode

2019-11-05 Thread Hieu Hoang
you should read this: http://www.statmt.org/moses/?n=Moses.Optimize Moses doesn't do tensors operations so GPUs are of no help so no supported Hieu Hoang http://statmt.org/hieu On Tue, 5 Nov 2019 at 04:42, Каргин Тимофей wrote: > I started to work with moses and stuck with too lon

Re: [Moses-support] Building mosesdecoder on Mac OS

2019-10-31 Thread Hieu Hoang
valid argument '-std=c++0x' not allowed with 'C' > ...failed clang-darwin.compile.c > symal/bin/clang-darwin-4.2.1/release/link-static/threading-multi/cmd.o... > > > > Regards, > > Hrafn Loftsson, Ph.D., www.ru.is/~hrafn<http://www.ru.is/~hrafn> > Dósent | As

Re: [Moses-support] Building mosesdecoder on Mac OS

2019-10-31 Thread Hieu Hoang
It's been a few years since I've used osx. My advice is 1. Don't include cmph library. It's only used by the compact phrase table which crashes on osx 2. If you're only using the moses command line to do experiments, you don't need the server so you don't need to include xmlrpc-c library. On

Re: [Moses-support] Moses build failed

2019-10-17 Thread Hieu Hoang
IRSTLM has not been compiled correctly. You don't need it in most instances - just use KenLM. exclude this from your bjam command --with-irstlm=/home/gryffindor/smt1/irstlm Hieu Hoang http://statmt.org/hieu On Thu, 17 Oct 2019 at 12:23, adnan islam wrote: > Exact Command: > ./

Re: [Moses-support] Problem regarding setup mosesdecoder

2019-10-01 Thread Hieu Hoang
you need the cmph library. See here for how to install it http://www.statmt.org/moses/?n=Development.GetStarted alternatively, don't compile with the --with-cmph flag but then you can't use the compressed phrase-table Hieu Hoang http://statmt.org/hieu On Tue, 1 Oct 2019 at 19:52

Re: [Moses-support] mosesserver segmentation fault

2019-09-05 Thread Hieu Hoang
I would personally use Moses2 for the server, of the model is a generic phrase based or hierarchical model. The server integration is cleaner and less buggy. And Moses2 is faster. However you must binarize with CreateProbingPT More details on Moses2 here http://www.statmt.org/moses/?n=Site.Mos

Re: [Moses-support] Segmentation fault and tcmalloc errors

2019-08-23 Thread Hieu Hoang
Don't use tcmalloc with Moses2, it has its own memory allocation optimization. Can you tell me the exact command you executed, the error it produced and send me the config file you used On Fri, 23 Aug 2019, 12:19 pm 周王春澍, wrote: > Dear Hieu, > > > > Hi, I have successfully trained and tuned the

Re: [Moses-support] ERROR: Wrong format of --lm. Expected: --lm factor:order:filename //train-model.perl line 605.

2019-07-30 Thread Hieu Hoang
you're gonna have to do some debugging yourself. Perhaps look inside train_Moses.job and training.out Hieu Hoang http://statmt.org/hieu On Tue, 30 Jul 2019 at 11:48, Aaron Poet wrote: > Hi Hieu > Thanks for the reply. But, after I added the colon there, it still have > some prob

Re: [Moses-support] ERROR: Wrong format of --lm. Expected: --lm factor:order:filename //train-model.perl line 605.

2019-07-30 Thread Hieu Hoang
On Mon, 29 Jul 2019, 19:58 Aaron Poet, wrote: > Hi Moses-Support > > I firstly build the lm as below: > > (base) aaronhan@grove2:~/Moses$ head -20 > /home/aaronhan/Moses/lm/wmt18_5maaZhEn.arpa.en > > \data\ > > ngram 1=553697 > > ngram 2=8790963 > > ngram 3=28838697 > > > \1-grams: > > -6.993945

Re: [Moses-support] Moses Server

2019-06-25 Thread Hieu Hoang
There's some documentation about the moses server here: http://www.statmt.org/moses/?n=Advanced.Moses Hieu Hoang http://statmt.org/hieu On Tue, 25 Jun 2019 at 13:13, Lucas Pimenta Porto wrote: > Hi > > I am a Master student and I started working with Moses soon. I have an

Re: [Moses-support] Compilation Failed with Moses

2019-04-06 Thread Hieu Hoang
ah great, just a small boost problem. cc'ing to the mailing list to let other people know Hieu Hoang http://statmt.org/hieu On Sat, 6 Apr 2019 at 22:23, liu shihao wrote: > Thanks for your reply! > After downloading a clean version of source code and installing a older > ve

Re: [Moses-support] Compilation Failed with Moses

2019-04-06 Thread Hieu Hoang
ract//extract-ghkm phrase-extract//pcfg-extract phrase-extract//pcfg-score phrase-extract//extract-mixed-syntax phrase-extract//score-stsg there will be some additionally tidying up to do in the code Hieu Hoang http://statmt.org/hieu On Sat, 6 Apr 2019 at 19:20, li

Re: [Moses-support] Asking your help

2019-03-27 Thread Hieu Hoang
I recommend using kenlm http://www.statmt.org/moses/?n=FactoredTraining.BuildingLanguageModel#ntoc20 It's included with moses and very fast and reliable Hieu Hoang Sent while bumping into things On Wed, 27 Mar 2019, 7:12 pm Zemichael Berihu, wrote: > What shall I do? Plz help me bu

Re: [Moses-support] Exit code 127 when tuning the moses baseline system.

2019-03-23 Thread Hieu Hoang
Can you please supply the exact command you ran. And maybe make the data you have available for download so the error can be reproduced On Sat, 23 Mar 2019, 05:14 Anthony Rubin, wrote: > Hello, > I am following the tutorial for the moses baseline system with the > instructions provided here http

Re: [Moses-support] Moses build failure support

2019-03-22 Thread Hieu Hoang
Ram Anirudh Research Scholar, University of Hyderabad ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://statmt.org/hieu ___ Moses-supp

Re: [Moses-support] Installation error

2019-02-28 Thread Hieu Hoang
mac doesn't have many of the Linux utilities needed to compile or run Moses. They need to be installed, I use Macports to do that https://www.macports.org/ Please also look at the section on OSX installation in http://www.statmt.org/moses/?n=Development.GetStarted Hieu Hoang

Re: [Moses-support] Installation error

2019-02-24 Thread Hieu Hoang
.cse.psu.edu/~yug125/ ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://statmt.org/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mai

Re: [Moses-support] German tokenizer may fail with numeric endings

2018-11-07 Thread Hieu Hoang
I think you have a point. If you change tokenizer.perl to avoid applying non-breaking prefix to the last word, please send me the change Hieu Hoang Sent while bumping into things On Tue, 6 Nov 2018, 10:46 pm Ozan Çağlayan Yes the rules are coming from the nonbreaking_prefixes files which are

Re: [Moses-support] extract.o.sorted.gz file not found error

2018-10-23 Thread Hieu Hoang
hiya, can you tell me what the exact commands you ran? Hieu Hoang http://statmt.org/hieu On Tue, 23 Oct 2018 at 19:46, Jamal Laoudi wrote: > I am trying to install Moses for the first time, and I am getting an error > at the translation model building stage as follows: > No suc

Re: [Moses-support] mert error

2018-09-06 Thread Hieu Hoang
in your moses.ini, replace the word SRILM with KENLM what was the exact command you use to create moses.ini? That should be changed so that KENLM is used instead of SRILM Hieu Hoang Sent while bumping into things On Thu, 6 Sep 2018, 11:28 am Claudia Matos Veliz, < claudia.matosve...@ugent

Re: [Moses-support] terminate called after throwing an instance of 'util::FDException'

2018-09-02 Thread Hieu Hoang
can you please let me see the file /home/arezoo1/emlla/train/model/moses.ini Hieu Hoang http://statmt.org/hieu On Sat, 1 Sep 2018 at 10:24, Arezoo Arjomand wrote: > Hi all, > I runthefollowingcommandtotunerule-table > butthe erroris appeared

Re: [Moses-support] Some one E-MAIL TO U Re: Fwd: Different translations are obtained from the same decoder without alignment information

2018-08-24 Thread Hieu Hoang
If you want an email to the mailing list, the archives are here https://www.mail-archive.com/moses-support@mit.edu/ Hieu Hoang http://statmt.org/hieu On Fri, 24 Aug 2018 at 17:04, Ergun Bicici wrote: > > Dear Hieu, > > I did not receive any further message from metaseby...@gm

Re: [Moses-support] Fwd: Different translations are obtained from the same decoder without alignment information

2018-08-24 Thread Hieu Hoang
could you run with alignments, but WITHOUT -unknown-word-prefix UNK. alignments shouldn't change the translation but the OOV prefix may do Hieu Hoang http://statmt.org/hieu On Fri, 24 Aug 2018 at 15:29, Ergun Bicici wrote: > > ok, thank you. I'll upload and send you a link.

Re: [Moses-support] Fwd: Different translations are obtained from the same decoder without alignment information

2018-08-24 Thread Hieu Hoang
that would be a bug. could you please make the model and input files available for download. I'll check it out Hieu Hoang http://statmt.org/hieu On Fri, 24 Aug 2018 at 15:15, Ergun Bicici wrote: > > only the evaluation decoding steps are repeated that are steps 10, 9, and

Re: [Moses-support] Fwd: Different translations are obtained from the same decoder without alignment information

2018-08-24 Thread Hieu Hoang
are you rerunning tuning for each case? Or are you using exactly the same moses.ini file for the with and with alignment experiments? Hieu Hoang http://statmt.org/hieu On Fri, 24 Aug 2018 at 14:34, Ergun Bicici wrote: > > Dear Moses maintainers, > > I discovered that the translati

Re: [Moses-support] Decoder died in tunning step!

2018-08-23 Thread Hieu Hoang
you need to binarize with CreateProbingPT if you use moses2 if you use CreateOnDiskPt then you must use the moses decoder Hieu Hoang http://statmt.org/hieu On Thu, 23 Aug 2018 at 09:02, Arezoo Arjomand wrote: > Hi, > > I installed successfully moses decoder on server. I run synta

Re: [Moses-support] Issues running MGiza on AWS machine

2018-08-01 Thread Hieu Hoang
I'm out of ideas. I've used aws and azure many times so it should work Hieu Hoang Sent while bumping into things On Wed, 1 Aug 2018, 20:01 James Baker, wrote: > Alas, nothing erroneous that I can see in the logs (using > ./train-model.perl > output.log 2>&1), and ne

Re: [Moses-support] Issues running MGiza on AWS machine

2018-08-01 Thread Hieu Hoang
redirect stdout and stderr into a file and grep for 'error' that usually turns up something Hieu Hoang http://statmt.org/hieu On 1 August 2018 at 17:38, James Baker wrote: > Thanks Hieu, > > I'll give that a go this morning and keep an eye on the disk space and &g

Re: [Moses-support] Issues running MGiza on AWS machine

2018-07-31 Thread Hieu Hoang
k space to sort intermediate files. I would monitor those 2 things Hieu Hoang http://statmt.org/hieu On 31 July 2018 at 20:41, James Baker wrote: > Hi, > > I'm having some peculiar issues with MGiza++. Using MGiza and Moses, I've > successfully built some translation models

Re: [Moses-support] incomplete phrase table

2018-07-26 Thread Hieu Hoang
I guess you wanted it to create the following rules c -> x d -> y e -> z There's no guarantee that it will figure that out. A cause could be there isn't enough training data. Hieu Hoang http://statmt.org/hieu On 27 July 2018 at 02:06, Janek Amann wrote: > Hi a

Re: [Moses-support] Broken links for Installer for Windows with GUI

2018-07-12 Thread Hieu Hoang
thanks. Deleting both Hieu Hoang http://statmt.org/hieu On 12 July 2018 at 02:31, Mervyn Yeo wrote: > Hi Hieu, > > It seems that > > http://amittaibox.weebly.com/ > > is a dead link. Maybe you want to delete that reference as well. > > Thanks, > Mervyn > > O

Re: [Moses-support] Broken links for Installer for Windows with GUI

2018-07-11 Thread Hieu Hoang
You're better off compiling from source, using Slate toolkit https://www.slate.rocks/downloads/slate-toolkit-edition/ or Box http://amittaibox.weebly.com/ The Capita package is pretty old now and unmaintained. Will delete reference to it from the Moses website if no-one objects Hieu

Re: [Moses-support] Build failed for moses v4 on macOS 10.13.5

2018-06-23 Thread Hieu Hoang
...@me.com <mailto:mille...@me.com> ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://statmt.org/hieu ___ Moses-support

Re: [Moses-support] what is the EXACT command you executed when you got the error

2018-06-23 Thread Hieu Hoang
an.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://statmt.org/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Moses 4 binaries - xmlrpc not loaded - for macOS

2018-06-21 Thread Hieu Hoang
ah, it was linked to the xmlrpc-c shared library, rather than static library. I dont have a mac anymore to be able to create the binaries, apologies. it is pretty easy to compile on a mac though, work through this web page http://www.statmt.org/moses/?n=Development.GetStarted Hieu Hoang http

Re: [Moses-support] Regarding LM

2018-06-21 Thread Hieu Hoang
what was the error? Why not try KenLM? Hieu Hoang http://statmt.org/hieu On 21 June 2018 at 11:10, Kamal Deep Garg wrote: > Dear sir > > I had created arpa file in LM with data of 11Lakh monolingual sentences > using iRSTLM. > > > when I am converting arpa file

Re: [Moses-support] Moses Compilation Error

2018-06-14 Thread Hieu Hoang
it looks like there is an incompatible version of xmlrpc-c library that moses is trying to link to. Add this to your bjam command --no-xmlrpc-c Hieu Hoang On 14 June 2018 at 09:08, Cheshta Kwatra wrote: > EXACT command executed - cd ~/mosesdeco

Re: [Moses-support] Free cloud service to train NMT

2018-06-08 Thread Hieu Hoang
Laptop gpu are small and expensive. I would personally get a cheap desktop and a gtx 1080 Hieu Hoang Sent while bumping into things On Fri, 8 Jun 2018, 5:52 pm amir haghighi, wrote: > Thanks Hieu. > > Is it possible to train the NMT system on the laptop? I mean is there any > lapto

Re: [Moses-support] Free cloud service to train NMT

2018-06-08 Thread Hieu Hoang
try this https://developer.nvidia.com/academic_gpu_seeding or search the web Hieu Hoang On 8 June 2018 at 14:14, amir haghighi wrote: > Hello > > I'm going to set up an NMT system using openNMT or Nematus but I can't run > it on my laptop and I don't have acc

Re: [Moses-support] Unsubscribe me please

2018-05-15 Thread Hieu Hoang
gladly. However, if you subscribed yourself, you should know how to unsubscribe yourself. If not, your should contact the owners at moses-support-ow...@mit.edu Please don't spam everyone on the list with your request Hieu Hoang http://moses-smt.org/ On 15 May 2018 at 14:11, blessybj

Re: [Moses-support] Please fix my error

2018-05-10 Thread Hieu Hoang
-irstlm=/home/pallavi/smt/irstlm --with-giza-pp=/home/pallavi/smt/bin -j4 ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://moses-smt.org/less

Re: [Moses-support] Install moses on Windows

2018-05-09 Thread Hieu Hoang
s https://docs.microsoft.com/en-us/windows/wsl/about I used this to test training on windows for Moses version 4 release. More details here http://www.statmt.org/moses/RELEASE-4.0/Moses-v4.0-release-notes.pdf Hieu Hoang http://moses-smt.org/ On 9 May 2018 at 16:44, Mohamed Amine MENACER wrote: &

Re: [Moses-support] Install moses on Windows

2018-05-09 Thread Hieu Hoang
hamed Amine Menacer PhD Student, LORIA -France- Ingénieur d'état en informatique, École nationale Supérieure d'Informatique E.S.I -Algerie- ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-su

Re: [Moses-support] https://www.mail-archive.com/moses-support@mit.edu/ is still not reached from Turkey after 3 years

2018-04-23 Thread Hieu Hoang
Hieu Hoang http://moses-smt.org/ On 23 April 2018 at 14:02, Ergun Bicici wrote: > > Dear Hieu, > > Thank you for your message. Is there a mirror website to access? > external websites mirror the moses-support mailing list archive, eg http://moses-support.mit.narkive.com/#slid

Re: [Moses-support] https://www.mail-archive.com/moses-support@mit.edu/ is still not reached from Turkey after 3 years

2018-04-23 Thread Hieu Hoang
.@googlegroups.com>. For more options, visit https://groups.google.com/d/optout. -- Hieu Hoang http://moses-smt.org/ ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Error

2018-04-19 Thread Hieu Hoang
it looks like the xmlrpc-c library has not been compiled correctly. If you don't need this library (required by moses server and moses2) then add the argument --no-xmlrpc-c to the bjam command when you compile moses Hieu Hoang http://moses-smt.org/ 2018-04-20 2:04 GMT+01:00 G

Re: [Moses-support] Dual Licensing or relicensing Moses

2018-04-10 Thread Hieu Hoang
Still the same problem - everyone owns Moses so you need everyone's permission, not just mine. So no Hieu Hoang http://moses-smt.org/ On 10 April 2018 at 17:13, liling tan wrote: > I understand. > > Could we have permission that it's okay to derive work from Moses with &

Re: [Moses-support] Dual Licensing or relicensing Moses

2018-04-10 Thread Hieu Hoang
we can't change the license, or dual license it, without the agreement of everyone who's contributed to Moses. Too much work Hieu Hoang http://moses-smt.org/ On 10 April 2018 at 15:47, liling tan wrote: > Dear Moses Dev, > > NLTK has a Python port of the word tokenizer in M

Re: [Moses-support] Installation: symlinks created at the wrong place when using --prefix?

2018-02-20 Thread Hieu Hoang
I would actually advised against using --prefix The moses scripts are written with the assumption that the directories bin scripts are side-by-side. --prefix seems to move bin, but not scripts Hieu Hoang http://moses-smt.org/ On 20 February 2018 at 09:20, Hieu Hoang wrote: > >

Re: [Moses-support] Installation: symlinks created at the wrong place when using --prefix?

2018-02-20 Thread Hieu Hoang
Hieu Hoang Sent while bumping into things On 20 Feb 2018 8:25 a.m., "Yves Scherrer" wrote: Hi all, My first attempt at testing moses2 failed because CreateProbingPT2 could not be found... On the last line of mosesdecoder/Jamroot, is created as a symlink to CreateProbingPT, but th

  1   2   3   4   5   6   7   8   9   10   >