Re: [Moses-support] mosesserver output empty string for hie models

2017-03-09 Thread Guchun Zhang
Okie dokie. All is working now. One catch is that when compiling filter-pt, one needs to either set LD_LIBRARY_PATH to be the same as LIBRARY_PATH or make a static bin. Thanks, Guchun On 9 March 2017 at 13:11, Guchun Zhang wrote: > ​Hi Hieu, > > I will use the link Mike gave to t

Re: [Moses-support] mosesserver output empty string for hie models

2017-03-09 Thread Guchun Zhang
http://moses-smt.org/ > > > On 9 March 2017 at 12:30, Guchun Zhang wrote: > >> Hi Hieu, >> >> It works now. I didn't manage to make binarize4moses2.perl work as >> sigtest-filter didn't compile and SALM page seems down. >> >> Thanks, >&g

Re: [Moses-support] mosesserver output empty string for hie models

2017-03-09 Thread Guchun Zhang
Hi Hieu, It works now. I didn't manage to make binarize4moses2.perl work as sigtest-filter didn't compile and SALM page seems down. Thanks, Guchun On 8 March 2017 at 16:01, Guchun Zhang wrote: > Ah, cool. Will let you know how it goes in a few days time. > > Thanks a lot

Re: [Moses-support] mosesserver output empty string for hie models

2017-03-08 Thread Guchun Zhang
scripts/generic/binarize4moses2.perl > to binarize. If you are using hiero models, don't forget the flag --scfg > > * Looking for MT/NLP opportunities * > Hieu Hoang > http://moses-smt.org/ > > > On 8 March 2017 at 14:43, Guchun Zhang wrote: > >> Great. T

Re: [Moses-support] mosesserver output empty string for hie models

2017-03-08 Thread Guchun Zhang
Hoang wrote: > git pull and try again. I've just pushed a fix >https://github.com/moses-smt/mosesdecoder/commit/ > ac3069fb32d87c57ac84d5bac3d07328b5ab71dd > > * Looking for MT/NLP opportunities * > Hieu Hoang > http://moses-smt.org/ > > > On 8 March 2017

Re: [Moses-support] mosesserver output empty string for hie models

2017-03-08 Thread Guchun Zhang
ly answer that better. Hopefully the > faster Moses2 implementation can improve that. > > If it doesn't compile, please let me know > > * Looking for MT/NLP opportunities * > Hieu Hoang > http://moses-smt.org/ > > > On 8 March 2017 at 09:31, Guchun Zhang wrote:

Re: [Moses-support] mosesserver output empty string for hie models

2017-03-08 Thread Guchun Zhang
Also, may I ask why hie models aren't commonly used in the server mode? On 8 March 2017 at 09:28, Guchun Zhang wrote: > ​Thanks, Hieu. I will give Moses2 another try. Last time, it didn't > compile.​ > > On 7 March 2017 at 18:35, Hieu Hoang wrote: > >> if you&#

Re: [Moses-support] mosesserver output empty string for hie models

2017-03-08 Thread Guchun Zhang
ro model is used much in server mode so it's > suffering from code rot. > > The model is much faster in Moses2 so hopefully more people will use it. > The server code is also much simplier > > > * Looking for MT/NLP opportunities * > Hieu Hoang > http://moses-smt.

[Moses-support] mosesserver output empty string for hie models

2017-03-07 Thread Guchun Zhang
Hi, I pull the repo recently and just noticed that mosesserver outputs empty strings for hie models. The command I issued is *$ mosesserver --config moses.tuned.ini* There's no error message at all. Tried to record the server log and this is the log: *127.0.0.1:43644 -

Re: [Moses-support] Use processLexicalTableMin within EMS

2015-06-29 Thread Guchun Zhang
That's great. :-) Thanks, Guchun On 29 June 2015 at 15:22, Philipp Koehn wrote: > Hi, > > this setting will also compress the reordering table. > > -phi > > On Mon, Jun 29, 2015 at 10:16 AM, Guchun Zhang > wrote: > >> Hi Philipp, >> >> Thanks

Re: [Moses-support] Use processLexicalTableMin within EMS

2015-06-29 Thread Guchun Zhang
traightforward: > > just have the line > ttable-binarizer = "$moses-src-dir/bin/processPhraseTableMin" > > in the [GENERAL] section. > > -phi > > On Mon, Jun 29, 2015 at 7:29 AM, Guchun Zhang wrote: > >> Hi, >> >> How do I call processLexicalTableMin

[Moses-support] Use processLexicalTableMin within EMS

2015-06-29 Thread Guchun Zhang
Hi, How do I call processLexicalTableMin within EMS? It's pretty straightforward to use processPhraseTableMin, but I can't find a similar reference for the reordering table. Many thanks, Guchun ___ Moses-support mailing list Moses-support@mit.edu http:/

[Moses-support] Fwd: A small typo in Moses manual

2015-06-25 Thread Guchun Zhang
Hi there, In Section 5.13.7 NPLM on Page 267, the option "--words_file" passed to prepareNeuralLM expects an existing file containing the words to be added in the vocabulary. Considering the line right below the command, I guess what you really mean is "--write_words_file". ​ Also, "​-- n_vocab ​

Re: [Moses-support] Git sparse-checkout

2014-12-15 Thread Guchun Zhang
tried doing sparse > checkout? let me know how it goes > > On 12 December 2014 at 11:51, Guchun Zhang wrote: > >> Hi, >> >> I just wonder whether git's sparse-checkout has been enabled in Moses' >> Repository. >> >> Regards, >> Guchun >

[Moses-support] Git sparse-checkout

2014-12-12 Thread Guchun Zhang
Hi, I just wonder whether git's sparse-checkout has been enabled in Moses' Repository. Regards, Guchun ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Alignment output from mosesserver for hiero models

2014-11-24 Thread Guchun Zhang
t; > For (2), just follow the phrase-based code in mosesserver > > > On 24 November 2014 at 18:07, Guchun Zhang wrote: > >> Hi Barry, >> >> I will try. Where should I start with? >> >> Thanks, >> Guchun >> >> On 24 November 2014 at 16:58

Re: [Moses-support] Alignment output from mosesserver for hiero models

2014-11-24 Thread Guchun Zhang
Hi Barry, I will try. Where should I start with? Thanks, Guchun On 24 November 2014 at 16:58, Barry Haddow wrote: > Hi Guchun > > I'm afraid word alignment is not implemented for hiero models, in moses > server. You're welcome to add it. > > cheers - Barry > &g

[Moses-support] Alignment output from mosesserver for hiero models

2014-11-24 Thread Guchun Zhang
Hi there, When mosesserver is called with phrase based models, I can get both the translation and alignment using the sample client scripts in *contrib*. However, when it's used with hiero models, I can't get the alignment with the same scripts. Is this intentional? Where should I look at to get t

Re: [Moses-support] Hierarchical model binarization error in EMS and using binarize-model.perl

2014-10-30 Thread Guchun Zhang
> I only change the master branch, not the releases. The master branch seems > to be working olk. > > On 29 October 2014 12:56, Guchun Zhang wrote: > >> Hi, >> >> I don't know if this has been reported or fixed. >> >> In v2.1.1 (9098f3a8b419a6dd6a

[Moses-support] Hierarchical model binarization error in EMS and using binarize-model.perl

2014-10-29 Thread Guchun Zhang
Hi, I don't know if this has been reported or fixed. In v2.1.1 (9098f3a8b419a6dd6ae7c1c5678f82334877504e), binarization for hierarchical models will fail in EMS, which calls binarize-model.perl. The problem is caused by the missing double quotes for $ttable-binarizer in experiment.meta and binari

[Moses-support] Large model loading

2014-10-03 Thread Guchun Zhang
Hi, I have some relatively large models, a few GB in size. It takes some time for Moses to load an entire model (phrase table, reordering table, etc.) into memory. I wonder whether preloading these models into memory (using vmtouch or RAM disk) will help speed it up. Many thanks, Guchun _

Re: [Moses-support] Moses installation terminated with IRSTLM and RANDLM

2013-11-05 Thread Guchun Zhang
upport-boun...@mit.edu] on > behalf of Guchun Zhang [gzh...@alphacrc.com] > Sent: 05 November 2013 17:44 > To: moses-support@MIT.EDU > Subject: [Moses-support] Moses installation terminated with IRSTLM and > RANDLM > > Hi, > > Trying to install a new Moses and link it with

[Moses-support] Moses installation terminated with IRSTLM and RANDLM

2013-11-05 Thread Guchun Zhang
Hi, Trying to install a new Moses and link it with a few LMs. But I got the following errors, regarding IRSTLM and RANDLM. The directories for search are incorrect, but I don't know where to change them. Or I am expected to create those directories and copy the files into there? *"g++" -ftemplat

Re: [Moses-support] Check staticData.IsChart() failed in moses-chart-cmd/Main.cpp:278

2013-10-25 Thread Guchun Zhang
On 25 October 2013 07:16, Guchun Zhang wrote: > >> Hi community, >> >> This error is seen during the recasing step in EMS for an EN-JA >> (Japanese) model. The translation model is the hierarchical model. I use >> recaser. The command automatically generated by EMS

[Moses-support] Check staticData.IsChart() failed in moses-chart-cmd/Main.cpp:278

2013-10-25 Thread Guchun Zhang
Hi community, This error is seen during the recasing step in EMS for an EN-JA (Japanese) model. The translation model is the hierarchical model. I use recaser. The command automatically generated by EMS is /home/guchun/Work/moses/moses-scripts/recaser/recase.perl -moses /home/guchun/Work/moses/mo

Re: [Moses-support] MGIZA coredump when called through a web interface

2013-08-22 Thread Guchun Zhang
getenv("USER"); > this might be a problem for you > > > > On 14 August 2013 18:29, Guchun Zhang wrote: > >> Hi, >> >> I have a web interface on which I can submit training and translation >> requests. The training is done in the background using EMS.

[Moses-support] MGIZA coredump when called through a web interface

2013-08-14 Thread Guchun Zhang
Hi, I have a web interface on which I can submit training and translation requests. The training is done in the background using EMS. Everything is fine. Now, I'm trying to call train-model.perl through the interface but not using EMS. At step 3, MGIZA throws a coredump signal. I re-ran the MGIZA

Re: [Moses-support] Questions about "--enable-mpi" build option

2013-07-26 Thread Guchun Zhang
ith SGE (now owned by Oracle) > > cheers - Barry > > > On 26/07/13 11:20, Guchun Zhang wrote: > > Morning, > > I just saw on Moses' installation page that there was a new (or new to > me, as I don't visit this page often) "--enable-mpi" option. I

[Moses-support] Questions about "--enable-mpi" build option

2013-07-26 Thread Guchun Zhang
Morning, I just saw on Moses' installation page that there was a new (or new to me, as I don't visit this page often) "--enable-mpi" option. I suppose this option will help for the decoder run on a cluster. So how do I run the decoder with MPI enabled? Any additional settings in EMS? And which MPI

Re: [Moses-support] Fuzzy match code

2013-05-03 Thread Guchun Zhang
thanks, Guchun On 29 April 2013 09:24, Guchun Zhang wrote: > Thanks, Hieu. > > Cheers, > Guchun > > > On 28 April 2013 18:36, Hieu Hoang wrote: > >> hiya >> >> try here >> >> http://www.statmt.org/moses/?**n=Moses.AdvancedFeatures#

Re: [Moses-support] Fuzzy match code

2013-04-29 Thread Guchun Zhang
; let me know how it goes > > > On 26/04/2013 16:32, Guchun Zhang wrote: > >> Hi Hieu, >> >> I am trying to use some of your code in fuzzy-match. Is it possible you >> can give me some clues about where I should start and possibly the intern

Re: [Moses-support] Segmentation fault (core dumped) in moses_chart during TUNING for tree-to-tree models

2013-03-25 Thread Guchun Zhang
's quite difficult to debug this error. Can you make available a small > model and test data that replicate this problem? > > also, bear in mind tree-to-tree models will have coverage problems so > they're unlikely to get competitive bleu scores. > * > On 25 March 201

Re: [Moses-support] Segmentation fault (core dumped) in moses_chart during TUNING for tree-to-tree models

2013-03-25 Thread Guchun Zhang
in ?? () It seems something is checking at address 0. Hope the info helps you (and me). Regards, Guchun On 25 March 2013 10:47, Guchun Zhang wrote: > Hi, > > Hope someone can give me some clues for this issue. Basically, tuning dies > in the first run and the error is >

[Moses-support] Segmentation fault (core dumped) in moses_chart during TUNING for tree-to-tree models

2013-03-25 Thread Guchun Zhang
Hi, Hope someone can give me some clues for this issue. Basically, tuning dies in the first run and the error is */var/spool/gridengine/execd/ubuntu11/job_scripts/82585: line 9: 23008 Segmentation fault (core dumped) /home/guchun/Work/moses/mosesdecoder/bin/moses_chart -w -0.285714 -lm 0.142

Re: [Moses-support] Wrong reordering table in hierarchical training using EMS

2013-01-11 Thread Guchun Zhang
y 2013 11:24, Guchun Zhang wrote: > >> Hi, >> >> I am testing hierarchical training using EMS between English and Chinese. >> The config is largely the same as the example. However, the reordering >> table created contains only >> >> ||| ||| 0.250

[Moses-support] Wrong reordering table in hierarchical training using EMS

2013-01-11 Thread Guchun Zhang
Hi, I am testing hierarchical training using EMS between English and Chinese. The config is largely the same as the example. However, the reordering table created contains only ||| ||| 0.25 0.25 0.25 0.25 0.25 0.25 0.25 0.25 The reordering setting is hier-mslr-b

Re: [Moses-support] Multi-threaded mert on SGE

2012-11-15 Thread Guchun Zhang
Sorry, it's doing multi-threading now. Need a bit patience. Guchun On 15 November 2012 22:00, Guchun Zhang wrote: > Hi, > > I notice that when mert is run on SGE, the --threads switch doesn't take > effect. Thus it becomes a huge bottleneck and partly defeats the purpose

[Moses-support] Multi-threaded mert on SGE

2012-11-15 Thread Guchun Zhang
Hi, I notice that when mert is run on SGE, the --threads switch doesn't take effect. Thus it becomes a huge bottleneck and partly defeats the purpose of using SGE. Is this normal or is there something I haven't set up correctly? Many thanks, Guchun __

Re: [Moses-support] Two errors during decode and tuning

2012-11-12 Thread Guchun Zhang
Thanks, Barry. On 12 November 2012 09:24, Barry Haddow wrote: > Hi Guchun > > -text-type is connected with some experimental domain adaptation features. > -t is an abbreviation for -report-segmentation > > cheers - Barry > > > On 10/11/12 09:38, Guchun Zhang wrote:

Re: [Moses-support] Two errors during decode and tuning

2012-11-10 Thread Guchun Zhang
Hi Barry, Just a quick question that what -t and -text-type in the decoder are for? Many thanks, Guchun On 10 November 2012 09:26, Guchun Zhang wrote: > Hi Barry, > > Both problems are gone now on SGE. Excellent. > > Cheers, > > Guchun > > > On 9 November 2

Re: [Moses-support] Two errors during decode and tuning

2012-11-10 Thread Guchun Zhang
Hi Barry, Both problems are gone now on SGE. Excellent. Cheers, Guchun On 9 November 2012 13:41, Guchun Zhang wrote: > Hi Barry, > > I am doing it now. :-) > > Cheers, > > Guchun > > > On 9 November 2012 13:35, Barry Haddow wrote: > >> Hi Guchun >&

Re: [Moses-support] Two errors during decode and tuning

2012-11-09 Thread Guchun Zhang
t; cheers - Barry > > > On 09/11/12 13:26, Guchun Zhang wrote: > >> Thanks, Barry. >> >> The following is the output file of one of the qsub jobs: >> >> Linux ubuntu11 3.2.0-24-generic #39-Ubuntu SMP Mon May 21 16:52:17 UTC >> 2012 x86

Re: [Moses-support] Two errors during decode and tuning

2012-11-09 Thread Guchun Zhang
it doesn't fix it, can you send me your ini file to help with > testing. > > For the first error, could you post one of the decoder log files to see > why the decoder is crashing, > > cheers - Barry > > > On 09/11/12 11:15, Guchun Zhang wrote: > >> Hi ther

[Moses-support] Two errors during decode and tuning

2012-11-09 Thread Guchun Zhang
Hi there, I hope you can help me out with two new problems after installing a new Moses commit. I have spent some time on them, but to no avail. The first occurred during decode. The command is # /home/guchun/Work/moses/moses-scripts/generic/moses-parallel.pl -decoder /home/guchun/Work/moses

Re: [Moses-support] A small problem at the filter stage of EMS

2012-11-08 Thread Guchun Zhang
> $cmd .= "-lm 0:3:$dir/steps/$VERSION/config.$VERSION "; # dummy > > -phi > > On Wed, Nov 7, 2012 at 7:23 AM, Guchun Zhang wrote: > > Hi, > > > > I'd like to report a trivial problem at the filter stage of the latest > Moses > > version.

[Moses-support] A small problem at the filter stage of EMS

2012-11-07 Thread Guchun Zhang
Hi, I'd like to report a trivial problem at the filter stage of the latest Moses version. At the filter stage, train-model.perl will use the working directory as the temporary language model (which I don't understand) if it exists and is non-zero. Line 430 of train-model.perl will do the checking

[Moses-support] Incremental training crashes in run-giza and run-giza-inverse

2012-08-31 Thread Guchun Zhang
Hi, I am trying out incremental training again. I pulled a recent version of mosesdecoder. And as instructed, I downloaded the inc-giza-pp-read-only directory from http://code.google.com/p/inc-giza-pp/. I compiled the incremental giza and copied the compiled GIZA++, plain2snt.out and snt2cooc.out

Re: [Moses-support] merge_alignment.py (mgiza) issue

2012-03-15 Thread Guchun Zhang
Hi, I actually just discovered the cause of the problem. The problem lies with the maximum number of threads mgiza can handle, which is 10 in the current version of it. As long as it doesn't exceed 10, there's no problem with the run-giza/run-giza-inverse stage. When the number is larger than 10,

[Moses-support] merge_alignment.py (mgiza) issue

2012-03-14 Thread Guchun Zhang
Hi, I pulled the latest Moses today. Recompiled OK. Then I re-ran some experiments using EMS to check everything. I got an error at the run_giza/run_giza_inverse stage. Executing: /home/alphac/Work/moses/giza-pp/bin/merge_alignment.py /home/alphac/Work/exp/exp1/fr-en/working/basic/sge/training/

Re: [Moses-support] A little bug in extract-parallel.perl

2012-02-15 Thread Guchun Zhang
quot;) { rename "$TMPDIR/extract.0.o", "$extract.o"; } }* The reason is that sometimes multiple tmp directories are created such as in the sge situation and not all the files in question are in the same tmp directory when being combined. Cheers, Guchun On 15 February 2012 1

[Moses-support] A little bug in extract-parallel.perl

2012-02-15 Thread Guchun Zhang
Hi, I'd like to report a little bug inside generic/extract-parallel.perl on line 104. For the current code, the ordering file will never be produced under the parallel scenario as $TMPDIR/extract.0.o never exists. It's quite straightforward to remove the bug as follows, changing from if (-e "$T

Re: [Moses-support] Problem with saving EMS output on a network drive

2012-02-13 Thread Guchun Zhang
Hi, The -s option also needs to be removed in the ems/support/consolidate-training-data.perl file. Cheers, Guchun On 11 February 2012 01:57, Guchun Zhang wrote: > Hi Hieu, > > It's a Windows file server. I have tried cp with no luck either. > > Cheers, Guchun > >

Re: [Moses-support] Problem with saving EMS output on a network drive

2012-02-10 Thread Guchun Zhang
t; A hard link is also like to be unsupported on windows > > You could replace "ln -s" with cp instead > > Hieu > Sent from my flying horse > > On 11 Feb 2012, at 12:04 AM, Guchun Zhang wrote: > > Hi there, > > I am trying to have all the outputs of EMS to be d

Re: [Moses-support] Problem with saving EMS output on a network drive

2012-02-10 Thread Guchun Zhang
Hi Hieu, It's a Windows file server. I have tried cp with no luck either. Cheers, Guchun Sent from my Windows Phone -- From: Hieu Hoang Sent: 10/02/2012 18:43 To: Guchun Zhang Cc: moses-support@MIT.EDU Subject: Re: [Moses-support] Problem with saving EMS output

[Moses-support] Problem with saving EMS output on a network drive

2012-02-10 Thread Guchun Zhang
Hi there, I am trying to have all the outputs of EMS to be directly saved onto a Windows network drive where there is a lot more space. But it crashes at the TRUECASER:train step. The error is ERROR: could not open '/home/guchun/Work/exp/exp1/fr-en/working/basic/sge/truecaser/corpus.2.fr' at /hom

Re: [Moses-support] EMS on SGE crashes

2012-02-03 Thread Guchun Zhang
tion nodes to be same as that of the head node, which is not permitted in bash as I understand. Have a nice weekend. Many thanks, Guchun On 2 February 2012 14:14, Guchun Zhang wrote: > Hi Barry, > > Many thanks for the answers. They are very helpful. :-) > > Regards, > >

Re: [Moses-support] EMS on SGE crashes

2012-02-02 Thread Guchun Zhang
Hi Barry, Many thanks for the answers. They are very helpful. :-) Regards, Guchun On 2 February 2012 13:53, Barry Haddow wrote: > Hi Guchun > > On Thursday 02 Feb 2012 12:34:09 Guchun Zhang wrote: > > Hi Barry, > > > > It still crashes after the run-giza a

Re: [Moses-support] EMS on SGE crashes

2012-02-02 Thread Guchun Zhang
script or use the option in the command. So I tried to add it to general-parallelizer.perl. But it made no effect. Do you in any chance know how to do it? Many thanks, Guchun On 1 February 2012 17:30, Guchun Zhang wrote: > Hi Guchun > > So it looks as though this line in the script &g

Re: [Moses-support] EMS on SGE crashes

2012-02-01 Thread Guchun Zhang
Hi Barry, I found the failed step which was pos. ksh wasn't installed on the execution nodes so mxpost didn't run correctly on those nodes, which led to the failure in the prepare_data step since there was no English pos data to be prepared. Now I have got a more difficult problem. The run-giza a

Re: [Moses-support] EMS on SGE crashes

2012-01-31 Thread Guchun Zhang
mail.com [mailto:astonzh...@gmail.com] *Im Auftrag von > *Guchun Zhang > *Gesendet:* Dienstag, 31. Januar 2012 15:14 > *An:* Noubours, Sandra > *Betreff:* Fwd: [Moses-support] EMS on SGE crashes > > ** ** > > Many thanks, Sandra and Barry. > > ** ** > > To

Re: [Moses-support] EMS on SGE crashes

2012-01-31 Thread Guchun Zhang
rticular, does the file > referenced by the -corpus argument exist, and and is it available to the > cluster nodes? > > cheers - Barry > > On Friday 27 January 2012 17:33:50 Guchun Zhang wrote: > > Hi there, > > > > I am trying to run EMS for factored training on SGE

Re: [Moses-support] EMS on SGE crashes

2012-01-31 Thread Guchun Zhang
;PATH=/... > would indeed produce the error >PATH=/gf: Command not found. > > > > On Mon, Jan 30, 2012 at 11:53 PM, Guchun Zhang wrote: > >> Hi Hieu, >> >> Thanks for this hint. But I am not quite sure that's the cause of the >> problem. I h

Re: [Moses-support] EMS on SGE crashes

2012-01-30 Thread Guchun Zhang
GIZA++ programs have been copied there > > > On Sat, Jan 28, 2012 at 12:33 AM, Guchun Zhang wrote: > >> Hi there, >> >> I am trying to run EMS for factored training on SGE. The config is simple >> -- use generic-parallelizer.perl and set job number to 2. No other set

[Moses-support] EMS on SGE crashes

2012-01-27 Thread Guchun Zhang
Hi there, I am trying to run EMS for factored training on SGE. The config is simple -- use generic-parallelizer.perl and set job number to 2. No other settings for SGE. At the training_prepare-data step, it crashed. The error given from the stderr file is PATH=/usr/lib/lightdm/lightdm:/usr/local

Re: [Moses-support] Incremental training

2012-01-20 Thread Guchun Zhang
here: > > http://geek.kyloo.net/software/doku.php/mgiza:forcealignment > > Hope it meets your need, but if not you may need to seek helps from author > of inc-giza-pp. > > Best, > --Q > > > > On Fri, Jan 20, 2012 at 10:07 AM, Guchun Zhang wrote: > >> I

Re: [Moses-support] Moses-support Digest, Vol 63, Issue 31

2012-01-20 Thread Guchun Zhang
specific > than "Re: Contents of Moses-support digest..." > > > Today's Topics: > > 1. Re: Incremental training (Hieu Hoang) > 2. EAMT 2012 - The 16th Annual Conference of the European > Association for Machi

Re: [Moses-support] Incremental training

2012-01-20 Thread Guchun Zhang
i, Jan 20, 2012 at 9:11 AM, Guchun Zhang wrote: > >> Hi again, >> >> I got the config file done as suggested by the sample config file. >> However, I received a few errors regarding the parameters set in the config >> file. >> >> ERROR: parameter &

Re: [Moses-support] Incremental training

2012-01-20 Thread Guchun Zhang
ssing some tricks here? Also a Segmentation Fault crashed GIZA++ after --- Model1: Iteration 1 Reading more sentence pairs into memory ... Segmentation fault Any help or advice is greatly appreciated. Cheers, Guchun On 20 January 2012 09:54, Guchun Zhang wrote: > Cheers. >

Re: [Moses-support] Incremental training

2012-01-20 Thread Guchun Zhang
riginal (not-updated) model. >> >> -phi >> >> On Thu, Jan 19, 2012 at 9:36 AM, Guchun Zhang wrote: >> >>> Hi, >>> >>> I am trying out incremental training. I am stuck in the Update and >>> Compute Alignments stage. In the samp

[Moses-support] Incremental training

2012-01-19 Thread Guchun Zhang
Hi, I am trying out incremental training. I am stuck in the Update and Compute Alignments stage. In the sample config file for GIZA++, I am not quite sure what are the following parameters oldTrPrbs: (old translation probabilities?) oldAlPrbs: (old alignment probabilities?) and where are the f

Re: [Moses-support] Tune on SGE

2011-11-18 Thread Guchun Zhang
Hi, I found the problem that led to the "No such file or directory" error. When I modified Makefile under scripts/training/lexical-reordering, I accidentally change the file name score to scor. Once this is corrected, everything is ok now. By the way, the change I have to make in Makefile under s

Re: [Moses-support] Tune on SGE II

2011-11-18 Thread Guchun Zhang
gt; > Best regards, > > Sandra > > > > > > -Ursprüngliche Nachricht- > Von: moses-support-boun...@mit.edu [mailto:moses-support-boun...@mit.edu] > Im Auftrag von Lane Schwartz > Gesendet: Mittwoch, 16. November 2011 16:11 > An: Guchun Zhang > Cc: Tom Hoar;

Re: [Moses-support] Tune on SGE

2011-11-17 Thread Guchun Zhang
x27; WARNING: Building compact rule table tools failed. How do I proceed? Do I just ignore these errors? Many thanks, Guchun On 16 November 2011 16:57, Guchun Zhang wrote: > Hi Barry, > > It could well be the problem. I will have a go with all-x86 later. > > Cheers, > > G

Re: [Moses-support] Tune on SGE

2011-11-16 Thread Guchun Zhang
ke your build and execute environments > consistent, > > cheers - Barry > > On Wednesday 16 November 2011 15:27:28 Guchun Zhang wrote: > > Hi Miles, > > > > The gcc versions on two exec nodes are different. bunix-server has 4.4.5 > > and the other 4.6.1. Both ar

Re: [Moses-support] Tune on SGE II

2011-11-16 Thread Guchun Zhang
n't > be able to look at things until at least December, though, and more > likely January. > > Lane > > > On Wed, Nov 16, 2011 at 10:08 AM, Guchun Zhang > wrote: > > Hi Tom, > > Thanks for Barry's post back in January. I wasn't a member at that time

Re: [Moses-support] Tune on SGE

2011-11-16 Thread Guchun Zhang
something more profound? Cheers, Guchun On 16 November 2011 12:21, Miles Osborne wrote: > check the gcc version on the slaves. it looks like eg you are running > 64 code on a 32 bit machine > > Miles > > On 16 November 2011 12:15, Guchun Zhang wrote: > > Hi Barry,

Re: [Moses-support] Tune on SGE II

2011-11-16 Thread Guchun Zhang
system which can cause problems on > clusters. > > Our group's machines are a mixture of 8 and 16 core Xeon 2.67GHz, with > 36-72G ram, no sge. We also have access to the university cluster, but > since the most ram you can get is 16G and sge hold jobs don't work at the

Re: [Moses-support] Tune on SGE

2011-11-16 Thread Guchun Zhang
files? > eg > /home/guchun/Work/tasks/ro-en/tuning-sge/out.job12017-aa > /home/guchun/Work/tasks/ro-en/tuning-sge/err.job12017-aa > > cheers - Barry > > On Tuesday 15 Nov 2011 22:01:41 Guchun Zhang wrote: > > Hi there, > > > > I am trying to tune on a SG

[Moses-support] Tune on SGE II

2011-11-15 Thread Guchun Zhang
Sorry, forgot to attach the mert.out file. Guchun mert.out Description: Binary data ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] Tune on SGE

2011-11-15 Thread Guchun Zhang
Hi there, I am trying to tune on a SGE cluster. I ran the following command on the head node, /home/guchun/Work/moses-scripts/scripts-2011-1703/training/mert-moses.pl \ /home/guchun/Work/tasks/ro-en/corpus/euparl.lc.ro \ /home/guchun/Work/tasks/ro-en/corpus/euparl.lc.en \ /home/guchun/Work/m