_
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
which
> can be seen and dealt quickly with, eg. by putting in extra waits or
> explict checking for files. Your error isn't detected unless you trawl
> through the mert iterations.
>
> The need to rerun tuning is just to counter the random variability in
> mert but this would
files have appeared for each split. Does this
sound right, or is there a better place for the check? (I haven't been
following updates to Moses for a little while, so if this is all made
redundant by recent changes, my apologies.)
Suzy
--
Suzy Howlett
http://mert-moses-new.pl>
>>>>>>>>> /users/parole/cnasri/moses_work/corpus/source2TOK
>>>>>>>>> /users/parole/cnasri/moses_work/corpus/ref2TOK
>>>>>>>>>
>>>>>>>>> /users/parole/cnasri/moses_work/moses/moses-cmd/src/moses
>>>>>>
>>>>>>
>>>>>> /users/parole/cnasri/moses_work/moses-scripts/scripts-20110727-1543/trai
>>>>>> n
>>>>>>
>>>>>>>>> ing/moses.ini --working-dir
>>>>>>>>> /users/parole/cnasri/moses_work/tuning/
>>>>>>>>> --mertdir /users/parole/cnasri/moses_work/moses/mert
>>>>>>>>>
>>>>>>>>> But there is only one iteration, after it stops and
>>>>>>
>>>>>> itshow:
>>>>>>>>> Peeking at the beginning of nbestlist to get order of
>>>>>>>>> scores: run1.best100.out
>>>>>>>>> The decoder returns the scores in this order: d lm w
>>>>>>>>> tm
>>>>>>>>> tm
>>>>>>
>>>>>> tm
>>>>>>
>>>>>>>>> Executing: gzip -f run1.best100.out
>>>>>>>>> Scoring the nbestlist.
>>>>>>>>> Executing:
>>>>>>>>> /users/parole/cnasri/moses_work/moses/mert/extractor
>>>>>>>>> --scconfig case:true --scfile run1.scores.dat --ffile
>>>>>>>>> run1.features.dat -r
>>>>>>>>> /users/parole/cnasri/moses_work/corpus/ref2TOK -n
>>>>>>>>> run1.best100.out.gz>extract.out 2>extract.err
>>>>>>>>> Executing: \cp -f init.opt run1.init.opt
>>>>>>>>> Executing:
>>>>>>>>> /users/parole/cnasri/moses_work/moses/mert/mert -d 6 --scconfig
>>>>>>>>> case:true -n 20 --ffile run1.features.dat --scfile run1.scores.dat
>>>>>>>>> --ifile run1.init.opt 2>mert.log Exit code: 3
>>>>>>>>> Failed to run mert at ./mert-moses-new.pl
>>>>>>>>> <http://mert-moses-new.pl>line 752.
>>>>>>>>>and in the mert log :
>>>>>>>>>
>>>>>>>>> Seeding random numbers with system clock
>>>>>>>>>
>>>>>>>>> :Too few minimum weights.
>>>>>>>>>
>>>>>>>>> error could not initialize start point with
>>>>>>>>>
>>>>>>>>> I have not idea how i resolve this problem.
>>>>>>>>> Any idea please?
>>>>>>>>>
>>>>>>>>> Thank you
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ___
>>>>>>>>> Moses-support mailing list
>>>>>>>>> Moses-support@mit.edu<mailto:Moses-support@mit.edu>
>>>>>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --- J.B.S. Haldane
>>>>>>>>>
>>>>>>>>> ___
>>>>>>>>> Moses-support mailing list
>>>>>>>>> Moses-support@mit.edu<mailto:Moses-support@mit.edu>
>>>>>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --- J.B.S. Haldane
>>>>>>>
>>>>>>> ___
>>>>>>> Moses-support mailing list
>>>>>>> Moses-support@mit.edu
>>>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> ** J�rg Tiedemann
>>>>>> jorg.tiedem...@lingfil.uu.se
>>>>>>Dep. of Linguistics and Philology
>>>>>> http://stp.lingfil.uu.se/~joerg/
>>>>>>Uppsala University tel: +46 (0)18
>>>>>> -
>>>>>> 471 1412
>>>>>>Box 635, SE-751 26 Uppsala/SWEDEN fax: +46 (0)18 - 471 1094
>>>>>
>>>>> ___
>>>>> Moses-support mailing list
>>>>> Moses-support@mit.edu
>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>
>>>
>>> --
>>> The University of Edinburgh is a charitable body, registered in
>>> Scotland, with registration number SC005336.
>>>
>>>
>>> ___
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
>
>
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
way how to solve it.*
> **
> *Thank you very much.*
> **
> *Regards,*
> *James*
>
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
el, I think that
>> Suzy's point is well taken. I think there would be value in published
>> studies showing just how wide the gap due to nondeterminism can be expected
>> to be. It may be that such studies already exist, and I'm just not aware of
>> them. Does anyone k
n/listinfo/moses-support
>>
>>
>>
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
> ___
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
h/without tuning is achieved by turning off/on weight-config in the config
> file.
>
> Thank you!
> Best Wishes,
> Jia
>
>
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://m
t; format(into Binary format or Quantized format). is it right? If yes, is
> there anyway to ask EMS to use IRSTLM instead of SRILM and build the
> language model using it from scratch?
>
> Regards.
>
>
>
> ___
> Moses-support mailing l
ection I write in: TRAINING:config
>> instead of in: TUNING:weight-config.
>> What is the right way to do this?
>> Thanks,
>> John
>> _______
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
___
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
; train-model.perl...but for what i read is better to do
>> train-factored-phrase-model.perl...i
>> do not have it oin my moses or scripts/2011../training
>>
>
> train-factored-phrase-model.perl is now called train-model.perl
>
> best regards
> Barry
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
n
> order to be able to install the srilm at the time, hence the added
> "-gcc4" when in fact it should be just "i686". I had to edit one of the
> files in so that it would compile using gcc 4, because i didn't have the
> older version 3. I hope this info woul
gt;
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
Neat, thanks.
Suzy
On 21/01/11 11:24 PM, Herve Saint-Amand wrote:
> Hi,
>
> I think it should look healthier now. Let me know if something's still
> amiss.
>
> Cheers
> Herve
>
>
> On 21/01/11 04:20, Suzy Howlett wrote:
>> Hi,
>>
>> Does anyon
d.
S.
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
on't know a good workaround. If you can get an updated
> version of TORQUE that accepts the afterokarray flag, I'd be happy to
> incorporate that.
> Cheers,
> Lane
>
> On Fri, Dec 24, 2010 at 1:31 AM, Suzy Howlett <mailto:s...@showlett.id.au>> wrote:
>
>
-my ($file) = @_;
+my ($file,$type) = @_;
my ($bleu,$ratio);
foreach (`cat $file`) {
$bleu = $1 if /BLEU = (\S+), /;
@@ -107,5 +108,5 @@
$AVERAGE{"multi-bleu"} += $bleu;
-return $output."BLEU";
+return $output.$TYPE{$type};
}
O
ated GIZA++ and Moses. It successes to run on
> regular Moses step by step, while crashed in ems.
> Could you please tell me why it happens? And what is the walk around?
>
> Best Regards
> Xiaojun Zhang
>
>
>
> ___
> Moses
itch to SGE?? I wish TORQUE had the "-sync" option...) but I don't
think that will happen quickly.
I think this is a failure from my end, unfortunately.
Suzy
On 23/12/10 9:19 AM, Suzy Howlett wrote:
> Hi Lane,
>
> Sorry it's taken me a while to get back to you. I&
message, so I thought I should repost it in case someone who knows the
answer overlooked the original. My apologies for the duplicate posting.
Thanks and happy holidays,
Suzy
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
Lane
--
When a place gets crowded enough to require ID's, social collapse is not
far away. It is time to go elsewhere. The best thing about space travel
is that it made it possible to go elsewhere.
-- R.A. Heinlein, "Time Enough For Love"
--
Suzy Howlett
utput' should be replaced by 'system-output' (or
'cleaned-output'?), which is tokenized and lowercased (getting a
case-insensitive BLEU score).
Does this sound right, or have I missed something? Should multi-bleu be
case-sensitive or case-insensitive?
Suzy
On 30/11/10 11:
o
>> hear people's thoughts on the matter first.
>> Cheers,
>> Lane
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinf
gt; Karlis
>
> If you change everything to use bash, I'll check it in. Using /bin/sh is
> just asking for trouble
>
> Hieu
>
> Sent from my flying horse
>
>
>
> _______
> Mose
ation/nc-dev2007.truecased.2
> >
> /home/s0565741/disk1/de-en/europarl.2/working-dir/evaluation/nc-dev2007.multi-bleu.2
>
> Does anyone happen to know why?
>
>
>
>
>
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
gt;>
>>>> Cheers,
>>>> Lane
>>>> _______
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>> ___
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>
>>
>>
>> --
>> The University of Edinburgh is a charitable body, registered in
>> Scotland, with registration number SC005336.
>>
>> ___
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
tional scripts
> regards
> jasleen
>
>
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
last night, and tested it again. I found something
> confusing. Moses can read the file in the first time off running and
> translates it correctly. but after that it can't read the file. I have
> no idea about this problem....
> Can anyone help me?
>
>
> On Mon, Oct 11, 20
ut object : [0.000] seconds
>
>
> Is something in moses configured incorrectly?
>
>
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
er perl script as well. I suggest installing perl at
/usr/bin/perl if at all possible.
Suzy
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
ata in this format be used by EMS? If yes, how and where should I
> describe my files in config.factored? If no, what should I convert it
> to?
>
> I also wonder how I can make EMS use only the surface form and create
> an unfactored language and translation model.
>
> Regards,
&
the string)
b) add a separate case to catch weights with the exponent in them and
replace them with 0 (or do something else?)
I assume (a) is the best course of action and that there is no reason to
replace these weights with 0, but I thought I'd check first before
making the fix.
Su
ks, everyone.
>
> Thomas
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
it as 'tokenized-stem' (already been
tokenised), 'lowercased-stem' (already been tokenised, filtered and
lowercased), etc. You may need to familiarise yourself with the
experiment.meta file to work out exactly what your options are.
Best,
Suzy
--
Suzy Howlett
http://www.s
t;> harass your sysadmin and try a few of these too
>> http://fixunix.com/nfs/61890-forcing-nfs-sync.html
>>
>> On 02/09/2010 04:09, Suzy Howlett wrote:
>>> Hi everyone,
>>>
>>> I'm running Moses through its experiment management system acros
but this is not helping in general - I think
sometimes the delay is as much as a couple of minutes.
Has anyone else faced this problem, or have a better idea for how to get
around it?
Cheers,
Suzy
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-suppo
nd does anyone know how I might fix it?
Thanks,
Suzy
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
Hi,
As far as I can tell, filter-model-given-input.pl can't handle input in
lattice format. It finds no matches and the filtered table contains no
entries. Has anyone worked on this?
Suzy
--
Suzy Howlett
http://www.showlett.id.au/
___
Moses-su
rerun-on-change: config
default-name: model/moses.bin.ini
template: $binarize-all $ttable-binarizer $rtable-binarizer OUT IN
I can specify ttable-binarizer and rtable-binarizer, but I can't work
out what the value of binarize-all should be. Any suggestions?
Thanks,
Suzy
-
these are not disabled, the script still thinks that it has to build
> a truecaser model, and hence needs to find unpreprocessed data.
>
> -phi
>
>
> On Tue, May 25, 2010 at 10:47 AM, Suzy Howlett wrote:
>> Hi,
>>
>> I'm trying to run a system through the EMS wher
like it's still trying to run
the get-corpus/tokenize/clean steps - it produces files like
steps/1/CORPUS_combined_get-corpus.1* which contain error messages about
not being able to find files. What am I missing?
Thanks,
Suzy
--
Suzy Howlett
http://web.science.mq.edu.au
in the log file "TRUCASER_consolidate.1.STDERR"
>
> /myworkdir/steps/1/TRUECASER_consolidate.1:
> 9: /edinburgh-script-dir/consolidate-training-data.perl: not found
>
> It seemed that I didn't have the script
> "consolidate-training-data.perl". I searched f
config because that scripts directory doesn't include generic/mteval-
v12.pl or the tokenizer and ems directories. Is the solution to update
~/mosesdecoder/scripts/released_files, or to change BINDIR in train-
model.perl without running 'make release', or somethi
I've occasionally had the reuse-weights.pl script eat a weight or two,
so if you call that script after tuning, check its output to see if
it's spitting
out any warnings.
Suzy
On 17/05/2010, at 10:13 AM, Chris Dyer wrote:
> Jie's assessment is correct, your moses.ini is missing a value under
>
;
> --
> Raphael Payen
>
>
> -Original Message-
> From: moses-support-boun...@mit.edu [mailto:moses-support-boun...@mit.edu
> ]
> On Behalf Of Suzy Howlett
> Sent: 22 April 2010 07:16
> To: moses-support@mit.edu
> Subject: [Moses-support] idea for handling unknown word
Hi,
I was thinking about how unknown words are handled in Moses - namely
being copied verbatim to the output or being dropped completely - and
I had an idea. Would it be worth allowing the user to specify (through
a command line argument) an external program that could be called on
an unkn
e the following values for this kind of indicator
> scores:
> 0.368 = exp(-1)
> 0.606 = exp(-0.5)
> 1 = exp(0)
> This will translate into 0, -0.5 and -1 in logspace. Using negative
> scores avoids unnecessary warnings about probabilities >1.
>
> Best,
> Christian
Does anyone know of any quirks
or tricks with using lattice input that I might have overlooked that I
could try out?
Thanks,
Suzy
On 06/04/2010, at 4:24 PM, Suzy Howlett wrote:
> Hi,
>
> I'm trying to tune Moses using lattice input (not confusion network
> input) and I&#x
Hi,
I'm trying to tune Moses using lattice input (not confusion network
input) and I'm getting some weird errors. I'd appreciate it if someone
could point out where I'm going wrong.
Here's what I'm trying to do:
I can train and run a model on ordinary data. I can also reorder
sentences in a
you want. It just becomes a
> feature in the system's log-linear model. The weight used to bias
> this feature is weight-i.
>
> Chris
>
> On Fri, Mar 26, 2010 at 1:17 AM, Suzy Howlett
> wrote:
>> Thanks, that sounds like a good thing to try. But where would you
&
a transition (in fact, I think you can
> have an arbitrary number of features), so you can use that to encoded
> whether the path your on corresponds to the reordered variant or not.
> -Chris
>
> On Thu, Mar 25, 2010 at 8:51 PM, Suzy Howlett
> wrote:
>> Hi Chris,
>>
thing like this. What are you trying to do?
>
> -Chris
>
> On Thu, Mar 25, 2010 at 8:14 PM, Suzy Howlett
> wrote:
>> Hi,
>>
>> I am just starting my foray into the world of adding features to
>> Moses
>> and haven't quite got my head around
Hi,
I am just starting my foray into the world of adding features to Moses
and haven't quite got my head around it yet. Could someone please
check I'm on the right track, or tell me if I've overlooked an easier
alternative?
The feature that I want to add is essentially a sentence-level flag
54 matches
Mail list logo
