Re: [Moses-support] decoding a confusion network using Moses' API

2012-05-03 Thread Sylvain Raybaud
ypo(); if(prev != NULL) return moses_get_hyp(prev)+string(" ")+current; return current; } I must confess that I don't really understand what I'm doing :( I'm just copying code that works, and, well, that works. cheers, Sylvain On 27/04/12 13:11, Sylvain Raybaud

Re: [Moses-support] decoding a confusion network using Moses' API

2012-04-27 Thread Sylvain Raybaud
t really is producing "of" as the > translation, and why. > > cheers - Barry > > On Thursday 26 April 2012 16:41:06 Sylvain Raybaud wrote: >> wild guessing here: in TranslationTask::Run, I see there are many >> alternatives for processing the sentence, like doLatt

Re: [Moses-support] decoding a confusion network using Moses' API

2012-04-26 Thread Sylvain Raybaud
with this part of the code, but the strange score suggests >> that there's some uninitialised memory. You could try running through >> valgrind >> and it might give some clues, >> >> cheers - Barry >> >> On Thursday 26 Apr 2012 12:24:11 Sylvain Raybau

Re: [Moses-support] decoding a confusion network using Moses' API

2012-04-26 Thread Sylvain Raybaud
> Hi Sylvain > > I'm not familiar with this part of the code, but the strange score suggests > that there's some uninitialised memory. You could try running through > valgrind > and it might give some clues, > > cheers - Barry > > On Thursday 26 Apr

[Moses-support] decoding a confusion network using Moses' API

2012-04-26 Thread Sylvain Raybaud
mp;factor_order) { debug("start"); MyConfusionNet * cn = new MyConfusionNet(); int i = 0; while(phonemes[i]!=NULL) { debug("%s",phonemes[i]); MyConfusionNet::Column col = create_phoneme_col(cm,phonemes[i],width,thresh,factor_order);

Re: [Moses-support] KenLM: "The context of every 4-gram should appear as a 3-gram"

2012-02-17 Thread Sylvain Raybaud
ven't tried with a bigger corpus yet. You'll find the corpus here: http://perso.crans.org/raybaud/toy.sent_start_end.en.gz cheers, Sylvain > - As concerns Ken's question I have to double-check with the other > developers, I will come back to you very soon. > > best, >

Re: [Moses-support] KenLM: "The context of every 4-gram should appear as a 3-gram"

2012-02-16 Thread Sylvain Raybaud
emove this 4-gram the same problem arises with another >>> one, whose 3-gram prefix is also missing. I think it is the problem. If >>> I change the smoothing method to "sb" instead of "msb" I get a usable >>> LM. Is this normal behavior? Do you think it's a KenLM or

[Moses-support] KenLM: "The context of every 4-gram should appear as a 3-gram"

2012-02-16 Thread Sylvain Raybaud
t's a KenLM or an IRSTLM related problem? cheers, -- Sylvain Raybaud ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] [SOLVED?] GetLMImplementation function

2012-02-15 Thread Sylvain Raybaud
y suggest > separate unigram language model because Kneser-Ney, modified or > unmodified, assumes that you've backed off to a unigram and that > assumption doesn't hold in this case. > > Kenneth > > On 02/14/2012 10:49 AM, Sylvain Raybaud wrote: >> float moses_s

Re: [Moses-support] [SOLVED?] GetLMImplementation function

2012-02-14 Thread Sylvain Raybaud
ell me now :) I'll report back when it's done. cheers, and thanks everybody for your help, Sylvain On 06/02/12 13:20, Sylvain Raybaud wrote: > Hello > > I'm trying to update a software that makes use of Moses API. It uses (among > others) Moses' LanguageModel

Re: [Moses-support] problems compiling and installing lasted version

2012-02-14 Thread Sylvain Raybaud
On 13/02/12 20:32, Kenneth Heafield wrote: > Commit d62f301 adds option --includedir[=/path] to install headers. > Most headers are copied with their full paths; moses/src/* is installed > at the root. It works perfectly so far, thank you! cheers Sylvain -- Sylvai

Re: [Moses-support] problems compiling and installing lasted version

2012-02-13 Thread Sylvain Raybaud
em.jam:749: in load from module build-system ./jam-files/boost-build/kernel/modules.jam:283: in import from module modules ./jam-files/boost-build/kernel/bootstrap.jam:142: in boost-build from module ./jam-files/boost-build/boost-build.jam:8: in module scope from module It looks like it gets confused because of the symlink kenlm->lm. I guess I should tell it to ignore one of them. Do you have an idea how to do that? regards, -- Sylvain Raybaud ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] GetLMImplementation function

2012-02-08 Thread Sylvain Raybaud
eers - Barry > > On Tuesday 07 February 2012 12:24:07 Sylvain Raybaud wrote: > > Hi, List > > > > I've been digging into this but I'm still clueless... I really need to get > > > > the LanguageModelImplementation object, but nowhere in Base.h/cpp or

Re: [Moses-support] GetLMImplementation function

2012-02-08 Thread Sylvain Raybaud
2012 20:05:54 Hieu Hoang wrote: > hi sylvain > > i don't know the answer but from what i see, mosesserver still compiles > > On 07/02/2012 19:24, Sylvain Raybaud wrote: > > Hi, List > > > > I've been digging into this but I'

Re: [Moses-support] GetLMImplementation function

2012-02-07 Thread Sylvain Raybaud
ld then be renamed). But it also makes > people suspect foul play if I break anything in the process. > > Kenneth > > On 02/07/2012 09:03 AM, Barry Haddow wrote: > > Hi Sylvain > > > > I've updated the doxygen docs, if that helps, > > > > che

Re: [Moses-support] GetLMImplementation function

2012-02-07 Thread Sylvain Raybaud
By the way, I think mosesserver has got the same problem since its implementation uses the same methods I used. regards, Sylvain On Monday 06 February 2012 13:20:07 Sylvain Raybaud wrote: > Hello > > I'm trying to update a software that makes use of Moses API. It uses (among > o

[Moses-support] GetLMImplementation function

2012-02-06 Thread Sylvain Raybaud
Hello I'm trying to update a software that makes use of Moses API. It uses (among others) Moses' LanguageModel and LanguageModelImplementation classes. It used to call method GetLMImplementation of an object of type LanguageModel, in order to use methods NewState and GetValueForgotState of clas

Re: [Moses-support] problems compiling and installing lasted version

2012-02-06 Thread Sylvain Raybaud
*.hh : jam-files dist ] : > $(includedir)moses/src ; > > then run the same bjam command as you did before, it will install all > *.h and *.hh files (except those in dist or jam-files) and preserve > their directory structure. For example, lm/blank.hh will be installed > in /us

Re: [Moses-support] problems compiling and installing lasted version

2012-02-02 Thread sylvain . raybaud
y is not polluted, and one would just have to add -I$(includedir)/moses to one's compile flags in order to use Moses API? otherwise, what would you suggest to be able to use moses libraries? -I/path/to/mosesdecoder/moses/src? regards, > > Sorry for the build barf, > > Kenneth

[Moses-support] problems compiling and installing lasted version

2012-02-02 Thread Sylvain Raybaud
re CFLAGS? or is there a proper way to install headers? it seems rather strange to me that I can install DSO but not headers as it seems quite useless... best regards, -- Sylvain Raybaud ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] moses loading phrase table two times?

2011-02-23 Thread Sylvain Raybaud
rently running moses compiled from the last svn version. regards, -- Sylvain Raybaud # MERT optimized configuration # decoder /usr/local/bin/moses # BLEU 0.230684 on dev /home/sylvain/GMR/DATA/EUROPARL/test/en-fr.clean.fr # We were before running iteration 10 # finished Fri Feb 18 05:08:51 CET 2011 #

Re: [Moses-support] the insides of lattice decoding

2011-01-26 Thread Sylvain Raybaud
ols > data type are std::string's, which are converted to Moses's internal > integer format. In some cases, this could be a bit slower, but I don't > think it will be too inconvenient for most use cases. > > You can get the code by syncing to the tip of the trunk branch. >

Re: [Moses-support] the insides of lattice decoding

2011-01-25 Thread Sylvain Raybaud
when it comes to moses development, but if you think the above isn't really a problem, I'll consider implementing and checking in this builder. Anyway, I will first implement the workaround with istringstream :) best regards, -- Sylvain Raybaud

Re: [Moses-support] the insides of lattice decoding

2011-01-25 Thread Sylvain Raybaud
e good news is that it probably means less work for me. The bad news is that I'm really not sure about efficiency. But I'll worry about that later. > > hope that helps - regards - Barry It does, a lot. Thank you! -- Sylvain Raybaud ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] the insides of lattice decoding

2011-01-25 Thread Sylvain Raybaud
nt a a class, say MyWordLattices, that inherits Moses::WordLattice with a method to read lattices from memory 2) feed objects of type MyWordLattice to the Manager 3) look in awe as the magic happens. Am I right? thanks, and regards, -- Sylvain Raybaud __

Re: [Moses-support] Moses User Survey by TAUS

2011-01-19 Thread Sylvain Raybaud
s, > Philipp Koehn Hello After the very last step ("thanks") I got a 404 (http://www.translationautomation.com/about-taus/newsletters-and- alerts.htmlhttp://www.surveymonkey.com/). It's no big deal of course :) Also, will the results be published on this li

Re: [Moses-support] error with --with-kenlm

2011-01-12 Thread Sylvain Raybaud
d subsume "-L$(top_srcdir)/OnDiskPt/src -lOnDiskPt" since libmoses > depends on that too. There's probably a more elegant solution but > libtool/autoconf/automake/autodefectivekitchensink terrify me; I'm a > Boost.Build user. > > On 01/11/11 09:41, Sylvain Raybau

Re: [Moses-support] error with --enabled-shared

2011-01-11 Thread Sylvain Raybaud
Ooops, wrong subject, fixed. On Tuesday 11 January 2011 15:41:51 Sylvain Raybaud wrote: > Hi! thank you for the answer. It seems there is a problem when building > moses using --enable-shared. See: > > #with --enable-shared and --with-kenlm: > sylv...@markov ~/tmp $

Re: [Moses-support] error with --with-kenlm

2011-01-11 Thread Sylvain Raybaud
u do there as it doesn't affect others. If > you have useful contributions to trunk, then we're happy to have them, but > we'd need to be careful to keep the trunk as stable as possible. > > best regards - Barry > > On Tuesday 11 January 2011 09:59, Sylvain Raybaud w

[Moses-support] good practice for developping moses and using the svn

2011-01-11 Thread Sylvain Raybaud
the repository under the "branches" directory. What are the conditions to check in some work here ? should the entire source tree be copied here, or just the files I want to change ? thank you best regards, -- Sylvain Raybaud sylvain.rayb...@loria.fr http://www.loria.fr/~raybauds/ P

Re: [Moses-support] SLF to PLF - tests - moses crashing

2010-08-09 Thread Sylvain Raybaud
ry large number, which prevents some bad pruning > from taking place that can lead to crashes. > > [max-phrase-length] > > > Chris > Hi, thanks for your answer! I run moses with the option: -max-phrase-length 10 this should do, right? regards, Sylvain > On

Re: [Moses-support] SLF to PLF - tests - moses crashing

2010-08-09 Thread Sylvain Raybaud
rapper.cpp:511 #18 0x004086c4 in main (argc=11, argv=0x7fffd0f8) at Main.cpp:398 As I understand it, it crashed while it reads the lattice. So there must be something wrong in my script. It can't be probability above one, can it? Any hint is more than welcome... regards, Sylvai

Re: [Moses-support] SLF to PLF: how to remove links

2010-08-06 Thread Sylvain Raybaud
sible with giza++? regards, On Friday 06 August 2010 15:17:06 Sylvain Raybaud wrote: > fixed one more bug. But now... moses just seems to be doing nothing: > > sylv...@markov /global/markov/raybauds/XP/S2T $ nice moses -inputtype 2 - > weight-i 1 -f working-dir/filtered-Oll

Re: [Moses-support] translation input format

2010-08-06 Thread Sylvain Raybaud
On Friday 06 August 2010 15:36:14 Gary Daine wrote: > I have a very basic-sounding question, but I've not been able to find > any reference in the documentation. > > Since Moses is trained on tokenized, lowercased corpora, is it necessary > to tokenize and lowercase the text to be translated as we

Re: [Moses-support] SLF to PLF

2010-08-06 Thread Sylvain Raybaud
avg. cols/sent:-nan On Friday 06 August 2010 15:04:59 Sylvain Raybaud wrote: > Yep that works, I promise next time I'll think before I post :) > Thank you! > > see new script attached. > > On Friday 06 August 2010 14:54:41 Jie Jiang wrote: > > add a \ before t

Re: [Moses-support] SLF to PLF

2010-08-06 Thread Sylvain Raybaud
t; Glasnevin, Dublin 9. > Tel: +353 (0)1 700 6724 > > > > > 2010/8/6 Sylvain Raybaud > > > On Friday 06 August 2010 14:06:55 Sylvain Raybaud wrote: > > > * moses cannot translate "real world" graph generated with this tool. > > > &g

Re: [Moses-support] SLF to PLF

2010-08-06 Thread Sylvain Raybaud
On Friday 06 August 2010 14:06:55 Sylvain Raybaud wrote: > * moses cannot translate "real world" graph generated with this tool. > See for example: http://perso.crans.org/raybaud/realworld.slf.gz got it: sphinx hypothesis contains a quote: nous incombe d' assurer which

Re: [Moses-support] SLF to PLF

2010-08-06 Thread Sylvain Raybaud
On Friday 06 August 2010 11:44:25 Sylvain Raybaud wrote: > Hello > > A few days ago I came to you asking if someone knew of a script to turn > word lattice from SLF (HTK format) into PLF (Moses input format). It seems > that doesn't exist yet, so here is my proposal (

[Moses-support] SLF to PLF

2010-08-06 Thread Sylvain Raybaud
ing: utf-8 -*- # # # Copyright (C) 2010, Sylvain Raybaud # All rights reserved. # # Redistribution and use in source and binary forms, with or without # modification, are permitted provided that the following conditions are met: # * Redistributions of source code must retain the above copyright #

Re: [Moses-support] converting lattice from HTK to PLF

2010-08-03 Thread Sylvain Raybaud
be happy to answer questions about the lattice format > as they come up, although I'm starting a new job this week and may be > delayed in responding to questions. > > On Mon, Aug 2, 2010 at 10:47 AM, Sylvain Raybaud > > wrote: > > Hello, dear Moses community >

[Moses-support] converting lattice from HTK to PLF

2010-08-02 Thread Sylvain Raybaud
lcome. Thank you! best regards, -- Sylvain Raybaud sylvain.rayb...@loria.fr http://www.loria.fr/~raybauds/ PhD student LORIA/INRIA - Nancy, France office C137 +33 3 83 59 30 32 ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mi