[Moses-support] Multi-parallel Corpus of Educational Domain

2015-10-20 Thread Hassan Sajjad
Dear all, We have collected a multilingually-aligned parallel corpus of transcripts of educational videos, and made it available for research purposes. The corpus consists of 20 different languages and the number of parallel sentences ranges from 335k to 43k. In addition to the commonly used langu

[Moses-support] Mixture modeling for OSM model

2015-10-15 Thread Hassan Sajjad
Hi all, We have modified the script for Operation Sequence Model (OSM) to incorporate language-model-like interpolation (of OSM sub-models trained individually on each domain), optimized on tune-set. We found this to be useful in our recent experiments. Please refer to the following paper for det

Re: [Moses-support] experiment.perl: command not found

2015-02-02 Thread Hassan Sajjad
Hi Fatma, experiment.perl exists in mosesdecoder/scripts/ems/. So to run with config.toy, you should say ../experiment.perl -config config.toy If everything looks okay after that. You can run ../experiment.perl -config config.toy -exec to run it. Hassan On Mon, Feb 2, 2015 at 6:23 PM, fatma elz

Re: [Moses-support] Moses-support post from hassaan...@gmail.com requires approval

2015-01-08 Thread Hassan Sajjad
/mgiza > Compared to what old version from where? > > I need to know what u ran and the corpus you ran. I'm not an expert on > mgiza so my debugging is as good as yours in this area > > On 08/01/15 12:52, Hassan Sajjad wrote: > > Sorry, I emailed from the wrong ad

Re: [Moses-support] Moses-support post from hassaan...@gmail.com requires approval

2015-01-08 Thread Hassan Sajjad
newer version of mgiza >> Reason: Post by non-member to a members-only list >> >> At your convenience, visit: >> >> http://mailman.mit.edu/mailman/admindb/moses-support >> >> to approve or deny the request. >> >> >> -

Re: [Moses-support] Regarding Transliteration using Moses

2013-11-30 Thread Hassan Sajjad
Hi Pranjal, If the command you mentioned is of your transliteration system then you are very close to done. Rather than specifying like the following: echo 'भारत'| ~/mosesdecoder/bin/moses -f ~/work1/train/model/moses.ini put space between the characters of the input word. So, moses considers it

[Moses-support] Problem in using MML

2013-08-31 Thread Hassan Sajjad
Hi, I am trying to use MML but it's crashing at the TRAINING_mml-filter-before-wa step. I could not resolve the problem. The error and conf entries are copied here. The corpus-mml-score.3 contains lines equal to my in-domain data and have score 9 on all lines. Is this correct? Thank you, Re

[Moses-support] Experimenter: giving an aligned corpus

2013-08-27 Thread Hassan Sajjad
ion it in GENERAL? I use "corpus =" -- Regards; Hassan Sajjad ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] mgiza: hillclimb different sums (-nan)

2013-04-13 Thread Hassan Sajjad
Hi, I am using mgiza for alignment. At model 4 1st iteration, hillclimb gives the following warning WARNING: already 47 iterations in hillclimb: 1.1 0 79 48 *WARNING: DIFFERENT SUMS: (1) (-nan)* WARNING: already 41 iterations in hillclimb: 3.28489 1 24 37 and after that p0_count is -nan whic