[Moses-support] running giza in parts

2009-12-23 Thread Mark Fishel
Dear list,

can anyone direct me to a description of the exact algorithm of
running giza++ in parts? I know the co-occurrence file is used for
more memory efficient storage of the translation table and probably
basically defines which word pairs are to be included into the
t-table. However I'm not sure how the combination of several
co-occurrence files is performed if the training data is processed in
several parts (--parts N). I tried reading the training script (the
"run_single_giza_on_parts" sub) and the algorithm is still a mystery
to me.

Thank You in advance,
Mark Fishel
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] The results of your email commands

2009-12-23 Thread Miles Osborne
randlm is already in a binary format, so there is no extra conversion

loading randomised models faster is not something that we have really
looked at.

Miles

2009/12/23 Arda Tezcan :
> Hi,
> I would really appreciate it if you could help me with the following
> question I have:
> I was wondering if a LM created with RANDLM can be converted into a binary
> format?
> Or is there maybe another way of loading the model faster?
>
> I know it is possible with IRSTLM and SRILM but I couldn't find anything
> about RANDLM.
> Thank you in advance for your support
>
> Best regards,
> Arda Tezcan
>
>
>
>
>
> ___
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>



-- 
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] The results of your email commands

2009-12-23 Thread Arda Tezcan
Hi,
I would really appreciate it if you could help me with the following question I 
have:
I was wondering if a LM created with RANDLM can be converted into a binary 
format?

Or is there maybe another way of loading the model faster? 

I know it is possible with IRSTLM and SRILM but I couldn't find anything about 
RANDLM.
Thank you in advance for your support

Best regards,
Arda Tezcan


  ___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support