Re: [Moses-support] CeateOnDiskPt throws 'Already Saved' Exception on phrase table in sample_models/phrase-model

2015-05-04 Thread Hieu Hoang
On 05/05/2015 02:46, kwame porter robinson wrote: Hi, I am attempting to binarize a large ascii phrase table using CreateOnDiskPt. Each phrase table row contains the source phrase, target phrase and a single score. I am getting a 'Already Saved' exception for phrase tables larger than 9 lines.

[Moses-support] CeateOnDiskPt throws 'Already Saved' Exception on phrase table in sample_models/phrase-model

2015-05-04 Thread kwame porter robinson
Hi, I am attempting to binarize a large ascii phrase table using CreateOnDiskPt. Each phrase table row contains the source phrase, target phrase and a single score. I am getting a 'Already Saved' exception for phrase tables larger than 9 lines. I am using Moses release 2.1. The exception is repro

Re: [Moses-support] 12-gram language model ARPA file for 16GB

2015-05-04 Thread Marcin Junczys-Dowmunt
Yeah, I guess going up by one order of magnitude might be necessary. This might be a good opportunity to try pruning? It will same some space from the third step on. W dniu 04.05.2015 o 21:06, liling tan pisze: @Marcin, thank you for the helpful insight. I guess i'll need to ask for more HDD s

Re: [Moses-support] 12-gram language model ARPA file for 16GB

2015-05-04 Thread liling tan
@Marcin, thank you for the helpful insight. I guess i'll need to ask for more HDD space from my supervisor =) ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] 12-gram language model ARPA file for 16GB

2015-05-04 Thread Marcin Junczys-Dowmunt
Hi, I've been happily building 9-gram models, but class-based from some 80 GB gzipped text. I think lmplz used up to 2.5 TB for that? W dniu 04.05.2015 o 20:50, liling tan pisze: Dear Moses devs/users, Does anyone know an estimation of the HDD space needed for 12grams language model on 16GB

Re: [Moses-support] 12-gram language model ARPA file for 16GB

2015-05-04 Thread liling tan
Dear Moses devs/users, Does anyone know an estimation of the HDD space needed for 12grams language model on 16GB of text? Has anyone tried something similar? I've tried to clear up my HDD and even with 420GB, it's not enough to store the 12grams language model. *STDERR:* === 1/5 Counting and so

Re: [Moses-support] How to use XML-Input in Moses?

2015-05-04 Thread Philipp Koehn
Hi, there is no tool distributed with Moses to do that. -phi On Sat, May 2, 2015 at 6:09 PM, liling tan wrote: > Dear Moses devs/users, > > I want to use the XML-Input to add constraints when decoding > (http://www.statmt.org/moses/?n=Advanced.Hybrid#ntoc7) > > The example on the Moses page sho