Re: [Moses-support] Problem with processPhraseTableMin

2016-02-02 Thread Marcin Junczys-Dowmunt
Looks fine, I had no problems running it with 18 and more domain indicators. Your machine is certainly more than suitable. Just one remark, using more than 8-12 threads usually slows things down, but should not cause crashes. Any chance to have a look at that table? W dniu 02.02.2016 o 18:16, J

Re: [Moses-support] Problem with processPhraseTableMin

2016-02-02 Thread Jeremy Gwinnup
Marcin, I was able to use -T with processLexicalTableMin successfully. I also tried processPhraseTableMin using a local tmp dir with 200G free and it still crashed at step 3 with the huge malloc message. Phrase table is nothing fancy - just standard 4 scores and 3 domain indicator features. Her

Re: [Moses-support] Problem with processPhraseTableMin

2016-02-02 Thread Marcin Junczys-Dowmunt
Ooh right, didn't look at that. That's weird. Is there something special about that phrase table other than the 7 scores? It seems to build a huge huffman tree for the the first set of scores. Based on the reported memory allocation it seems to be quite big, but not big enough that it should ca

Re: [Moses-support] Problem with processPhraseTableMin

2016-02-02 Thread Kenneth Heafield
That typically causes a bus error. Why is there an overly huge malloc? On 02/02/2016 03:53 PM, Marcin Junczys-Dowmunt wrote: > I think it fills up your temporary folder, try "-T ." to specify thew > local folder for temporary files. > > On 02.02.2016 16:21, Jeremy Gwinnup wrote: >> Hi, >> >> I’

Re: [Moses-support] Problem with processPhraseTableMin

2016-02-02 Thread Marcin Junczys-Dowmunt
I think it fills up your temporary folder, try "-T ." to specify thew local folder for temporary files. On 02.02.2016 16:21, Jeremy Gwinnup wrote: > Hi, > > I’m having a problem using processPhraseTableMin to compress a phrase table > with 7 scores - the program consistently coredumps at step 3

[Moses-support] Problem with processPhraseTableMin

2016-02-02 Thread Jeremy Gwinnup
Hi, I’m having a problem using processPhraseTableMin to compress a phrase table with 7 scores - the program consistently coredumps at step 3 - command and relevant output below. Is there anything I’m doing glaringly wrong? Thanks! -Jeremy Command: 1tqoct1:model> $MOSES/bin/processPhraseTableM

Re: [Moses-support] kbmira died with SIGABRT when tuning

2016-02-02 Thread Dingyuan Wang
Hi all, Sorry for posting on the old thread. It can't be a memory problem. I ran a similar experiment on another machine, and failed the same way that some bytes in WT feature score are corrupted. 在 2016年01月20日 18:20, Barry Haddow 写道: > Hi Dingyuan > > What platform are you running on? I could