Re: [Moses-support] hierarchical pbmt issue
Thanks for the reply.. I will try it out.. On Thu, Dec 17, 2020 at 4:10 PM Hieu Hoang wrote: > also, the lack of disk space may be in /tmp, not just your output > directory. > > i'm not sure exactly how you run the training but in the command > extract-parallel.perl, the 'sort' should use a temp directory that has lots > space. So change your command >...extract-parallel.perl 40 split "sort" > to >...extract-parallel.perl 40 split "sort -T [directory with lots of > space]" > > Hieu Hoang > http://statmt.org/hieu > > > On Thu, 17 Dec 2020 at 02:31, Hieu Hoang wrote: > >> its likely you have run out of disk space during the extraction of the >> hierarchical phrase table. it requires about 10 times more disk space to >> train than the standard phrase-nased models >> On Thu Dec 17,20 2:10 AM, ram anirudh cherukupally wrote: >> Hi Everyone >> >> I have been trying to train a hierarchical PBMT (without linguistic >> annotation) system using moses, with the switch --hierarchical to >> train-model.perl (as specified in the manual) >> >> I see that rule-table is not being generated during the training. Phrase >> table is being generated without any problem, but rule table is empty >> (rule-table.gz) turns out to be empty. >> >> Apparently, gzip is failing in Step 5. But I don't know why, because it >> appears to work fine with vanilla PBMT. I am sending the training log >> (stdout), Kindly help me. >> >> -- >> CH Ram Anirudh >> >> -- >> Hieu Hoanghttp://statmt.org/hieu >> >> -- CH Ram Anirudh ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] hierarchical pbmt issue
also, the lack of disk space may be in /tmp, not just your output directory. i'm not sure exactly how you run the training but in the command extract-parallel.perl, the 'sort' should use a temp directory that has lots space. So change your command ...extract-parallel.perl 40 split "sort" to ...extract-parallel.perl 40 split "sort -T [directory with lots of space]" Hieu Hoang http://statmt.org/hieu On Thu, 17 Dec 2020 at 02:31, Hieu Hoang wrote: > its likely you have run out of disk space during the extraction of the > hierarchical phrase table. it requires about 10 times more disk space to > train than the standard phrase-nased models > On Thu Dec 17,20 2:10 AM, ram anirudh cherukupally wrote: > Hi Everyone > > I have been trying to train a hierarchical PBMT (without linguistic > annotation) system using moses, with the switch --hierarchical to > train-model.perl (as specified in the manual) > > I see that rule-table is not being generated during the training. Phrase > table is being generated without any problem, but rule table is empty > (rule-table.gz) turns out to be empty. > > Apparently, gzip is failing in Step 5. But I don't know why, because it > appears to work fine with vanilla PBMT. I am sending the training log > (stdout), Kindly help me. > > -- > CH Ram Anirudh > > -- > Hieu Hoanghttp://statmt.org/hieu > > ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] hierarchical pbmt issue
its likely you have run out of disk space during the extraction of the hierarchical phrase table. it requires about 10 times more disk space to train than the standard phrase-nased models On Thu Dec 17,20 2:10 AM, ram anirudh cherukupally wrote: Hi Everyone I have been trying to train a hierarchical PBMT (without linguistic annotation) system using moses, with the switch --hierarchical to train-model.perl (as specified in the manual) I see that rule-table is not being generated during the training. Phrase table is being generated without any problem, but rule table is empty (rule-table.gz) turns out to be empty. Apparently, gzip is failing in Step 5. But I don't know why, because it appears to work fine with vanilla PBMT. I am sending the training log (stdout), Kindly help me. -- CH Ram Anirudh -- Hieu Hoang http://statmt.org/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
