Re: Advise needed for Mahout heap size allocation (seq2sparse failure)

2014-12-19 Thread 万代豊
Thanks Andrew I believed to have specified something long before but there was no entry regarding heap specification in my mapred-site.xml. I have added mapred.child.java.opts property and have given -Xmx2024m. It started running well and have completed the job successfully. I guess I should also

Re: Advise needed for Mahout heap size allocation (seq2sparse failure)

2014-12-17 Thread Andrew Musselman
But also please update to Mahout version 0.9 since you're two versions behind. On Wed, Dec 17, 2014 at 10:55 AM, Andrew Musselman < andrew.mussel...@gmail.com> wrote: > > It's worth trying to increase the heap size for child JVMs per this doc, > depending on what version you're running: > http://h

Re: Advise needed for Mahout heap size allocation (seq2sparse failure)

2014-12-17 Thread Andrew Musselman
It's worth trying to increase the heap size for child JVMs per this doc, depending on what version you're running: http://hadoop.apache.org/docs/r2.5.1/hadoop-project-dist/hadoop-common/ClusterSetup.html On Tue, Dec 16, 2014 at 11:33 PM, 万代豊 <20525entrad...@gmail.com> wrote: > > Hi > After my seve

Advise needed for Mahout heap size allocation (seq2sparse failure)

2014-12-16 Thread 万代豊
Hi After my several successful jobs experiences on other Mahout Kmeans calculation in the past , I'm facing a sudden heap error as below in Mahout seq2sparse process.(Mahout-0.70 on Hadoop-0.20.203 Pseudo-distributed) [hadoop@localhost TEST]$ $MAHOUT_HOME/bin/mahout seq2sparse --namedVector -i TES