[ 
https://issues.apache.org/jira/browse/MAHOUT-588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12989192#comment-12989192
 ] 

Szymon Chojnacki commented on MAHOUT-588:
-----------------------------------------

seq2sparse_small_fail does not have detailed info why a job did not succeed, 
e.g.

2011-01-30 01:25:55,726 INFO org.apache.hadoop.mapred.JobClient (main): Task Id 
: attempt_201101300001_0003_m_000159_0, Status : FAILED

I get such info locally, maybe changing mapred.child.java.opts parameter in 
conf/mapred-site.xml can help, I have: 

     <property>
          <name>mapred.child.java.opts</name>
          <value>-Xmx2000M -XX:-HeapDumpOnOutOfMemoryError</value>
     </property>


> Benchmark Mahout's clustering performance on EC2 and publish the results
> ------------------------------------------------------------------------
>
>                 Key: MAHOUT-588
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-588
>             Project: Mahout
>          Issue Type: Task
>            Reporter: Grant Ingersoll
>         Attachments: SequenceFilesFromMailArchives.java, 
> SequenceFilesFromMailArchives2.java, Uncompress.java, 
> distcp_large_to_s3_failed.log, seq2sparse_small_failed.log, 
> seq2sparse_xlarge_ok.log
>
>
> For Taming Text, I've commissioned some benchmarking work on Mahout's 
> clustering algorithms.  I've asked the two doing the project to do all the 
> work in the open here.  The goal is to use a publicly reusable dataset (for 
> now, the ASF mail archives, assuming it is big enough) and run on EC2 and 
> make all resources available so others can reproduce/improve.
> I'd like to add the setup code to utils (although it could possibly be done 
> as a Vectorizer) and the publication of the results will be put up on the 
> Wiki as well as in the book.  This issue is to track the patches, etc.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to