[ 
https://issues.apache.org/jira/browse/MAHOUT-1766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15223380#comment-15223380
 ] 

Suneel Marthi commented on MAHOUT-1766:
---------------------------------------

I would go with documenting this in README

> Increase default PermGen size for spark-shell
> ---------------------------------------------
>
>                 Key: MAHOUT-1766
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1766
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Mahout spark shell
>    Affects Versions: 0.11.0
>            Reporter: Sergey Tryuber
>            Assignee: Andrew Musselman
>             Fix For: 0.12.0
>
>
> Mahout spark-shell is run with default perm gen size (64MB). Taking into 
> account that it depends on lots of external jars and the whole count of used 
> Java classes is very large, we constantly observe spontaneous corresponding 
> OOM exceptions.
> A hot fix from our side is to modify envelope bash script (added 
> -XX:PermSize=512m):
> {code}
> "$JAVA" $JAVA_HEAP_MAX -XX:PermSize=512m $MAHOUT_OPTS -classpath "$CLASSPATH" 
> "org.apache.mahout.sparkbindings.shell.Main" $@
> {code}
> Of course, more elegant solution is needed. After the applied fix, the errors 
> had gone.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to