[
https://issues.apache.org/jira/browse/MAHOUT-1766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200095#comment-15200095
]
Andrew Palumbo commented on MAHOUT-1766:
----------------------------------------
I've run into this with different spark versions and different jvms. It's
easily overcome by stetting the JVM options in line when launching the
spark-shell.
eg.:
{code}
$MAHOUT_OPTS="-Xmx6g -XX:MaxPermSize=512m" mahout spark-shell
{code}
It does seem to pop up mow with Spatk 1.5.2 regularly, so maybe we should add
this as the default into the {{/bin/mahout}} launcher, though that might be a
bit restrictive.
> Increase default PermGen size for spark-shell
> ---------------------------------------------
>
> Key: MAHOUT-1766
> URL: https://issues.apache.org/jira/browse/MAHOUT-1766
> Project: Mahout
> Issue Type: Improvement
> Components: Mahout spark shell
> Affects Versions: 0.11.0
> Reporter: Sergey Tryuber
> Assignee: Andrew Palumbo
> Fix For: 0.12.0
>
>
> Mahout spark-shell is run with default perm gen size (64MB). Taking into
> account that it depends on lots of external jars and the whole count of used
> Java classes is very large, we constantly observe spontaneous corresponding
> OOM exceptions.
> A hot fix from our side is to modify envelope bash script (added
> -XX:PermSize=512m):
> {code}
> "$JAVA" $JAVA_HEAP_MAX -XX:PermSize=512m $MAHOUT_OPTS -classpath "$CLASSPATH"
> "org.apache.mahout.sparkbindings.shell.Main" $@
> {code}
> Of course, more elegant solution is needed. After the applied fix, the errors
> had gone.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
