[ https://issues.apache.org/jira/browse/SPARK-17942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15576375#comment-15576375 ]
Harish commented on SPARK-17942: -------------------------------- --conf "spark.executor.extraJavaOptions=-XX:ReservedCodeCacheSize=600m" -- will work. thanks > OpenJDK 64-Bit Server VM warning: Try increasing the code cache size using > -XX:ReservedCodeCacheSize= > ----------------------------------------------------------------------------------------------------- > > Key: SPARK-17942 > URL: https://issues.apache.org/jira/browse/SPARK-17942 > Project: Spark > Issue Type: Bug > Components: PySpark > Affects Versions: 2.0.1 > Reporter: Harish > Priority: Minor > > My code snipped is in below location. In that snippet i had put only few > columns, but in my test case i have data with 10M rows and 10,000 columns. > http://stackoverflow.com/questions/39602596/convert-groupbykey-to-reducebykey-pyspark > I see below message in spark 2.0.2 snapshot > # Stderr of the node > OpenJDK 64-Bit Server VM warning: CodeCache is full. Compiler has been > disabled. > OpenJDK 64-Bit Server VM warning: Try increasing the code cache size using > -XX:ReservedCodeCacheSize= > # stdout of the node > CodeCache: size=245760Kb used=242680Kb max_used=242689Kb free=3079Kb > bounds [0x00007f32c5000000, 0x00007f32d4000000, 0x00007f32d4000000] > total_blobs=41388 nmethods=40792 adapters=501 > compilation: disabled (not enough contiguous free space left) -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org