[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157129#comment-15157129 ]
Stavros Kontopoulos edited comment on SPARK-13431 at 2/22/16 3:32 PM: ---------------------------------------------------------------------- The Java Virtual Machine specification limits the size of generated Java byte code for each method in a class to the maximum of 64K bytes. so i think its not something you can avoid at shade or scala compiler level. Some highly relevant links: https://groups.google.com/forum/#!topic/scala-internals/f6PwUxc8K7I http://www.cubrid.org/blog/dev-platform/understanding-jvm-internals/ was (Author: skonto): The Java Virtual Machine specification limits the size of generated Java byte code for each method in a class to the maximum of 64K bytes. so i think its not something you cannot avoid at shade or scala compiler level. Some highly relevant links: https://groups.google.com/forum/#!topic/scala-internals/f6PwUxc8K7I http://www.cubrid.org/blog/dev-platform/understanding-jvm-internals/ > Maven build fails due to: Method code too large! in Catalyst > ------------------------------------------------------------ > > Key: SPARK-13431 > URL: https://issues.apache.org/jira/browse/SPARK-13431 > Project: Spark > Issue Type: Bug > Components: Build, Optimizer > Affects Versions: 2.0.0 > Reporter: Stavros Kontopoulos > Priority: Blocker > > Cannot build the project when run the normal build commands: > eg. > {code} > build/mvn -Phadoop-2.6 -Dhadoop.version=2.6.0 clean package > ./make-distribution.sh --name test --tgz -Phadoop-2.6 > {code} > Integration builds are also failing: > https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-hadoop-2.6/229/console > https://ci.typesafe.com/job/mit-docker-test-zk-ref/12/console > It looks like this is the commit that introduced the issue: > https://github.com/apache/spark/commit/7925071280bfa1570435bde3e93492eaf2167d56 -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org