[ https://issues.apache.org/jira/browse/SPARK-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13965857#comment-13965857 ]
Xuan Gong commented on SPARK-1465: ---------------------------------- YARN-1824 changes the APIs in Apps, which causes the spark build to break if built against a version 2.4.0. > Spark compilation is broken with the latest hadoop-2.4.0 release > ---------------------------------------------------------------- > > Key: SPARK-1465 > URL: https://issues.apache.org/jira/browse/SPARK-1465 > Project: Spark > Issue Type: Bug > Reporter: Xuan Gong > > Building spark with the latest 2.4.0 version of yarn, appears to be broken > {code} > [ERROR] Apps.addToEnvironment(env, Environment.CLASSPATH.name, > Environment.PWD.$() + > [ERROR] ^ > [ERROR] > /yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala:441: > not enough arguments for method addToEnvironment: (x$1: > java.util.Map[String,String], x$2: String, x$3: String, x$4: String)Unit. > Unspecified value parameter x$4. > [ERROR] Apps.addToEnvironment(env, Environment.CLASSPATH.name, > Environment.PWD.$() + > [ERROR] ^ > [ERROR] > /yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala:446: > not enough arguments for method addToEnvironment: (x$1: > java.util.Map[String,String], x$2: String, x$3: String, x$4: String)Unit. > Unspecified value parameter x$4. > [ERROR] Apps.addToEnvironment(env, Environment.CLASSPATH.name, > Environment.PWD.$() + > [ERROR] ^ > [ERROR] > /yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala:449: > not enough arguments for method addToEnvironment: (x$1: > java.util.Map[String,String], x$2: String, x$3: String, x$4: String)Unit. > Unspecified value parameter x$4. > [ERROR] Apps.addToEnvironment(env, Environment.CLASSPATH.name, > Environment.PWD.$() + > [ERROR] ^ > [ERROR] > /yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala:170: > not enough arguments for method setEnvFromInputString: (x$1: > java.util.Map[String,String], x$2: String, x$3: String)Unit. > Unspecified value parameter x$3. > [ERROR] Apps.setEnvFromInputString(env, > System.getenv("SPARK_YARN_USER_ENV")) > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)