[
https://issues.apache.org/jira/browse/SPARK-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13967784#comment-13967784
]
Sean Owen commented on SPARK-1479:
----------------------------------
"yarn" is the slightly more appropriate profile, but, read:
https://github.com/apache/spark/pull/151
What Spark doesn't quite support is "YARN beta" and that's what you've got on
your hands here.
FWIW I am in favor of the change in this PR to make it all work. Soon, support
for YARN alpha/beta can just go away anyway.
If you are interested in CDH, the best thing is moving to CDH5, which already
has Spark set up in standalone mode, and which has "YARN stable". It also works
with CDH 4.6 in standalone mode as a parcel.
> building spark on 2.0.0-cdh4.4.0 failed
> ---------------------------------------
>
> Key: SPARK-1479
> URL: https://issues.apache.org/jira/browse/SPARK-1479
> Project: Spark
> Issue Type: Question
> Environment: 2.0.0-cdh4.4.0
> Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL
> spark 0.9.1
> java version "1.6.0_32"
> Reporter: jackielihf
> Attachments: mvn.log
>
>
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile (scala-compile-first) on
> project spark-yarn-alpha_2.10: Execution scala-compile-first of goal
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed. CompileFailed ->
> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal net.alchim31.maven:scala-maven-plugin:3.1.5:compile
> (scala-compile-first) on project spark-yarn-alpha_2.10: Execution
> scala-compile-first of goal
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:225)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution
> scala-compile-first of goal
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:110)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
> ... 19 more
> Caused by: Compilation failed
> at sbt.compiler.AnalyzingCompiler.call(AnalyzingCompiler.scala:76)
> at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:35)
> at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:29)
> at
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply$mcV$sp(AggressiveCompile.scala:71)
> at
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
> at
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
> at
> sbt.compiler.AggressiveCompile.sbt$compiler$AggressiveCompile$$timed(AggressiveCompile.scala:101)
> at
> sbt.compiler.AggressiveCompile$$anonfun$4.compileScala$1(AggressiveCompile.scala:70)
> at
> sbt.compiler.AggressiveCompile$$anonfun$4.apply(AggressiveCompile.scala:88)
> at
> sbt.compiler.AggressiveCompile$$anonfun$4.apply(AggressiveCompile.scala:60)
> at
> sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:24)
> at
> sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:22)
> at sbt.inc.Incremental$.cycle(Incremental.scala:40)
> at sbt.inc.Incremental$.compile(Incremental.scala:25)
> at sbt.inc.IncrementalCompile$.apply(Compile.scala:20)
> at sbt.compiler.AggressiveCompile.compile2(AggressiveCompile.scala:96)
> at sbt.compiler.AggressiveCompile.compile1(AggressiveCompile.scala:44)
> at com.typesafe.zinc.Compiler.compile(Compiler.scala:158)
> at com.typesafe.zinc.Compiler.compile(Compiler.scala:142)
> at
> sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:77)
> at
> scala_maven.ScalaCompilerSupport.incrementalCompile(ScalaCompilerSupport.java:296)
> at
> scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:123)
> at
> scala_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:104)
> at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:460)
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
> ... 20 more
> [ERROR]
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn <goals> -rf :spark-yarn-alpha_2.10
> =============
> thks
--
This message was sent by Atlassian JIRA
(v6.2#6252)
