[jira] [Commented] (SPARK-1479) building spark on 2.0.0-cdh4.4.0 failed

2014-10-16 Thread qiaohaijun (JIRA) 

[ 
https://issues.apache.org/jira/browse/SPARK-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173543#comment-14173543
 ] 

qiaohaijun commented on SPARK-1479:
---

 sh make-distribution.sh --tgz -Phadoop-provided -Pyarn -DskipTests 
-Dhadoop.version=2.3.0-cdh5.0.0 -Phive -Dhive.verison=0.13.1

get the same error output

> building spark on 2.0.0-cdh4.4.0 failed
> ---
>
> Key: SPARK-1479
> URL: https://issues.apache.org/jira/browse/SPARK-1479
> Project: Spark
>  Issue Type: Question
> Environment: 2.0.0-cdh4.4.0
> Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL
> spark 0.9.1
> java version "1.6.0_32"
>Reporter: jackielihf
> Attachments: mvn.log
>
>
> [INFO] 
> 
> [ERROR] Failed to execute goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile (scala-compile-first) on 
> project spark-yarn-alpha_2.10: Execution scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed. CompileFailed -> 
> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute 
> goal net.alchim31.maven:scala-maven-plugin:3.1.5:compile 
> (scala-compile-first) on project spark-yarn-alpha_2.10: Execution 
> scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:225)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
>   at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
>   at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
>   at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
>   at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
>   at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>   at java.lang.reflect.Method.invoke(Method.java:597)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution 
> scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
>   at 
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:110)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
>   ... 19 more
> Caused by: Compilation failed
>   at sbt.compiler.AnalyzingCompiler.call(AnalyzingCompiler.scala:76)
>   at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:35)
>   at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:29)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply$mcV$sp(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile.sbt$compiler$AggressiveCompile$$timed(AggressiveCompile.scala:101)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.compileScala$1(AggressiveCompile.scala:70)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.apply(AggressiveCompile.scala:88)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.apply(AggressiveCompile.scala:60)
>   at 
> sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:24)
>   at 
> sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:22)
>   at sbt.inc.Incremental$.cycle(Incremental.scala:40)
>   at sbt.inc.Incremental$.compile(Incrementa

[jira] [Commented] (SPARK-1479) building spark on 2.0.0-cdh4.4.0 failed

2014-07-15 Thread James Z.M. Gao (JIRA) 

[ 
https://issues.apache.org/jira/browse/SPARK-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063098#comment-14063098
 ] 

James Z.M. Gao commented on SPARK-1479:
---

What's the status about this issue, do we have decision whether to accept the 
PR, or have a timeline for totally removing all support of un-stable yarn api?

> building spark on 2.0.0-cdh4.4.0 failed
> ---
>
> Key: SPARK-1479
> URL: https://issues.apache.org/jira/browse/SPARK-1479
> Project: Spark
>  Issue Type: Question
> Environment: 2.0.0-cdh4.4.0
> Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL
> spark 0.9.1
> java version "1.6.0_32"
>Reporter: jackielihf
> Attachments: mvn.log
>
>
> [INFO] 
> 
> [ERROR] Failed to execute goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile (scala-compile-first) on 
> project spark-yarn-alpha_2.10: Execution scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed. CompileFailed -> 
> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute 
> goal net.alchim31.maven:scala-maven-plugin:3.1.5:compile 
> (scala-compile-first) on project spark-yarn-alpha_2.10: Execution 
> scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:225)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
>   at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
>   at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
>   at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
>   at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
>   at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>   at java.lang.reflect.Method.invoke(Method.java:597)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution 
> scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
>   at 
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:110)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
>   ... 19 more
> Caused by: Compilation failed
>   at sbt.compiler.AnalyzingCompiler.call(AnalyzingCompiler.scala:76)
>   at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:35)
>   at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:29)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply$mcV$sp(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile.sbt$compiler$AggressiveCompile$$timed(AggressiveCompile.scala:101)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.compileScala$1(AggressiveCompile.scala:70)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.apply(AggressiveCompile.scala:88)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.apply(AggressiveCompile.scala:60)
>   at 
> sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:24)
>   at 
> sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:22)
>   at sbt.inc.Incremental$.cycle(Incremental.scala:40)
>   at sbt.inc.Incremental$.compile(I

[jira] [Commented] (SPARK-1479) building spark on 2.0.0-cdh4.4.0 failed

2014-04-15 Thread James Z.M. Gao (JIRA) 

[ 
https://issues.apache.org/jira/browse/SPARK-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13969397#comment-13969397
 ] 

James Z.M. Gao commented on SPARK-1479:
---

yes, long-term solution should be migrating to stable api or CDH5(stable 
version just come out two weeks ago) or hadoop 2.3.
for many production environments, IMO, this PR make sense.

> building spark on 2.0.0-cdh4.4.0 failed
> ---
>
> Key: SPARK-1479
> URL: https://issues.apache.org/jira/browse/SPARK-1479
> Project: Spark
>  Issue Type: Question
> Environment: 2.0.0-cdh4.4.0
> Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL
> spark 0.9.1
> java version "1.6.0_32"
>Reporter: jackielihf
> Attachments: mvn.log
>
>
> [INFO] 
> 
> [ERROR] Failed to execute goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile (scala-compile-first) on 
> project spark-yarn-alpha_2.10: Execution scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed. CompileFailed -> 
> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute 
> goal net.alchim31.maven:scala-maven-plugin:3.1.5:compile 
> (scala-compile-first) on project spark-yarn-alpha_2.10: Execution 
> scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:225)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
>   at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
>   at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
>   at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
>   at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
>   at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>   at java.lang.reflect.Method.invoke(Method.java:597)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution 
> scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
>   at 
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:110)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
>   ... 19 more
> Caused by: Compilation failed
>   at sbt.compiler.AnalyzingCompiler.call(AnalyzingCompiler.scala:76)
>   at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:35)
>   at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:29)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply$mcV$sp(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile.sbt$compiler$AggressiveCompile$$timed(AggressiveCompile.scala:101)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.compileScala$1(AggressiveCompile.scala:70)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.apply(AggressiveCompile.scala:88)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.apply(AggressiveCompile.scala:60)
>   at 
> sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:24)
>   at 
> sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:22)
>   at sbt.inc.Incremental$.cycle(Incremental.scala:40)
>   at sbt

[jira] [Commented] (SPARK-1479) building spark on 2.0.0-cdh4.4.0 failed

2014-04-13 Thread Sean Owen (JIRA) 

[ 
https://issues.apache.org/jira/browse/SPARK-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13967784#comment-13967784
 ] 

Sean Owen commented on SPARK-1479:
--

"yarn" is the slightly more appropriate profile, but, read: 
https://github.com/apache/spark/pull/151
What Spark doesn't quite support is "YARN beta" and that's what you've got on 
your hands here.

FWIW I am in favor of the change in this PR to make it all work. Soon, support 
for YARN alpha/beta can just go away anyway.

If you are interested in CDH, the best thing is moving to CDH5, which already 
has Spark set up in standalone mode, and which has "YARN stable". It also works 
with CDH 4.6 in standalone mode as a parcel.

> building spark on 2.0.0-cdh4.4.0 failed
> ---
>
> Key: SPARK-1479
> URL: https://issues.apache.org/jira/browse/SPARK-1479
> Project: Spark
>  Issue Type: Question
> Environment: 2.0.0-cdh4.4.0
> Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL
> spark 0.9.1
> java version "1.6.0_32"
>Reporter: jackielihf
> Attachments: mvn.log
>
>
> [INFO] 
> 
> [ERROR] Failed to execute goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile (scala-compile-first) on 
> project spark-yarn-alpha_2.10: Execution scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed. CompileFailed -> 
> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute 
> goal net.alchim31.maven:scala-maven-plugin:3.1.5:compile 
> (scala-compile-first) on project spark-yarn-alpha_2.10: Execution 
> scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:225)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
>   at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
>   at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
>   at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
>   at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
>   at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>   at java.lang.reflect.Method.invoke(Method.java:597)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution 
> scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
>   at 
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:110)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
>   ... 19 more
> Caused by: Compilation failed
>   at sbt.compiler.AnalyzingCompiler.call(AnalyzingCompiler.scala:76)
>   at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:35)
>   at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:29)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply$mcV$sp(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile.sbt$compiler$AggressiveCompile$$timed(AggressiveCompile.scala:101)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.compileScala$1(AggressiveCompile.scala:70)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.apply(AggressiveCompile.scala:88)
>

[jira] [Commented] (SPARK-1479) building spark on 2.0.0-cdh4.4.0 failed

2014-04-13 Thread witgo (JIRA) 

[ 
https://issues.apache.org/jira/browse/SPARK-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13967769#comment-13967769
 ] 

witgo commented on SPARK-1479:
--

CDH4.4.0 yarn api has changed .Right now Spark doesn't support 
cdh4.4,cdh4.5,cdh4.6

> building spark on 2.0.0-cdh4.4.0 failed
> ---
>
> Key: SPARK-1479
> URL: https://issues.apache.org/jira/browse/SPARK-1479
> Project: Spark
>  Issue Type: Question
> Environment: 2.0.0-cdh4.4.0
> Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL
> spark 0.9.1
> java version "1.6.0_32"
>Reporter: jackielihf
> Attachments: mvn.log
>
>
> [INFO] 
> 
> [ERROR] Failed to execute goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile (scala-compile-first) on 
> project spark-yarn-alpha_2.10: Execution scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed. CompileFailed -> 
> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute 
> goal net.alchim31.maven:scala-maven-plugin:3.1.5:compile 
> (scala-compile-first) on project spark-yarn-alpha_2.10: Execution 
> scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:225)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
>   at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
>   at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
>   at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
>   at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
>   at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>   at java.lang.reflect.Method.invoke(Method.java:597)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution 
> scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
>   at 
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:110)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
>   ... 19 more
> Caused by: Compilation failed
>   at sbt.compiler.AnalyzingCompiler.call(AnalyzingCompiler.scala:76)
>   at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:35)
>   at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:29)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply$mcV$sp(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile.sbt$compiler$AggressiveCompile$$timed(AggressiveCompile.scala:101)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.compileScala$1(AggressiveCompile.scala:70)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.apply(AggressiveCompile.scala:88)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.apply(AggressiveCompile.scala:60)
>   at 
> sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:24)
>   at 
> sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:22)
>   at sbt.inc.Incremental$.cycle(Incremental.scala:40)
>   at sbt.inc.Incremental$.compile(Incremental.scala:25)
>   at sbt.inc.IncrementalCompile$.apply(Compile.scala:20)
>

[jira] [Commented] (SPARK-1479) building spark on 2.0.0-cdh4.4.0 failed

2014-04-12 Thread witgo (JIRA) 

[ 
https://issues.apache.org/jira/browse/SPARK-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13967719#comment-13967719
 ] 

witgo commented on SPARK-1479:
--

You can give all of the logs?
{code}
mvn -Pyarn-alpha -Dhadoop.version=2.0.0-cdh4.4.0 -Dyarn.version=2.0.0-chd4.4.0 
-DskipTests clean package -X > mvn.log
{code}

> building spark on 2.0.0-cdh4.4.0 failed
> ---
>
> Key: SPARK-1479
> URL: https://issues.apache.org/jira/browse/SPARK-1479
> Project: Spark
>  Issue Type: Bug
> Environment: 2.0.0-cdh4.4.0
> Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL
> spark 0.9.1
> java version "1.6.0_32"
>Reporter: jackielihf
>
> [INFO] 
> 
> [ERROR] Failed to execute goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile (scala-compile-first) on 
> project spark-yarn-alpha_2.10: Execution scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed. CompileFailed -> 
> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute 
> goal net.alchim31.maven:scala-maven-plugin:3.1.5:compile 
> (scala-compile-first) on project spark-yarn-alpha_2.10: Execution 
> scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:225)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
>   at 
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
>   at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
>   at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
>   at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
>   at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
>   at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>   at java.lang.reflect.Method.invoke(Method.java:597)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
>   at 
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution 
> scala-compile-first of goal 
> net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
>   at 
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:110)
>   at 
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
>   ... 19 more
> Caused by: Compilation failed
>   at sbt.compiler.AnalyzingCompiler.call(AnalyzingCompiler.scala:76)
>   at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:35)
>   at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:29)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply$mcV$sp(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
>   at 
> sbt.compiler.AggressiveCompile.sbt$compiler$AggressiveCompile$$timed(AggressiveCompile.scala:101)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.compileScala$1(AggressiveCompile.scala:70)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.apply(AggressiveCompile.scala:88)
>   at 
> sbt.compiler.AggressiveCompile$$anonfun$4.apply(AggressiveCompile.scala:60)
>   at 
> sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:24)
>   at 
> sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:22)
>   at sbt.inc.Incremental$.cycle(Incremental.scala:40)
>   at sbt.inc.Incremental$.compile(Incremental.scala:25)
>   at sbt.inc.Incremental