I think the difference was the -Dscala2.11 to the command line. I have seen this show up when I miss that.
Regards, Nachiketa On Sat 3 Sep, 2016, 12:14 PM Diwakar Dhanuskodi, < diwakar.dhanusk...@gmail.com> wrote: > Hi, > > Just re-ran again without killing zinc server process > > /make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive > -Pyarn -Dmaven.version=3.0.4 -Dscala-2.11 -X -rf :spark-sql_2.11 > > Build is success. Not sure how it worked with just re-running command > again. > > On Sat, Sep 3, 2016 at 11:44 AM, Diwakar Dhanuskodi < > diwakar.dhanusk...@gmail.com> wrote: > >> Hi, >> >> java version 7 >> >> mvn command >> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive >> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 >> >> >> yes, I executed script to change scala version to 2.11 >> killed "com.typesafe zinc.Nailgun" process >> >> re-ran mvn with below command again >> >> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive >> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 -X -rf :spark-sql_2.11 >> >> Getting same error >> >> [warn] >> /home/cloudera/Downloads/spark-1.6.2/sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala:911: >> method isDir in class FileStatus is deprecated: see corresponding Javadoc >> for more information. >> [warn] status.isDir, >> [warn] ^ >> [error] missing or invalid dependency detected while loading class file >> 'WebUI.class'. >> [error] Could not access term eclipse in package org, >> [error] because it (or its dependencies) are missing. Check your build >> definition for >> [error] missing or conflicting dependencies. (Re-run with >> `-Ylog-classpath` to see the problematic classpath.) >> [error] A full rebuild may help if 'WebUI.class' was compiled against an >> incompatible version of org. >> [error] missing or invalid dependency detected while loading class file >> 'WebUI.class'. >> [error] Could not access term jetty in value org.eclipse, >> [error] because it (or its dependencies) are missing. Check your build >> definition for >> [error] missing or conflicting dependencies. (Re-run with >> `-Ylog-classpath` to see the problematic classpath.) >> [error] A full rebuild may help if 'WebUI.class' was compiled against an >> incompatible version of org.eclipse. >> [warn] 17 warnings found >> [error] two errors found >> [debug] Compilation failed (CompilerInterface) >> [error] Compile failed at Sep 3, 2016 11:28:34 AM [21.611s] >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Reactor Summary: >> [INFO] >> [INFO] Spark Project Parent POM .......................... SUCCESS >> [5.583s] >> [INFO] Spark Project Test Tags ........................... SUCCESS >> [4.189s] >> [INFO] Spark Project Launcher ............................ SUCCESS >> [12.226s] >> [INFO] Spark Project Networking .......................... SUCCESS >> [13.386s] >> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS >> [6.723s] >> [INFO] Spark Project Unsafe .............................. SUCCESS >> [21.231s] >> [INFO] Spark Project Core ................................ SUCCESS >> [3:46.334s] >> [INFO] Spark Project Bagel ............................... SUCCESS >> [7.032s] >> [INFO] Spark Project GraphX .............................. SUCCESS >> [19.558s] >> [INFO] Spark Project Streaming ........................... SUCCESS >> [50.452s] >> [INFO] Spark Project Catalyst ............................ SUCCESS >> [1:14.172s] >> [INFO] Spark Project SQL ................................. FAILURE >> [23.222s] >> [INFO] Spark Project ML Library .......................... SKIPPED >> [INFO] Spark Project Tools ............................... SKIPPED >> [INFO] Spark Project Hive ................................ SKIPPED >> [INFO] Spark Project Docker Integration Tests ............ SKIPPED >> [INFO] Spark Project REPL ................................ SKIPPED >> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED >> [INFO] Spark Project YARN ................................ SKIPPED >> [INFO] Spark Project Assembly ............................ SKIPPED >> [INFO] Spark Project External Twitter .................... SKIPPED >> [INFO] Spark Project External Flume Sink ................. SKIPPED >> [INFO] Spark Project External Flume ...................... SKIPPED >> [INFO] Spark Project External Flume Assembly ............. SKIPPED >> [INFO] Spark Project External MQTT ....................... SKIPPED >> [INFO] Spark Project External MQTT Assembly .............. SKIPPED >> [INFO] Spark Project External ZeroMQ ..................... SKIPPED >> [INFO] Spark Project External Kafka ...................... SKIPPED >> [INFO] Spark Project Examples ............................ SKIPPED >> [INFO] Spark Project External Kafka Assembly ............. SKIPPED >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] BUILD FAILURE >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Total time: 7:45.641s >> [INFO] Finished at: Sat Sep 03 11:28:34 IST 2016 >> [INFO] Final Memory: 49M/415M >> [INFO] >> ------------------------------------------------------------------------ >> [ERROR] Failed to execute goal >> net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) >> on project spark-sql_2.11: Execution scala-compile-first of goal >> net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed >> -> [Help 1] >> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute >> goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile >> (scala-compile-first) on project spark-sql_2.11: Execution >> scala-compile-first of goal >> net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:225) >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) >> at >> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) >> at >> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) >> at >> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) >> at >> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) >> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) >> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) >> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537) >> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196) >> at org.apache.maven.cli.MavenCli.main(MavenCli.java:141) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at >> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290) >> at >> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230) >> at >> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409) >> at >> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352) >> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution >> scala-compile-first of goal >> net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. >> at >> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:110) >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209) >> ... 19 more >> Caused by: Compile failed via zinc server >> at >> sbt_inc.SbtIncrementalCompiler.zincCompile(SbtIncrementalCompiler.java:136) >> at sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:86) >> at >> scala_maven.ScalaCompilerSupport.incrementalCompile(ScalaCompilerSupport.java:303) >> at scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:119) >> at >> scala_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:99) >> at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482) >> at >> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101) >> ... 20 more >> [ERROR] >> [ERROR] >> [ERROR] For more information about the errors and possible solutions, >> please read the following articles: >> [ERROR] [Help 1] >> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException >> [ERROR] >> [ERROR] After correcting the problems, you can resume the build with the >> command >> [ERROR] mvn <goals> -rf :spark-sql_2.11 >> >> >> On Thu, Sep 1, 2016 at 8:23 AM, Divya Gehlot <divya.htco...@gmail.com> >> wrote: >> >>> Which java version are you using ? >>> >>> On 31 August 2016 at 04:30, Diwakar Dhanuskodi < >>> diwakar.dhanusk...@gmail.com> wrote: >>> >>>> Hi, >>>> >>>> While building Spark 1.6.2 , getting below error in spark-sql. Much >>>> appreciate for any help. >>>> >>>> ERROR] missing or invalid dependency detected while loading class file >>>> 'WebUI.class'. >>>> Could not access term eclipse in package org, >>>> because it (or its dependencies) are missing. Check your build >>>> definition for >>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to >>>> see the problematic classpath.) >>>> A full rebuild may help if 'WebUI.class' was compiled against an >>>> incompatible version of org. >>>> [ERROR] missing or invalid dependency detected while loading class file >>>> 'WebUI.class'. >>>> Could not access term jetty in value org.eclipse, >>>> because it (or its dependencies) are missing. Check your build >>>> definition for >>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to >>>> see the problematic classpath.) >>>> A full rebuild may help if 'WebUI.class' was compiled against an >>>> incompatible version of org.eclipse. >>>> [WARNING] 17 warnings found >>>> [ERROR] two errors found >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [INFO] Reactor Summary: >>>> [INFO] >>>> [INFO] Spark Project Parent POM .......................... SUCCESS >>>> [4.399s] >>>> [INFO] Spark Project Test Tags ........................... SUCCESS >>>> [3.443s] >>>> [INFO] Spark Project Launcher ............................ SUCCESS >>>> [10.131s] >>>> [INFO] Spark Project Networking .......................... SUCCESS >>>> [11.849s] >>>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS >>>> [6.641s] >>>> [INFO] Spark Project Unsafe .............................. SUCCESS >>>> [19.765s] >>>> [INFO] Spark Project Core ................................ SUCCESS >>>> [4:16.511s] >>>> [INFO] Spark Project Bagel ............................... SUCCESS >>>> [13.401s] >>>> [INFO] Spark Project GraphX .............................. SUCCESS >>>> [1:08.824s] >>>> [INFO] Spark Project Streaming ........................... SUCCESS >>>> [2:18.844s] >>>> [INFO] Spark Project Catalyst ............................ SUCCESS >>>> [2:43.695s] >>>> [INFO] Spark Project SQL ................................. FAILURE >>>> [1:01.762s] >>>> [INFO] Spark Project ML Library .......................... SKIPPED >>>> [INFO] Spark Project Tools ............................... SKIPPED >>>> [INFO] Spark Project Hive ................................ SKIPPED >>>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED >>>> [INFO] Spark Project REPL ................................ SKIPPED >>>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED >>>> [INFO] Spark Project YARN ................................ SKIPPED >>>> [INFO] Spark Project Assembly ............................ SKIPPED >>>> [INFO] Spark Project External Twitter .................... SKIPPED >>>> [INFO] Spark Project External Flume Sink ................. SKIPPED >>>> [INFO] Spark Project External Flume ...................... SKIPPED >>>> [INFO] Spark Project External Flume Assembly ............. SKIPPED >>>> [INFO] Spark Project External MQTT ....................... SKIPPED >>>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED >>>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED >>>> [INFO] Spark Project External Kafka ...................... SKIPPED >>>> [INFO] Spark Project Examples ............................ SKIPPED >>>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [INFO] BUILD FAILURE >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [INFO] Total time: 12:40.525s >>>> [INFO] Finished at: Wed Aug 31 01:56:50 IST 2016 >>>> [INFO] Final Memory: 71M/830M >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [ERROR] Failed to execute goal >>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) >>>> on project spark-sql_2.11: Execution scala-compile-first of goal >>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed >>>> -> [Help 1] >>>> [ERROR] >>>> [ERROR] To see the full stack trace of the errors, re-run Maven with >>>> the -e switch. >>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >>>> [ERROR] >>>> [ERROR] For more information about the errors and possible solutions, >>>> please read the following articles: >>>> [ERROR] [Help 1] >>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException >>>> [ERROR] >>>> [ERROR] After correcting the problems, you can resume the build with >>>> the command >>>> [ERROR] mvn <goals> -rf :spark-sql_2.11 >>>> >>>> >>>> >>> >> >
