Eran, Looks like this is a problem related to Xmx, when using sbt for scala.
Here are the instructions - http://www.scala-sbt.org/0.13/docs/Setup-Notes.html#JVM+heap%2C+permgen%2C+and+stack+sizes . Do revert with the outcome of the new settings of sbt launcher. Thanks, Rohit. On Fri, Nov 6, 2015 at 9:49 AM, Eran Witkon <[email protected]> wrote: > Anyone? > On Thu, 5 Nov 2015 at 21:23 Eran Witkon <[email protected]> wrote: > > > Here is the last part of log > > [WARNING] unused-1.0.0.jar, spark-catalyst_2.10-1.5.1.jar, > > spark-sql_2.10-1.5.1.jar, spark-mllib_2.10-1.5.1.jar, > > spark-graphx_2.10-1.5.1.jar, spark-streaming-twitter_2.10-1.5.1.jar, > > spark-hive_2.10-1.5.1.jar, spark-core_2.10-1.5.1.jar, > > spark-launcher_2.10-1.5.1.jar, spark-network-common_2.10-1.5.1.jar, > > spark-network-shuffle_2.10-1.5.1.jar, spark-repl_2.10-1.5.1.jar, > > spark-unsafe_2.10-1.5.1.jar, spark-bagel_2.10-1.5.1.jar, > > spark-streaming_2.10-1.5.1.jar define 1 overlappping classes: > > [WARNING] - org.apache.spark.unused.UnusedStubClass > > [WARNING] parquet-format-2.3.0-incubating.jar, > > parquet-hadoop-bundle-1.6.0.jar define 151 overlappping classes: > > [WARNING] - parquet.org.apache.thrift.server.TServer$Args > > [WARNING] - > > parquet.org.apache.thrift.transport.AutoExpandingBufferWriteTransport > > [WARNING] - > > parquet.org.apache.thrift.transport.TSaslTransport$NegotiationStatus > > [WARNING] - parquet.org.apache.thrift.protocol.TMessage > > [WARNING] - parquet.org.apache.thrift.meta_data.StructMetaData > > [WARNING] - parquet.org.apache.thrift.protocol.TProtocolException > > [WARNING] - > > parquet.org.apache.thrift.server.TNonblockingServer$FrameBuffer > > [WARNING] - parquet.org.apache.thrift.TBaseProcessor > > [WARNING] - parquet.org.slf4j.helpers.BasicMarker > > [WARNING] - parquet.org.apache.thrift.protocol.TSimpleJSONProtocol > > [WARNING] - 141 more... > > [WARNING] kryo-2.21.jar, minlog-1.2.jar define 2 overlappping classes: > > [WARNING] - com.esotericsoftware.minlog.Log > > [WARNING] - com.esotericsoftware.minlog.Log$Logger > > [WARNING] kryo-2.21.jar, objenesis-1.2.jar define 32 overlappping > classes: > > [WARNING] - org.objenesis.ObjenesisBase > > [WARNING] - org.objenesis.instantiator.gcj.GCJInstantiator > > [WARNING] - org.objenesis.ObjenesisHelper > > [WARNING] - > org.objenesis.instantiator.jrockit.JRockitLegacyInstantiator > > [WARNING] - > > org.objenesis.instantiator.sun.SunReflectionFactoryInstantiator > > [WARNING] - org.objenesis.instantiator.ObjectInstantiator > > [WARNING] - > > org.objenesis.instantiator.gcj.GCJInstantiatorBase$DummyStream > > [WARNING] - > > org.objenesis.instantiator.basic.ObjectStreamClassInstantiator > > [WARNING] - org.objenesis.ObjenesisException > > [WARNING] - org.objenesis.Objenesis > > [WARNING] - 22 more... > > [WARNING] jansi-1.4.jar, jline-2.12.jar, jline-2.10.4.jar define 23 > > overlappping classes: > > [WARNING] - org.fusesource.hawtjni.runtime.Library > > [WARNING] - org.fusesource.jansi.Ansi$2 > > [WARNING] - org.fusesource.jansi.AnsiConsole$1 > > [WARNING] - org.fusesource.jansi.internal.Kernel32 > > [WARNING] - org.fusesource.jansi.Ansi$1 > > [WARNING] - org.fusesource.jansi.WindowsAnsiOutputStream > > [WARNING] - org.fusesource.jansi.AnsiString > > [WARNING] - org.fusesource.jansi.internal.Kernel32$COORD > > [WARNING] - org.fusesource.jansi.Ansi$NoAnsi > > [WARNING] - org.fusesource.jansi.AnsiRenderer > > [WARNING] - 13 more... > > [WARNING] commons-logging-1.1.1.jar, jcl-over-slf4j-1.7.10.jar define 6 > > overlappping classes: > > [WARNING] - org.apache.commons.logging.impl.SimpleLog$1 > > [WARNING] - org.apache.commons.logging.Log > > [WARNING] - org.apache.commons.logging.impl.SimpleLog > > [WARNING] - org.apache.commons.logging.LogConfigurationException > > [WARNING] - org.apache.commons.logging.impl.NoOpLog > > [WARNING] - org.apache.commons.logging.LogFactory > > [WARNING] apache-log4j-extras-1.2.17.jar, log4j-1.2.17.jar define 126 > > overlappping classes: > > [WARNING] - org.apache.log4j.pattern.MessagePatternConverter > > [WARNING] - org.apache.log4j.xml.DOMConfigurator$4 > > [WARNING] - > > org.apache.log4j.pattern.NameAbbreviator$DropElementAbbreviator > > [WARNING] - org.apache.log4j.varia.StringMatchFilter > > [WARNING] - org.apache.log4j.spi.OptionHandler > > [WARNING] - org.apache.log4j.pattern.LevelPatternConverter > > [WARNING] - org.apache.log4j.pattern.BridgePatternParser > > [WARNING] - org.apache.log4j.BasicConfigurator > > [WARNING] - org.apache.log4j.pattern.LoggingEventPatternConverter > > [WARNING] - org.apache.log4j.ConsoleAppender$SystemErrStream > > [WARNING] - 116 more... > > [WARNING] jline-2.12.jar, jline-2.10.4.jar define 2 overlappping classes: > > [WARNING] - org.fusesource.jansi.internal.Kernel32$INPUT_RECORD > > [WARNING] - org.fusesource.jansi.internal.Kernel32$KEY_EVENT_RECORD > > [WARNING] javax.servlet-3.0.0.v201112011016.jar, > > javax.servlet-api-3.0.1.jar, javax.servlet-3.1.jar define 74 overlappping > > classes: > > [WARNING] - javax.servlet.http.Cookie > > [WARNING] - javax.servlet.ServletContext > > [WARNING] - javax.servlet.Registration > > [WARNING] - javax.servlet.http.HttpSessionListener > > [WARNING] - javax.servlet.http.HttpSessionContext > > [WARNING] - javax.servlet.FilterChain > > [WARNING] - javax.servlet.http.HttpServletRequestWrapper > > [WARNING] - javax.servlet.http.HttpSessionAttributeListener > > [WARNING] - javax.servlet.annotation.HandlesTypes > > [WARNING] - javax.servlet.http.HttpSessionBindingListener > > [WARNING] - 64 more... > > [WARNING] kryo-2.21.jar, reflectasm-1.07-shaded.jar define 23 > overlappping > > classes: > > [WARNING] - > > com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.Opcodes > > [WARNING] - com.esotericsoftware.reflectasm.AccessClassLoader > > [WARNING] - > > com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.Label > > [WARNING] - > > com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.ClassWriter > > [WARNING] - > > > com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.AnnotationVisitor > > [WARNING] - > com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.Type > > [WARNING] - com.esotericsoftware.reflectasm.FieldAccess > > [WARNING] - com.esotericsoftware.reflectasm.ConstructorAccess > > [WARNING] - > com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.Edge > > [WARNING] - > > com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.ClassVisitor > > [WARNING] - 13 more... > > [WARNING] spark-network-common_2.10-1.5.1.jar, guava-15.0.jar define 7 > > overlappping classes: > > [WARNING] - com.google.common.base.Absent > > [WARNING] - com.google.common.base.Function > > [WARNING] - com.google.common.base.Supplier > > [WARNING] - com.google.common.base.Optional$1$1 > > [WARNING] - com.google.common.base.Optional$1 > > [WARNING] - com.google.common.base.Present > > [WARNING] - com.google.common.base.Optional > > [WARNING] hadoop-yarn-api-2.2.0.jar, hadoop-yarn-common-2.2.0.jar define > 3 > > overlappping classes: > > [WARNING] - org.apache.hadoop.yarn.util.package-info > > [WARNING] - org.apache.hadoop.yarn.factories.package-info > > [WARNING] - org.apache.hadoop.yarn.factory.providers.package-info > > [WARNING] maven-shade-plugin has detected that some .class files > > [WARNING] are present in two or more JARs. When this happens, only > > [WARNING] one single version of the class is copied in the uberjar. > > [WARNING] Usually this is not harmful and you can skeep these > > [WARNING] warnings, otherwise try to manually exclude artifacts > > [WARNING] based on mvn dependency:tree -Ddetail=true and the above > > [WARNING] output > > [WARNING] See http://docs.codehaus.org/display/MAVENUSER/Shade+Plugin > > [INFO] Replacing original artifact with shaded artifact. > > [INFO] Replacing > > > /opt/incubator-zeppelin-master/spark-dependencies/target/zeppelin-spark-dependencies-0.6.0-incubating-SNAPSHOT.jar > > with > > > /opt/incubator-zeppelin-master/spark-dependencies/target/zeppelin-spark-dependencies-0.6.0-incubating-SNAPSHOT-shaded.jar > > [INFO] Dependency-reduced POM written at: > > > /opt/incubator-zeppelin-master/spark-dependencies/dependency-reduced-pom.xml > > [INFO] > > [INFO] --- maven-dependency-plugin:2.8:copy-dependencies > > (copy-dependencies) @ zeppelin-spark-dependencies --- > > [INFO] Copying datanucleus-api-jdo-3.2.6.jar to > > > /opt/incubator-zeppelin-master/spark-dependencies/target/../../interpreter/spark/dep/datanucleus-api-jdo-3.2.6.jar > > [INFO] Copying datanucleus-core-3.2.10.jar to > > > /opt/incubator-zeppelin-master/spark-dependencies/target/../../interpreter/spark/dep/datanucleus-core-3.2.10.jar > > [INFO] Copying datanucleus-rdbms-3.2.9.jar to > > > /opt/incubator-zeppelin-master/spark-dependencies/target/../../interpreter/spark/dep/datanucleus-rdbms-3.2.9.jar > > [INFO] > > [INFO] --- maven-dependency-plugin:2.8:copy (default) @ > > zeppelin-spark-dependencies --- > > [INFO] Configured Artifact: > > > org.apache.zeppelin:zeppelin-spark-dependencies:0.6.0-incubating-SNAPSHOT:jar > > [INFO] Copying zeppelin-spark-dependencies-0.6.0-incubating-SNAPSHOT.jar > > to > > > /opt/incubator-zeppelin-master/spark-dependencies/target/../../interpreter/spark/dep/zeppelin-spark-dependencies-0.6.0-incubating-SNAPSHOT.jar > > [INFO] > > [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ > > zeppelin-spark-dependencies --- > > [INFO] > > [INFO] > > ------------------------------------------------------------------------ > > [INFO] Building Zeppelin: Spark 0.6.0-incubating-SNAPSHOT > > [INFO] > > ------------------------------------------------------------------------ > > [INFO] > > [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @ > zeppelin-spark > > --- > > [INFO] Deleting /opt/incubator-zeppelin-master/spark/target > > [INFO] > > [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build) @ > > zeppelin-spark --- > > [INFO] > > [INFO] > > [INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ > > zeppelin-spark --- > > [INFO] Using 'UTF-8' encoding to copy filtered resources. > > [INFO] Copying 17 resources > > [INFO] > > [INFO] --- maven-remote-resources-plugin:1.4:process (default) @ > > zeppelin-spark --- > > [INFO] > > [INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ > > zeppelin-spark --- > > [INFO] Using 'UTF-8' encoding to copy filtered resources. > > [INFO] Copying 1 resource > > [INFO] Copying 4 resources > > [INFO] > > [INFO] --- maven-scala-plugin:2.15.2:compile (default) @ zeppelin-spark > --- > > [INFO] Checking for multiple versions of scala > > [WARNING] Expected all dependencies to require Scala version: 2.10.4 > > [WARNING] com.twitter:chill_2.10:0.5.0 requires scala version: 2.10.4 > > [WARNING] org.spark-project.akka:akka-remote_2.10:2.3.4-spark requires > > scala version: 2.10.4 > > [WARNING] org.spark-project.akka:akka-actor_2.10:2.3.4-spark requires > > scala version: 2.10.4 > > [WARNING] org.spark-project.akka:akka-slf4j_2.10:2.3.4-spark requires > > scala version: 2.10.4 > > [WARNING] org.apache.spark:spark-core_2.10:1.4.1 requires scala version: > > 2.10.4 > > [WARNING] org.json4s:json4s-jackson_2.10:3.2.10 requires scala version: > > 2.10.0 > > [WARNING] Multiple versions of scala libraries detected! > > [INFO] includes = [**/*.java,**/*.scala,] > > [INFO] excludes = [] > > [INFO] /opt/incubator-zeppelin-master/spark/src/main/java:-1: info: > > compiling > > [INFO] /opt/incubator-zeppelin-master/spark/src/main/scala:-1: info: > > compiling > > [INFO] Compiling 15 source files to > > /opt/incubator-zeppelin-master/spark/target/classes at 1446751226698 > > [ERROR] OpenJDK 64-Bit Server VM warning: INFO: > > os::commit_memory(0x00000000fd873000, 41472000, 0) failed; error='Cannot > > allocate memory' (errno=12) > > [ERROR] OpenJDK 64-Bit Server VM warning: INFO: > > os::commit_memory(0x00000000fd873000, 41472000, 0) failed; error='Cannot > > allocate memory' (errno=12)# > > [INFO] # There is insufficient memory for the Java Runtime Environment to > > continue. > > [INFO] # Native memory allocation (mmap) failed to map 41472000 bytes for > > committing reserved memory. > > [ERROR] # An error report file with more information is saved as: > > [INFO] # /opt/incubator-zeppelin-master/hs_err_pid15757.log > > [INFO] > > ------------------------------------------------------------------------ > > [INFO] Reactor Summary: > > [INFO] > > [INFO] Zeppelin ........................................... SUCCESS [ > > 18.509 s] > > [INFO] Zeppelin: Interpreter .............................. SUCCESS [ > > 24.603 s] > > [INFO] Zeppelin: Zengine .................................. SUCCESS [ > > 8.009 s] > > [INFO] Zeppelin: Spark dependencies ....................... SUCCESS > [01:06 > > min] > > [INFO] Zeppelin: Spark .................................... FAILURE [ > > 29.037 s] > > [INFO] Zeppelin: Markdown interpreter ..................... SKIPPED > > [INFO] Zeppelin: Angular interpreter ...................... SKIPPED > > [INFO] Zeppelin: Shell interpreter ........................ SKIPPED > > [INFO] Zeppelin: Hive interpreter ......................... SKIPPED > > [INFO] Zeppelin: Apache Phoenix Interpreter ............... SKIPPED > > [INFO] Zeppelin: PostgreSQL interpreter ................... SKIPPED > > [INFO] Zeppelin: Tajo interpreter ......................... SKIPPED > > [INFO] Zeppelin: Flink .................................... SKIPPED > > [INFO] Zeppelin: Apache Ignite interpreter ................ SKIPPED > > [INFO] Zeppelin: Kylin interpreter ........................ SKIPPED > > [INFO] Zeppelin: Lens interpreter ......................... SKIPPED > > [INFO] Zeppelin: Cassandra ................................ SKIPPED > > [INFO] Zeppelin: web Application .......................... SKIPPED > > [INFO] Zeppelin: Server ................................... SKIPPED > > [INFO] Zeppelin: Packaging distribution ................... SKIPPED > > [INFO] > > ------------------------------------------------------------------------ > > [INFO] BUILD FAILURE > > [INFO] > > ------------------------------------------------------------------------ > > [INFO] Total time: 02:29 min > > [INFO] Finished at: 2015-11-05T14:20:39-05:00 > > [INFO] Final Memory: 59M/241M > > [INFO] > > ------------------------------------------------------------------------ > > [ERROR] Failed to execute goal > > org.scala-tools:maven-scala-plugin:2.15.2:compile (default) on project > > zeppelin-spark: wrap: org.apache.commons.exec.ExecuteException: Process > > exited with an error: 1(Exit value: 1) -> [Help 1] > > [ERROR] > > [ERROR] To see the full stack trace of the errors, re-run Maven with the > > -e switch. > > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > > [ERROR] > > [ERROR] For more information about the errors and possible solutions, > > please read the following articles: > > [ERROR] [Help 1] > > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException > > [ERROR] > > [ERROR] After correcting the problems, you can resume the build with the > > command > > [ERROR] mvn <goals> -rf :zeppelin-spark > > > > > > On Thu, Nov 5, 2015 at 9:14 PM rohit choudhary <[email protected]> > wrote: > > > >> Hi Eran, > >> > >> Some more logs please? > >> > >> Thanks, > >> Rohit. > >> > >> On Fri, Nov 6, 2015 at 12:15 AM, Eran Witkon <[email protected]> > >> wrote: > >> > >> > Does anyone knows what this is and how to resolve it? > >> > > >> > [ERROR] Failed to execute goal > >> > org.scala-tools:maven-scala-plugin:2.15.2:compile (default) on project > >> > zeppelin-spark: wrap: org.apache.commons.exec.ExecuteException: > Process > >> > exited with an error: 137(Exit value: 137) -> [Help 1] > >> > > >> > Eran > >> > > >> > > >
