Hello,I am trying to build Zeppeling. The cluster it will be connecting to is
on Spark 1.4.1 and Hadoop 2.7 so I need to build it with support for Yarn,
Spark 1.4 and Hadoop 2.7. This is the command I am trying:mvn clean install
-Pspark-1.4 -Dspark.version=1.4.1 -Dhadoop.version=2.7.0 -Phadoop-2.7 -Pyarn
-DskipTestsAnd this is the error I get:[WARNING] The requested profile
"spark-1.4" could not be activated because it does not exist.[WARNING] The
requested profile "hadoop-2.7" could not be activated because it does not
exist.[ERROR] Failed to execute goal on project zeppelin-spark: Could not
resolve dependencies for project
com.nflabs.zeppelin:zeppelin-spark:jar:0.5.0-SNAPSHOT: The following artifacts
could not be resolved: org.apache.hadoop:hadoop-yarn-api:jar:1.0.4,
org.apache.hadoop:hadoop-yarn-common:jar:1.0.4,
org.apache.hadoop:hadoop-yarn-server-web-proxy:jar:1.0.4,
org.apache.hadoop:hadoop-yarn-client:jar:1.0.4: Could not find artifact
org.apache.hadoop:hadoop-yarn-api:jar:1.0.4 in nflabs public repository
(https://raw.github.com/NFLabs/mvn-repo/master/releases) -> [Help 1]If I launch
Zeppeling, it gets to start, but when I execute anything on the notebook,
nothing happens, and I see an error in the interpreter log:
ERROR [2015-08-09 22:26:25,974] ({pool-1-thread-3}
ProcessFunction.java[process]:41) - Internal error processing
openjava.lang.NoClassDefFoundError: Could not initialize class
org.apache.spark.deploy.yarn.YarnSparkHadoopUtil$ at
org.apache.spark.deploy.yarn.ClientArguments.<init>(ClientArguments.scala:39)
at
org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:54)
at
org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:141)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:497) at
com.nflabs.zeppelin.spark.SparkInterpreter.createSparkContext(SparkInterpreter.java:255)
at
com.nflabs.zeppelin.spark.SparkInterpreter.getSparkContext(SparkInterpreter.java:127)
at
com.nflabs.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:373) at
com.nflabs.zeppelin.interpreter.ClassloaderInterpreter.open(ClassloaderInterpreter.java:56)
at
com.nflabs.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:51)
at
com.nflabs.zeppelin.interpreter.remote.RemoteInterpreterServer.open(RemoteInterpreterServer.java:145)
at
com.nflabs.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$open.getResult(RemoteInterpreterService.java:741)
at
com.nflabs.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$open.getResult(RemoteInterpreterService.java:726)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at
org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Did anybody suceeded to build with these versions?Thanks in advance
