The spark shell interpreter logs don’t seem to give me much more info. It says
it cannot run the job and the exception given is
org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit
value: 1)
at
org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404)
at
org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166)
at
org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:153)
at
org.apache.zeppelin.shell.ShellInterpreter.interpret(ShellInterpreter.java:74)
at
org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:57)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:300)
at org.apache.zeppelin.scheduler.Job.run(Job.java:169)
at
org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:134)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
From: Jeff Zhang <[email protected]>
Reply-To: "[email protected]" <[email protected]>
Date: Tuesday, August 16, 2016 at 9:13 AM
To: "[email protected]" <[email protected]>
Subject: Re: Possible to use Zeppelin Shell Interpreter to start a spark-submit
job?
Please check the shell interpreter log.
On Tue, Aug 16, 2016 at 10:11 PM, Peter DeNicola
<[email protected]<mailto:[email protected]>>
wrote:
I’m trying to run a spark-submit job using a jar in HDFS from Zeppelin, but all
I’m getting back is Process exited with an error: 1 (Exit value: 1)
Which I’m not sure what this means. If anyone knows anything about this—or if
it is even possible—I could use some help.
--
Best Regards
Jeff Zhang