Trevor Grant created ZEPPELIN-1507:
--------------------------------------
Summary: SparkR doesn't work on YARN
Key: ZEPPELIN-1507
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1507
Project: Zeppelin
Issue Type: Bug
Components: r-interpreter
Reporter: Trevor Grant
Assignee: Trevor Grant
Priority: Minor
Fix For: 0.6.2, 0.7.0, 0.6.1, 0.6.0
SparkR fails when running on YARN because "localhost" is hardcoded.
Error:
.zeppelinR = SparkR:::callJStatic("org.apache.zeppelin.spark.ZeppelinR",
"getZeppelinR", hashCode)
at
org.apache.zeppelin.spark.ZeppelinR.waitForRScriptInitialized(ZeppelinR.java:295)
at org.apache.zeppelin.spark.ZeppelinR.request(ZeppelinR.java:235)
at org.apache.zeppelin.spark.ZeppelinR.eval(ZeppelinR.java:183)
at org.apache.zeppelin.spark.ZeppelinR.open(ZeppelinR.java:172)
at
org.apache.zeppelin.spark.SparkRInterpreter.open(SparkRInterpreter.java:85)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.getProgress(LazyOpenInterpreter.java:110)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer.getProgress(RemoteInterpreterServer.java:454)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$getProgress.getResult(RemoteInterpreterService.java:1701)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$getProgress.getResult(RemoteInterpreterService.java:1686)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
This is was recently fixed in Spark:
https://github.com/apache/spark/pull/14666/files
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
