Github user zjffdu commented on the issue:
https://github.com/apache/zeppelin/pull/1404
@Leemoonsoo , I follow the above command, but seems it doesn't work. I
check `AbstractTestRestApi`, It seems pyspark related job would only run either
in travis CI or set in spark standalone with SPARK_HOME is setup (`pyspark`
needs to be set as true). Do I understand correctly ?
```
// ci environment runs spark cluster for testing
// so configure zeppelin use spark cluster
if ("true".equals(System.getenv("CI"))) {
// assume first one is spark
InterpreterSetting sparkIntpSetting = null;
for(InterpreterSetting intpSetting :
ZeppelinServer.notebook.getInterpreterFactory().get()) {
if (intpSetting.getName().equals("spark")) {
sparkIntpSetting = intpSetting;
}
}
// set spark master and other properties
sparkIntpSetting.getProperties().setProperty("master", "spark://" +
getHostname() + ":7071");
sparkIntpSetting.getProperties().setProperty("spark.cores.max",
"2");
// set spark home for pyspark
sparkIntpSetting.getProperties().setProperty("spark.home",
getSparkHome());
pySpark = true;
sparkR = true;
ZeppelinServer.notebook.getInterpreterFactory().restart(sparkIntpSetting.getId());
} else {
// assume first one is spark
InterpreterSetting sparkIntpSetting = null;
for(InterpreterSetting intpSetting :
ZeppelinServer.notebook.getInterpreterFactory().get()) {
if (intpSetting.getName().equals("spark")) {
sparkIntpSetting = intpSetting;
}
}
String sparkHome = getSparkHome();
if (sparkHome != null) {
sparkIntpSetting.getProperties().setProperty("master", "spark://"
+ getHostname() + ":7071");
sparkIntpSetting.getProperties().setProperty("spark.cores.max",
"2");
// set spark home for pyspark
sparkIntpSetting.getProperties().setProperty("spark.home",
sparkHome);
pySpark = true;
sparkR = true;
}
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
