Github user Leemoonsoo commented on the issue:
https://github.com/apache/zeppelin/pull/1349
Hi, @gbloisi Thanks for the contribution.
Zeppelin can be built with one version of Spark. The specific version of
spark dependencies will be collected into "${INTERPRETER_DIR}/dep". When user
doesn't have local spark installation, Zeppelin will load them in the classpath.
When user have spark installation, Zeppelin allows user set SPARK_HOME to a
different version that Zeppelin has been built with. It supposed to work.
So when SPARK_HOME is set, Zeppelin will run interpreter process with
SPARK_HOME/bin/spark-submit command and it'll include spark dependencies under
SPARK_HOME in the classpath. And the spark dependencies version can be
different from dependencies in "${INTERPRETER_DIR}/dep". So we probably don't
want to add "${INTERPRETER_DIR}/dep" into the classpath in this case.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---