Mike Sells created ZEPPELIN-1342: ------------------------------------ Summary: Adding dependencies via SPARK_SUBMIT_OPTIONS doesn't work on Spark 2.0.0 Key: ZEPPELIN-1342 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1342 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.6.1, 0.7.0 Reporter: Mike Sells
Passing dependencies via the SPARK_SUBMIT_OPTIONS seems to be broken in 0.6.1 and 0.7.0 when using Spark 2.0. To replicate pass in a package to SPARK_SUBMIT_OPTIONS like below: SPARK_SUBMIT_OPTIONS="--packages com.databricks:spark-avro_2.11:3.0.0" Now try to import it with: import com.databricks.spark.avro._ It will error out: <console>:25: error: object databricks is not a member of package com import com.databricks.spark.avro._ I checked the logs are there is no error retrieving the package. So it seems to be something with the classpath. -- This message was sent by Atlassian JIRA (v6.3.4#6332)