Re: Issue loading dependency with SPARK_SUBMIT_OPTIONS w/ 0.6.1

2016-08-17 Thread Michael Sells
Thanks. Created a JIRA and referenced 0.6.1 and 0.7.0. On Wed, Aug 17, 2016 at 8:21 AM Dylan Meissner < dylan.meiss...@gettyimages.com> wrote: > Thanks for pointing this out. It is impacting 0.7.0 as well. > -- > *From:* Michael Sells <mjse...@

Issue loading dependency with SPARK_SUBMIT_OPTIONS w/ 0.6.1

2016-08-16 Thread Michael Sells
Testing out 0.6.1 with Spark 2.0 and discovered the way we load dependencies doesn't seem to be working with the new update. We pass new dependencies in via a SPARK_SUBMIT_OPTIONS environment variable pass the following flags: --packages com.databricks:spark-avro_2.11:3.0.0 Now when I try to