Re: Spark sql with hive table running on Yarn-cluster mode

2014-07-22 Thread Andrew Or
Hi Jenny, It won't work for yarn-cluster simply because this part of the code is missing. For now, you will have to manually add them using `--jars`. Thanks for letting us know; we will fix this by 1.1. Andrew 2014-07-22 10:19 GMT-07:00 Jenny Zhao : > Hi, > > For running spark sql, the dataneu

Spark sql with hive table running on Yarn-cluster mode

2014-07-22 Thread Jenny Zhao
Hi, For running spark sql, the dataneuclus*.jar are automatically added in classpath, this works fine for spark standalone mode and yarn-client mode, however, for Yarn-cluster mode, I have to explicitly put these jars using --jars option when submitting this job, otherwise, the job will fail, why