Hi,
I'm working wiht the latest version of Spark JobServer together with Spark 2.0.2. I'm able to do almost all my needs but there is only one noisy thing. I have placed a hive-site.xml to specify a connection to my mysql db so I can have the metastore_db on mysql, that's works fine while I'm submitting my jobs through spark-submit. But once I start using the Spark JobServer doesn't work the only parameter take it from the hive-site.xml is the hive.metastore.warehouse.dir . Even I have tried to use the default, I mean without the hive-site.xml so spark should use derby to store the metastore_db, but also doesn't work. I don't have hive installed, I just use the hive support which comes with sparkl. this is my hive-site.xml <?xml version="1.0"?> <configuration> <property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://localhost:3306/metastore_db?createDatabaseIfNotExist=tru e</value> <description>JDBC connect string for a JDBC metastore</description> </property> <property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.jdbc.Driver</value> <description>Driver class name for a JDBC metastore</description> </property> <property> <name>javax.jdo.option.ConnectionUserName</name> <value>user</value> <description>username to use against metastore database</description> </property> <property> <name>javax.jdo.option.ConnectionPassword</name> <value>passwork</value> <description>password to use against metastore database</description> </property> <property> <name>hive.metastore.warehouse.dir</name> <value>/data/spark-warehouse</value> <description>Warehouse Location</description> </property> </configuration> --- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus
