Sahil Takiar created HIVE-19910: ----------------------------------- Summary: hive.spark.log.dir isn't honored for TestSparkCliDriver Key: HIVE-19910 URL: https://issues.apache.org/jira/browse/HIVE-19910 Project: Hive Issue Type: Sub-task Components: Spark Reporter: Sahil Takiar
I haven't actually confirmed this, but I don't think {{hive.spark.log.dir}} is getting honored for any Spark test that sets {{spark.master}} to {{local-cluster}} because it adds {{hive.spark.log.dir}} as a system property via the {{spark.driver.extraJavaOptions}} configuration, but according to the Spark docs passing system properties via this parameter doesn't work in client mode, users have to use {{--driver-java-options}} instead. -- This message was sent by Atlassian JIRA (v7.6.3#76005)