[ https://issues.apache.org/jira/browse/OOZIE-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15870826#comment-15870826 ]
Satish Subhashrao Saley commented on OOZIE-2712: ------------------------------------------------ OOZIE-2799 Recently, we added a fix to create hive-site.xml similar to hive action. bq.If the passed a hive-site.xml or a properties files to Spark it won't work any more. If users are passing files using <file> tag then it should work. > Merge Spark opts with two possible options > ------------------------------------------- > > Key: OOZIE-2712 > URL: https://issues.apache.org/jira/browse/OOZIE-2712 > Project: Oozie > Issue Type: Bug > Reporter: Peter Cseh > Assignee: Peter Cseh > Priority: Critical > Attachments: OOZIE-2712.001.patch > > > Issues like OOZIE-2658 can happen with more properties. > || {{--conf}} || overwritten by || > | {{spark.driver.memory}} | {{--driver-memory}} | > | {{spark.driver.extraJavaOptions}} | {{--driver-java-options}}| > | {{spark.driver.extraLibraryPath}} | {{--driver-library-path}} | > | {{spark.executor.instances}} | {{--num-executors}} | > | {{spark.driver.extraClassPath}} | {{--driver-class-path}} | > | {{spark.yarn.dist.files}} || {{--files}}| > We should make sure that one is converted to the other (the current pattern > is to use {{--conf}} versions of these) so we don't run into issues where the > log4j properties are overwritten. (OOZIE-2705 can be affected by this) -- This message was sent by Atlassian JIRA (v6.3.15#6346)