[
https://issues.apache.org/jira/browse/OOZIE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15894831#comment-15894831
]
Robert Kanter commented on OOZIE-2811:
--------------------------------------
I suppose for backwards compatibility, we'll need to still respect
{{spark.configurations.ignore.spark.yarn.jar}} though (so let's deprecate it).
But I agree a general blacklist of properties is better.
> Add support for filtering out properties from SparkConfigurationService
> -----------------------------------------------------------------------
>
> Key: OOZIE-2811
> URL: https://issues.apache.org/jira/browse/OOZIE-2811
> Project: Oozie
> Issue Type: Bug
> Reporter: Peter Cseh
>
> There is support for filtering out
> [spark.yarn.jar|https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/service/SparkConfigurationService.java#L89],
> but it's changed to spark.yarn.jars in Spark2.
> We should add a general blacklist of properties instead of the current
> boolean of {{spark.configurations.ignore.spark.yarn.jar}}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
