[
https://issues.apache.org/jira/browse/SPARK-44077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kapil Singh updated SPARK-44077:
--------------------------------
Description: When calling SQLConf.get on executors, the configs are read
from the local properties on the TaskContext. The local properties are
populated driver-side when scheduling the job, using the properties found in
sparkContext.localProperties. For RDD actions, local properties were not
getting populated.
> Session Configs were not getting honored in RDDs
> ------------------------------------------------
>
> Key: SPARK-44077
> URL: https://issues.apache.org/jira/browse/SPARK-44077
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 3.4.0
> Reporter: Kapil Singh
> Priority: Major
>
> When calling SQLConf.get on executors, the configs are read from the local
> properties on the TaskContext. The local properties are populated driver-side
> when scheduling the job, using the properties found in
> sparkContext.localProperties. For RDD actions, local properties were not
> getting populated.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
