[
https://issues.apache.org/jira/browse/SPARK-35669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro updated SPARK-35669:
-------------------------------------
Description:
This is a followup of [#31964|https://github.com/apache/spark/pull/31964]
We should only quote the column name when nested column predicate pushdown is
enabled, otherwise the data source side may not have the logic to parse the
quoted column name and fail. This is not a problem before
[#31964|https://github.com/apache/spark/pull/31964] , as we don't quote the
column name if there is no dot in the name. But
[#31964|https://github.com/apache/spark/pull/31964] changed it.
> fix special char in CSV header with filter pushdown
> ---------------------------------------------------
>
> Key: SPARK-35669
> URL: https://issues.apache.org/jira/browse/SPARK-35669
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.2.0
> Reporter: Wenchen Fan
> Priority: Major
>
> This is a followup of [#31964|https://github.com/apache/spark/pull/31964]
> We should only quote the column name when nested column predicate pushdown is
> enabled, otherwise the data source side may not have the logic to parse the
> quoted column name and fail. This is not a problem before
> [#31964|https://github.com/apache/spark/pull/31964] , as we don't quote the
> column name if there is no dot in the name. But
> [#31964|https://github.com/apache/spark/pull/31964] changed it.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
