[
https://issues.apache.org/jira/browse/SPARK-40169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40169:
---------------------------------
Description:
This is a follow for SPARK-39833. In
[https://github.com/apache/spark/pull/37419,] we disabled column index for
Parquet due to correctness issues that we found when filtering data on the
partition column overlapping with data schema.
This ticket is for permanent and thorough fix for the issue and re-enablement
of the column index. See more details in the PR linked above.
was:
This is a follow for SPARK-39833.
We disabled
> Fix the issue with Parquet column index and predicate pushdown in Data source
> V1
> --------------------------------------------------------------------------------
>
> Key: SPARK-40169
> URL: https://issues.apache.org/jira/browse/SPARK-40169
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.4.0, 3.3.1, 3.2.3
> Reporter: Ivan Sadikov
> Priority: Major
>
> This is a follow for SPARK-39833. In
> [https://github.com/apache/spark/pull/37419,] we disabled column index for
> Parquet due to correctness issues that we found when filtering data on the
> partition column overlapping with data schema.
>
> This ticket is for permanent and thorough fix for the issue and re-enablement
> of the column index. See more details in the PR linked above.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
