[
https://issues.apache.org/jira/browse/SPARK-53476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuchuan Huang resolved SPARK-53476.
-----------------------------------
Resolution: Duplicate
> Add case for SupportsPushDownCatalystFilters in PushDownUtils
> -------------------------------------------------------------
>
> Key: SPARK-53476
> URL: https://issues.apache.org/jira/browse/SPARK-53476
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 4.1.0
> Reporter: Yuchuan Huang
> Priority: Critical
>
>
> {code:java}
> package org.apache.spark.sql.execution.datasources.v2
> object PushDownUtils {
> def pushFilters(scanBuilder: ScanBuilder, filters: Seq[Expression])
> : (Either[Seq[sources.Filter], Seq[Predicate]], Seq[Expression]) = {
> scanBuilder match {
> case r: SupportsPushDownFilters => ... // public interface extends
> ScanBuilder
> case r: SupportsPushDownV2Filters => ... // public interface extends
> ScanBuilder
> case f: FileScanBuilder => ... // abstract class extends ScanBuilder
> case s: SupportsPushDownCatalystFilters => ... // trait
> case _ => (Left(Nil), filters)
> } {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]