[
https://issues.apache.org/jira/browse/SPARK-26018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marco Gaido resolved SPARK-26018.
---------------------------------
Resolution: Won't Fix
This may be very hard to do as we now add filters to datasources from logical
plans, hence we cannot get the result from ScalarSubqueries there. This may be
probably easier to be done in the context of adaptive execution. Hence I am
closing this as "Won't Fix" for now.
Please [~cloud_fan] feel free to reopen if you don't agree with my analysis
above and/or you think this can be achieved also now. Thanks.
> Support Scalar subqueries in predicate push down to datasources
> ---------------------------------------------------------------
>
> Key: SPARK-26018
> URL: https://issues.apache.org/jira/browse/SPARK-26018
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Marco Gaido
> Priority: Major
>
> As of now, existing datasources are not using filters containing scalar
> subqueries for their predicate pushdown. This ticket aims to support that as
> a result of the discussion in https://github.com/apache/spark/pull/22518.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
