[
https://issues.apache.org/jira/browse/SPARK-59710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-59710:
----------------------------------
Fix Version/s: 4.2.2
4.1.5
4.3.1
> Join pushdown of JDBC data source does not handle partitioning well
> -------------------------------------------------------------------
>
> Key: SPARK-59710
> URL: https://issues.apache.org/jira/browse/SPARK-59710
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 4.1.0, 4.2.0, 4.3.0, 4.1.3
> Reporter: Uros Stankovic
> Assignee: Uros Stankovic
> Priority: Blocker
> Labels: correctness, pull-request-available
> Fix For: 4.4.0, 4.2.2, 4.1.5, 4.3.1
>
>
> When we use JDBC DSv2 join pushdown, I noticed two bugs:
> - When I specify partitioning options, query fails with error "Options query
> and partition_coumn can not be specified together". It is expected that query
> runs successfully even join and partitioning can't be supported that easily.
> - Partial aggregate pushdown optimizer rule can pushdown AVG to SUM/COUNT
> with multiple partitions, in that case, incorrect result is returned in some
> cases.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]