Huaxin Gao created SPARK-37262:
----------------------------------
Summary: Not log empty aggregate and group by in JDBCScan
Key: SPARK-37262
URL: https://issues.apache.org/jira/browse/SPARK-37262
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 3.2.0, 3.3.0
Reporter: Huaxin Gao
Address the comment
https://github.com/apache/spark/pull/34451#discussion_r740220800
Current behavior:
Scan
org.apache.spark.sql.execution.datasources.v2.jdbc.JDBCScan$$anon$1@72e75786
[NAME#1,SALARY#2] PushedAggregates: [], PushedFilters: [IsNotNull(SALARY),
GreaterThan(SALARY,100.00)], PushedGroupby: [], ReadSchema:
struct<NAME:string,SALARY:decimal(20,2)>
After the fix, it will be
Scan
org.apache.spark.sql.execution.datasources.v2.jdbc.JDBCScan$$anon$1@72e75786
[NAME#1,SALARY#2] PushedFilters: [IsNotNull(SALARY),
GreaterThan(SALARY,100.00)], ReadSchema:
struct<NAME:string,SALARY:decimal(20,2)>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
