lincoln lee created FLINK-30006: ----------------------------------- Summary: Cannot remove columns that are incorrectly considered constants from an Aggregate In Streaming Key: FLINK-30006 URL: https://issues.apache.org/jira/browse/FLINK-30006 Project: Flink Issue Type: Bug Components: Table SQL / Planner Affects Versions: 1.16.0 Reporter: lincoln lee Fix For: 1.17.0
In Streaming, columns generated by dynamic functions are incorrectly considered constants and removed from an Aggregate via optimization rule `CoreRules.AGGREGATE_PROJECT_PULL_UP_CONSTANTS` an example query: {code} SELECT cat, gmt_date, SUM(cnt), count(*) FROM t1 WHERE gmt_date = current_date GROUP BY cat, gmt_date {code} the wrong plan: {code} Calc(select=[cat, CAST(CURRENT_DATE() AS DATE) AS gmt_date, EXPR$2, EXPR$3]) +- GroupAggregate(groupBy=[cat], select=[cat, SUM(cnt) AS EXPR$2, COUNT(*) AS EXPR$3]) +- Exchange(distribution=[hash[cat]]) +- Calc(select=[cat, cnt], where=[=(gmt_date, CURRENT_DATE())]) +- TableSourceScan(table=[[default_catalog, default_database, t1, filter=[], project=[cat, cnt, gmt_date], metadata=[]]], fields=[cat, cnt, gmt_date]) {code} In addition to this issue, we need to check all optimization rules in streaming completely to avoid similar problems. -- This message was sent by Atlassian Jira (v8.20.10#820010)