Jungtaek Lim created SPARK-41539:
------------------------------------
Summary: stats and constraints in LogicalRDD may not be in sync
with output attributes
Key: SPARK-41539
URL: https://issues.apache.org/jira/browse/SPARK-41539
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.4.0
Reporter: Jungtaek Lim
We encountered the case where the output of logical plan and optimized plan
were different in LogicalRDD (the difference was exprId for the case), led the
situation that stats and constraints are out of sync with output attributes,
eventually failed the query.
We should remap stats and constraints based on the output of logical plan,
assuming that the output of logical plan and optimized plan are "slightly"
different (e.g. exprId) but "semantically" same.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
