[
https://issues.apache.org/jira/browse/SPARK-44007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tongwei resolved SPARK-44007.
-----------------------------
Resolution: Won't Fix
> Unresolved hint cause query failure
> -----------------------------------
>
> Key: SPARK-44007
> URL: https://issues.apache.org/jira/browse/SPARK-44007
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.3.1, 3.4.0
> Reporter: Tongwei
> Priority: Major
>
> After the Resolve Hints Rules are completed, immediately remove unknown Hints
> to *avoid query errors caused by Unresolved Hints.*
> Query error:
> {code:java}
> // create t0,t1
> CREATE TABLE t0(c0 bigint) USING PARQUET
> CREATE TABLE t1(c1 bigint) USING PARQUET
> // query with unknown hint
> with w0 as (select * from t0),
> w1 as (select c0 from w0 group by c0),
> w2 as (select /*+ userHint(t1) */ c1 from t1 ),
> w3 as (
> select w2.c1, w0.c0, w1.c0
> from w2
> join w0 on w2.c1 = w0.c0
> join w1 on w2.c1 = w1.c0
> )
> select * from w3;
> 23/06/08 17:25:23 WARN HintErrorLogger: Unrecognized hint: userHint(t1)
> [UNRESOLVED_COLUMN.WITH_SUGGESTION] A column or function parameter with name
> `w2`.`c1` cannot be resolved. Did you mean one of the following? [`w2`.`c1`,
> `w0`.`c0`].; line 8 pos 11;
> 'WithCTE
> :- CTERelationDef 4, false
> : +- SubqueryAlias w0
> : +- Project [c0#0L]
> : +- SubqueryAlias spark_catalog.default.t0
> : +- Relation spark_catalog.default.t0[c0#0L] parquet
> :- CTERelationDef 5, false
> : +- SubqueryAlias w1
> : +- Aggregate [c0#0L], [c0#0L]
> : +- SubqueryAlias w0
> : +- CTERelationRef 4, true, [c0#0L]
> :- CTERelationDef 6, false
> : +- SubqueryAlias w2
> : +- Project [c1#1L]
> : +- SubqueryAlias spark_catalog.default.t1
> : +- Relation spark_catalog.default.t1[c1#1L] parquet
> :- 'CTERelationDef 7, false
> : +- 'SubqueryAlias w3
> : +- 'Project ['w2.c1, 'w0.c0, 'w1.c0]
> : +- 'Join Inner, ('w2.c1 = 'w1.c0)
> : :- Join Inner, (c1#1L = c0#0L)
> : : :- SubqueryAlias w2
> : : : +- CTERelationRef 6, true, [c1#1L]
> : : +- SubqueryAlias w0
> : : +- CTERelationRef 4, true, [c0#0L]
> : +- SubqueryAlias w1
> : +- CTERelationRef 5, true, [c0#0L]
> +- 'Project [*]
> +- 'SubqueryAlias w3
> +- 'CTERelationRef 7, false
> // query without unknown hint
> with w0 as (select * from t0),
> w1 as (select * from w0 group by c0),
> w2 as (select c1 from t1 ),
> w3 as (
> select w2.c1, w0.c0, w1.c0
> from w2
> join w0 on w2.c1 = w0.c0
> join w1 on w2.c1 = w1.c0
> )
> select * from w3;
> Time taken: 12.666 seconds
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
