[ https://issues.apache.org/jira/browse/SPARK-44007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tongwei resolved SPARK-44007. ----------------------------- Resolution: Won't Fix > Unresolved hint cause query failure > ----------------------------------- > > Key: SPARK-44007 > URL: https://issues.apache.org/jira/browse/SPARK-44007 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.3.1, 3.4.0 > Reporter: Tongwei > Priority: Major > > After the Resolve Hints Rules are completed, immediately remove unknown Hints > to *avoid query errors caused by Unresolved Hints.* > Query error: > {code:java} > // create t0,t1 > CREATE TABLE t0(c0 bigint) USING PARQUET > CREATE TABLE t1(c1 bigint) USING PARQUET > // query with unknown hint > with w0 as (select * from t0), > w1 as (select c0 from w0 group by c0), > w2 as (select /*+ userHint(t1) */ c1 from t1 ), > w3 as ( > select w2.c1, w0.c0, w1.c0 > from w2 > join w0 on w2.c1 = w0.c0 > join w1 on w2.c1 = w1.c0 > ) > select * from w3; > 23/06/08 17:25:23 WARN HintErrorLogger: Unrecognized hint: userHint(t1) > [UNRESOLVED_COLUMN.WITH_SUGGESTION] A column or function parameter with name > `w2`.`c1` cannot be resolved. Did you mean one of the following? [`w2`.`c1`, > `w0`.`c0`].; line 8 pos 11; > 'WithCTE > :- CTERelationDef 4, false > : +- SubqueryAlias w0 > : +- Project [c0#0L] > : +- SubqueryAlias spark_catalog.default.t0 > : +- Relation spark_catalog.default.t0[c0#0L] parquet > :- CTERelationDef 5, false > : +- SubqueryAlias w1 > : +- Aggregate [c0#0L], [c0#0L] > : +- SubqueryAlias w0 > : +- CTERelationRef 4, true, [c0#0L] > :- CTERelationDef 6, false > : +- SubqueryAlias w2 > : +- Project [c1#1L] > : +- SubqueryAlias spark_catalog.default.t1 > : +- Relation spark_catalog.default.t1[c1#1L] parquet > :- 'CTERelationDef 7, false > : +- 'SubqueryAlias w3 > : +- 'Project ['w2.c1, 'w0.c0, 'w1.c0] > : +- 'Join Inner, ('w2.c1 = 'w1.c0) > : :- Join Inner, (c1#1L = c0#0L) > : : :- SubqueryAlias w2 > : : : +- CTERelationRef 6, true, [c1#1L] > : : +- SubqueryAlias w0 > : : +- CTERelationRef 4, true, [c0#0L] > : +- SubqueryAlias w1 > : +- CTERelationRef 5, true, [c0#0L] > +- 'Project [*] > +- 'SubqueryAlias w3 > +- 'CTERelationRef 7, false > // query without unknown hint > with w0 as (select * from t0), > w1 as (select * from w0 group by c0), > w2 as (select c1 from t1 ), > w3 as ( > select w2.c1, w0.c0, w1.c0 > from w2 > join w0 on w2.c1 = w0.c0 > join w1 on w2.c1 = w1.c0 > ) > select * from w3; > Time taken: 12.666 seconds > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org