[
https://issues.apache.org/jira/browse/SPARK-36488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403050#comment-17403050
]
merrily01 commented on SPARK-36488:
-----------------------------------
Hi [~planga82] ,
Thans for your attention and sorry for late reply.
It's OK to improve the error message, but I don't quite agree with you that
it is not a bug.
Firstly, for a very common SQL, the query results of opening and closing
parameters are different, which is not easy to accept. At least it can prove
that this function is not perfect.(I always feel that the regular expression of
this function should not deal with part 'database'. )
Secondly, at the begining, this feature was compatible with and reference to
hive feature. But now, the above cases can be executed normally when turn on
the feature in Hive, Spak has a problem.
> "Invalid usage of '*' in expression" error due to the feature of
> 'quotedRegexColumnNames' in some scenarios.
> ------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-36488
> URL: https://issues.apache.org/jira/browse/SPARK-36488
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, SQL
> Affects Versions: 2.4.8, 3.1.2
> Reporter: merrily01
> Priority: Major
>
> In some cases, the error happens when the following property is set.
> {code:java}
> spark.sql("set spark.sql.parser.quotedRegexColumnNames=true")
> {code}
> *case 1:*
> {code:java}
> spark-sql> create table tb_test as select 1 as col_a, 2 as col_b;
> spark-sql> select `tb_test`.`col_a` from tb_test;
> 1
> spark-sql> set spark.sql.parser.quotedRegexColumnNames=true;
> spark-sql> select `tb_test`.`col_a` from tb_test;
> Error in query: Invalid usage of '*' in expression 'unresolvedextractvalue'
> {code}
>
> *case 2:*
> {code:java}
> > select `col_a`/`col_b` as `col_c` from (select 3 as `col_a` ,
> 3.14 as `col_b`);
> 0.955414
> spark-sql> set spark.sql.parser.quotedRegexColumnNames=true;
> spark-sql> select `col_a`/`col_b` as `col_c` from (select 3 as `col_a` ,
> 3.14 as `col_b`);
> Error in query: Invalid usage of '*' in expression 'divide'
> {code}
>
> This problem exists in 3.X, 2.4.X and master versions.
>
> Related issue ：
> https://issues.apache.org/jira/browse/SPARK-12139
> （As can be seen in the latest comments, some people have encountered the same
> problem）
>
> Similar problems：
> https://issues.apache.org/jira/browse/SPARK-28897
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
