[
https://issues.apache.org/jira/browse/SPARK-37895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475360#comment-17475360
]
Wenchen Fan commented on SPARK-37895:
-------------------------------------
This bug is only in JDBC v2. In the v2 code path, we always enable nested
column in filter pushdown, and the column name in the predicate follows SQL
style, which may have quotes.
In the long term, this problem can be fixed by using v2 filters, which has
native support for nested columns, so that we don't need to encode nested
column into a single string and introduce quotes. For now, I think we should
fix the v1 filter pushdown code path in JDBC v2, which is
`JDBCScanBuilder.pushFilters`.
> Error while joining two tables with non-english field names
> -----------------------------------------------------------
>
> Key: SPARK-37895
> URL: https://issues.apache.org/jira/browse/SPARK-37895
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.2.0, 3.3.0
> Reporter: Marina Krasilnikova
> Priority: Minor
>
> While trying to join two tables with non-english field names in postgresql
> with query like
> "select view1.`Имя1` , view1.`Имя2`, view2.`Имя3` from view1 left join view2
> on view1.`Имя2`=view2.`Имя4`"
> we get an error which says that there is no field "`Имя4`" (field name is
> surrounded by backticks).
> It appears that to get the data from the second table it constructs query like
> SELECT "Имя3","Имя4" FROM "public"."tab2" WHERE ("`Имя4`" IS NOT NULL)
> and these backticks are redundant in WHERE clause.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
