[ https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
EdisonWang updated SPARK-32559: ------------------------------- Description: The trim logic in Cast expression introduced in [https://github.com/apache/spark/pull/26622] will trim chinese characters unexpectly. For example, sql select cast("1中文" as float) gives 1 instead of null was: The trim logic in Cast expression introduced in [https://github.com/apache/spark/pull/26622] will trim chinese characters unexpectly. For example, !image-2020-08-06-17-01-48-646.png! > Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters > correctly > --------------------------------------------------------------------------------------- > > Key: SPARK-32559 > URL: https://issues.apache.org/jira/browse/SPARK-32559 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.0.0 > Reporter: EdisonWang > Priority: Minor > > The trim logic in Cast expression introduced in > [https://github.com/apache/spark/pull/26622] will trim chinese characters > unexpectly. > For example, sql select cast("1中文" as float) gives 1 instead of null > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org