[jira] [Updated] (SPARK-32559) Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters correctly
[ https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-32559: Attachment: error.log > Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters > correctly > --- > > Key: SPARK-32559 > URL: https://issues.apache.org/jira/browse/SPARK-32559 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.0.0 >Reporter: EdisonWang >Assignee: EdisonWang >Priority: Major > Labels: correctness > Fix For: 3.0.1 > > Attachments: error.log > > > The trim logic in Cast expression introduced in > [https://github.com/apache/spark/pull/26622] will trim chinese characters > unexpectly. > For example, sql select cast("1中文" as float) gives 1 instead of null > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-32559) Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters correctly
[ https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32559: -- Priority: Major (was: Minor) > Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters > correctly > --- > > Key: SPARK-32559 > URL: https://issues.apache.org/jira/browse/SPARK-32559 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.0.0 >Reporter: EdisonWang >Assignee: EdisonWang >Priority: Major > Labels: correctness > Fix For: 3.0.1 > > > The trim logic in Cast expression introduced in > [https://github.com/apache/spark/pull/26622] will trim chinese characters > unexpectly. > For example, sql select cast("1中文" as float) gives 1 instead of null > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-32559) Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters correctly
[ https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32559: -- Labels: correctness (was: ) > Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters > correctly > --- > > Key: SPARK-32559 > URL: https://issues.apache.org/jira/browse/SPARK-32559 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.0.0 >Reporter: EdisonWang >Assignee: EdisonWang >Priority: Minor > Labels: correctness > Fix For: 3.0.1 > > > The trim logic in Cast expression introduced in > [https://github.com/apache/spark/pull/26622] will trim chinese characters > unexpectly. > For example, sql select cast("1中文" as float) gives 1 instead of null > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-32559) Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters correctly
[ https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] EdisonWang updated SPARK-32559: --- Description: The trim logic in Cast expression introduced in [https://github.com/apache/spark/pull/26622] will trim chinese characters unexpectly. For example, sql select cast("1中文" as float) gives 1 instead of null was: The trim logic in Cast expression introduced in [https://github.com/apache/spark/pull/26622] will trim chinese characters unexpectly. For example, !image-2020-08-06-17-01-48-646.png! > Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters > correctly > --- > > Key: SPARK-32559 > URL: https://issues.apache.org/jira/browse/SPARK-32559 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.0.0 >Reporter: EdisonWang >Priority: Minor > > The trim logic in Cast expression introduced in > [https://github.com/apache/spark/pull/26622] will trim chinese characters > unexpectly. > For example, sql select cast("1中文" as float) gives 1 instead of null > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org