[jira] [Updated] (SPARK-43594) Add LocalDateTime to anyToMicros

[ https://issues.apache.org/jira/browse/SPARK-43594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-43594: -- Affects Version/s: 3.5.0 (was: 3.4.0) > Add LocalDateTime to

[jira] [Resolved] (SPARK-43594) Add LocalDateTime to anyToMicros

[ https://issues.apache.org/jira/browse/SPARK-43594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43594. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41238

[jira] [Assigned] (SPARK-43594) Add LocalDateTime to anyToMicros

[ https://issues.apache.org/jira/browse/SPARK-43594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43594: - Assignee: Fokko Driesprong > Add LocalDateTime to anyToMicros >

[jira] [Commented] (SPARK-43934) Add regexp_* functions to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17731152#comment-17731152 ] Snoot.io commented on SPARK-43934: -- User 'beliefer' has created a pull request for this issue:

[jira] [Updated] (SPARK-43944) Add string functions to Scala and Python - part 2

[ https://issues.apache.org/jira/browse/SPARK-43944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43944: -- Description: Add following functions: * replace * split_part * substr * parse_url * printf *

[jira] [Updated] (SPARK-43934) Add regexp_* functions to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43934: -- Description: Add following functions: * rlike * regexp * regexp_count * regexp_extract_all *

[jira] [Assigned] (SPARK-43615) Enable DataFrameSlowParityTests.test_eval

[ https://issues.apache.org/jira/browse/SPARK-43615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43615: - Assignee: Ruifeng Zheng (was: Haejoon Lee) > Enable

[jira] [Resolved] (SPARK-43616) Enable pyspark.pandas.spark.functions.mode in Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43616. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41523

[jira] (SPARK-43928) Add bit operations to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43928 ] BingKun Pan deleted comment on SPARK-43928: - was (Author: panbingkun): I work on it. > Add bit operations to Scala and Python > -- > >

[jira] [Commented] (SPARK-43928) Add bit operations to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17731118#comment-17731118 ] BingKun Pan commented on SPARK-43928: - I work on it. > Add bit operations to Scala and Python >

[jira] [Resolved] (SPARK-43610) Enable `InternalFrame.attach_distributed_column` in Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43610. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41528

[jira] [Assigned] (SPARK-43610) Enable `InternalFrame.attach_distributed_column` in Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43610: Assignee: Haejoon Lee > Enable `InternalFrame.attach_distributed_column` in Spark

[jira] [Resolved] (SPARK-43971) Support Python's createDataFrame in streaming manner

[ https://issues.apache.org/jira/browse/SPARK-43971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-43971. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41537

[jira] [Commented] (SPARK-42890) Add Identifier to the InMemoryTableScan node on the SQL page

[ https://issues.apache.org/jira/browse/SPARK-42890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17731109#comment-17731109 ] Yian Liou commented on SPARK-42890: --- PR open at https://github.com/apache/spark/pull/40529 > Add

[jira] [Updated] (SPARK-40637) Spark-shell can correctly encode BINARY type but Spark-sql cannot

[ https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40637: - Issue Type: Improvement (was: Bug) Priority: Minor (was: Major) > Spark-shell can

[jira] [Created] (SPARK-44016) Artifacts with name as an absolute path may overwrite other files

Venkata Sai Akhil Gudesa created SPARK-44016: Summary: Artifacts with name as an absolute path may overwrite other files Key: SPARK-44016 URL: https://issues.apache.org/jira/browse/SPARK-44016

[jira] [Updated] (SPARK-43404) Filter current version while reusing sst files for RocksDB state store provider while uploading to DFS to prevent id mismatch

[ https://issues.apache.org/jira/browse/SPARK-43404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-43404: - Fix Version/s: 3.4.1 > Filter current version while reusing sst files for RocksDB state store

[jira] [Comment Edited] (SPARK-43514) Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features caused by certain SQL functions

[ https://issues.apache.org/jira/browse/SPARK-43514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17730925#comment-17730925 ] Svyatoslav Semenyuk edited comment on SPARK-43514 at 6/9/23 11:24 AM:

[jira] [Commented] (SPARK-43514) Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features caused by certain SQL functions

[ https://issues.apache.org/jira/browse/SPARK-43514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17730925#comment-17730925 ] Svyatoslav Semenyuk commented on SPARK-43514: - [~ritikam], thank you for sharing the link.

[jira] [Assigned] (SPARK-43648) Maven test failed: `interrupt all - background queries, foreground interrupt` and `interrupt all - foreground queries, background interrupt`

[ https://issues.apache.org/jira/browse/SPARK-43648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43648: Assignee: Yang Jie > Maven test failed: `interrupt all - background queries, foreground

[jira] [Resolved] (SPARK-43648) Maven test failed: `interrupt all - background queries, foreground interrupt` and `interrupt all - foreground queries, background interrupt`

[ https://issues.apache.org/jira/browse/SPARK-43648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43648. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41487

[jira] [Commented] (SPARK-43404) Filter current version while reusing sst files for RocksDB state store provider while uploading to DFS to prevent id mismatch

[ https://issues.apache.org/jira/browse/SPARK-43404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17730889#comment-17730889 ] ASF GitHub Bot commented on SPARK-43404: User 'HeartSaVioR' has created a pull request for this

[jira] [Updated] (SPARK-43404) Filter current version while reusing sst files for RocksDB state store provider while uploading to DFS to prevent id mismatch

[ https://issues.apache.org/jira/browse/SPARK-43404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-43404: - Issue Type: Bug (was: Task) > Filter current version while reusing sst files for RocksDB state

[jira] [Commented] (SPARK-43937) Add not,if,ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17730884#comment-17730884 ] ASF GitHub Bot commented on SPARK-43937: User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-43610) Enable `InternalFrame.attach_distributed_column` in Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17730886#comment-17730886 ] ASF GitHub Bot commented on SPARK-43610: User 'itholic' has created a pull request for this

[jira] [Commented] (SPARK-43937) Add not,if,ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17730882#comment-17730882 ] ASF GitHub Bot commented on SPARK-43937: User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-32559) Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters correctly

[ https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17730870#comment-17730870 ] 王俊博 commented on SPARK-32559: - This is the detailed error log. [^error.log] > Fix the trim logic in

[jira] [Updated] (SPARK-32559) Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters correctly

[ https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-32559: Attachment: error.log > Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters >

[jira] [Commented] (SPARK-32559) Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters correctly

[ https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17730869#comment-17730869 ] 王俊博 commented on SPARK-32559: - The expressions `getByte(s) <= ' '` and `Character.isWhitespace(getByte(s))`

[jira] [Created] (SPARK-44015) Support SIMILAR TO operator

melin created SPARK-44015: - Summary: Support SIMILAR TO operator Key: SPARK-44015 URL: https://issues.apache.org/jira/browse/SPARK-44015 Project: Spark Issue Type: New Feature Components:

[jira] [Created] (SPARK-44014) Support BETWEEN SYMMETRIC operator

melin created SPARK-44014: - Summary: Support BETWEEN SYMMETRIC operator Key: SPARK-44014 URL: https://issues.apache.org/jira/browse/SPARK-44014 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-44007) Unresolved hint cause query failure

[ https://issues.apache.org/jira/browse/SPARK-44007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei resolved SPARK-44007. - Resolution: Won't Fix > Unresolved hint cause query failure > --- > >