[jira] [Resolved] (SPARK-47302) Collation name should be identifier

2024-03-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47302. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45405

[jira] [Assigned] (SPARK-47302) Collation name should be identifier

2024-03-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-47302: Assignee: Aleksandar Tomic > Collation name should be identifier >

[jira] [Updated] (SPARK-47325) Use the latest buf-setup-action in github workflow

2024-03-08 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47325: Component/s: Project Infra (was: Build) > Use the latest buf-setup-action in

[jira] [Updated] (SPARK-47325) Use the latest buf-setup-action in github workflow

2024-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47325: --- Labels: pull-request-available (was: ) > Use the latest buf-setup-action in github

[jira] [Updated] (SPARK-47319) Improve missingInput calculation

2024-03-08 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-47319: --- Summary: Improve missingInput calculation (was: Fix missingInput calculation) > Improve

[jira] [Updated] (SPARK-47319) Improve missingInput calculation

2024-03-08 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-47319: --- Description: {{QueryPlan.missingInput()}} calculation seems to be the root cause of

[jira] [Updated] (SPARK-47319) Improve missingInput calculation

2024-03-08 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-47319: --- Description: {{QueryPlan.missingInput()}} calculation seems to be the root cause of

[jira] [Resolved] (SPARK-47316) Fix TimestampNTZ in Postgres Array

2024-03-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47316. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45418

[jira] [Assigned] (SPARK-47316) Fix TimestampNTZ in Postgres Array

2024-03-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47316: Assignee: Kent Yao > Fix TimestampNTZ in Postgres Array > --- >

[jira] [Created] (SPARK-47325) Use the latest buf-setup-action in github workflow

2024-03-08 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47325: --- Summary: Use the latest buf-setup-action in github workflow Key: SPARK-47325 URL: https://issues.apache.org/jira/browse/SPARK-47325 Project: Spark Issue Type:

[jira] [Created] (SPARK-47324) Call convertJavaTimestampToTimeStamp in Array getter

2024-03-08 Thread Kent Yao (Jira)
Kent Yao created SPARK-47324: Summary: Call convertJavaTimestampToTimeStamp in Array getter Key: SPARK-47324 URL: https://issues.apache.org/jira/browse/SPARK-47324 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47255) Assign names to the error classes _LEGACY_ERROR_TEMP_324[7-9]

2024-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47255: --- Labels: pull-request-available starter (was: starter) > Assign names to the error classes

[jira] [Updated] (SPARK-47324) Call convertJavaTimestampToTimeStamp in Array getter

2024-03-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47324: - Affects Version/s: 4.0.0 (was: 3.5.1) > Call convertJavaTimestampToTimeStamp

[jira] [Assigned] (SPARK-47322) Make `withColumnsRenamed` duplicated column name handling consisten with `withColumnRenamed`

2024-03-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47322: Assignee: Ruifeng Zheng > Make `withColumnsRenamed` duplicated column name handling

[jira] [Resolved] (SPARK-47322) Make `withColumnsRenamed` duplicated column name handling consisten with `withColumnRenamed`

2024-03-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47322. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45431

[jira] [Assigned] (SPARK-47254) Assign names to the error classes _LEGACY_ERROR_TEMP_325[1-9]

2024-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47254: -- Assignee: (was: Apache Spark) > Assign names to the error classes

[jira] [Assigned] (SPARK-47254) Assign names to the error classes _LEGACY_ERROR_TEMP_325[1-9]

2024-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47254: -- Assignee: Apache Spark > Assign names to the error classes

[jira] [Assigned] (SPARK-47316) Fix TimestampNTZ in Postgres Array

2024-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47316: -- Assignee: (was: Apache Spark) > Fix TimestampNTZ in Postgres Array >

[jira] [Resolved] (SPARK-47265) Use `createTable(..., schema: StructType, ...)` instead of `createTable(..., columns: Array[Column], ...)` in UT

2024-03-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47265. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45368

[jira] [Assigned] (SPARK-47265) Use `createTable(..., schema: StructType, ...)` instead of `createTable(..., columns: Array[Column], ...)` in UT

2024-03-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47265: --- Assignee: BingKun Pan > Use `createTable(..., schema: StructType, ...)` instead of

[jira] [Assigned] (SPARK-47322) Make `withColumnsRenamed` duplicated column name handling consisten with `withColumnRenamed`

2024-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47322: -- Assignee: Apache Spark > Make `withColumnsRenamed` duplicated column name handling

[jira] [Assigned] (SPARK-47322) Make `withColumnsRenamed` duplicated column name handling consisten with `withColumnRenamed`

2024-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47322: -- Assignee: (was: Apache Spark) > Make `withColumnsRenamed` duplicated column name

[jira] [Commented] (SPARK-47255) Assign names to the error classes _LEGACY_ERROR_TEMP_324[7-9]

2024-03-08 Thread Milan Dankovic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824692#comment-17824692 ] Milan Dankovic commented on SPARK-47255: I am working on it. > Assign names to the error

[jira] [Updated] (SPARK-47324) Call convertJavaTimestampToTimeStamp in Array getter

2024-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47324: --- Labels: pull-request-available (was: ) > Call convertJavaTimestampToTimeStamp in Array

[jira] [Created] (SPARK-47326) Moving tests to related Suites

2024-03-08 Thread Mihailo Milosevic (Jira)
Mihailo Milosevic created SPARK-47326: - Summary: Moving tests to related Suites Key: SPARK-47326 URL: https://issues.apache.org/jira/browse/SPARK-47326 Project: Spark Issue Type:

[jira] [Commented] (SPARK-47286) IN operator support

2024-03-08 Thread Gideon P (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824786#comment-17824786 ] Gideon P commented on SPARK-47286: -- [~dbatomic] can I raise a pr to implement this one?  > IN operator

[jira] [Updated] (SPARK-47327) Fix thread safety issue in ICU Collator

2024-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47327: --- Labels: pull-request-available (was: ) > Fix thread safety issue in ICU Collator >

[jira] [Commented] (SPARK-47286) IN operator support

2024-03-08 Thread Aleksandar Tomic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824795#comment-17824795 ] Aleksandar Tomic commented on SPARK-47286: -- [~gpgp] There is already a PR that should handle

[jira] [Commented] (SPARK-47286) IN operator support

2024-03-08 Thread Gideon P (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824811#comment-17824811 ] Gideon P commented on SPARK-47286: -- [~dbatomic] Awesome, I will create the benchmarking suite. I will

[jira] [Updated] (SPARK-47313) scala.MatchError should be treated as internal error

2024-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47313: --- Labels: pull-request-available (was: ) > scala.MatchError should be treated as internal

[jira] [Created] (SPARK-47327) Fix thread safety issue in ICU Collator

2024-03-08 Thread Stefan Kandic (Jira)
Stefan Kandic created SPARK-47327: - Summary: Fix thread safety issue in ICU Collator Key: SPARK-47327 URL: https://issues.apache.org/jira/browse/SPARK-47327 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47328) Change utf8 collation names to UTF8_BINARY

2024-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47328: --- Labels: pull-request-available (was: ) > Change utf8 collation names to UTF8_BINARY >

[jira] [Created] (SPARK-47330) XML: Add XmlExpressionsSuite

2024-03-08 Thread Yousof Hosny (Jira)
Yousof Hosny created SPARK-47330: Summary: XML: Add XmlExpressionsSuite Key: SPARK-47330 URL: https://issues.apache.org/jira/browse/SPARK-47330 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-44115) Upgrade Apache ORC to 2.0

2024-03-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44115: - Assignee: Dongjoon Hyun > Upgrade Apache ORC to 2.0 > - > >

[jira] [Commented] (SPARK-44115) Upgrade Apache ORC to 2.0

2024-03-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824844#comment-17824844 ] Dongjoon Hyun commented on SPARK-44115: --- Hi, [~engrravijain] . Thank you. However, this is a

[jira] [Updated] (SPARK-44115) Upgrade Apache ORC to 2.0

2024-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44115: --- Labels: pull-request-available (was: ) > Upgrade Apache ORC to 2.0 >

[jira] [Created] (SPARK-47328) Change utf8 collation names to UTF8_BINARY

2024-03-08 Thread Stefan Kandic (Jira)
Stefan Kandic created SPARK-47328: - Summary: Change utf8 collation names to UTF8_BINARY Key: SPARK-47328 URL: https://issues.apache.org/jira/browse/SPARK-47328 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47330) XML: Add XmlExpressionsSuite

2024-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47330: --- Labels: pull-request-available (was: ) > XML: Add XmlExpressionsSuite >

[jira] [Updated] (SPARK-47320) Datasets involving self joins behave in an inconsistent and unintuitive manner

2024-03-08 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-47320: - Description: The behaviour of Datasets involving self joins behave in an unintuitive manner in terms when

[jira] [Updated] (SPARK-47320) Datasets involving self joins behave in an inconsistent and unintuitive manner

2024-03-08 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-47320: - Description: The behaviour of Datasets involving self joins behave in an unintuitive manner in terms when

[jira] [Updated] (SPARK-47320) Datasets involving self joins behave in an inconsistent and unintuitive manner

2024-03-08 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-47320: - Description: The behaviour of Datasets involving self joins behave in an unintuitive manner in terms when

[jira] [Resolved] (SPARK-44115) Upgrade Apache ORC to 2.0

2024-03-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44115. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45443

[jira] [Updated] (SPARK-47320) Datasets involving self joins behave in an inconsistent and unintuitive manner

2024-03-08 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-47320: - Description: The behaviour of Datasets involving self joins behave in an unintuitive manner in terms when

[jira] [Updated] (SPARK-47320) Datasets involving self joins behave in an inconsistent and unintuitive manner

2024-03-08 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-47320: - Description: The behaviour of Datasets involving self joins behave in an unintuitive manner in terms when

[jira] [Commented] (SPARK-47320) Datasets involving self joins behave in an inconsistent and unintuitive manner

2024-03-08 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824877#comment-17824877 ] Asif commented on SPARK-47320: -- Opened following PR

[jira] [Created] (SPARK-47331) Serialization using case classes/primitives/POJO based on SQL encoder for Arbitrary State API v2.

2024-03-08 Thread Jing Zhan (Jira)
Jing Zhan created SPARK-47331: - Summary: Serialization using case classes/primitives/POJO based on SQL encoder for Arbitrary State API v2. Key: SPARK-47331 URL: https://issues.apache.org/jira/browse/SPARK-47331

[jira] [Created] (SPARK-47332) StreamingPythonRunner don't need redundant logic for starting python process

2024-03-08 Thread Wei Liu (Jira)
Wei Liu created SPARK-47332: --- Summary: StreamingPythonRunner don't need redundant logic for starting python process Key: SPARK-47332 URL: https://issues.apache.org/jira/browse/SPARK-47332 Project: Spark

[jira] [Updated] (SPARK-47320) Datasets involving self joins behave in an inconsistent and unintuitive manner

2024-03-08 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-47320: - Labels: pull-request-available (was: ) > Datasets involving self joins behave in an inconsistent and

[jira] [Updated] (SPARK-47331) Serialization using case classes/primitives/POJO based on SQL encoder for Arbitrary State API v2.

2024-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47331: --- Labels: pull-request-available (was: ) > Serialization using case classes/primitives/POJO