[jira] [Commented] (SPARK-47104) Spark SQL query fails with NullPointerException

2024-02-23 Thread Chhavi Bansal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17819970#comment-17819970 ] Chhavi Bansal commented on SPARK-47104: --- Thanks Team for looking into the issue an

[jira] [Closed] (SPARK-47104) Spark SQL query fails with NullPointerException

2024-02-23 Thread Chhavi Bansal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chhavi Bansal closed SPARK-47104. - > Spark SQL query fails with NullPointerException > ---

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: (was: Apache Spark) > Add COLLATION_ENABLED config flag > -

[jira] [Updated] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-23 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-47102: -- Description: *What changes were proposed in this pull request?* This PR adds COLLATION

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: Apache Spark > Add COLLATION_ENABLED config flag >

[jira] [Assigned] (SPARK-47135) Implement error classes for Kafka data loss exceptions

2024-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47135: -- Assignee: (was: Apache Spark) > Implement error classes for Kafka data loss excep

[jira] [Assigned] (SPARK-47135) Implement error classes for Kafka data loss exceptions

2024-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47135: -- Assignee: Apache Spark > Implement error classes for Kafka data loss exceptions > --

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: (was: Apache Spark) > Add COLLATION_ENABLED config flag > -

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: Apache Spark > Add COLLATION_ENABLED config flag >

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: Apache Spark > Add COLLATION_ENABLED config flag >

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: (was: Apache Spark) > Add COLLATION_ENABLED config flag > -

[jira] [Created] (SPARK-47144) Fix Spark Connect collation issue

2024-02-23 Thread Nikola Mandic (Jira)
Nikola Mandic created SPARK-47144: - Summary: Fix Spark Connect collation issue Key: SPARK-47144 URL: https://issues.apache.org/jira/browse/SPARK-47144 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-47144) Fix Spark Connect collation issue

2024-02-23 Thread Nikola Mandic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Mandic updated SPARK-47144: -- Component/s: SQL > Fix Spark Connect collation issue > - > >

[jira] [Updated] (SPARK-47144) Fix Spark Connect collation issue

2024-02-23 Thread Nikola Mandic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Mandic updated SPARK-47144: -- Epic Link: SPARK-46830 > Fix Spark Connect collation issue > -

[jira] [Created] (SPARK-47145) Provide table identifier to scan node when DS v2 strategy is applied

2024-02-23 Thread Uros Stankovic (Jira)
Uros Stankovic created SPARK-47145: -- Summary: Provide table identifier to scan node when DS v2 strategy is applied Key: SPARK-47145 URL: https://issues.apache.org/jira/browse/SPARK-47145 Project: Spa

[jira] [Updated] (SPARK-47023) Upgrade `aircompressor` to 0.26

2024-02-23 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-47023: - Summary: Upgrade `aircompressor` to 0.26 (was: Upgrade `aircompressor` to 1.26) > Upgrade `air

[jira] [Updated] (SPARK-47023) Upgrade `aircompressor` to 0.26

2024-02-23 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-47023: - Description: `aircompressor` is a transitive dependency from Apache ORC and Parquet. `aircompre

[jira] [Updated] (SPARK-47144) Fix Spark Connect collation issue

2024-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47144: --- Labels: pull-request-available (was: ) > Fix Spark Connect collation issue > --

[jira] [Created] (SPARK-47146) Possible thread leak when doing sort merge join

2024-02-23 Thread JacobZheng (Jira)
JacobZheng created SPARK-47146: -- Summary: Possible thread leak when doing sort merge join Key: SPARK-47146 URL: https://issues.apache.org/jira/browse/SPARK-47146 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-44914) Upgrade Ivy to 2.5.2

2024-02-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44914. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45075 [https://

[jira] [Assigned] (SPARK-47129) Make ResolveRelations cache connect plan properly

2024-02-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47129: - Assignee: Ruifeng Zheng > Make ResolveRelations cache connect plan properly > -

[jira] [Resolved] (SPARK-47129) Make ResolveRelations cache connect plan properly

2024-02-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47129. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45214 [https://

[jira] [Created] (SPARK-47148) [AQE] Avoid to materialize ShuffleQueryStage on the cancellation

2024-02-23 Thread Eren Avsarogullari (Jira)
Eren Avsarogullari created SPARK-47148: -- Summary: [AQE] Avoid to materialize ShuffleQueryStage on the cancellation Key: SPARK-47148 URL: https://issues.apache.org/jira/browse/SPARK-47148 Project:

[jira] [Updated] (SPARK-47148) Avoid to materialize AQE ShuffleQueryStage on the cancellation

2024-02-23 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-47148: --- Summary: Avoid to materialize AQE ShuffleQueryStage on the cancellation (was: [AQE]

[jira] [Updated] (SPARK-46639) Add WindowExec SQLMetrics

2024-02-23 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-46639: --- Attachment: WindowExec SQLMetrics.png > Add WindowExec SQLMetrics >

[jira] [Updated] (SPARK-46639) Add WindowExec SQLMetrics

2024-02-23 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-46639: --- Description: Currently, WindowExec Physical Operator has only spillSize SQLMetric. T

[jira] [Updated] (SPARK-46639) Add WindowExec SQLMetrics

2024-02-23 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-46639: --- Description: Currently, WindowExec Physical Operator has only spillSize SQLMetric. T

[jira] [Updated] (SPARK-47148) Avoid to materialize AQE ShuffleQueryStage on the cancellation

2024-02-23 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-47148: --- Description: AQE can materialize *ShuffleQueryStage* on the cancellation. This cause

[jira] [Assigned] (SPARK-46975) Support dedicated fallback methods

2024-02-23 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-46975: Assignee: Ruifeng Zheng > Support dedicated fallback methods > --

[jira] [Commented] (SPARK-45101) Spark UI: A stage is still active even when all of it's tasks are succeeded

2024-02-23 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17820182#comment-17820182 ] Bjørn Jørgensen commented on SPARK-45101: - did you use spark.stop() > Spark U

[jira] [Resolved] (SPARK-46975) Support dedicated fallback methods

2024-02-23 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-46975. -- Resolution: Done Resolved by https://github.com/apache/spark/pull/45026 > Support dedicated f

[jira] [Resolved] (SPARK-47118) Upgrade Jetty to 11

2024-02-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47118. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45154 [https://

[jira] [Created] (SPARK-47149) Add Use Pandas API on Spark section on Pandas Scaling to large datasets page

2024-02-23 Thread Jira
Bjørn Jørgensen created SPARK-47149: --- Summary: Add Use Pandas API on Spark section on Pandas Scaling to large datasets page Key: SPARK-47149 URL: https://issues.apache.org/jira/browse/SPARK-47149 Pr

[jira] [Resolved] (SPARK-47035) Protocol for client side StreamingQueryListener

2024-02-23 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-47035. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45091 [https://

[jira] [Created] (SPARK-47150) String length (...) exceeds the maximum length (20000000)

2024-02-23 Thread Sergii Mikhtoniuk (Jira)
Sergii Mikhtoniuk created SPARK-47150: - Summary: String length (...) exceeds the maximum length (2000) Key: SPARK-47150 URL: https://issues.apache.org/jira/browse/SPARK-47150 Project: Spark

[jira] [Created] (SPARK-47151) Update pandas to 2.2.1

2024-02-23 Thread Jira
Bjørn Jørgensen created SPARK-47151: --- Summary: Update pandas to 2.2.1 Key: SPARK-47151 URL: https://issues.apache.org/jira/browse/SPARK-47151 Project: Spark Issue Type: Dependency upgrade

[jira] [Updated] (SPARK-47151) Update pandas to 2.2.1

2024-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47151: --- Labels: pull-request-available (was: ) > Update pandas to 2.2.1 > -- >

[jira] [Created] (SPARK-47152) Provide Apache Hive Jackson dependency via a new optional directory

2024-02-23 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47152: - Summary: Provide Apache Hive Jackson dependency via a new optional directory Key: SPARK-47152 URL: https://issues.apache.org/jira/browse/SPARK-47152 Project: Spark

[jira] [Updated] (SPARK-47152) Provide Apache Hive Jackson dependency via a new optional directory

2024-02-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47152: -- Component/s: Build > Provide Apache Hive Jackson dependency via a new optional directory > ---

[jira] [Updated] (SPARK-47152) Provide Apache Hive Jackson dependency via a new optional directory

2024-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47152: --- Labels: pull-request-available (was: ) > Provide Apache Hive Jackson dependency via a new o

[jira] [Updated] (SPARK-47152) Provide `CodeHaus Jackson` dependencies via a new optional directory

2024-02-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47152: -- Summary: Provide `CodeHaus Jackson` dependencies via a new optional directory (was: Provide A

[jira] [Assigned] (SPARK-47152) Provide `CodeHaus Jackson` dependencies via a new optional directory

2024-02-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47152: - Assignee: Dongjoon Hyun > Provide `CodeHaus Jackson` dependencies via a new optional di

[jira] [Resolved] (SPARK-47151) Update pandas to 2.2.1

2024-02-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47151. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45236 [https://

[jira] [Assigned] (SPARK-47151) Update pandas to 2.2.1

2024-02-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47151: - Assignee: Bjørn Jørgensen > Update pandas to 2.2.1 > -- > >

[jira] [Created] (SPARK-47153) Guard serialize/deserialize in JavaSerializer with try-with-resource block

2024-02-23 Thread Yan-Lin (Jared) Wang (Jira)
Yan-Lin (Jared) Wang created SPARK-47153: Summary: Guard serialize/deserialize in JavaSerializer with try-with-resource block Key: SPARK-47153 URL: https://issues.apache.org/jira/browse/SPARK-47153

[jira] [Updated] (SPARK-47153) Guard serialize/deserialize in JavaSerializer with try-with-resource block

2024-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47153: --- Labels: pull-request-available (was: ) > Guard serialize/deserialize in JavaSerializer with

[jira] [Resolved] (SPARK-44319) Migrate jersey 2 to jersey 3

2024-02-23 Thread HiuFung Kwok (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HiuFung Kwok resolved SPARK-44319. -- Fix Version/s: 4.0.0 Resolution: Fixed The work is done under the scope of SPARK-47118.

[jira] [Commented] (SPARK-44319) Migrate jersey 2 to jersey 3

2024-02-23 Thread HiuFung Kwok (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17820268#comment-17820268 ] HiuFung Kwok commented on SPARK-44319: -- [~dongjoon] FYI I marked this as resolved a

[jira] [Updated] (SPARK-47126) Re-enable Spark 3.4 test in HiveExternalCatalogVersionsSuite

2024-02-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47126: -- Parent: (was: SPARK-47046) Issue Type: Bug (was: Sub-task) > Re-enable Spark 3.4