[jira] [Commented] (SPARK-47042) Fix `common-utils` module to have explicit `commons-lang3` dependency

[ https://issues.apache.org/jira/browse/SPARK-47042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817403#comment-17817403 ] William Wong commented on SPARK-47042: -- Apart from missing commons-lang3 dependencies,

[jira] [Updated] (SPARK-47043) Fix `spark-common-utils` module to have explicit `jackson-core` and `jackson-annotations`dependency

[ https://issues.apache.org/jira/browse/SPARK-47043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Wong updated SPARK-47043: - Description: Following scala code depends on `jackson-core` and `jackson-annotations`

[jira] [Updated] (SPARK-47043) Fix `spark-common-utils` module to have explicit `jackson-core` and `jackson-annotations`dependency

[ https://issues.apache.org/jira/browse/SPARK-47043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47043: --- Labels: pull-request-available (was: ) > Fix `spark-common-utils` module to have explicit

[jira] [Created] (SPARK-47046) Apache Spark 4.0.0 Dependency Audit and Cleanup

Dongjoon Hyun created SPARK-47046: - Summary: Apache Spark 4.0.0 Dependency Audit and Cleanup Key: SPARK-47046 URL: https://issues.apache.org/jira/browse/SPARK-47046 Project: Spark Issue

[jira] [Updated] (SPARK-47038) Remove shaded `protobuf-java` 2.6.1 dependency from `kinesis-asl-assembly`

[ https://issues.apache.org/jira/browse/SPARK-47038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47038: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Remove shaded `protobuf-java` 2.6.1

[jira] [Updated] (SPARK-47023) Upgrade `aircompressor` to 1.26

[ https://issues.apache.org/jira/browse/SPARK-47023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47023: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Upgrade `aircompressor` to 1.26 >

[jira] [Updated] (SPARK-45502) Upgrade Kafka to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-45502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45502: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Upgrade Kafka to 3.6.1 >

[jira] [Commented] (SPARK-47043) Fix `spark-common-utils` module to have explicit `jackson-core` and `jackson-annotations`dependency

[ https://issues.apache.org/jira/browse/SPARK-47043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817482#comment-17817482 ] William Wong commented on SPARK-47043: -- The ticket was created via cloning. Somehow, the cloned

[jira] [Updated] (SPARK-47049) Ban non-shaded Hadoop dependencies

[ https://issues.apache.org/jira/browse/SPARK-47049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47049: --- Labels: pull-request-available (was: ) > Ban non-shaded Hadoop dependencies >

[jira] [Updated] (SPARK-47043) Fix `spark-common-utils` module to have explicit `jackson-core` and `jackson-annotations`dependency

[ https://issues.apache.org/jira/browse/SPARK-47043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Wong updated SPARK-47043: - Summary: Fix `spark-common-utils` module to have explicit `jackson-core` and

[jira] [Created] (SPARK-47043) Fix `common-utils` module to have explicit `jackson-core` and `jackson-annotations`dependency

William Wong created SPARK-47043: Summary: Fix `common-utils` module to have explicit `jackson-core` and `jackson-annotations`dependency Key: SPARK-47043 URL: https://issues.apache.org/jira/browse/SPARK-47043

[jira] [Updated] (SPARK-47042) Fix `spark-common-utils` module to have explicit `commons-lang3` dependency

[ https://issues.apache.org/jira/browse/SPARK-47042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Wong updated SPARK-47042: - Summary: Fix `spark-common-utils` module to have explicit `commons-lang3` dependency (was: Fix

[jira] [Updated] (SPARK-47044) Add JDBC query to explain formatted command

[ https://issues.apache.org/jira/browse/SPARK-47044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47044: --- Labels: pull-request-available (was: ) > Add JDBC query to explain formatted command >

[jira] [Updated] (SPARK-47045) Replace IllegalArgumentException by SparkIllegalArgumentException in sql/api

[ https://issues.apache.org/jira/browse/SPARK-47045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-47045: - Description: Replace all IllegalArgumentException by SparkIllegalArgumentException in *sql/api* code

[jira] [Created] (SPARK-47045) Replace IllegalArgumentException by SparkIllegalArgumentException in sql/api

Max Gekk created SPARK-47045: Summary: Replace IllegalArgumentException by SparkIllegalArgumentException in sql/api Key: SPARK-47045 URL: https://issues.apache.org/jira/browse/SPARK-47045 Project: Spark

[jira] [Updated] (SPARK-45743) Upgrade dropwizard metrics 4.2.21

[ https://issues.apache.org/jira/browse/SPARK-45743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45743: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Upgrade dropwizard metrics 4.2.21 >

[jira] [Updated] (SPARK-44445) Use `org.seleniumhq.selenium.htmlunit3-driver` instead of `net.sourceforge.htmlunit`

[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-5: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Use

[jira] [Created] (SPARK-47044) Add JDBC query to explain formatted command

Uros Stankovic created SPARK-47044: -- Summary: Add JDBC query to explain formatted command Key: SPARK-47044 URL: https://issues.apache.org/jira/browse/SPARK-47044 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46832) Collate and Collation expression support

[ https://issues.apache.org/jira/browse/SPARK-46832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46832. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45064

[jira] [Assigned] (SPARK-46832) Collate and Collation expression support

[ https://issues.apache.org/jira/browse/SPARK-46832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46832: Assignee: Aleksandar Tomic > Collate and Collation expression support >

[jira] [Assigned] (SPARK-47043) Fix `spark-common-utils` module to have explicit `jackson-core` and `jackson-annotations`dependency

[ https://issues.apache.org/jira/browse/SPARK-47043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47043: - Assignee: (was: Dongjoon Hyun) > Fix `spark-common-utils` module to have explicit

[jira] [Updated] (SPARK-46938) Migrate jetty 10 to jetty 11

[ https://issues.apache.org/jira/browse/SPARK-46938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46938: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Migrate jetty 10 to jetty 11 >

[jira] [Updated] (SPARK-47042) Fix `common-utils` module to have explicit `commons-lang3` dependency

[ https://issues.apache.org/jira/browse/SPARK-47042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Wong updated SPARK-47042: - Description: Following scala code depends on `commons-lang3` explicitly.  However, the

[jira] [Updated] (SPARK-47043) Fix `spark-common-utils` module to have explicit `jackson-core` and `jackson-annotations`dependency

[ https://issues.apache.org/jira/browse/SPARK-47043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Wong updated SPARK-47043: - Labels: (was: pull-request-available) > Fix `spark-common-utils` module to have explicit

[jira] [Commented] (SPARK-38958) Override S3 Client in Spark Write/Read calls

[ https://issues.apache.org/jira/browse/SPARK-38958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817460#comment-17817460 ] ASF GitHub Bot commented on SPARK-38958: steveloughran commented on code in PR #6550: URL:

[jira] [Updated] (SPARK-47021) Fix `kvstore` module to have explicit `commons-lang3` test dependency

[ https://issues.apache.org/jira/browse/SPARK-47021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47021: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Fix `kvstore` module to have explicit

[jira] [Updated] (SPARK-46257) Upgrade Derby to 10.16.1.1

[ https://issues.apache.org/jira/browse/SPARK-46257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46257: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Upgrade Derby to 10.16.1.1 >

[jira] [Updated] (SPARK-47015) Disable partitioning on collated columns

[ https://issues.apache.org/jira/browse/SPARK-47015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47015: --- Labels: pull-request-available (was: ) > Disable partitioning on collated columns >

[jira] [Resolved] (SPARK-47038) Remove shaded `protobuf-java` 2.6.1 dependency from `kinesis-asl-assembly`

[ https://issues.apache.org/jira/browse/SPARK-47038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47038. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45096

[jira] [Commented] (SPARK-47042) Fix `spark-common-utils` module to have explicit `commons-lang3` dependency

[ https://issues.apache.org/jira/browse/SPARK-47042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817470#comment-17817470 ] Dongjoon Hyun commented on SPARK-47042: --- I removed my name from assignee field. > Fix

[jira] [Commented] (SPARK-47043) Fix `spark-common-utils` module to have explicit `jackson-core` and `jackson-annotations`dependency

[ https://issues.apache.org/jira/browse/SPARK-47043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817471#comment-17817471 ] Dongjoon Hyun commented on SPARK-47043: --- I removed my name from assignee field. > Fix

[jira] [Assigned] (SPARK-47042) Fix `spark-common-utils` module to have explicit `commons-lang3` dependency

[ https://issues.apache.org/jira/browse/SPARK-47042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47042: - Assignee: (was: Dongjoon Hyun) > Fix `spark-common-utils` module to have explicit

[jira] [Assigned] (SPARK-47014) Implement methods dumpPerfProfiles and dumpMemoryProfiles of SparkSession

[ https://issues.apache.org/jira/browse/SPARK-47014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-47014: Assignee: Xinrong Meng > Implement methods dumpPerfProfiles and dumpMemoryProfiles of

[jira] [Resolved] (SPARK-47014) Implement methods dumpPerfProfiles and dumpMemoryProfiles of SparkSession

[ https://issues.apache.org/jira/browse/SPARK-47014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-47014. -- Resolution: Done Resolved by https://github.com/apache/spark/pull/45073 > Implement methods

[jira] [Created] (SPARK-47049) Ban non-shaded Hadoop dependencies

Dongjoon Hyun created SPARK-47049: - Summary: Ban non-shaded Hadoop dependencies Key: SPARK-47049 URL: https://issues.apache.org/jira/browse/SPARK-47049 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47042) Fix `common-utils` module to have explicit `commons-lang3` dependency

[ https://issues.apache.org/jira/browse/SPARK-47042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47042: --- Labels: pull-request-available (was: ) > Fix `common-utils` module to have explicit

[jira] [Updated] (SPARK-47043) Fix `spark-common-utils` module to have explicit `jackson-core` and `jackson-annotations`dependency

[ https://issues.apache.org/jira/browse/SPARK-47043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Wong updated SPARK-47043: - Description: Following scala code depends on `jackson-core` and `jackson-annotations`

[jira] [Resolved] (SPARK-47039) Add a checkstyle rule to ban `commons-lang` in Java code

[ https://issues.apache.org/jira/browse/SPARK-47039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47039. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45097

[jira] [Assigned] (SPARK-47039) Add a checkstyle rule to ban `commons-lang` in Java code

[ https://issues.apache.org/jira/browse/SPARK-47039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47039: - Assignee: Dongjoon Hyun > Add a checkstyle rule to ban `commons-lang` in Java code >

[jira] [Created] (SPARK-47047) Add support for transformWithState operator with state data source reader

Anish Shrigondekar created SPARK-47047: -- Summary: Add support for transformWithState operator with state data source reader Key: SPARK-47047 URL: https://issues.apache.org/jira/browse/SPARK-47047

[jira] [Commented] (SPARK-47043) Fix `spark-common-utils` module to have explicit `jackson-core` and `jackson-annotations`dependency

[ https://issues.apache.org/jira/browse/SPARK-47043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817466#comment-17817466 ] Dongjoon Hyun commented on SPARK-47043: --- [~william1104]. May I ask why do you use my name in your

[jira] [Commented] (SPARK-47042) Fix `spark-common-utils` module to have explicit `commons-lang3` dependency

[ https://issues.apache.org/jira/browse/SPARK-47042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817465#comment-17817465 ] Dongjoon Hyun commented on SPARK-47042: --- [~william1104]. May I ask why do you use my name in your

[jira] [Commented] (SPARK-47042) Fix `spark-common-utils` module to have explicit `commons-lang3` dependency

[ https://issues.apache.org/jira/browse/SPARK-47042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817483#comment-17817483 ] William Wong commented on SPARK-47042: -- The ticket was created via cloning. Somehow, the cloned

[jira] [Updated] (SPARK-47042) Fix `common-utils` module to have explicit `commons-lang3` dependency

[ https://issues.apache.org/jira/browse/SPARK-47042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Wong updated SPARK-47042: - Affects Version/s: 4.0.0 (was: 3.3.0)

[jira] [Updated] (SPARK-47042) Fix `common-utils` module to have explicit `commons-lang3` dependency

[ https://issues.apache.org/jira/browse/SPARK-47042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Wong updated SPARK-47042: - Labels: (was: pull-request-available) > Fix `common-utils` module to have explicit

[jira] [Updated] (SPARK-47042) Fix `common-utils` module to have explicit `commons-lang3` dependency

[ https://issues.apache.org/jira/browse/SPARK-47042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Wong updated SPARK-47042: - Fix Version/s: (was: 3.5.1) (was: 3.4.3) > Fix `common-utils` module

[jira] [Created] (SPARK-47042) Fix `common-utils` module to have explicit `commons-lang3` dependency

William Wong created SPARK-47042: Summary: Fix `common-utils` module to have explicit `commons-lang3` dependency Key: SPARK-47042 URL: https://issues.apache.org/jira/browse/SPARK-47042 Project: Spark

[jira] [Updated] (SPARK-47009) Create table with collation

[ https://issues.apache.org/jira/browse/SPARK-47009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47009: --- Labels: pull-request-available (was: ) > Create table with collation >

[jira] [Updated] (SPARK-45956) Upgrade ZooKeeper to 3.9.1

[ https://issues.apache.org/jira/browse/SPARK-45956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45956: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Upgrade ZooKeeper to 3.9.1 >

[jira] [Updated] (SPARK-45522) Migrate jetty 9 to jetty 10

[ https://issues.apache.org/jira/browse/SPARK-45522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45522: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Migrate jetty 9 to jetty 10 >

[jira] [Created] (SPARK-47048) spark.rpc.askTimeout default value is not observed

Stephen Mcmullan created SPARK-47048: Summary: spark.rpc.askTimeout default value is not observed Key: SPARK-47048 URL: https://issues.apache.org/jira/browse/SPARK-47048 Project: Spark

[jira] [Updated] (SPARK-47046) Apache Spark 4.0.0 Dependency Audit and Cleanup

[ https://issues.apache.org/jira/browse/SPARK-47046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47046: -- Labels: releasenotes (was: ) > Apache Spark 4.0.0 Dependency Audit and Cleanup >

[jira] [Updated] (SPARK-47025) Switch `Guava 19.0` dependency scope from `provided` to `test`

[ https://issues.apache.org/jira/browse/SPARK-47025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47025: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Switch `Guava 19.0` dependency scope from

[jira] [Updated] (SPARK-44319) Migrate jersey 2 to jersey 3

[ https://issues.apache.org/jira/browse/SPARK-44319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44319: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Migrate jersey 2 to jersey 3 >

[jira] [Updated] (SPARK-44170) Migrating Junit4 to Junit5

[ https://issues.apache.org/jira/browse/SPARK-44170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44170: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Migrating Junit4 to Junit5 >

[jira] [Created] (SPARK-47053) Docker image for release has to bump versions of some python libraries for 3.5.1

Jungtaek Lim created SPARK-47053: Summary: Docker image for release has to bump versions of some python libraries for 3.5.1 Key: SPARK-47053 URL: https://issues.apache.org/jira/browse/SPARK-47053

[jira] [Created] (SPARK-47052) Separate state tracking variables from MicroBatchExecution/StreamExecution

Boyang Jerry Peng created SPARK-47052: - Summary: Separate state tracking variables from MicroBatchExecution/StreamExecution Key: SPARK-47052 URL: https://issues.apache.org/jira/browse/SPARK-47052

[jira] [Updated] (SPARK-45396) Add doc entry for `pyspark.ml.connect` module

[ https://issues.apache.org/jira/browse/SPARK-45396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45396: - Fix Version/s: (was: 3.5.1) > Add doc entry for `pyspark.ml.connect` module >

[jira] [Commented] (SPARK-45396) Add doc entry for `pyspark.ml.connect` module

[ https://issues.apache.org/jira/browse/SPARK-45396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817564#comment-17817564 ] Hyukjin Kwon commented on SPARK-45396: -- Reverted in branch-3.5:

[jira] [Created] (SPARK-47050) Collect and publish partition level metrics

Steve Vaughan created SPARK-47050: - Summary: Collect and publish partition level metrics Key: SPARK-47050 URL: https://issues.apache.org/jira/browse/SPARK-47050 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-47049) Ban non-shaded Hadoop dependencies

[ https://issues.apache.org/jira/browse/SPARK-47049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47049: - Assignee: Dongjoon Hyun > Ban non-shaded Hadoop dependencies >

[jira] [Resolved] (SPARK-47049) Ban non-shaded Hadoop dependencies

[ https://issues.apache.org/jira/browse/SPARK-47049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47049. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45106

[jira] [Updated] (SPARK-47052) Separate state tracking variables from MicroBatchExecution/StreamExecution

[ https://issues.apache.org/jira/browse/SPARK-47052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47052: --- Labels: pull-request-available (was: ) > Separate state tracking variables from

[jira] [Commented] (SPARK-38958) Override S3 Client in Spark Write/Read calls

[ https://issues.apache.org/jira/browse/SPARK-38958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817557#comment-17817557 ] ASF GitHub Bot commented on SPARK-38958: AbhiAMZ commented on code in PR #6550: URL:

[jira] [Commented] (SPARK-38958) Override S3 Client in Spark Write/Read calls

[ https://issues.apache.org/jira/browse/SPARK-38958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817558#comment-17817558 ] ASF GitHub Bot commented on SPARK-38958: AbhiAMZ commented on code in PR #6550: URL:

[jira] [Updated] (SPARK-47054) Remove pinned version of torch for Python 3.12 support

[ https://issues.apache.org/jira/browse/SPARK-47054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47054: --- Labels: pull-request-available (was: ) > Remove pinned version of torch for Python 3.12

[jira] [Updated] (SPARK-47053) Docker image for release has to bump versions of some python libraries for 3.5.1

[ https://issues.apache.org/jira/browse/SPARK-47053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47053: --- Labels: pull-request-available (was: ) > Docker image for release has to bump versions of

[jira] [Resolved] (SPARK-47051) Create a new test pipeline for `yarn` and `connect`

[ https://issues.apache.org/jira/browse/SPARK-47051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47051. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45107

[jira] [Assigned] (SPARK-47051) Create a new test pipeline for `yarn` and `connect`

[ https://issues.apache.org/jira/browse/SPARK-47051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47051: - Assignee: Dongjoon Hyun > Create a new test pipeline for `yarn` and `connect` >

[jira] [Created] (SPARK-47054) Remove pinned version of torch for Python 3.12 support

Hyukjin Kwon created SPARK-47054: Summary: Remove pinned version of torch for Python 3.12 support Key: SPARK-47054 URL: https://issues.apache.org/jira/browse/SPARK-47054 Project: Spark Issue

[jira] [Resolved] (SPARK-47045) Replace IllegalArgumentException by SparkIllegalArgumentException in sql/api

[ https://issues.apache.org/jira/browse/SPARK-47045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47045. -- Resolution: Fixed Issue resolved by pull request 45098 [https://github.com/apache/spark/pull/45098]

[jira] [Resolved] (SPARK-47053) Docker image for release has to bump versions of some python libraries for 3.5.1

[ https://issues.apache.org/jira/browse/SPARK-47053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47053. -- Fix Version/s: 3.5.1 Resolution: Fixed Issue resolved by pull request 45111

[jira] [Assigned] (SPARK-47053) Docker image for release has to bump versions of some python libraries for 3.5.1

[ https://issues.apache.org/jira/browse/SPARK-47053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-47053: Assignee: Jungtaek Lim > Docker image for release has to bump versions of some python

[jira] [Created] (SPARK-47041) PushDownUtils uses FileScanBuilder instead of SupportsPushDownCatalystFilters trait

Никита Соколов created SPARK-47041: -- Summary: PushDownUtils uses FileScanBuilder instead of SupportsPushDownCatalystFilters trait Key: SPARK-47041 URL: https://issues.apache.org/jira/browse/SPARK-47041

[jira] [Commented] (SPARK-47041) PushDownUtils uses FileScanBuilder instead of SupportsPushDownCatalystFilters trait

[ https://issues.apache.org/jira/browse/SPARK-47041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817369#comment-17817369 ] Никита Соколов commented on SPARK-47041: [https://github.com/apache/spark/pull/45099] >

[jira] [Created] (SPARK-47040) Allow Spark Connect Server Script to wait

Dongjoon Hyun created SPARK-47040: - Summary: Allow Spark Connect Server Script to wait Key: SPARK-47040 URL: https://issues.apache.org/jira/browse/SPARK-47040 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-47040) Allow Spark Connect Server Script to wait

[ https://issues.apache.org/jira/browse/SPARK-47040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47040: - Assignee: Dongjoon Hyun > Allow Spark Connect Server Script to wait >

[jira] [Resolved] (SPARK-47040) Allow Spark Connect Server Script to wait

[ https://issues.apache.org/jira/browse/SPARK-47040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47040. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45090

[jira] [Assigned] (SPARK-47040) Allow Spark Connect Server Script to wait

[ https://issues.apache.org/jira/browse/SPARK-47040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47040: - Assignee: Martin Grund (was: Dongjoon Hyun) > Allow Spark Connect Server Script to

[jira] [Updated] (SPARK-47040) Allow Spark Connect Server Script to wait

[ https://issues.apache.org/jira/browse/SPARK-47040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47040: --- Labels: pull-request-available (was: ) > Allow Spark Connect Server Script to wait >

[jira] [Created] (SPARK-47038) Remove `protobuf-java` dependency override

Dongjoon Hyun created SPARK-47038: - Summary: Remove `protobuf-java` dependency override Key: SPARK-47038 URL: https://issues.apache.org/jira/browse/SPARK-47038 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47038) Remove shaded `protobuf-java` 2.6.1 dependency from `kinesis-asl-assembly`

[ https://issues.apache.org/jira/browse/SPARK-47038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47038: -- Summary: Remove shaded `protobuf-java` 2.6.1 dependency from `kinesis-asl-assembly` (was:

[jira] [Updated] (SPARK-47038) Remove shaded `protobuf-java` 2.6.1 dependency from `kinesis-asl-assembly`

[ https://issues.apache.org/jira/browse/SPARK-47038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47038: --- Labels: pull-request-available (was: ) > Remove shaded `protobuf-java` 2.6.1 dependency

[jira] [Assigned] (SPARK-47038) Remove shaded `protobuf-java` 2.6.1 dependency from `kinesis-asl-assembly`

[ https://issues.apache.org/jira/browse/SPARK-47038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47038: - Assignee: Dongjoon Hyun > Remove shaded `protobuf-java` 2.6.1 dependency from

[jira] [Updated] (SPARK-47038) Remove shaded `protobuf-java` 2.6.1 dependency from `kinesis-asl-assembly`

[ https://issues.apache.org/jira/browse/SPARK-47038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47038: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Remove shaded

[jira] [Updated] (SPARK-47025) Switch `Guava 19.0` dependency scope from `provided` to `test`

[ https://issues.apache.org/jira/browse/SPARK-47025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47025: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Switch `Guava 19.0`

[jira] [Updated] (SPARK-47039) Add a checkstyle rule to ban `commons-lang2` in Java code

[ https://issues.apache.org/jira/browse/SPARK-47039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47039: -- Summary: Add a checkstyle rule to ban `commons-lang2` in Java code (was: Add a checkstyle

[jira] [Updated] (SPARK-47039) Add a checkstyle rule to ban `commons-lang2` in Java code

[ https://issues.apache.org/jira/browse/SPARK-47039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47039: --- Labels: pull-request-available (was: ) > Add a checkstyle rule to ban `commons-lang2` in

[jira] [Created] (SPARK-47039) Add a checkstyle url to ban `commons-lang2` in Java code

Dongjoon Hyun created SPARK-47039: - Summary: Add a checkstyle url to ban `commons-lang2` in Java code Key: SPARK-47039 URL: https://issues.apache.org/jira/browse/SPARK-47039 Project: Spark

[jira] [Updated] (SPARK-47039) Add a checkstyle rule to ban `commons-lang` in Java code

[ https://issues.apache.org/jira/browse/SPARK-47039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47039: -- Summary: Add a checkstyle rule to ban `commons-lang` in Java code (was: Add a checkstyle

[jira] [Assigned] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43259: -- Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_2024 >

[jira] [Assigned] (SPARK-47037) JoinWith on non-inner joins adds an unnecessary shuffle

[ https://issues.apache.org/jira/browse/SPARK-47037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47037: -- Assignee: (was: Apache Spark) > JoinWith on non-inner joins adds an unnecessary

[jira] [Assigned] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43259: -- Assignee: (was: Apache Spark) > Assign a name to the error class

[jira] [Assigned] (SPARK-47037) JoinWith on non-inner joins adds an unnecessary shuffle

[ https://issues.apache.org/jira/browse/SPARK-47037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47037: -- Assignee: Apache Spark > JoinWith on non-inner joins adds an unnecessary shuffle >

[jira] [Updated] (SPARK-47021) Fix `kvstore` module to have explicit `commons-lang3` test dependency

[ https://issues.apache.org/jira/browse/SPARK-47021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47021: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Fix `kvstore` module to have

[jira] [Updated] (SPARK-44445) Use `org.seleniumhq.selenium.htmlunit3-driver` instead of `net.sourceforge.htmlunit`

[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-5: -- Summary: Use `org.seleniumhq.selenium.htmlunit3-driver` instead of `net.sourceforge.htmlunit`

[jira] [Updated] (SPARK-47023) Upgrade `aircompressor` to 1.26

[ https://issues.apache.org/jira/browse/SPARK-47023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47023: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Upgrade `aircompressor` to