[jira] [Updated] (SPARK-46094) Support Executor JVM Profiling

[ https://issues.apache.org/jira/browse/SPARK-46094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-46094: Component/s: Spark Core (was: Connect) > Support Executor JVM Profiling > ---

[jira] [Resolved] (SPARK-51926) Add INVALID_CONF_VALUE.subXXX error class to ConfigEntry errors

[ https://issues.apache.org/jira/browse/SPARK-51926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-51926. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50729 [https://github.com

[jira] [Assigned] (SPARK-51926) Add INVALID_CONF_VALUE.subXXX error class to ConfigEntry errors

[ https://issues.apache.org/jira/browse/SPARK-51926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-51926: Assignee: Kent Yao > Add INVALID_CONF_VALUE.subXXX error class to ConfigEntry errors > --

[jira] [Resolved] (SPARK-51934) Add `MacOS` integration test with Apache Spark 3.5.5

[ https://issues.apache.org/jira/browse/SPARK-51934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51934. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 9

[jira] [Resolved] (SPARK-51869) Create classification for user errors within handleInputRows for Scala TransformWithState

[ https://issues.apache.org/jira/browse/SPARK-51869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-51869. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50667 [https://gi

[jira] [Assigned] (SPARK-51869) Create classification for user errors within handleInputRows for Scala TransformWithState

[ https://issues.apache.org/jira/browse/SPARK-51869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-51869: Assignee: Eric Marnadi > Create classification for user errors within handleInputRows for

[jira] [Resolved] (SPARK-51930) Upgrade datasketches-java to 6.2.0

[ https://issues.apache.org/jira/browse/SPARK-51930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51930. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50733 [https://

[jira] [Updated] (SPARK-51934) Add `MacOS` integration test with Apache Spark 3.5.5

[ https://issues.apache.org/jira/browse/SPARK-51934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51934: --- Labels: pull-request-available (was: ) > Add `MacOS` integration test with Apache Spark 3.5

[jira] [Created] (SPARK-51934) Add `MacOS` integration test with Apache Spark 3.5.5

Dongjoon Hyun created SPARK-51934: - Summary: Add `MacOS` integration test with Apache Spark 3.5.5 Key: SPARK-51934 URL: https://issues.apache.org/jira/browse/SPARK-51934 Project: Spark Issue

[jira] [Assigned] (SPARK-51899) Implement error handling rules for spark.catalog.listTables()

[ https://issues.apache.org/jira/browse/SPARK-51899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51899: --- Assignee: Yihong He > Implement error handling rules for spark.catalog.listTables() > -

[jira] [Resolved] (SPARK-51899) Implement error handling rules for spark.catalog.listTables()

[ https://issues.apache.org/jira/browse/SPARK-51899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51899. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50696 [https://gith

[jira] [Updated] (SPARK-51933) Document the new API `transformWithState` in PySpark

[ https://issues.apache.org/jira/browse/SPARK-51933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51933: --- Labels: pull-request-available (was: ) > Document the new API `transformWithState` in PySpa

[jira] [Created] (SPARK-51933) Document the new API `transformWithState` in PySpark

Jungtaek Lim created SPARK-51933: Summary: Document the new API `transformWithState` in PySpark Key: SPARK-51933 URL: https://issues.apache.org/jira/browse/SPARK-51933 Project: Spark Issue Ty

[jira] [Created] (SPARK-51932) Enable SparkConnectProgressHandlerE2E in connect-only mode

Ruifeng Zheng created SPARK-51932: - Summary: Enable SparkConnectProgressHandlerE2E in connect-only mode Key: SPARK-51932 URL: https://issues.apache.org/jira/browse/SPARK-51932 Project: Spark

[jira] [Updated] (SPARK-51932) Enable SparkConnectProgressHandlerE2E in connect-only mode

[ https://issues.apache.org/jira/browse/SPARK-51932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51932: --- Labels: pull-request-available (was: ) > Enable SparkConnectProgressHandlerE2E in connect-o

[jira] [Resolved] (SPARK-51880) Avoid eager model removal in meta algorithms when collectSubModel is true

[ https://issues.apache.org/jira/browse/SPARK-51880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-51880. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50707 [https://

[jira] [Updated] (SPARK-51931) Add maxBytesPerOutputBatch to limit the number of bytes of Arrow output batch

[ https://issues.apache.org/jira/browse/SPARK-51931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51931: --- Labels: pull-request-available (was: ) > Add maxBytesPerOutputBatch to limit the number of

[jira] [Resolved] (SPARK-51827) Support Spark Connect in new API `transformWithState` in PySpark

[ https://issues.apache.org/jira/browse/SPARK-51827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-51827. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50704 [https://gi

[jira] [Assigned] (SPARK-51827) Support Spark Connect in new API `transformWithState` in PySpark

[ https://issues.apache.org/jira/browse/SPARK-51827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-51827: Assignee: Jungtaek Lim > Support Spark Connect in new API `transformWithState` in PySpark

[jira] [Assigned] (SPARK-51823) Add option to not persist state stores on executors

[ https://issues.apache.org/jira/browse/SPARK-51823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-51823: Assignee: Adam Binford > Add option to not persist state stores on executors > --

[jira] [Resolved] (SPARK-51823) Add option to not persist state stores on executors

[ https://issues.apache.org/jira/browse/SPARK-51823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-51823. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50612 [https://gi

[jira] [Assigned] (SPARK-51931) Add maxBytesPerOutputBatch to limit the number of bytes of Arrow output batch

[ https://issues.apache.org/jira/browse/SPARK-51931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-51931: --- Assignee: L. C. Hsieh > Add maxBytesPerOutputBatch to limit the number of bytes of Arrow ou

[jira] [Created] (SPARK-51931) Add maxBytesPerOutputBatch to limit the number of bytes of Arrow output batch

L. C. Hsieh created SPARK-51931: --- Summary: Add maxBytesPerOutputBatch to limit the number of bytes of Arrow output batch Key: SPARK-51931 URL: https://issues.apache.org/jira/browse/SPARK-51931 Project:

[jira] [Updated] (SPARK-51895) Update K8s IT CI to use K8s 1.33

[ https://issues.apache.org/jira/browse/SPARK-51895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51895: -- Fix Version/s: 4.0.0 (was: 4.1.0) > Update K8s IT CI to use K8s 1.33 >

[jira] [Updated] (SPARK-51895) Update K8s IT CI to use K8s 1.33

[ https://issues.apache.org/jira/browse/SPARK-51895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51895: -- Parent Issue: SPARK-49524 (was: SPARK-44111) > Update K8s IT CI to use K8s 1.33 > ---

[jira] [Updated] (SPARK-51895) Update K8s IT CI to use K8s 1.33

[ https://issues.apache.org/jira/browse/SPARK-51895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51895: -- Affects Version/s: 4.0.0 (was: 4.1.0) > Update K8s IT CI to use K8s

[jira] [Updated] (SPARK-51908) Update `setup-minikube` to v0.0.19

[ https://issues.apache.org/jira/browse/SPARK-51908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51908: -- Parent Issue: SPARK-49524 (was: SPARK-51166) > Update `setup-minikube` to v0.0.19 > -

[jira] [Updated] (SPARK-51908) Update `setup-minikube` to v0.0.19

[ https://issues.apache.org/jira/browse/SPARK-51908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51908: -- Fix Version/s: 4.0.0 (was: 4.1.0) > Update `setup-minikube` to v0.0.19

[jira] [Updated] (SPARK-51908) Update `setup-minikube` to v0.0.19

[ https://issues.apache.org/jira/browse/SPARK-51908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51908: -- Fix Version/s: 4.1.0 > Update `setup-minikube` to v0.0.19 > --

[jira] [Resolved] (SPARK-51928) Upgrade Apache commons-text to 1.13.1

[ https://issues.apache.org/jira/browse/SPARK-51928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51928. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50732 [https://

[jira] [Updated] (SPARK-51928) Upgrade Apache commons-text to 1.13.1

[ https://issues.apache.org/jira/browse/SPARK-51928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51928: -- Parent: SPARK-51166 Issue Type: Sub-task (was: Improvement) > Upgrade Apache commons-

[jira] [Assigned] (SPARK-51928) Upgrade Apache commons-text to 1.13.1

[ https://issues.apache.org/jira/browse/SPARK-51928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51928: - Assignee: Yang Jie > Upgrade Apache commons-text to 1.13.1 > --

[jira] [Resolved] (SPARK-51757) `LEAD` causes NullPointerException in window function

[ https://issues.apache.org/jira/browse/SPARK-51757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51757. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50552 [https://gith

[jira] [Resolved] (SPARK-51929) Upgrade AWS SDK v2 to 2.29.52

[ https://issues.apache.org/jira/browse/SPARK-51929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-51929. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50731 [https://github.com

[jira] [Updated] (SPARK-51827) Support Spark Connect in new API `transformWithState` in PySpark

[ https://issues.apache.org/jira/browse/SPARK-51827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-51827: - Fix Version/s: (was: 4.1.0) > Support Spark Connect in new API `transformWithState` in PySpark > ---

[jira] [Reopened] (SPARK-51827) Support Spark Connect in new API `transformWithState` in PySpark

[ https://issues.apache.org/jira/browse/SPARK-51827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reopened SPARK-51827: -- Assignee: (was: Jungtaek Lim) > Support Spark Connect in new API `transformWithState` in PySpark

[jira] [Created] (SPARK-51930) Upgrade datasketches-java to 6.2.0

Yang Jie created SPARK-51930: Summary: Upgrade datasketches-java to 6.2.0 Key: SPARK-51930 URL: https://issues.apache.org/jira/browse/SPARK-51930 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-51924) Upgrade jupiter-interface to 0.14.0 and Junit5 to 5.12.2

[ https://issues.apache.org/jira/browse/SPARK-51924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-51924: Assignee: Yang Jie > Upgrade jupiter-interface to 0.14.0 and Junit5 to 5.12.2 > -

[jira] [Resolved] (SPARK-51924) Upgrade jupiter-interface to 0.14.0 and Junit5 to 5.12.2

[ https://issues.apache.org/jira/browse/SPARK-51924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51924. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50724 [https://github.com

[jira] [Updated] (SPARK-51930) Upgrade datasketches-java to 6.2.0

[ https://issues.apache.org/jira/browse/SPARK-51930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51930: --- Labels: pull-request-available (was: ) > Upgrade datasketches-java to 6.2.0 > -

[jira] [Resolved] (SPARK-51827) Support Spark Connect in new API `transformWithState` in PySpark

[ https://issues.apache.org/jira/browse/SPARK-51827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-51827. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50704 [https://gi

[jira] [Created] (SPARK-51929) Upgrade AWS SDK v2 to 2.29.52

Dongjoon Hyun created SPARK-51929: - Summary: Upgrade AWS SDK v2 to 2.29.52 Key: SPARK-51929 URL: https://issues.apache.org/jira/browse/SPARK-51929 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-51928) Upgrade Apache commons-text to 1.13.1

[ https://issues.apache.org/jira/browse/SPARK-51928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51928: --- Labels: pull-request-available (was: ) > Upgrade Apache commons-text to 1.13.1 > --

[jira] [Created] (SPARK-51928) Upgrade Apache commons-text to 1.13.1

Yang Jie created SPARK-51928: Summary: Upgrade Apache commons-text to 1.13.1 Key: SPARK-51928 URL: https://issues.apache.org/jira/browse/SPARK-51928 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-51927) Upgrade jackson to 2.19.0

[ https://issues.apache.org/jira/browse/SPARK-51927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51927: --- Labels: pull-request-available (was: ) > Upgrade jackson to 2.19.0 > --

[jira] [Assigned] (SPARK-51827) Support Spark Connect in new API `transformWithState` in PySpark

[ https://issues.apache.org/jira/browse/SPARK-51827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-51827: Assignee: Jungtaek Lim > Support Spark Connect in new API `transformWithState` in PySpark

[jira] [Created] (SPARK-51927) Upgrade jackson to 2.19.0

Yang Jie created SPARK-51927: Summary: Upgrade jackson to 2.19.0 Key: SPARK-51927 URL: https://issues.apache.org/jira/browse/SPARK-51927 Project: Spark Issue Type: Improvement Component

[jira] [Assigned] (SPARK-51817) [CONNECT][SCALA] Removing ansiConfig parameter in error-class causes client to be incompatible

[ https://issues.apache.org/jira/browse/SPARK-51817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51817: Assignee: Niranjan Jayakar > [CONNECT][SCALA] Removing ansiConfig parameter in error-clas

[jira] [Resolved] (SPARK-51817) [CONNECT][SCALA] Removing ansiConfig parameter in error-class causes client to be incompatible

[ https://issues.apache.org/jira/browse/SPARK-51817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51817. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50604 [https://gi