[jira] [Updated] (SPARK-49319) Add `SparkCluster` to `spark-operator-api` module and examples

[ https://issues.apache.org/jira/browse/SPARK-49319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49319: --- Labels: pull-request-available (was: ) > Add `SparkCluster` to `spark-operator-api` module

[jira] [Updated] (SPARK-49319) Add `SparkCluster` to `spark-operator-api` module and examples

[ https://issues.apache.org/jira/browse/SPARK-49319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49319: -- Summary: Add `SparkCluster` to `spark-operator-api` module and examples (was: Add `SparkClust

[jira] [Created] (SPARK-49319) Add `SparkCluster` to `spark-operator-api` module

Dongjoon Hyun created SPARK-49319: - Summary: Add `SparkCluster` to `spark-operator-api` module Key: SPARK-49319 URL: https://issues.apache.org/jira/browse/SPARK-49319 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-49317) Add `pi-on-yunikorn.yaml` example

[ https://issues.apache.org/jira/browse/SPARK-49317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49317. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Commented] (SPARK-48867) Upgrade the kubernetes-client dependency okhttp version 4.12

[ https://issues.apache.org/jira/browse/SPARK-48867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875053#comment-17875053 ] Gabor Roczei commented on SPARK-48867: -- [~melin], > Exclude huaweicloud jar. huawe

[jira] [Resolved] (SPARK-49075) Upgrade JUnit5 related to the latest version

[ https://issues.apache.org/jira/browse/SPARK-49075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-49075. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47560 [https://github.com

[jira] [Assigned] (SPARK-49317) Add `pi-on-yunikorn.yaml` example

[ https://issues.apache.org/jira/browse/SPARK-49317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49317: - Assignee: Dongjoon Hyun > Add `pi-on-yunikorn.yaml` example > -

[jira] [Created] (SPARK-49318) Preempt low priority LCA internal error until the end of check analysis

Xinyi Yu created SPARK-49318: Summary: Preempt low priority LCA internal error until the end of check analysis Key: SPARK-49318 URL: https://issues.apache.org/jira/browse/SPARK-49318 Project: Spark

[jira] [Updated] (SPARK-49317) Add `pi-on-yunikorn.yaml` example

[ https://issues.apache.org/jira/browse/SPARK-49317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49317: --- Labels: pull-request-available (was: ) > Add `pi-on-yunikorn.yaml` example > --

[jira] [Created] (SPARK-49317) Add `pi-on-yunikorn.yaml` example

Dongjoon Hyun created SPARK-49317: - Summary: Add `pi-on-yunikorn.yaml` example Key: SPARK-49317 URL: https://issues.apache.org/jira/browse/SPARK-49317 Project: Spark Issue Type: Sub-task

[jira] [Comment Edited] (SPARK-48867) Upgrade the kubernetes-client dependency okhttp version 4.12

[ https://issues.apache.org/jira/browse/SPARK-48867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875044#comment-17875044 ] melin edited comment on SPARK-48867 at 8/20/24 4:30 AM: Exclude

[jira] [Commented] (SPARK-48867) Upgrade the kubernetes-client dependency okhttp version 4.12

[ https://issues.apache.org/jira/browse/SPARK-48867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875044#comment-17875044 ] melin commented on SPARK-48867: --- Exclude huaweicloud jar. huaweicloud is rarely used. Add

[jira] [Updated] (SPARK-49026) Create conversions Column API to Connect protos

[ https://issues.apache.org/jira/browse/SPARK-49026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49026: --- Labels: pull-request-available (was: ) > Create conversions Column API to Connect protos >

[jira] [Resolved] (SPARK-49316) Generalize `printer-columns.sh` to handle `*.spark.apache.org-v1.yml` files

[ https://issues.apache.org/jira/browse/SPARK-49316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49316. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49315) Generalize `relocateGeneratedCRD` Gradle Task to handle `*.spark.apache.org-v1.yml`

[ https://issues.apache.org/jira/browse/SPARK-49315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49315. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49316) Generalize `printer-columns.sh` to handle `*.spark.apache.org-v1.yml` files

[ https://issues.apache.org/jira/browse/SPARK-49316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49316: - Assignee: Dongjoon Hyun > Generalize `printer-columns.sh` to handle `*.spark.apache.org

[jira] [Assigned] (SPARK-49315) Generalize `relocateGeneratedCRD` Gradle Task to handle `*.spark.apache.org-v1.yml`

[ https://issues.apache.org/jira/browse/SPARK-49315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49315: - Assignee: Dongjoon Hyun > Generalize `relocateGeneratedCRD` Gradle Task to handle > `*

[jira] [Updated] (SPARK-49316) Generalize `printer-columns.sh` to handle `*.spark.apache.org-v1.yml` files

[ https://issues.apache.org/jira/browse/SPARK-49316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49316: --- Labels: pull-request-available (was: ) > Generalize `printer-columns.sh` to handle `*.spark

[jira] [Created] (SPARK-49316) Generalize `printer-columns.sh` to handle `*.spark.apache.org-v1.yml` files

Dongjoon Hyun created SPARK-49316: - Summary: Generalize `printer-columns.sh` to handle `*.spark.apache.org-v1.yml` files Key: SPARK-49316 URL: https://issues.apache.org/jira/browse/SPARK-49316 Project

[jira] [Updated] (SPARK-49315) Generalize `relocateGeneratedCRD` Gradle Task to handle `*.spark.apache.org-v1.yml`

[ https://issues.apache.org/jira/browse/SPARK-49315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49315: --- Labels: pull-request-available (was: ) > Generalize `relocateGeneratedCRD` Gradle Task to h

[jira] [Created] (SPARK-49315) Generalize `relocateGeneratedCRD` Gradle Task to handle `*.spark.apache.org-v1.yml`

Dongjoon Hyun created SPARK-49315: - Summary: Generalize `relocateGeneratedCRD` Gradle Task to handle `*.spark.apache.org-v1.yml` Key: SPARK-49315 URL: https://issues.apache.org/jira/browse/SPARK-49315

[jira] [Updated] (SPARK-40425) DROP TABLE does not need to do table lookup

[ https://issues.apache.org/jira/browse/SPARK-40425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-40425: --- Labels: pull-request-available (was: ) > DROP TABLE does not need to do table lookup >

[jira] [Commented] (SPARK-49297) Flaky test: `SPARK-46957: Migrated shuffle files should be able to cleanup from executor` with Java 21

[ https://issues.apache.org/jira/browse/SPARK-49297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875033#comment-17875033 ] Yang Jie commented on SPARK-49297: -- The Maven daily test with Java 21 also failed, but

[jira] [Resolved] (SPARK-48505) Simplify the implementation of Utils#isG1GC

[ https://issues.apache.org/jira/browse/SPARK-48505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48505. -- Resolution: Won't Fix > Simplify the implementation of Utils#isG1GC >

[jira] [Resolved] (SPARK-48796) Load Column Family Id from State Schema for VCF when restarting

[ https://issues.apache.org/jira/browse/SPARK-48796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-48796. -- Fix Version/s: 4.0.0 Assignee: Eric Marnadi (was: Jungtaek Lim) Resolution: Fi

[jira] [Assigned] (SPARK-48796) Load Column Family Id from State Schema for VCF when restarting

[ https://issues.apache.org/jira/browse/SPARK-48796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-48796: Assignee: Jungtaek Lim > Load Column Family Id from State Schema for VCF when restarting

[jira] [Resolved] (SPARK-49025) Prepare move to SQL API for Column classes

[ https://issues.apache.org/jira/browse/SPARK-49025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-49025. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47785 [

[jira] [Updated] (SPARK-49312) Improve error message for assertSchemaEqual

[ https://issues.apache.org/jira/browse/SPARK-49312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49312: --- Labels: pull-request-available (was: ) > Improve error message for assertSchemaEqual >

[jira] [Updated] (SPARK-49314) Upgrade `h2` to 2.3.232

[ https://issues.apache.org/jira/browse/SPARK-49314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49314: --- Labels: pull-request-available (was: ) > Upgrade `h2` to 2.3.232 > ---

[jira] [Updated] (SPARK-49313) Upgrade `DB2` & `MySQL` & `Postgres` & `Mariadb` docker image version

[ https://issues.apache.org/jira/browse/SPARK-49313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-49313: Summary: Upgrade `DB2` & `MySQL` & `Postgres` & `Mariadb` docker image version (was: Upgrade DB2

[jira] [Updated] (SPARK-49313) Upgrade DB2 & MySQL & Postgres & Mariadb docker image version

[ https://issues.apache.org/jira/browse/SPARK-49313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49313: --- Labels: pull-request-available (was: ) > Upgrade DB2 & MySQL & Postgres & Mariadb docker im

[jira] [Created] (SPARK-49313) Upgrade DB2 & MySQL & Postgres & Mariadb docker image version

BingKun Pan created SPARK-49313: --- Summary: Upgrade DB2 & MySQL & Postgres & Mariadb docker image version Key: SPARK-49313 URL: https://issues.apache.org/jira/browse/SPARK-49313 Project: Spark

[jira] [Resolved] (SPARK-49131) TransformWithState doesn't set implicit grouping key when lazy iterators are used

[ https://issues.apache.org/jira/browse/SPARK-49131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-49131. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47641 [https://gi

[jira] [Assigned] (SPARK-49131) TransformWithState doesn't set implicit grouping key when lazy iterators are used

[ https://issues.apache.org/jira/browse/SPARK-49131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-49131: Assignee: Neil Ramaswamy > TransformWithState doesn't set implicit grouping key when lazy

[jira] [Assigned] (SPARK-49274) Support java serialization in AgnosticEncoders

[ https://issues.apache.org/jira/browse/SPARK-49274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-49274: - Assignee: Herman van Hövell > Support java serialization in AgnosticEncoders >

[jira] [Resolved] (SPARK-49263) Spark Connect python client: Consistently handle boolean Dataframe reader options

[ https://issues.apache.org/jira/browse/SPARK-49263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-49263. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47790 [https://gi

[jira] [Assigned] (SPARK-49263) Spark Connect python client: Consistently handle boolean Dataframe reader options

[ https://issues.apache.org/jira/browse/SPARK-49263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-49263: Assignee: Juliusz Sompolski > Spark Connect python client: Consistently handle boolean Da

[jira] [Updated] (SPARK-49311) Large INTERVAL SECOND values cannot be cast to decimal

[ https://issues.apache.org/jira/browse/SPARK-49311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49311: --- Labels: pull-request-available (was: ) > Large INTERVAL SECOND values cannot be cast to dec

[jira] [Created] (SPARK-49311) Large INTERVAL SECOND values cannot be cast to decimal

Harsh Motwani created SPARK-49311: - Summary: Large INTERVAL SECOND values cannot be cast to decimal Key: SPARK-49311 URL: https://issues.apache.org/jira/browse/SPARK-49311 Project: Spark Issu

[jira] [Assigned] (SPARK-49309) Use `HTTP_*` constant variables instead of magic numbers

[ https://issues.apache.org/jira/browse/SPARK-49309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49309: - Assignee: Dongjoon Hyun > Use `HTTP_*` constant variables instead of magic numbers > --

[jira] [Resolved] (SPARK-49309) Use `HTTP_*` constant variables instead of magic numbers

[ https://issues.apache.org/jira/browse/SPARK-49309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49309. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Updated] (SPARK-49310) Upgrade Apache Parquet to 1.14.2

[ https://issues.apache.org/jira/browse/SPARK-49310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49310: --- Labels: pull-request-available (was: ) > Upgrade Apache Parquet to 1.14.2 > ---

[jira] [Created] (SPARK-49310) Upgrade Apache Parquet to 1.14.2

Fokko Driesprong created SPARK-49310: Summary: Upgrade Apache Parquet to 1.14.2 Key: SPARK-49310 URL: https://issues.apache.org/jira/browse/SPARK-49310 Project: Spark Issue Type: Improvem

[jira] [Updated] (SPARK-49309) Use `HTTP_*` constant variables instead of magic numbers

[ https://issues.apache.org/jira/browse/SPARK-49309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49309: --- Labels: pull-request-available (was: ) > Use `HTTP_*` constant variables instead of magic n

[jira] [Created] (SPARK-49309) Use `HTTP_*` constant variables instead of magic numbers

Dongjoon Hyun created SPARK-49309: - Summary: Use `HTTP_*` constant variables instead of magic numbers Key: SPARK-49309 URL: https://issues.apache.org/jira/browse/SPARK-49309 Project: Spark Is

[jira] [Created] (SPARK-49308) Support UserDefinedAggregateFunction in Connect

Herman van Hövell created SPARK-49308: - Summary: Support UserDefinedAggregateFunction in Connect Key: SPARK-49308 URL: https://issues.apache.org/jira/browse/SPARK-49308 Project: Spark Iss

[jira] [Resolved] (SPARK-49305) Revise `Spark Operator` docker image

[ https://issues.apache.org/jira/browse/SPARK-49305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49305. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Commented] (SPARK-49023) Integrate Column Node API in Dataset

[ https://issues.apache.org/jira/browse/SPARK-49023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874987#comment-17874987 ] Herman van Hövell commented on SPARK-49023: --- We might hold this of for now. It

[jira] [Created] (SPARK-49307) Support Kryo Serialization with AgnosticEncoders

Herman van Hövell created SPARK-49307: - Summary: Support Kryo Serialization with AgnosticEncoders Key: SPARK-49307 URL: https://issues.apache.org/jira/browse/SPARK-49307 Project: Spark Is

[jira] [Commented] (SPARK-48867) Upgrade the kubernetes-client dependency okhttp version 4.12

[ https://issues.apache.org/jira/browse/SPARK-48867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874986#comment-17874986 ] Gabor Roczei commented on SPARK-48867: -- [~ste...@apache.org], > If you aren't usin

[jira] [Updated] (SPARK-49274) Support java serialization in AgnosticEncoders

[ https://issues.apache.org/jira/browse/SPARK-49274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-49274: -- Summary: Support java serialization in AgnosticEncoders (was: Support java/kryo seria

[jira] [Updated] (SPARK-49274) Support java/kryo serialization in AgnosticEncoders

[ https://issues.apache.org/jira/browse/SPARK-49274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49274: --- Labels: pull-request-available (was: ) > Support java/kryo serialization in AgnosticEncoder

[jira] [Created] (SPARK-49306) Create SQL function aliases for 'zeroifnull' and 'nullifzero'

Daniel created SPARK-49306: -- Summary: Create SQL function aliases for 'zeroifnull' and 'nullifzero' Key: SPARK-49306 URL: https://issues.apache.org/jira/browse/SPARK-49306 Project: Spark Issue Type

[jira] [Assigned] (SPARK-49305) Revise `Spark Operator` docker image

[ https://issues.apache.org/jira/browse/SPARK-49305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49305: - Assignee: Dongjoon Hyun > Revise `Spark Operator` docker image > --

[jira] [Updated] (SPARK-49305) Revise `Spark Operator` docker image

[ https://issues.apache.org/jira/browse/SPARK-49305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49305: --- Labels: pull-request-available (was: ) > Revise `Spark Operator` docker image > ---

[jira] [Created] (SPARK-49305) Revise `Spark Operator` docker image

Dongjoon Hyun created SPARK-49305: - Summary: Revise `Spark Operator` docker image Key: SPARK-49305 URL: https://issues.apache.org/jira/browse/SPARK-49305 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-49304) Add `-SNAPSHOT` postfix to `Spark Operator` version

[ https://issues.apache.org/jira/browse/SPARK-49304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49304. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49304) Add `-SNAPSHOT` postfix to `Spark Operator` version

[ https://issues.apache.org/jira/browse/SPARK-49304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49304: - Assignee: Dongjoon Hyun > Add `-SNAPSHOT` postfix to `Spark Operator` version > ---

[jira] [Updated] (SPARK-49304) Add `-SNAPSHOT` postfix to `Spark Operator` version

[ https://issues.apache.org/jira/browse/SPARK-49304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49304: --- Labels: pull-request-available (was: ) > Add `-SNAPSHOT` postfix to `Spark Operator` versio

[jira] [Created] (SPARK-49304) Add `-SNAPSHOT` postfix to `Spark Operator` version

Dongjoon Hyun created SPARK-49304: - Summary: Add `-SNAPSHOT` postfix to `Spark Operator` version Key: SPARK-49304 URL: https://issues.apache.org/jira/browse/SPARK-49304 Project: Spark Issue T

[jira] [Updated] (SPARK-49303) Implement value state ttl for transformWithStateInPandas

[ https://issues.apache.org/jira/browse/SPARK-49303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49303: --- Labels: pull-request-available (was: ) > Implement value state ttl for transformWithStateIn

[jira] [Created] (SPARK-49303) Implement value state ttl for transformWithStateInPandas

Chaoqin Li created SPARK-49303: -- Summary: Implement value state ttl for transformWithStateInPandas Key: SPARK-49303 URL: https://issues.apache.org/jira/browse/SPARK-49303 Project: Spark Issue Ty

[jira] [Commented] (SPARK-49302) Implement pipe operator syntax in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-49302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874961#comment-17874961 ] Daniel commented on SPARK-49302: I can help with this one > Implement pipe operator syn

[jira] [Created] (SPARK-49302) Implement pipe operator syntax in Spark SQL

Daniel created SPARK-49302: -- Summary: Implement pipe operator syntax in Spark SQL Key: SPARK-49302 URL: https://issues.apache.org/jira/browse/SPARK-49302 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-48755) [PySpark] Base implementation and ValueState support

[ https://issues.apache.org/jira/browse/SPARK-48755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Gao updated SPARK-48755: --- Summary: [PySpark] Base implementation and ValueState support (was: [Python State V2] Base implementation a

[jira] [Updated] (SPARK-49233) [PySpark] Classify internal and user facing errors in PySpark transformWithState

[ https://issues.apache.org/jira/browse/SPARK-49233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Gao updated SPARK-49233: --- Summary: [PySpark] Classify internal and user facing errors in PySpark transformWithState (was: [Python Sta

[jira] [Updated] (SPARK-49212) [PySpark] Implement schema evolution support

[ https://issues.apache.org/jira/browse/SPARK-49212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Gao updated SPARK-49212: --- Summary: [PySpark] Implement schema evolution support (was: [Python State V2] Implement schema evolution su

[jira] [Updated] (SPARK-49100) [PySpark] Add verification for result iterator of transformWithState UDF

[ https://issues.apache.org/jira/browse/SPARK-49100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Gao updated SPARK-49100: --- Summary: [PySpark] Add verification for result iterator of transformWithState UDF (was: [Python State V2] A

[jira] [Resolved] (SPARK-49299) Add `buildDockerImage` Gradle Task

[ https://issues.apache.org/jira/browse/SPARK-49299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49299. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49298) Reduce `spark-operator` fat jar size by excluding dependencies

[ https://issues.apache.org/jira/browse/SPARK-49298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49298. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Updated] (SPARK-49244) [M1] Further exception improvements

[ https://issues.apache.org/jira/browse/SPARK-49244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49244: --- Labels: pull-request-available (was: ) > [M1] Further exception improvements >

[jira] [Updated] (SPARK-47262) Assign classes to Parquet converter errors

[ https://issues.apache.org/jira/browse/SPARK-47262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47262: --- Labels: pull-request-available starter (was: starter) > Assign classes to Parquet converter

[jira] [Commented] (SPARK-48867) Upgrade the kubernetes-client dependency okhttp version 4.12

[ https://issues.apache.org/jira/browse/SPARK-48867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874854#comment-17874854 ] Steve Loughran commented on SPARK-48867: If you aren't using huawei cloud you ca

[jira] [Assigned] (SPARK-49266) Improve collation support testing - unit tests for FindInSet

[ https://issues.apache.org/jira/browse/SPARK-49266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-49266: Assignee: Uroš Bojanić > Improve collation support testing - unit tests for FindInSet > -

[jira] [Resolved] (SPARK-49266) Improve collation support testing - unit tests for FindInSet

[ https://issues.apache.org/jira/browse/SPARK-49266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-49266. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47728 [https://github.com

[jira] [Updated] (SPARK-49266) Improve collation support testing - unit tests for FindInSet

[ https://issues.apache.org/jira/browse/SPARK-49266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49266: --- Labels: pull-request-available (was: ) > Improve collation support testing - unit tests for

[jira] [Resolved] (SPARK-49017) Insert statement fails when multiple parameters are being used

[ https://issues.apache.org/jira/browse/SPARK-49017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-49017. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47501 [https://github.com

[jira] [Assigned] (SPARK-49017) Insert statement fails when multiple parameters are being used

[ https://issues.apache.org/jira/browse/SPARK-49017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-49017: Assignee: Mihailo Milosevic > Insert statement fails when multiple parameters are being used > --

[jira] [Assigned] (SPARK-49300) Fix Hadoop delegation token leak when tokenRenewalInterval is not set.

[ https://issues.apache.org/jira/browse/SPARK-49300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49300: -- Assignee: (was: Apache Spark) > Fix Hadoop delegation token leak when tokenRenewa

[jira] [Assigned] (SPARK-48344) [M0] Changes to sql() API

[ https://issues.apache.org/jira/browse/SPARK-48344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48344: -- Assignee: (was: Apache Spark) > [M0] Changes to sql() API > -

[jira] [Assigned] (SPARK-49300) Fix Hadoop delegation token leak when tokenRenewalInterval is not set.

[ https://issues.apache.org/jira/browse/SPARK-49300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49300: -- Assignee: Apache Spark > Fix Hadoop delegation token leak when tokenRenewalInterval i

[jira] [Assigned] (SPARK-48344) [M0] Changes to sql() API

[ https://issues.apache.org/jira/browse/SPARK-48344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48344: -- Assignee: Apache Spark > [M0] Changes to sql() API > - > >

[jira] [Assigned] (SPARK-49300) Fix Hadoop delegation token leak when tokenRenewalInterval is not set.

[ https://issues.apache.org/jira/browse/SPARK-49300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49300: -- Assignee: (was: Apache Spark) > Fix Hadoop delegation token leak when tokenRenewa

[jira] [Assigned] (SPARK-49300) Fix Hadoop delegation token leak when tokenRenewalInterval is not set.

[ https://issues.apache.org/jira/browse/SPARK-49300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49300: -- Assignee: Apache Spark > Fix Hadoop delegation token leak when tokenRenewalInterval i

[jira] [Assigned] (SPARK-48344) [M0] Changes to sql() API

[ https://issues.apache.org/jira/browse/SPARK-48344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48344: -- Assignee: (was: Apache Spark) > [M0] Changes to sql() API > -

[jira] [Assigned] (SPARK-48344) [M0] Changes to sql() API

[ https://issues.apache.org/jira/browse/SPARK-48344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48344: -- Assignee: Apache Spark > [M0] Changes to sql() API > - > >

[jira] [Assigned] (SPARK-48344) [M0] Changes to sql() API

[ https://issues.apache.org/jira/browse/SPARK-48344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48344: -- Assignee: Apache Spark > [M0] Changes to sql() API > - > >

[jira] [Assigned] (SPARK-48344) [M0] Changes to sql() API

[ https://issues.apache.org/jira/browse/SPARK-48344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48344: -- Assignee: (was: Apache Spark) > [M0] Changes to sql() API > -

[jira] [Updated] (SPARK-49300) Fix Hadoop delegation token leak when tokenRenewalInterval is not set.

[ https://issues.apache.org/jira/browse/SPARK-49300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated SPARK-49300: - Description: If tokenRenewalInterval is not set, HadoopFSDelegationTokenProvider#getTokenRenewal

[jira] [Updated] (SPARK-49300) Fix Hadoop delegation token leak when tokenRenewalInterval is not set.

[ https://issues.apache.org/jira/browse/SPARK-49300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49300: --- Labels: pull-request-available (was: ) > Fix Hadoop delegation token leak when tokenRenewal

[jira] [Created] (SPARK-49300) Fix Hadoop delegation token leak when tokenRenewalInterval is not set.

Shuyan Zhang created SPARK-49300: Summary: Fix Hadoop delegation token leak when tokenRenewalInterval is not set. Key: SPARK-49300 URL: https://issues.apache.org/jira/browse/SPARK-49300 Project: Spark

[jira] [Updated] (SPARK-49288) to_date ... too slow

[ https://issues.apache.org/jira/browse/SPARK-49288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ángel Álvarez Pascua updated SPARK-49288: - Description: The *to_date* _ _built-in udf is creating new _ParseException_ inst

[jira] [Assigned] (SPARK-49299) Add `buildDockerImage` Gradle Task

[ https://issues.apache.org/jira/browse/SPARK-49299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49299: - Assignee: Dongjoon Hyun > Add `buildDockerImage` Gradle Task >

[jira] [Updated] (SPARK-49299) Add `buildDockerImage` Gradle Task

[ https://issues.apache.org/jira/browse/SPARK-49299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49299: --- Labels: pull-request-available (was: ) > Add `buildDockerImage` Gradle Task > -

[jira] [Created] (SPARK-49299) Add `buildDockerImage` Gradle Task

Dongjoon Hyun created SPARK-49299: - Summary: Add `buildDockerImage` Gradle Task Key: SPARK-49299 URL: https://issues.apache.org/jira/browse/SPARK-49299 Project: Spark Issue Type: Sub-task