[jira] [Comment Edited] (SPARK-38079) Not waiting for configmap before starting driver

2025-06-12 Thread Junghyun Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17966966#comment-17966966 ] Junghyun Kim edited comment on SPARK-38079 at 6/13/25 6:03 AM: ---

[jira] [Updated] (SPARK-52469) Judge Java version via JDK method

2025-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52469: --- Labels: pull-request-available (was: ) > Judge Java version via JDK method > --

[jira] [Commented] (SPARK-38079) Not waiting for configmap before starting driver

2025-06-12 Thread Junghyun Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17966966#comment-17966966 ] Junghyun Kim commented on SPARK-38079: -- I’ve encountered a similar issue before. In

[jira] [Created] (SPARK-52469) Judge Java version via JDK method

2025-06-12 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-52469: - Summary: Judge Java version via JDK method Key: SPARK-52469 URL: https://issues.apache.org/jira/browse/SPARK-52469 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-52251) Use `crd-generator-cli` to generate CRDs

2025-06-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52251: - Assignee: Zhou JIANG > Use `crd-generator-cli` to generate CRDs > -

[jira] [Updated] (SPARK-52468) Support generating both v1alpha1 and v1beta1 from CRD generator

2025-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52468: --- Labels: pull-request-available (was: ) > Support generating both v1alpha1 and v1beta1 from

[jira] [Created] (SPARK-52468) Support generating both v1alpha1 and v1beta1 from CRD generator

2025-06-12 Thread Zhou JIANG (Jira)
Zhou JIANG created SPARK-52468: -- Summary: Support generating both v1alpha1 and v1beta1 from CRD generator Key: SPARK-52468 URL: https://issues.apache.org/jira/browse/SPARK-52468 Project: Spark

[jira] [Commented] (SPARK-52251) Use `crd-generator-cli` to generate CRDs

2025-06-12 Thread Zhou JIANG (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17966792#comment-17966792 ] Zhou JIANG commented on SPARK-52251: ack - while the PR introduces some base for thi

[jira] [Commented] (SPARK-52251) Use `crd-generator-cli` to generate CRDs

2025-06-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17966790#comment-17966790 ] Dongjoon Hyun commented on SPARK-52251: --- It seems that there is a misunderstanding

[jira] [Assigned] (SPARK-52251) Use `crd-generator-cli` to generate CRDs

2025-06-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52251: - Assignee: (was: Zhou JIANG) > Use `crd-generator-cli` to generate CRDs > --

[jira] [Assigned] (SPARK-52467) Add `dfs-read-write` and `localstack` examples

2025-06-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52467: - Assignee: Dongjoon Hyun > Add `dfs-read-write` and `localstack` examples >

[jira] [Assigned] (SPARK-52466) Clean up unnecessary comments in `e2e` tests

2025-06-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52466: - Assignee: Dongjoon Hyun > Clean up unnecessary comments in `e2e` tests > --

[jira] [Updated] (SPARK-52467) Add `dfs-read-write` and `localstack` examples

2025-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52467: --- Labels: pull-request-available (was: ) > Add `dfs-read-write` and `localstack` examples > -

[jira] [Created] (SPARK-52467) Add `dfs-read-write` and `localstack` examples

2025-06-12 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52467: - Summary: Add `dfs-read-write` and `localstack` examples Key: SPARK-52467 URL: https://issues.apache.org/jira/browse/SPARK-52467 Project: Spark Issue Type:

[jira] [Updated] (SPARK-52251) Use `crd-generator-cli` to generate CRDs

2025-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52251: --- Labels: pull-request-available (was: ) > Use `crd-generator-cli` to generate CRDs > ---

[jira] [Created] (SPARK-52466) Clean up unnecessary comments in `e2e` tests

2025-06-12 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52466: - Summary: Clean up unnecessary comments in `e2e` tests Key: SPARK-52466 URL: https://issues.apache.org/jira/browse/SPARK-52466 Project: Spark Issue Type: Su

[jira] [Updated] (SPARK-52466) Clean up unnecessary comments in `e2e` tests

2025-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52466: --- Labels: pull-request-available (was: ) > Clean up unnecessary comments in `e2e` tests > ---

[jira] [Resolved] (SPARK-52447) Move GetViewColumnByNameAndOrdinal normalization to SessionCatalogSuite

2025-06-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52447. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51155 [https://gith

[jira] [Assigned] (SPARK-52447) Move GetViewColumnByNameAndOrdinal normalization to SessionCatalogSuite

2025-06-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52447: --- Assignee: Vladimir Golubev > Move GetViewColumnByNameAndOrdinal normalization to SessionCat

[jira] [Updated] (SPARK-52447) Move GetViewColumnByNameAndOrdinal normalization to SessionCatalogSuite

2025-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52447: --- Labels: pull-request-available (was: ) > Move GetViewColumnByNameAndOrdinal normalization t

[jira] [Updated] (SPARK-52462) Enforce type coercion before children output deduplication in Union

2025-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52462: --- Labels: pull-request-available (was: ) > Enforce type coercion before children output dedup

[jira] [Updated] (SPARK-52462) Enforce type coercion before children output deduplication in Union

2025-06-12 Thread Mihailo Aleksic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-52462: Description: Right now, query the following query produces plans that are not consistent

[jira] [Resolved] (SPARK-52465) Update `.asf.yaml` with new `README.md` link

2025-06-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52465. --- Fix Version/s: connect-swift-0.4.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Assigned] (SPARK-52465) Update `.asf.yaml` with new `README.md` link

2025-06-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52465: - Assignee: Dongjoon Hyun > Update `.asf.yaml` with new `README.md` link > --

[jira] [Assigned] (SPARK-52464) Update `.asf.yaml` with new `README.md` link

2025-06-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52464: - Assignee: Dongjoon Hyun > Update `.asf.yaml` with new `README.md` link > --

[jira] [Resolved] (SPARK-52464) Update `.asf.yaml` with new `README.md` link

2025-06-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52464. --- Fix Version/s: kubernetes-operator-0.4.0 Resolution: Fixed Issue resolved by pull req

[jira] [Updated] (SPARK-52465) Update `.asf.yaml` with new `README.md` link

2025-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52465: --- Labels: pull-request-available (was: ) > Update `.asf.yaml` with new `README.md` link > ---

[jira] [Created] (SPARK-52465) Update `.asf.yaml` with new `README.md` link

2025-06-12 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52465: - Summary: Update `.asf.yaml` with new `README.md` link Key: SPARK-52465 URL: https://issues.apache.org/jira/browse/SPARK-52465 Project: Spark Issue Type: Su

[jira] [Updated] (SPARK-52464) Update `.asf.yaml` with new `README.md` link

2025-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52464: --- Labels: pull-request-available (was: ) > Update `.asf.yaml` with new `README.md` link > ---

[jira] [Created] (SPARK-52464) Update `.asf.yaml` with new `README.md` link

2025-06-12 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52464: - Summary: Update `.asf.yaml` with new `README.md` link Key: SPARK-52464 URL: https://issues.apache.org/jira/browse/SPARK-52464 Project: Spark Issue Type: Su

[jira] [Created] (SPARK-52463) Support clusterBy in SDP table and MV definitions

2025-06-12 Thread Sandy Ryza (Jira)
Sandy Ryza created SPARK-52463: -- Summary: Support clusterBy in SDP table and MV definitions Key: SPARK-52463 URL: https://issues.apache.org/jira/browse/SPARK-52463 Project: Spark Issue Type: Imp

[jira] [Created] (SPARK-52462) Enforce type coercion before children output deduplication in Union

2025-06-12 Thread Mihailo Aleksic (Jira)
Mihailo Aleksic created SPARK-52462: --- Summary: Enforce type coercion before children output deduplication in Union Key: SPARK-52462 URL: https://issues.apache.org/jira/browse/SPARK-52462 Project: Sp

[jira] [Updated] (SPARK-52461) Collapse inner Cast from DecimalType to DecimalType

2025-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52461: --- Labels: pull-request-available (was: ) > Collapse inner Cast from DecimalType to DecimalTyp

[jira] [Commented] (SPARK-52429) Initial checkin from sjrusso8/spark-connect-rs to apache/spark-connect-rust

2025-06-12 Thread Yuanjian Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17965498#comment-17965498 ] Yuanjian Li commented on SPARK-52429: - [~andygrove] Thanks for the reminder. The pro

[jira] [Assigned] (SPARK-52454) Automatically remove old releases from the mirror

2025-06-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52454: Assignee: Hyukjin Kwon > Automatically remove old releases from the mirror >

[jira] [Updated] (SPARK-52461) Collapse inner Cast from DecimalType to DecimalType

2025-06-12 Thread Mihailo Aleksic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-52461: Description: When coercing an expression from DecimalType to DecimalType, remove the inner

[jira] [Updated] (SPARK-52461) Collapse inner Cast from DecimalType to DecimalType

2025-06-12 Thread Mihailo Aleksic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-52461: Summary: Collapse inner Cast from DecimalType to DecimalType (was: Collapse inner cast fr

[jira] [Created] (SPARK-52461) Collapse inner cast from DecimalType to DecimalType

2025-06-12 Thread Mihailo Aleksic (Jira)
Mihailo Aleksic created SPARK-52461: --- Summary: Collapse inner cast from DecimalType to DecimalType Key: SPARK-52461 URL: https://issues.apache.org/jira/browse/SPARK-52461 Project: Spark Iss

[jira] [Assigned] (SPARK-52458) Support `spark.eventLog.excludedPatterns`

2025-06-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52458: - Assignee: Dongjoon Hyun > Support `spark.eventLog.excludedPatterns` > -

[jira] [Resolved] (SPARK-52454) Automatically remove old releases from the mirror

2025-06-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52454. -- Fix Version/s: 4.1.0 4.0.1 3.5.7 Resolution: Fixed

[jira] [Assigned] (SPARK-52453) Automatically release and drop artifacts in Apache Nexus repository

2025-06-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52453: Assignee: Hyukjin Kwon > Automatically release and drop artifacts in Apache Nexus reposit

[jira] [Resolved] (SPARK-52453) Automatically release and drop artifacts in Apache Nexus repository

2025-06-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52453. -- Fix Version/s: 4.1.0 4.0.1 3.5.7 Resolution: Fixed

[jira] [Updated] (SPARK-52459) Fix a subtle thread-safety issue with SQLAppStatusListener

2025-06-12 Thread xiaoping.huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaoping.huang updated SPARK-52459: --- Summary: Fix a subtle thread-safety issue with SQLAppStatusListener (was: SPDI-168275.Fix a

[jira] [Commented] (SPARK-50996) Increase `spark.kubernetes.allocation.batch.size` to 10

2025-06-12 Thread Bowen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17965470#comment-17965470 ] Bowen commented on SPARK-50996: --- May I ask how the value '10' is calculated? I would like

[jira] [Created] (SPARK-52459) SPDI-168275.Fix a subtle thread-safety issue with SQLAppStatusListener

2025-06-12 Thread xiaoping.huang (Jira)
xiaoping.huang created SPARK-52459: -- Summary: SPDI-168275.Fix a subtle thread-safety issue with SQLAppStatusListener Key: SPARK-52459 URL: https://issues.apache.org/jira/browse/SPARK-52459 Project: S

[jira] [Updated] (SPARK-52460) Store internal TIME values as nanoseconds

2025-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52460: --- Labels: pull-request-available (was: ) > Store internal TIME values as nanoseconds > --

[jira] [Created] (SPARK-52460) Store internal TIME values as nanoseconds

2025-06-12 Thread Max Gekk (Jira)
Max Gekk created SPARK-52460: Summary: Store internal TIME values as nanoseconds Key: SPARK-52460 URL: https://issues.apache.org/jira/browse/SPARK-52460 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-52459) Fix a subtle thread-safety issue with SQLAppStatusListener

2025-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52459: --- Labels: pull-request-available (was: ) > Fix a subtle thread-safety issue with SQLAppStatus

[jira] [Assigned] (SPARK-52430) Resolve bug with nullability of Union in rCTEs

2025-06-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52430: --- Assignee: Pavle Martinović > Resolve bug with nullability of Union in rCTEs > -

[jira] [Commented] (SPARK-39854) Catalyst 'ColumnPruning' Optimizer does not play well with sql function 'explode'

2025-06-12 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17965484#comment-17965484 ] Juha Iso-Sipilä commented on SPARK-39854: - I've hit this issue in a query the in

[jira] [Updated] (SPARK-52459) SPDI-168275.Fix a subtle thread-safety issue with SQLAppStatusListener

2025-06-12 Thread xiaoping.huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaoping.huang updated SPARK-52459: --- Attachment: image-2025-06-12-12-06-14-595.png > SPDI-168275.Fix a subtle thread-safety issue