[jira] [Commented] (SPARK-44884) Spark doesn't create SUCCESS file in Spark 3.3.0+ when partitionOverwriteMode is dynamic

2025-05-04 Thread Vu Tan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17949368#comment-17949368 ] Vu Tan commented on SPARK-44884: [~anikaKelhanka]  Thanks for the details. I believe y

[jira] [Updated] (SPARK-51999) Release Spark Connect Swift Client v0.2.0

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51999: -- Summary: Release Spark Connect Swift Client v0.2.0 (was: Release Spark Connect Swift v0.2.0)

[jira] [Updated] (SPARK-51577) Make gradle build to automatically append SNAPSHOT suffix to version for non-release builds

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51577: -- Fix Version/s: (was: kubernetes-operator-0.1.0) > Make gradle build to automatically appen

[jira] [Updated] (SPARK-51577) Make gradle build to automatically append SNAPSHOT suffix to version for non-release builds

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51577: -- Affects Version/s: kubernetes-operator-0.2.0 (was: kubernetes-operat

[jira] [Comment Edited] (SPARK-51577) Make gradle build to automatically append SNAPSHOT suffix to version for non-release builds

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17949357#comment-17949357 ] Dongjoon Hyun edited comment on SPARK-51577 at 5/4/25 11:27 PM: --

[jira] [Commented] (SPARK-51577) Make gradle build to automatically append SNAPSHOT suffix to version for non-release builds

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17949358#comment-17949358 ] Dongjoon Hyun commented on SPARK-51577: --- After reopening this JIRA issue, I moved

[jira] [Updated] (SPARK-51577) Make gradle build to automatically append SNAPSHOT suffix to version for non-release builds

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51577: -- Parent Issue: SPARK-52000 (was: SPARK-45923) > Make gradle build to automatically append SNAP

[jira] [Reopened] (SPARK-51577) Make gradle build to automatically append SNAPSHOT suffix to version for non-release builds

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-51577: --- Assignee: (was: Zhou JIANG) This is reverted via https://github.com/apache/spark-kube

[jira] [Resolved] (SPARK-52004) Improve `publish_snapshot_chart` GitHub Action job to support branches

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52004. --- Fix Version/s: kubernetes-operator-0.2.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-52004) Improve `publish_snapshot_chart` GitHub Action job to support branches

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52004: - Assignee: Dongjoon Hyun > Improve `publish_snapshot_chart` GitHub Action job to support

[jira] [Created] (SPARK-52005) Upgrade Spark to 4.0.0

2025-05-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52005: - Summary: Upgrade Spark to 4.0.0 Key: SPARK-52005 URL: https://issues.apache.org/jira/browse/SPARK-52005 Project: Spark Issue Type: Sub-task Compo

[jira] [Resolved] (SPARK-51448) Support Swift language in Spark Connect

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51448. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed > Support Swift language in Spar

[jira] [Updated] (SPARK-52004) Improve `publish_snapshot_chart` GitHub Action job to support branches

2025-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52004: --- Labels: pull-request-available (was: ) > Improve `publish_snapshot_chart` GitHub Action job

[jira] [Created] (SPARK-52004) Improve `publish_snapshot_chart` GitHub Action job to support branches

2025-05-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52004: - Summary: Improve `publish_snapshot_chart` GitHub Action job to support branches Key: SPARK-52004 URL: https://issues.apache.org/jira/browse/SPARK-52004 Project: Spa

[jira] [Resolved] (SPARK-52003) Improve `publish_snapshot_dockerhub` GitHub Action job to support branches

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52003. --- Fix Version/s: kubernetes-operator-0.2.0 Resolution: Fixed Issue resolved by pull req

[jira] [Updated] (SPARK-52003) Improve `publish_snapshot_dockerhub` GitHub Action job to support branches

2025-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52003: --- Labels: pull-request-available (was: ) > Improve `publish_snapshot_dockerhub` GitHub Action

[jira] [Created] (SPARK-52003) Improve `publish_snapshot_dockerhub` GitHub Action job to support branches

2025-05-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52003: - Summary: Improve `publish_snapshot_dockerhub` GitHub Action job to support branches Key: SPARK-52003 URL: https://issues.apache.org/jira/browse/SPARK-52003 Project:

[jira] [Comment Edited] (SPARK-51953) Support Java 24

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17949306#comment-17949306 ] Dongjoon Hyun edited comment on SPARK-51953 at 5/4/25 5:48 PM: ---

[jira] [Updated] (SPARK-45923) Spark Kubernetes Operator

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45923: -- Fix Version/s: kubernetes-operator-0.1.0 (was: kubernetes-operator-0.2.0

[jira] [Updated] (SPARK-45923) Spark Kubernetes Operator

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45923: -- Fix Version/s: kubernetes-operator-0.2.0 (was: 4.0.0) > Spark Kubernete

[jira] [Updated] (SPARK-51953) Support Java 24

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51953: -- Affects Version/s: kubernetes-operator-0.2.0 (was: kubernetes-operat

[jira] [Updated] (SPARK-51953) Support Java 24

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51953: -- Parent Issue: SPARK-52000 (was: SPARK-45923) > Support Java 24 > --- > >

[jira] [Updated] (SPARK-51953) Support Java 24

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51953: -- Fix Version/s: kubernetes-operator-0.2.0 (was: kubernetes-operator-0.1.0

[jira] [Commented] (SPARK-51953) Support Java 24

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17949306#comment-17949306 ] Dongjoon Hyun commented on SPARK-51953: --- This is reverted from `branch-0.1` and re

[jira] [Resolved] (SPARK-52002) Update GitHub Action YAML file in branch-0.1

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52002. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-52002) Update GitHub Action YAML file in branch-0.1

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52002: - Assignee: Dongjoon Hyun > Update GitHub Action YAML file in branch-0.1 > --

[jira] [Resolved] (SPARK-52001) Bump version to 0.2.0-SNAPSHOT in `main` branch

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52001. --- Fix Version/s: kubernetes-operator-0.2.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-52001) Bump version to 0.2.0-SNAPSHOT in `main` branch

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52001: - Assignee: Dongjoon Hyun > Bump version to 0.2.0-SNAPSHOT in `main` branch > ---

[jira] [Updated] (SPARK-51448) Support Swift language in Spark Connect

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51448: -- Description: This aims to release the initial release of Apache Spark Connect for Swift langu

[jira] [Updated] (SPARK-51448) Support Swift language in Spark Connect

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51448: -- Description: This aims to release the initial release of Apache Spark Connect for Swift langu

[jira] [Updated] (SPARK-51448) Support Swift language in Spark Connect

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51448: -- Description: This aims to release the initial release of Apache Spark Connect for Swift langu

[jira] [Updated] (SPARK-51448) Support Swift language in Spark Connect

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51448: -- Description: This aims to release the initial release of Apache Spark Connect for Swift langu

[jira] [Updated] (SPARK-51448) Support Swift language in Spark Connect

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51448: -- Description: This aims to release the initial release of Apache Spark Connect for Swift langu

[jira] [Updated] (SPARK-51448) Support Swift language in Spark Connect

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51448: -- Description: Repository: [https://github.com/apache/spark-connect-swift] This aims to release

[jira] [Updated] (SPARK-52002) Update GitHub Action YAML file in branch-0.1

2025-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52002: --- Labels: pull-request-available (was: ) > Update GitHub Action YAML file in branch-0.1 > ---

[jira] [Created] (SPARK-52002) Update GitHub Action YAML file in branch-0.1

2025-05-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52002: - Summary: Update GitHub Action YAML file in branch-0.1 Key: SPARK-52002 URL: https://issues.apache.org/jira/browse/SPARK-52002 Project: Spark Issue Type: Su

[jira] [Updated] (SPARK-52001) Bump version to 0.2.0-SNAPSHOT in `main` branch

2025-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52001: --- Labels: pull-request-available (was: ) > Bump version to 0.2.0-SNAPSHOT in `main` branch >

[jira] [Updated] (SPARK-52001) Bump version to 0.2.0-SNAPSHOT in `main` branch

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52001: -- Summary: Bump version to 0.2.0-SNAPSHOT in `main` branch (was: Bump version to 0.2.0 in `main

[jira] [Created] (SPARK-52001) Bump version to 0.2.0 in `main` branch

2025-05-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52001: - Summary: Bump version to 0.2.0 in `main` branch Key: SPARK-52001 URL: https://issues.apache.org/jira/browse/SPARK-52001 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-51448) Support Swift language in Spark Connect

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51448: -- Description: Repository: [https://github.com/apache/spark-connect-swift] This aims to release

[jira] [Created] (SPARK-51999) Release Spark Connect Swift v0.2.0

2025-05-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51999: - Summary: Release Spark Connect Swift v0.2.0 Key: SPARK-51999 URL: https://issues.apache.org/jira/browse/SPARK-51999 Project: Spark Issue Type: Umbrella

[jira] [Assigned] (SPARK-51448) Support Swift language in Spark Connect

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51448: - Assignee: Dongjoon Hyun > Support Swift language in Spark Connect > ---

[jira] [Created] (SPARK-52000) Release Spark Kubernetes Operator v0.2.0

2025-05-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52000: - Summary: Release Spark Kubernetes Operator v0.2.0 Key: SPARK-52000 URL: https://issues.apache.org/jira/browse/SPARK-52000 Project: Spark Issue Type: Umbrel

[jira] [Updated] (SPARK-51530) Client should support re-attachable execution

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51530: -- Affects Version/s: connect-swift-0.2.0 (was: 4.0.0) > Client should

[jira] [Updated] (SPARK-51530) Client should support re-attachable execution

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51530: -- Parent Issue: SPARK-51999 (was: SPARK-51448) > Client should support re-attachable execution

[jira] [Assigned] (SPARK-51997) Mark `nodoc` to hide generated and internal classes from docs

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51997: - Assignee: Dongjoon Hyun > Mark `nodoc` to hide generated and internal classes from docs

[jira] [Resolved] (SPARK-51997) Mark `nodoc` to hide generated and internal classes from docs

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51997. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Updated] (SPARK-51997) Mark `nodoc` to hide generated and internal classes from docs

2025-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51997: --- Labels: pull-request-available (was: ) > Mark `nodoc` to hide generated and internal classe

[jira] [Updated] (SPARK-51997) Mark `nodoc` to hide generated and internal classes from docs

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51997: -- Summary: Mark `nodoc` to hide generated and internal classes from docs (was: Add `nodoc` to h

[jira] [Updated] (SPARK-51997) Add `nodoc` to hide generated and internal classes from docs

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51997: -- Summary: Add `nodoc` to hide generated and internal classes from docs (was: Add `@nodoc` to h

[jira] [Created] (SPARK-51997) Add `@nodoc` to hide generated and internal classes from docs

2025-05-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51997: - Summary: Add `@nodoc` to hide generated and internal classes from docs Key: SPARK-51997 URL: https://issues.apache.org/jira/browse/SPARK-51997 Project: Spark

[jira] [Resolved] (SPARK-51996) Support `describe` and `summary` in `DataFrame`

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51996. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Assigned] (SPARK-51996) Support `describe` and `summary` in `DataFrame`

2025-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51996: - Assignee: Dongjoon Hyun > Support `describe` and `summary` in `DataFrame` > ---