[jira] [Assigned] (SPARK-52583) Add an API for stringifying values in UserDefinedType

2025-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52583: - Assignee: Kent Yao > Add an API for stringifying values in UserDefinedType > --

[jira] [Resolved] (SPARK-52586) Introduce AnyTimeType

2025-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52586. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51293 [https://

[jira] [Resolved] (SPARK-52583) Add an API for stringifying values in UserDefinedType

2025-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52583. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51289 [https://

[jira] [Updated] (SPARK-52518) AddMetadataColumnSuite.scala Test file in wrong package

2025-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52518: -- Affects Version/s: 4.1.0 (was: 4.0.0) > AddMetadataColumnSuite.scal

[jira] [Assigned] (SPARK-52518) AddMetadataColumnSuite.scala Test file in wrong package

2025-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52518: - Assignee: (was: Asif) > AddMetadataColumnSuite.scala Test file in wrong package > -

[jira] [Assigned] (SPARK-52518) AddMetadataColumnSuite.scala Test file in wrong package

2025-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52518: - Assignee: Asif > AddMetadataColumnSuite.scala Test file in wrong package >

[jira] [Resolved] (SPARK-52518) AddMetadataColumnSuite.scala Test file in wrong package

2025-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52518. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51265 [https://

[jira] [Assigned] (SPARK-52587) spark-shell 2.13 ignores -i parameter

2025-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52587: - Assignee: dzcxzl > spark-shell 2.13 ignores -i parameter >

[jira] [Resolved] (SPARK-52587) spark-shell 2.13 ignores -i parameter

2025-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52587. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51294 [https://

[jira] [Updated] (SPARK-52568) Fix `exec-maven-plugin` version used by `dev/test-dependencies.sh`

2025-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52568: -- Fix Version/s: 3.5.7 > Fix `exec-maven-plugin` version used by `dev/test-dependencies.sh` > --

[jira] [Created] (SPARK-52593) Avoid CAST_INVALID_INPUT of `Series.dot` in ANSI mode

2025-06-26 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52593: Summary: Avoid CAST_INVALID_INPUT of `Series.dot` in ANSI mode Key: SPARK-52593 URL: https://issues.apache.org/jira/browse/SPARK-52593 Project: Spark Issue T

[jira] [Updated] (SPARK-52592) Can't construct ps.Series from a ps.Series

2025-06-26 Thread Peter Nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Nguyen updated SPARK-52592: - Description: I'd like for this to work, but it does not.  {code:python} obj = ps.Series([x for x

[jira] [Updated] (SPARK-52592) Can't construct ps.Series from a ps.Series

2025-06-26 Thread Peter Nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Nguyen updated SPARK-52592: - Priority: Minor (was: Major) > Can't construct ps.Series from a ps.Series > ---

[jira] [Updated] (SPARK-52592) Can't construct ps.Series from a ps.Series

2025-06-26 Thread Peter Nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Nguyen updated SPARK-52592: - Priority: Major (was: Minor) > Can't construct ps.Series from a ps.Series > ---

[jira] [Created] (SPARK-52592) Can't construct ps.Series from a ps.Series

2025-06-26 Thread Peter Nguyen (Jira)
Peter Nguyen created SPARK-52592: Summary: Can't construct ps.Series from a ps.Series Key: SPARK-52592 URL: https://issues.apache.org/jira/browse/SPARK-52592 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-52591) Validate streaming-ness of DFs returned by SDP table and standalone flow definitions

2025-06-26 Thread Anish Mahto (Jira)
Anish Mahto created SPARK-52591: --- Summary: Validate streaming-ness of DFs returned by SDP table and standalone flow definitions Key: SPARK-52591 URL: https://issues.apache.org/jira/browse/SPARK-52591 Pr

[jira] [Updated] (SPARK-52589) Spark 3.5.5 on Kubernetes with Dynamic Allocation Hangs (minExecutors=0) Due to Stale Ghost Executors

2025-06-26 Thread Richard Cheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Cheng updated SPARK-52589: -- Description: _TLDR: After upgrading from Spark 3.5.1 to 3.5.5, we observe that jobs using dyn

[jira] [Created] (SPARK-52590) Add SQL query tests on optional return types

2025-06-26 Thread Allison Wang (Jira)
Allison Wang created SPARK-52590: Summary: Add SQL query tests on optional return types Key: SPARK-52590 URL: https://issues.apache.org/jira/browse/SPARK-52590 Project: Spark Issue Type: Sub-

[jira] [Updated] (SPARK-52499) Add more SQL query tests for different data types

2025-06-26 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52499: - Summary: Add more SQL query tests for different data types (was: Add more tests for data types)

[jira] [Updated] (SPARK-52589) Spark 3.5.5 on Kubernetes with Dynamic Allocation Hangs (minExecutors=0) Due to Stale Ghost Executors

2025-06-26 Thread Richard Cheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Cheng updated SPARK-52589: -- Description: _TLDR: After upgrading from Spark 3.5.1 to 3.5.5, we observe that jobs using dyn

[jira] [Updated] (SPARK-52589) Spark 3.5.5 on Kubernetes with Dynamic Allocation Hangs (minExecutors=0) Due to Stale Ghost Executors

2025-06-26 Thread Richard Cheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Cheng updated SPARK-52589: -- Description: _TLDR: After upgrading from Spark 3.5.1 to 3.5.5, we observe that jobs using dyn

[jira] [Updated] (SPARK-52589) Spark 3.5.5 on Kubernetes with Dynamic Allocation Hangs (minExecutors=0) Due to Stale Ghost Executors

2025-06-26 Thread Richard Cheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Cheng updated SPARK-52589: -- Description: _TLDR: After upgrading from Spark 3.5.1 to 3.5.5, we observe that jobs using dyn

[jira] [Updated] (SPARK-52589) Spark 3.5.5 on Kubernetes with Dynamic Allocation Hangs (minExecutors=0) Due to Stale Ghost Executors

2025-06-26 Thread Richard Cheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Cheng updated SPARK-52589: -- Description: _TLDR: After upgrading from Spark 3.5.1 to 3.5.5, we observe that jobs using dyn

[jira] [Updated] (SPARK-52589) Spark 3.5.5 on Kubernetes with Dynamic Allocation Hangs (minExecutors=0) Due to Stale Ghost Executors

2025-06-26 Thread Richard Cheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Cheng updated SPARK-52589: -- Description: _TLDR: After upgrading from Spark 3.5.1 to 3.5.5, we observe that jobs using dyn

[jira] [Updated] (SPARK-52589) Spark 3.5.5 on Kubernetes with Dynamic Allocation Hangs (minExecutors=0) Due to Stale Ghost Executors

2025-06-26 Thread Richard Cheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Cheng updated SPARK-52589: -- Description: _TLDR: After upgrading from Spark 3.5.1 to 3.5.5, we observe that jobs using dyn

[jira] [Created] (SPARK-52589) Spark 3.5.5 on Kubernetes with Dynamic Allocation Hangs (minExecutors=0) Due to Stale Ghost Executors

2025-06-26 Thread Richard Cheng (Jira)
Richard Cheng created SPARK-52589: - Summary: Spark 3.5.5 on Kubernetes with Dynamic Allocation Hangs (minExecutors=0) Due to Stale Ghost Executors Key: SPARK-52589 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Updated] (SPARK-52588) Add approx_top_k functions: accumulate, combine, estimate

2025-06-26 Thread Yuchuan Huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuchuan Huang updated SPARK-52588: -- Description: Following: [https://issues.apache.org/jira/projects/SPARK/issues/SPARK-52515], w

[jira] [Created] (SPARK-52588) Add approx_top_k functions: accumulate, combine, estimate

2025-06-26 Thread Yuchuan Huang (Jira)
Yuchuan Huang created SPARK-52588: - Summary: Add approx_top_k functions: accumulate, combine, estimate Key: SPARK-52588 URL: https://issues.apache.org/jira/browse/SPARK-52588 Project: Spark I

[jira] [Assigned] (SPARK-52515) Approx_top_k SQL function based on Apache DataSketches

2025-06-26 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-52515: -- Assignee: Yuchuan Huang > Approx_top_k SQL function based on Apache DataSketches > --

[jira] [Resolved] (SPARK-52515) Approx_top_k SQL function based on Apache DataSketches

2025-06-26 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-52515. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51236 [https:

[jira] [Created] (SPARK-52587) spark-shell 2.13 ignores -i parameter

2025-06-26 Thread dzcxzl (Jira)
dzcxzl created SPARK-52587: -- Summary: spark-shell 2.13 ignores -i parameter Key: SPARK-52587 URL: https://issues.apache.org/jira/browse/SPARK-52587 Project: Spark Issue Type: Bug Component

[jira] [Created] (SPARK-52586) Introduce AnyTimeType

2025-06-26 Thread Max Gekk (Jira)
Max Gekk created SPARK-52586: Summary: Introduce AnyTimeType Key: SPARK-52586 URL: https://issues.apache.org/jira/browse/SPARK-52586 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Resolved] (SPARK-52403) Add numTargetRowsCopied metric to MergeRowExec

2025-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52403. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51091 [https://gith

[jira] [Assigned] (SPARK-52403) Add numTargetRowsCopied metric to MergeRowExec

2025-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52403: --- Assignee: Szehon Ho > Add numTargetRowsCopied metric to MergeRowExec >

[jira] [Updated] (SPARK-52585) Failed to load class "org.slf4j.impl.StaticLoggerBinder" when using hadoop-aws

2025-06-26 Thread Laurens (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurens updated SPARK-52585: Description: I am a PySpark user. Ever since upgrading to PySpark 4.0.0, the first time I try to read fro

[jira] [Updated] (SPARK-52585) Failed to load class "org.slf4j.impl.StaticLoggerBinder" when using hadoop-aws

2025-06-26 Thread Laurens (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurens updated SPARK-52585: Priority: Minor (was: Major) > Failed to load class "org.slf4j.impl.StaticLoggerBinder" when using hadoop

[jira] [Created] (SPARK-52585) Failed to load class "org.slf4j.impl.StaticLoggerBinder" when using hadoop-aws

2025-06-26 Thread Laurens (Jira)
Laurens created SPARK-52585: --- Summary: Failed to load class "org.slf4j.impl.StaticLoggerBinder" when using hadoop-aws Key: SPARK-52585 URL: https://issues.apache.org/jira/browse/SPARK-52585 Project: Spark