[jira] [Assigned] (SPARK-48053) SparkSession.createDataFrame should warn for unsupported options

2024-04-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48053: Assignee: Hyukjin Kwon > SparkSession.createDataFrame should warn for unsupported

[jira] [Resolved] (SPARK-48053) SparkSession.createDataFrame should warn for unsupported options

2024-04-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48053. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46295

[jira] [Resolved] (SPARK-47585) SQL core: Migrate logInfo with variables to structured logging framework

2024-04-29 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47585. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46264

[jira] [Updated] (SPARK-48016) Fix a bug in try_divide function when with decimals

2024-04-29 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48016: --- Fix Version/s: 4.0.0 3.5.2 > Fix a bug in try_divide function when with

[jira] [Resolved] (SPARK-48016) Fix a bug in try_divide function when with decimals

2024-04-29 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48016. Fix Version/s: 3.4.4 Resolution: Fixed Issue resolved by pull request 46289

[jira] [Updated] (SPARK-48055) Enable PandasUDFScalarParityTests.{test_vectorized_udf_empty_partition, test_vectorized_udf_struct_with_empty_partition}

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48055: --- Labels: pull-request-available (was: ) > Enable

[jira] [Created] (SPARK-48054) Backward compatibility test for Spark Connect

2024-04-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48054: Summary: Backward compatibility test for Spark Connect Key: SPARK-48054 URL: https://issues.apache.org/jira/browse/SPARK-48054 Project: Spark Issue Type:

[jira] [Updated] (SPARK-48053) SparkSession.createDataFrame should warn for unsupported options

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48053: --- Labels: pull-request-available (was: ) > SparkSession.createDataFrame should warn for

[jira] [Resolved] (SPARK-48030) InternalRowComparableWrapper should cache rowOrdering to improve performace

2024-04-29 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-48030. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46265

[jira] [Assigned] (SPARK-48030) InternalRowComparableWrapper should cache rowOrdering to improve performace

2024-04-29 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-48030: Assignee: YE > InternalRowComparableWrapper should cache rowOrdering to improve performace >

[jira] [Created] (SPARK-48053) SparkSession.createDataFrame should warn for unsupported options

2024-04-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48053: Summary: SparkSession.createDataFrame should warn for unsupported options Key: SPARK-48053 URL: https://issues.apache.org/jira/browse/SPARK-48053 Project: Spark

[jira] [Created] (SPARK-48052) Recover pyspark-connect CI by parent classes

2024-04-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48052: Summary: Recover pyspark-connect CI by parent classes Key: SPARK-48052 URL: https://issues.apache.org/jira/browse/SPARK-48052 Project: Spark Issue Type:

[jira] [Updated] (SPARK-48051) Add Golden Table Tests for Variant from different engines

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48051: --- Labels: pull-request-available (was: ) > Add Golden Table Tests for Variant from different

[jira] [Created] (SPARK-48051) Add Golden Table Tests for Variant from different engines

2024-04-29 Thread Richard Chen (Jira)
Richard Chen created SPARK-48051: Summary: Add Golden Table Tests for Variant from different engines Key: SPARK-48051 URL: https://issues.apache.org/jira/browse/SPARK-48051 Project: Spark

[jira] [Updated] (SPARK-47129) Make ResolveRelations cache connect plan properly

2024-04-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-47129: -- Issue Type: Bug (was: Improvement) > Make ResolveRelations cache connect plan properly >

[jira] [Updated] (SPARK-47129) Make ResolveRelations cache connect plan properly

2024-04-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-47129: -- Affects Version/s: 3.4.3 3.5.1 > Make ResolveRelations cache connect

[jira] [Created] (SPARK-48050) Log logical plan at query start

2024-04-29 Thread Fanyue Xia (Jira)
Fanyue Xia created SPARK-48050: -- Summary: Log logical plan at query start Key: SPARK-48050 URL: https://issues.apache.org/jira/browse/SPARK-48050 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-48033) Support Generated Column expressions that are `RuntimeReplaceable`

2024-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48033. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46269

[jira] [Assigned] (SPARK-48033) Support Generated Column expressions that are `RuntimeReplaceable`

2024-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48033: --- Assignee: Richard Chen > Support Generated Column expressions that are

[jira] [Commented] (SPARK-48016) Fix a bug in try_divide function when with decimals

2024-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842200#comment-17842200 ] Dongjoon Hyun commented on SPARK-48016: --- Thank you so much! > Fix a bug in try_divide function

[jira] [Assigned] (SPARK-47741) Handle stack overflow when parsing query

2024-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47741: --- Assignee: Milan Stefanovic > Handle stack overflow when parsing query >

[jira] [Resolved] (SPARK-47741) Handle stack overflow when parsing query

2024-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47741. - Resolution: Fixed Issue resolved by pull request 45896

[jira] [Commented] (SPARK-48016) Fix a bug in try_divide function when with decimals

2024-04-29 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842193#comment-17842193 ] Gengliang Wang commented on SPARK-48016: [~dongjoon] sure, I just moved it. > Fix a bug in

[jira] [Updated] (SPARK-48016) Fix a bug in try_divide function when with decimals

2024-04-29 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48016: --- Parent Issue: SPARK-44111 (was: SPARK-35161) > Fix a bug in try_divide function when with

[jira] [Commented] (SPARK-48016) Fix a bug in try_divide function when with decimals

2024-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842191#comment-17842191 ] Dongjoon Hyun commented on SPARK-48016: --- Hi, [~Gengliang.Wang] . - I updated the JIRA title

[jira] [Updated] (SPARK-48016) Fix a bug in try_divide function when with decimals

2024-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48016: -- Summary: Fix a bug in try_divide function when with decimals (was: Binary Arithmetic

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/29/24 11:11 PM: -- Edit: I updated this

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/29/24 10:21 PM: -- Edit: I updated this

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/29/24 10:19 PM: -- Edit: I updated this

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/29/24 10:01 PM: -- Edit: I updated this

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/29/24 9:58 PM: - Edit: I updated this

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/29/24 9:44 PM: - Edit: I updated this

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/29/24 9:38 PM: - Edit: I updated this

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/29/24 9:26 PM: - Edit: I updated this

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/29/24 9:15 PM: - Edit: I updated this

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/29/24 8:54 PM: - Edit: I updated this

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/29/24 8:23 PM: - Edit: I updated this

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/29/24 8:07 PM: - Edit: I updated this

[jira] [Resolved] (SPARK-48042) Don't use a copy of timestamp formatter with a new override zone for each value

2024-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48042. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46282

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/29/24 4:50 PM: - Edit: I updated this

[jira] [Resolved] (SPARK-48044) Cache `DataFrame.isStreaming`

2024-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48044. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46281

[jira] [Commented] (SPARK-47585) SQL core: Migrate logInfo with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842094#comment-17842094 ] Daniel commented on SPARK-47585: [~panbingkun] here are the affected files: spark$ grep logWarning

[jira] [Commented] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842092#comment-17842092 ] Daniel commented on SPARK-47578: Sounds good, I start on this one now > Spark core: Migrate logWarn

[jira] [Resolved] (SPARK-48046) Remove `clock` parameter from `DriverServiceFeatureStep`

2024-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48046. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46284

[jira] [Assigned] (SPARK-48046) Remove `clock` parameter from `DriverServiceFeatureStep`

2024-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48046: - Assignee: Dongjoon Hyun > Remove `clock` parameter from `DriverServiceFeatureStep` >

[jira] [Updated] (SPARK-48043) Kryo serialization issue with push-based shuffle

2024-04-29 Thread Romain Ardiet (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Romain Ardiet updated SPARK-48043: -- Description: I'm running a spark job on AWS EMR. I wanted to test the new push-based shuffle

[jira] [Updated] (SPARK-48046) Remove `clock` parameter from `DriverServiceFeatureStep`

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48046: --- Labels: pull-request-available (was: ) > Remove `clock` parameter from

[jira] [Created] (SPARK-48046) Remove `clock` parameter from `DriverServiceFeatureStep`

2024-04-29 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-48046: - Summary: Remove `clock` parameter from `DriverServiceFeatureStep` Key: SPARK-48046 URL: https://issues.apache.org/jira/browse/SPARK-48046 Project: Spark

[jira] [Assigned] (SPARK-48038) Promote driverServiceName to KubernetesDriverConf

2024-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48038: - Assignee: Cheng Pan > Promote driverServiceName to KubernetesDriverConf >

[jira] [Resolved] (SPARK-48038) Promote driverServiceName to KubernetesDriverConf

2024-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48038. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46276

[jira] [Updated] (SPARK-48045) Pandas API groupby with multi-agg-relabel ignores as_index=False

2024-04-29 Thread Paul George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul George updated SPARK-48045: Summary: Pandas API groupby with multi-agg-relabel ignores as_index=False (was: Pandas groupby

[jira] [Resolved] (SPARK-47148) Avoid to materialize AQE ExchangeQueryStageExec on the cancellation

2024-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47148. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45234

[jira] [Updated] (SPARK-48045) Pandas groupby with multi-agg-relabel ignores as_index=False

2024-04-29 Thread Paul George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul George updated SPARK-48045: Description: A Pandas API DataFrame groupby with as_index=False and a multilevel relabeling,

[jira] [Updated] (SPARK-48042) Don't use a copy of timestamp formatter with a new override zone for each value

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48042: --- Labels: pull-request-available (was: ) > Don't use a copy of timestamp formatter with a

[jira] [Updated] (SPARK-48045) Pandas groupby with multi-agg-relabel ignores as_index=False

2024-04-29 Thread Paul George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul George updated SPARK-48045: Description: A Pandas API DataFrame groupby with as_index=False and a multilevel relabeling,

[jira] [Updated] (SPARK-48045) Pandas groupby with multi-agg-relabel ignores as_index=False

2024-04-29 Thread Paul George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul George updated SPARK-48045: Description: A Pandas API DataFrame groupby with as_index=False and a multilevel relabeling,

[jira] [Created] (SPARK-48045) Pandas groupby with multi-agg-relabel ignores as_index=False

2024-04-29 Thread Paul George (Jira)
Paul George created SPARK-48045: --- Summary: Pandas groupby with multi-agg-relabel ignores as_index=False Key: SPARK-48045 URL: https://issues.apache.org/jira/browse/SPARK-48045 Project: Spark

[jira] [Resolved] (SPARK-47994) SQLServer does not support 1 and 0 as boolean values

2024-04-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47994. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46231

[jira] [Updated] (SPARK-48041) Avoid call conf.resolver repeated in TableOutputResolver

2024-04-29 Thread xy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xy updated SPARK-48041: --- Description: Avoid call conf.resolver repeated in TableOutputResolver (was: Avoid repeated calls to conf.resolver

[jira] [Resolved] (SPARK-48039) Update the error class for `group.apply`

2024-04-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48039. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46277

[jira] [Created] (SPARK-48043) Kryo serialization issue with push-based shuffle

2024-04-29 Thread Romain Ardiet (Jira)
Romain Ardiet created SPARK-48043: - Summary: Kryo serialization issue with push-based shuffle Key: SPARK-48043 URL: https://issues.apache.org/jira/browse/SPARK-48043 Project: Spark Issue

[jira] [Updated] (SPARK-48043) Kryo serialization issue with push-based shuffle

2024-04-29 Thread Romain Ardiet (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Romain Ardiet updated SPARK-48043: -- Description: I'm running a spark job on AWS EMR. I wanted to test the new push-based shuffle

[jira] [Updated] (SPARK-48041) Avoid call conf.resolver repeated in TableOutputResolver

2024-04-29 Thread xy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xy updated SPARK-48041: --- Summary: Avoid call conf.resolver repeated in TableOutputResolver (was: Avoid repeated calls to conf.resolver in

[jira] [Updated] (SPARK-48042) Don't use a copy of timestamp formatter with a new override zone for each value

2024-04-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48042: - Issue Type: Improvement (was: Test) > Don't use a copy of timestamp formatter with a new override zone

[jira] [Created] (SPARK-48042) Don't use a copy of timestamp formatter with a new override zone for each value

2024-04-29 Thread Kent Yao (Jira)
Kent Yao created SPARK-48042: Summary: Don't use a copy of timestamp formatter with a new override zone for each value Key: SPARK-48042 URL: https://issues.apache.org/jira/browse/SPARK-48042 Project:

[jira] [Updated] (SPARK-48040) Spark connect supports set scheduler pool name

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48040: --- Labels: pull-request-available (was: ) > Spark connect supports set scheduler pool name >

[jira] [Updated] (SPARK-48041) Avoid repeated calls to conf.resolver in Analyzer

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48041: --- Labels: pull-request-available (was: ) > Avoid repeated calls to conf.resolver in Analyzer

[jira] [Created] (SPARK-48041) Avoid repeated calls to conf.resolver in Analyzer

2024-04-29 Thread xy (Jira)
xy created SPARK-48041: -- Summary: Avoid repeated calls to conf.resolver in Analyzer Key: SPARK-48041 URL: https://issues.apache.org/jira/browse/SPARK-48041 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-47567) StringLocate

2024-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47567. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45791

[jira] [Assigned] (SPARK-47567) StringLocate

2024-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47567: --- Assignee: Milan Dankovic > StringLocate > > > Key:

[jira] [Assigned] (SPARK-47567) StringLocate

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47567: -- Assignee: (was: Apache Spark) > StringLocate > > >

[jira] [Assigned] (SPARK-47567) StringLocate

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47567: -- Assignee: Apache Spark > StringLocate > > > Key:

[jira] [Created] (SPARK-48040) Spark connect supports set scheduler pool name

2024-04-29 Thread xie shuiahu (Jira)
xie shuiahu created SPARK-48040: --- Summary: Spark connect supports set scheduler pool name Key: SPARK-48040 URL: https://issues.apache.org/jira/browse/SPARK-48040 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-47567) StringLocate

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47567: -- Assignee: (was: Apache Spark) > StringLocate > > >

[jira] [Assigned] (SPARK-47567) StringLocate

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47567: -- Assignee: Apache Spark > StringLocate > > > Key:

[jira] [Resolved] (SPARK-47939) Parameterized queries fail for DESCRIBE & EXPLAIN w/ UNBOUND_SQL_PARAMETER error

2024-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47939. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46209

[jira] [Assigned] (SPARK-47939) Parameterized queries fail for DESCRIBE & EXPLAIN w/ UNBOUND_SQL_PARAMETER error

2024-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47939: --- Assignee: Vladimir Golubev > Parameterized queries fail for DESCRIBE & EXPLAIN w/

[jira] [Updated] (SPARK-48038) Promote driverServiceName to KubernetesDriverConf

2024-04-29 Thread Cheng Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Pan updated SPARK-48038: -- Summary: Promote driverServiceName to KubernetesDriverConf (was: Promote driverServiceName to

[jira] [Updated] (SPARK-48038) Promote driverServiceName to DriverServiceFeatureStep

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48038: --- Labels: pull-request-available (was: ) > Promote driverServiceName to

[jira] [Created] (SPARK-48038) Promote driverServiceName to DriverServiceFeatureStep

2024-04-29 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-48038: - Summary: Promote driverServiceName to DriverServiceFeatureStep Key: SPARK-48038 URL: https://issues.apache.org/jira/browse/SPARK-48038 Project: Spark Issue Type:

[jira] [Updated] (SPARK-48037) SortShuffleWriter lacks shuffle write related metrics resulting in potentially inaccurate data

2024-04-29 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-48037: --- Affects Version/s: 3.3.0 (was: 3.1.0) (was: 3.0.1) >