[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10

2024-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Description: {code} $ python3 --version Python 3.10.13 $ dev/lint-python --mypy starting

[jira] [Created] (SPARK-48068) Fix `mypy` failure in Python 3.10

2024-04-30 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-48068: - Summary: Fix `mypy` failure in Python 3.10 Key: SPARK-48068 URL: https://issues.apache.org/jira/browse/SPARK-48068 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-48067) Fix Variant default columns for more complex default variants

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48067: --- Labels: pull-request-available (was: ) > Fix Variant default columns for more complex

[jira] [Created] (SPARK-48067) Fix Variant default columns for more complex default variants

2024-04-30 Thread Richard Chen (Jira)
Richard Chen created SPARK-48067: Summary: Fix Variant default columns for more complex default variants Key: SPARK-48067 URL: https://issues.apache.org/jira/browse/SPARK-48067 Project: Spark

[jira] [Created] (SPARK-48066) TPCDSBenchmark fails with divide by zero in q90 for ANSI

2024-04-30 Thread Kent Yao (Jira)
Kent Yao created SPARK-48066: Summary: TPCDSBenchmark fails with divide by zero in q90 for ANSI Key: SPARK-48066 URL: https://issues.apache.org/jira/browse/SPARK-48066 Project: Spark Issue Type:

[jira] [Updated] (SPARK-48045) Pandas API groupby with multi-agg-relabel ignores as_index=False

2024-04-30 Thread Paul George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul George updated SPARK-48045: Description: A Pandas API DataFrame groupby with as_index=False and a multilevel relabeling,

[jira] [Assigned] (SPARK-46894) Move PySpark error conditions into standalone JSON file

2024-04-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46894: Assignee: Nicholas Chammas > Move PySpark error conditions into standalone JSON file >

[jira] [Resolved] (SPARK-46894) Move PySpark error conditions into standalone JSON file

2024-04-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46894. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44920

[jira] [Resolved] (SPARK-48028) Regenerate benchmark results after turning ANSI on

2024-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48028. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46266

[jira] [Created] (SPARK-48065) SPJ: allowJoinKeysSubsetOfPartitionKeys is too strict

2024-04-30 Thread Szehon Ho (Jira)
Szehon Ho created SPARK-48065: - Summary: SPJ: allowJoinKeysSubsetOfPartitionKeys is too strict Key: SPARK-48065 URL: https://issues.apache.org/jira/browse/SPARK-48065 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-48063) Enable `spark.stage.ignoreDecommissionFetchFailure` by default

2024-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48063. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46308

[jira] [Comment Edited] (SPARK-48023) Stream-stream join with windowed+watermarked dropDuplicates suppresses all rows

2024-04-30 Thread Scott Schenkein (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842509#comment-17842509 ] Scott Schenkein edited comment on SPARK-48023 at 4/30/24 9:33 PM: -- 1.

[jira] [Comment Edited] (SPARK-48023) Stream-stream join with windowed+watermarked dropDuplicates suppresses all rows

2024-04-30 Thread Scott Schenkein (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842509#comment-17842509 ] Scott Schenkein edited comment on SPARK-48023 at 4/30/24 9:33 PM: -- 1.

[jira] [Comment Edited] (SPARK-48023) Stream-stream join with windowed+watermarked dropDuplicates suppresses all rows

2024-04-30 Thread Scott Schenkein (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842509#comment-17842509 ] Scott Schenkein edited comment on SPARK-48023 at 4/30/24 9:32 PM: -- 1.

[jira] [Comment Edited] (SPARK-48023) Stream-stream join with windowed+watermarked dropDuplicates suppresses all rows

2024-04-30 Thread Scott Schenkein (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842509#comment-17842509 ] Scott Schenkein edited comment on SPARK-48023 at 4/30/24 9:32 PM: -- 1.

[jira] [Updated] (SPARK-48023) Stream-stream join with windowed+watermarked dropDuplicates suppresses all rows

2024-04-30 Thread Scott Schenkein (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Schenkein updated SPARK-48023: Description: When applying a streaming dropDuplicates-with-watermark to  a

[jira] [Comment Edited] (SPARK-48023) Stream-stream join with windowed+watermarked dropDuplicates suppresses all rows

2024-04-30 Thread Scott Schenkein (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842509#comment-17842509 ] Scott Schenkein edited comment on SPARK-48023 at 4/30/24 9:31 PM: -- 1.

[jira] [Comment Edited] (SPARK-48023) Stream-stream join with windowed+watermarked dropDuplicates suppresses all rows

2024-04-30 Thread Scott Schenkein (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842509#comment-17842509 ] Scott Schenkein edited comment on SPARK-48023 at 4/30/24 9:31 PM: -- 1.

[jira] [Commented] (SPARK-48023) Stream-stream join with windowed+watermarked dropDuplicates suppresses all rows

2024-04-30 Thread Scott Schenkein (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842509#comment-17842509 ] Scott Schenkein commented on SPARK-48023: - 1. My apologies, I updated the sample code with this

[jira] [Updated] (SPARK-48064) Improve error messages for routine related errors

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48064: --- Labels: pull-request-available (was: ) > Improve error messages for routine related errors

[jira] [Comment Edited] (SPARK-48023) Stream-stream join with windowed+watermarked dropDuplicates suppresses all rows

2024-04-30 Thread Siying Dong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842501#comment-17842501 ] Siying Dong edited comment on SPARK-48023 at 4/30/24 8:53 PM: -- I'm not able

[jira] [Comment Edited] (SPARK-48023) Stream-stream join with windowed+watermarked dropDuplicates suppresses all rows

2024-04-30 Thread Siying Dong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842501#comment-17842501 ] Siying Dong edited comment on SPARK-48023 at 4/30/24 8:53 PM: -- I'm not able

[jira] [Created] (SPARK-48064) Improve error messages for routine related errors

2024-04-30 Thread Allison Wang (Jira)
Allison Wang created SPARK-48064: Summary: Improve error messages for routine related errors Key: SPARK-48064 URL: https://issues.apache.org/jira/browse/SPARK-48064 Project: Spark Issue

[jira] [Commented] (SPARK-48023) Stream-stream join with windowed+watermarked dropDuplicates suppresses all rows

2024-04-30 Thread Siying Dong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842501#comment-17842501 ] Siying Dong commented on SPARK-48023: - I'm not able to run `.withWatermark("window")`. It throws

[jira] [Updated] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47578: --- Labels: pull-request-available (was: ) > Spark core: Migrate logWarn with variables to

[jira] [Assigned] (SPARK-48063) Enable `spark.stage.ignoreDecommissionFetchFailure` by default

2024-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48063: - Assignee: Dongjoon Hyun > Enable `spark.stage.ignoreDecommissionFetchFailure` by

[jira] [Updated] (SPARK-48063) Enable `spark.stage.ignoreDecommissionFetchFailure` by default

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48063: --- Labels: pull-request-available (was: ) > Enable

[jira] [Created] (SPARK-48063) Enable `spark.stage.ignoreDecommissionFetchFailure` by default

2024-04-30 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-48063: - Summary: Enable `spark.stage.ignoreDecommissionFetchFailure` by default Key: SPARK-48063 URL: https://issues.apache.org/jira/browse/SPARK-48063 Project: Spark

[jira] [Updated] (SPARK-48060) Fix StreamingQueryHashPartitionVerifySuite to update golden files correctly

2024-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48060: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Fix

[jira] [Resolved] (SPARK-48060) Fix StreamingQueryHashPartitionVerifySuite to update golden files correctly

2024-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48060. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46304

[jira] [Resolved] (SPARK-48057) Enable `GroupedApplyInPandasTests. test_grouped_with_empty_partition`

2024-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48057. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46299

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-30 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/30/24 7:11 PM: - Edit: I updated this

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-30 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/30/24 6:57 PM: - Edit: I updated this

[jira] [Commented] (SPARK-47892) XML: Stop ignoring CDATA within rows.

2024-04-30 Thread Yousof Hosny (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842481#comment-17842481 ] Yousof Hosny commented on SPARK-47892: -- This change was implemented as a Follow Up under:

[jira] [Resolved] (SPARK-47892) XML: Stop ignoring CDATA within rows.

2024-04-30 Thread Yousof Hosny (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yousof Hosny resolved SPARK-47892. -- Resolution: Duplicate > XML: Stop ignoring CDATA within rows. >

[jira] [Resolved] (SPARK-47275) XML: Change to not support DROPMALFORMED parse mode

2024-04-30 Thread Yousof Hosny (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yousof Hosny resolved SPARK-47275. -- Resolution: Duplicate > XML: Change to not support DROPMALFORMED parse mode >

[jira] [Commented] (SPARK-47275) XML: Change to not support DROPMALFORMED parse mode

2024-04-30 Thread Yousof Hosny (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842480#comment-17842480 ] Yousof Hosny commented on SPARK-47275: -- [~HF] Yes, that is correct thanks for the notice. Closed as

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-30 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/30/24 6:43 PM: - Edit: I updated this

[jira] [Updated] (SPARK-48035) try_add/try_multiply should not be semantic equal to add/multiply

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48035: --- Labels: pull-request-available (was: ) > try_add/try_multiply should not be semantic equal

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-30 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel edited comment on SPARK-47578 at 4/30/24 5:55 PM: - Edit: I updated this

[jira] [Resolved] (SPARK-48061) Parameterize max limits of `spark.sql.test.randomDataGenerator`

2024-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48061. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46305

[jira] [Updated] (SPARK-48062) Add pyspark test for SimpleDataSourceStreamingReader

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48062: --- Labels: pull-request-available (was: ) > Add pyspark test for

[jira] [Commented] (SPARK-47275) XML: Change to not support DROPMALFORMED parse mode

2024-04-30 Thread HiuFung Kwok (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842463#comment-17842463 ] HiuFung Kwok commented on SPARK-47275: -- [~yhosny] I thought, this is already done under

[jira] [Created] (SPARK-48062) Add pyspark test for SimpleDataSourceStreamingReader

2024-04-30 Thread Chaoqin Li (Jira)
Chaoqin Li created SPARK-48062: -- Summary: Add pyspark test for SimpleDataSourceStreamingReader Key: SPARK-48062 URL: https://issues.apache.org/jira/browse/SPARK-48062 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-48061) Parameterize max limits of `spark.sql.test.randomDataGenerator`

2024-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48061: - Assignee: Dongjoon Hyun > Parameterize max limits of

[jira] [Updated] (SPARK-48061) Parameterize max limits of `spark.sql.test.randomDataGenerator`

2024-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48061: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Parameterize max limits of

[jira] [Updated] (SPARK-48061) Parameterize max limits of `spark.sql.test.randomDataGenerator`

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48061: --- Labels: pull-request-available (was: ) > Parameterize max limits of

[jira] [Created] (SPARK-48061) Parameterize max limits of `spark.sql.test.randomDataGenerator`

2024-04-30 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-48061: - Summary: Parameterize max limits of `spark.sql.test.randomDataGenerator` Key: SPARK-48061 URL: https://issues.apache.org/jira/browse/SPARK-48061 Project: Spark

[jira] [Updated] (SPARK-48060) Fix StreamingQueryHashPartitionVerifySuite to update golden files correctly

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48060: --- Labels: pull-request-available (was: ) > Fix StreamingQueryHashPartitionVerifySuite to

[jira] [Created] (SPARK-48060) Fix StreamingQueryHashPartitionVerifySuite to update golden files correctly

2024-04-30 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-48060: - Summary: Fix StreamingQueryHashPartitionVerifySuite to update golden files correctly Key: SPARK-48060 URL: https://issues.apache.org/jira/browse/SPARK-48060

[jira] [Resolved] (SPARK-47359) StringTranslate (all collations)

2024-04-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47359. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45820

[jira] [Assigned] (SPARK-47359) StringTranslate (all collations)

2024-04-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47359: --- Assignee: Milan Dankovic > StringTranslate (all collations) >

[jira] [Resolved] (SPARK-47793) Implement SimpleDataSourceStreamReader for python streaming data source

2024-04-30 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47793. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45977

[jira] [Assigned] (SPARK-47793) Implement SimpleDataSourceStreamReader for python streaming data source

2024-04-30 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-47793: Assignee: Chaoqin Li > Implement SimpleDataSourceStreamReader for python streaming data

[jira] [Resolved] (SPARK-48003) Hll sketch aggregate support for strings with collation

2024-04-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48003. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46241

[jira] [Updated] (SPARK-48050) Log logical plan at query start

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48050: --- Labels: pull-request-available (was: ) > Log logical plan at query start >

[jira] [Assigned] (SPARK-48050) Log logical plan at query start

2024-04-30 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-48050: Assignee: Fanyue Xia > Log logical plan at query start > ---

[jira] [Resolved] (SPARK-48050) Log logical plan at query start

2024-04-30 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-48050. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46292

[jira] [Updated] (SPARK-48059) Implement the structured log framework on the java side

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48059: --- Labels: pull-request-available (was: ) > Implement the structured log framework on the

[jira] [Created] (SPARK-48059) Implement the structured log framework on the java side

2024-04-30 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48059: --- Summary: Implement the structured log framework on the java side Key: SPARK-48059 URL: https://issues.apache.org/jira/browse/SPARK-48059 Project: Spark Issue

[jira] [Updated] (SPARK-48058) `UserDefinedFunction.returnType` parse the DDL string

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48058: --- Labels: pull-request-available (was: ) > `UserDefinedFunction.returnType` parse the DDL

[jira] [Created] (SPARK-48058) `UserDefinedFunction.returnType` parse the DDL string

2024-04-30 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-48058: - Summary: `UserDefinedFunction.returnType` parse the DDL string Key: SPARK-48058 URL: https://issues.apache.org/jira/browse/SPARK-48058 Project: Spark

[jira] [Resolved] (SPARK-48052) Recover pyspark-connect CI by parent classes

2024-04-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48052. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46294

[jira] [Resolved] (SPARK-47566) SubstringIndex

2024-04-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47566. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45725

[jira] [Assigned] (SPARK-47566) SubstringIndex

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47566: -- Assignee: Apache Spark > SubstringIndex > -- > > Key:

[jira] [Assigned] (SPARK-47566) SubstringIndex

2024-04-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47566: --- Assignee: Milan Dankovic > SubstringIndex > -- > > Key:

[jira] [Assigned] (SPARK-47566) SubstringIndex

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47566: -- Assignee: (was: Apache Spark) > SubstringIndex > -- > >

[jira] [Updated] (SPARK-47409) StringTrim & StringTrimLeft/Right/Both (binary & lowercase collation only)

2024-04-30 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47409: - Description: Enable collation support for the *StringTrim* built-in string function in Spark

[jira] [Updated] (SPARK-47409) StringTrim & StringTrimLeft/Right/Both (binary & lowercase collation only)

2024-04-30 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47409: - Summary: StringTrim & StringTrimLeft/Right/Both (binary & lowercase collation only) (was:

[jira] [Resolved] (SPARK-46122) Set `spark.sql.legacy.createHiveTableByDefault` to `false` by default

2024-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46122. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46207

[jira] [Resolved] (SPARK-48055) Enable PandasUDFScalarParityTests.{test_vectorized_udf_empty_partition, test_vectorized_udf_struct_with_empty_partition}

2024-04-30 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-48055. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46296

[jira] [Updated] (SPARK-48054) Backward compatibility test for Spark Connect

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48054: --- Labels: pull-request-available (was: ) > Backward compatibility test for Spark Connect >