[jira] [Resolved] (SPARK-45752) Unreferenced CTE should all be checked by CheckAnalysis0

[ https://issues.apache.org/jira/browse/SPARK-45752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45752. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43614

[jira] [Updated] (SPARK-45848) spark-build-info.ps1 missing the docroot property

[ https://issues.apache.org/jira/browse/SPARK-45848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45848: --- Labels: pull-request-available (was: ) > spark-build-info.ps1 missing the docroot property

[jira] [Updated] (SPARK-45848) spark-build-info.ps1 missing the docroot property

[ https://issues.apache.org/jira/browse/SPARK-45848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-45848: Description: https://github.com/apache/spark/blob/master/build/spark-build-info.ps1#L38-L44

[jira] [Created] (SPARK-45848) spark-build-info.ps1 missing the docroot property

Yuming Wang created SPARK-45848: --- Summary: spark-build-info.ps1 missing the docroot property Key: SPARK-45848 URL: https://issues.apache.org/jira/browse/SPARK-45848 Project: Spark Issue Type:

[jira] [Commented] (SPARK-44662) SPIP: Improving performance of BroadcastHashJoin queries with stream side join key on non partition columns

[ https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17784282#comment-17784282 ] Asif commented on SPARK-44662: -- The changes for iceberg which support broadcast-var-pushdown are present in

[jira] [Updated] (SPARK-45830) Refactor StorageUtils#bufferCleaner

[ https://issues.apache.org/jira/browse/SPARK-45830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45830: --- Labels: pull-request-available (was: ) > Refactor StorageUtils#bufferCleaner >

[jira] [Assigned] (SPARK-45831) Change to using the collection factory to create an immutable Java collection

[ https://issues.apache.org/jira/browse/SPARK-45831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45831: - Assignee: Yang Jie > Change to using the collection factory to create an immutable

[jira] [Resolved] (SPARK-45831) Change to using the collection factory to create an immutable Java collection

[ https://issues.apache.org/jira/browse/SPARK-45831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45831. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43709

[jira] [Assigned] (SPARK-45835) Make gitHub labeler more accurate and remove outdated comments

[ https://issues.apache.org/jira/browse/SPARK-45835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45835: - Assignee: BingKun Pan > Make gitHub labeler more accurate and remove outdated comments

[jira] [Resolved] (SPARK-45835) Make gitHub labeler more accurate and remove outdated comments

[ https://issues.apache.org/jira/browse/SPARK-45835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45835. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43716

[jira] [Resolved] (SPARK-45842) Refactor Catalog Function APIs to use analyzer

[ https://issues.apache.org/jira/browse/SPARK-45842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45842. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43720

[jira] [Assigned] (SPARK-45842) Refactor Catalog Function APIs to use analyzer

[ https://issues.apache.org/jira/browse/SPARK-45842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45842: - Assignee: Yihong He > Refactor Catalog Function APIs to use analyzer >

[jira] [Created] (SPARK-45846) spark.sql.optimizeNullAwareAntiJoin should respect spark.sql.autoBroadcastJoinThreshold

Chao Sun created SPARK-45846: Summary: spark.sql.optimizeNullAwareAntiJoin should respect spark.sql.autoBroadcastJoinThreshold Key: SPARK-45846 URL: https://issues.apache.org/jira/browse/SPARK-45846

[jira] [Updated] (SPARK-45845) Streaming UI add number of evicted state rows

[ https://issues.apache.org/jira/browse/SPARK-45845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45845: --- Labels: pull-request-available (was: ) > Streaming UI add number of evicted state rows >

[jira] [Created] (SPARK-45845) Streaming UI add number of evicted state rows

Wei Liu created SPARK-45845: --- Summary: Streaming UI add number of evicted state rows Key: SPARK-45845 URL: https://issues.apache.org/jira/browse/SPARK-45845 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-45843) Support `killAll` in REST Submission API

[ https://issues.apache.org/jira/browse/SPARK-45843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45843: - Assignee: Dongjoon Hyun > Support `killAll` in REST Submission API >

[jira] [Resolved] (SPARK-45843) Support `killAll` in REST Submission API

[ https://issues.apache.org/jira/browse/SPARK-45843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45843. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43721

[jira] [Updated] (SPARK-45843) Support `killall` in REST Submission API

[ https://issues.apache.org/jira/browse/SPARK-45843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45843: -- Summary: Support `killall` in REST Submission API (was: Support `killAll` in REST Submission

[jira] [Resolved] (SPARK-42821) Remove unused parameters in splitFiles methods

[ https://issues.apache.org/jira/browse/SPARK-42821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42821. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 40454

[jira] [Assigned] (SPARK-42821) Remove unused parameters in splitFiles methods

[ https://issues.apache.org/jira/browse/SPARK-42821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42821: Assignee: BingKun Pan > Remove unused parameters in splitFiles methods >

[jira] [Updated] (SPARK-45844) Implement case insensitivity for XML

[ https://issues.apache.org/jira/browse/SPARK-45844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45844: --- Labels: pull-request-available (was: ) > Implement case insensitivity for XML >

[jira] [Created] (SPARK-45844) Implement case insensitivity for XML

Shujing Yang created SPARK-45844: Summary: Implement case insensitivity for XML Key: SPARK-45844 URL: https://issues.apache.org/jira/browse/SPARK-45844 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45827) Add variant data type in Spark

[ https://issues.apache.org/jira/browse/SPARK-45827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45827: --- Labels: pull-request-available (was: ) > Add variant data type in Spark >

[jira] [Updated] (SPARK-45843) Support `killAll` in REST Submission API

[ https://issues.apache.org/jira/browse/SPARK-45843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45843: --- Labels: pull-request-available (was: ) > Support `killAll` in REST Submission API >

[jira] [Created] (SPARK-45843) Support `killAll` in REST Submission API

Dongjoon Hyun created SPARK-45843: - Summary: Support `killAll` in REST Submission API Key: SPARK-45843 URL: https://issues.apache.org/jira/browse/SPARK-45843 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-45639) Support loading Python data sources in DataFrameReader

[ https://issues.apache.org/jira/browse/SPARK-45639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45639. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43630

[jira] [Assigned] (SPARK-45639) Support loading Python data sources in DataFrameReader

[ https://issues.apache.org/jira/browse/SPARK-45639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45639: Assignee: Allison Wang > Support loading Python data sources in DataFrameReader >

[jira] [Resolved] (SPARK-45828) Remove deprecated method in dsl

[ https://issues.apache.org/jira/browse/SPARK-45828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45828. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43708

[jira] [Commented] (SPARK-45282) Join loses records for cached datasets

[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17784115#comment-17784115 ] koert kuipers commented on SPARK-45282: --- it does look like same issue and partitioning being the

[jira] [Commented] (SPARK-45282) Join loses records for cached datasets

[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17784109#comment-17784109 ] Emil Ejbyfeldt commented on SPARK-45282: The code reproducing the bug looks quite similar to

[jira] [Updated] (SPARK-45826) Add a SQL config for extra stack traces in Origin

[ https://issues.apache.org/jira/browse/SPARK-45826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45826: --- Labels: pull-request-available (was: ) > Add a SQL config for extra stack traces in Origin

[jira] [Updated] (SPARK-45842) Refactor Catalog Function APIs to use analyzer

[ https://issues.apache.org/jira/browse/SPARK-45842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45842: --- Labels: pull-request-available (was: ) > Refactor Catalog Function APIs to use analyzer >

[jira] [Created] (SPARK-45842) Refactor Catalog Function APIs to use analyzer

Yihong He created SPARK-45842: - Summary: Refactor Catalog Function APIs to use analyzer Key: SPARK-45842 URL: https://issues.apache.org/jira/browse/SPARK-45842 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-45841) Expose stack trace by DataFrameQueryContext

[ https://issues.apache.org/jira/browse/SPARK-45841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45841. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43703

[jira] [Updated] (SPARK-45841) Expose stack trace by DataFrameQueryContext

[ https://issues.apache.org/jira/browse/SPARK-45841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45841: --- Labels: pull-request-available (was: ) > Expose stack trace by DataFrameQueryContext >

[jira] [Updated] (SPARK-45837) Report underlying error in scala client

[ https://issues.apache.org/jira/browse/SPARK-45837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45837: --- Labels: pull-request-available (was: ) > Report underlying error in scala client >

[jira] [Created] (SPARK-45841) Expose stack trace by DataFrameQueryContext

Max Gekk created SPARK-45841: Summary: Expose stack trace by DataFrameQueryContext Key: SPARK-45841 URL: https://issues.apache.org/jira/browse/SPARK-45841 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45840) Fix these issue in module sql/hive, sql/hive-thriftserver

[ https://issues.apache.org/jira/browse/SPARK-45840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-45840: --- Summary: Fix these issue in module sql/hive, sql/hive-thriftserver (was: Fix these issue in module

[jira] [Created] (SPARK-45840) Fix these issue in module sql/hive

Jiaan Geng created SPARK-45840: -- Summary: Fix these issue in module sql/hive Key: SPARK-45840 URL: https://issues.apache.org/jira/browse/SPARK-45840 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-45839) Fix these issue in module sql/api

Jiaan Geng created SPARK-45839: -- Summary: Fix these issue in module sql/api Key: SPARK-45839 URL: https://issues.apache.org/jira/browse/SPARK-45839 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-45838) Fix these issue in module sql/core

Jiaan Geng created SPARK-45838: -- Summary: Fix these issue in module sql/core Key: SPARK-45838 URL: https://issues.apache.org/jira/browse/SPARK-45838 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-45825) Fix these issue in module sql/catalyst

[ https://issues.apache.org/jira/browse/SPARK-45825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-45825: --- Summary: Fix these issue in module sql/catalyst (was: Fix these issue in package sql/catalyst) >

[jira] [Resolved] (SPARK-45816) Return null when overflowing during casting from timestamp to integers

[ https://issues.apache.org/jira/browse/SPARK-45816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng resolved SPARK-45816. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43694

[jira] [Assigned] (SPARK-45816) Return null when overflowing during casting from timestamp to integers

[ https://issues.apache.org/jira/browse/SPARK-45816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng reassigned SPARK-45816: -- Assignee: L. C. Hsieh > Return null when overflowing during casting from timestamp to

[jira] [Created] (SPARK-45837) Report underlying error in scala client

Alice Sayutina created SPARK-45837: -- Summary: Report underlying error in scala client Key: SPARK-45837 URL: https://issues.apache.org/jira/browse/SPARK-45837 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-45606) Release restrictions on multi-layer runtime filter

[ https://issues.apache.org/jira/browse/SPARK-45606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng resolved SPARK-45606. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43449

[jira] [Resolved] (SPARK-45829) The default value of ‘spark.executor.logs.rolling.maxSize' on the official website is incorrect

[ https://issues.apache.org/jira/browse/SPARK-45829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-45829. -- Fix Version/s: 3.3.4 3.5.1 4.0.0 3.4.2

[jira] [Assigned] (SPARK-45829) The default value of ‘spark.executor.logs.rolling.maxSize' on the official website is incorrect

[ https://issues.apache.org/jira/browse/SPARK-45829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-45829: Assignee: chenyu > The default value of ‘spark.executor.logs.rolling.maxSize' on the official >

[jira] [Updated] (SPARK-45825) Fix these issue in package sql/catalyst

[ https://issues.apache.org/jira/browse/SPARK-45825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45825: --- Labels: pull-request-available (was: ) > Fix these issue in package sql/catalyst >

[jira] [Updated] (SPARK-43341) StructType.toDDL does not pick up on non-nullability of column in nested struct

[ https://issues.apache.org/jira/browse/SPARK-43341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43341: --- Labels: pull-request-available (was: ) > StructType.toDDL does not pick up on

[jira] [Assigned] (SPARK-45816) Return null when overflowing during casting from timestamp to integers

[ https://issues.apache.org/jira/browse/SPARK-45816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45816: -- Assignee: Apache Spark > Return null when overflowing during casting from timestamp

[jira] [Assigned] (SPARK-45816) Return null when overflowing during casting from timestamp to integers

[ https://issues.apache.org/jira/browse/SPARK-45816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45816: -- Assignee: (was: Apache Spark) > Return null when overflowing during casting from

[jira] [Reopened] (SPARK-42821) Remove unused parameters in splitFiles methods

[ https://issues.apache.org/jira/browse/SPARK-42821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reopened SPARK-42821: -- > Remove unused parameters in splitFiles methods > -- > >

[jira] [Updated] (SPARK-42821) Remove unused parameters in splitFiles methods

[ https://issues.apache.org/jira/browse/SPARK-42821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42821: - Affects Version/s: 4.0.0 (was: 3.5.0) > Remove unused parameters in

[jira] [Resolved] (SPARK-45824) Enforce error class in ParseException

[ https://issues.apache.org/jira/browse/SPARK-45824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45824. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43702

[jira] [Updated] (SPARK-42821) Remove unused parameters in splitFiles methods

[ https://issues.apache.org/jira/browse/SPARK-42821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42821: --- Labels: pull-request-available (was: ) > Remove unused parameters in splitFiles methods >

[jira] [Updated] (SPARK-45835) Make gitHub labeler more accurate and remove outdated comments

[ https://issues.apache.org/jira/browse/SPARK-45835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45835: --- Labels: pull-request-available (was: ) > Make gitHub labeler more accurate and remove