[jira] [Resolved] (SPARK-51821) Possible deadlock in UninterruptibleThread

[ https://issues.apache.org/jira/browse/SPARK-51821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51821. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50594 [https://gith

[jira] [Assigned] (SPARK-51821) Possible deadlock in UninterruptibleThread

[ https://issues.apache.org/jira/browse/SPARK-51821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51821: --- Assignee: Vlad Rozov > Possible deadlock in UninterruptibleThread > ---

[jira] [Resolved] (SPARK-51998) Upgrade ORC to 2.1.2

[ https://issues.apache.org/jira/browse/SPARK-51998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51998. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50786 [https://

[jira] [Assigned] (SPARK-52022) Add additional check in default method for SparkThrowable.getQueryContext

[ https://issues.apache.org/jira/browse/SPARK-52022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52022: Assignee: Hyukjin Kwon > Add additional check in default method for SparkThrowable.getQue

[jira] [Resolved] (SPARK-52022) Add additional check in default method for SparkThrowable.getQueryContext

[ https://issues.apache.org/jira/browse/SPARK-52022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52022. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50807 [https://gi

[jira] [Updated] (SPARK-52022) Add additional check in default method for SparkThrowable.getQueryContext

[ https://issues.apache.org/jira/browse/SPARK-52022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52022: --- Labels: pull-request-available (was: ) > Add additional check in default method for SparkTh

[jira] [Created] (SPARK-52022) Add additional check in default method for SparkThrowable.getQueryContext

Hyukjin Kwon created SPARK-52022: Summary: Add additional check in default method for SparkThrowable.getQueryContext Key: SPARK-52022 URL: https://issues.apache.org/jira/browse/SPARK-52022 Project: Sp

[jira] [Updated] (SPARK-49881) SPIP : Improving analyzer performance by skipping DeduplicateRelations rule conditionally

[ https://issues.apache.org/jira/browse/SPARK-49881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49881: --- Labels: pull-request-available (was: ) > SPIP : Improving analyzer performance by skipping

[jira] [Resolved] (SPARK-51983) Prepare tests for pandas API on Spark with ANSI mode enabled

[ https://issues.apache.org/jira/browse/SPARK-51983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51983. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50779 [https://gi

[jira] [Assigned] (SPARK-51983) Prepare tests for pandas API on Spark with ANSI mode enabled

[ https://issues.apache.org/jira/browse/SPARK-51983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51983: Assignee: Takuya Ueshin > Prepare tests for pandas API on Spark with ANSI mode enabled >

[jira] [Resolved] (SPARK-44856) Improve Python UDTF arrow serializer performance

[ https://issues.apache.org/jira/browse/SPARK-44856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44856. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50099 [https://gi

[jira] [Updated] (SPARK-51835) Extend InMemoryTable to support table versions

[ https://issues.apache.org/jira/browse/SPARK-51835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51835: --- Labels: pull-request-available (was: ) > Extend InMemoryTable to support table versions > -

[jira] [Updated] (SPARK-51835) Extend InMemoryTable to support table versions

[ https://issues.apache.org/jira/browse/SPARK-51835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-51835: --- Summary: Extend InMemoryTable to support table versions (was: Extend InMemoryTableCatalog t

[jira] [Commented] (SPARK-49872) Spark History UI -- StreamConstraintsException: String length (20054016) exceeds the maximum length (20000000)

[ https://issues.apache.org/jira/browse/SPARK-49872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17949834#comment-17949834 ] Parag Kesar commented on SPARK-49872: - [~steven.aerts], thanks for the fix! Do we p

[jira] [Commented] (SPARK-47150) String length (...) exceeds the maximum length (20000000)

[ https://issues.apache.org/jira/browse/SPARK-47150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17949835#comment-17949835 ] Parag Kesar commented on SPARK-47150: - [~steven.aerts], thanks for addressing the is

[jira] [Assigned] (SPARK-51905) Disallow NOT ENFORCED CHECK constraint

[ https://issues.apache.org/jira/browse/SPARK-51905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-51905: -- Assignee: Gengliang Wang > Disallow NOT ENFORCED CHECK constraint > -

[jira] [Resolved] (SPARK-51905) Disallow NOT ENFORCED CHECK constraint

[ https://issues.apache.org/jira/browse/SPARK-51905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-51905. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50772 [https:

[jira] [Updated] (SPARK-52021) Separate expression and operator patterns

[ https://issues.apache.org/jira/browse/SPARK-52021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52021: --- Labels: pull-request-available (was: ) > Separate expression and operator patterns > --

[jira] [Assigned] (SPARK-51989) Add missing Filter subclasses to __all__ list in pyspark.sql.datasource

[ https://issues.apache.org/jira/browse/SPARK-51989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang reassigned SPARK-51989: Assignee: Allison Wang > Add missing Filter subclasses to __all__ list in pyspark.sql.dat

[jira] [Resolved] (SPARK-51989) Add missing Filter subclasses to __all__ list in pyspark.sql.datasource

[ https://issues.apache.org/jira/browse/SPARK-51989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved SPARK-51989. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50782 [https://gi

[jira] [Created] (SPARK-52020) remove sql/hive/src/test/noclasspath/hive-test-udfs.jar and add source code for UDFs

Vlad Rozov created SPARK-52020: -- Summary: remove sql/hive/src/test/noclasspath/hive-test-udfs.jar and add source code for UDFs Key: SPARK-52020 URL: https://issues.apache.org/jira/browse/SPARK-52020 Proj

[jira] [Resolved] (SPARK-52015) Update OracleDatabaseOnDocker Docker Image Tag to oracle-free:23.7-slim

[ https://issues.apache.org/jira/browse/SPARK-52015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52015. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50801 [https://

[jira] [Assigned] (SPARK-52015) Update OracleDatabaseOnDocker Docker Image Tag to oracle-free:23.7-slim

[ https://issues.apache.org/jira/browse/SPARK-52015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52015: - Assignee: Luca Canali > Update OracleDatabaseOnDocker Docker Image Tag to oracle-free:2

[jira] [Commented] (SPARK-44389) ExecutorDeadException when using decommissioning without external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-44389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17949759#comment-17949759 ] Dongjoon Hyun commented on SPARK-44389: --- To [~SamWheating], sorry but could you tr

[jira] [Closed] (SPARK-44389) ExecutorDeadException when using decommissioning without external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-44389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-44389. - > ExecutorDeadException when using decommissioning without external shuffle > service > ---

[jira] [Resolved] (SPARK-44389) ExecutorDeadException when using decommissioning without external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-44389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44389. --- Resolution: Incomplete BTW, IIRC, this issue itself is fixed at 3.4.2. Let me close this to

[jira] [Updated] (SPARK-52019) Strip outer reference before creating a name in toPrettySQL

[ https://issues.apache.org/jira/browse/SPARK-52019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52019: --- Labels: pull-request-available (was: ) > Strip outer reference before creating a name in to

[jira] [Commented] (SPARK-44389) ExecutorDeadException when using decommissioning without external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-44389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17949755#comment-17949755 ] Dongjoon Hyun commented on SPARK-44389: --- Thank you for reporting, [~SamWheating].

[jira] [Updated] (SPARK-52019) Strip outer reference before creating a name in toPrettySQL

[ https://issues.apache.org/jira/browse/SPARK-52019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-52019: Summary: Strip outer reference before creating a name in toPrettySQL (was: Strips outer r

[jira] [Updated] (SPARK-52019) Strips outer reference before creating a name in toPrettySQL

[ https://issues.apache.org/jira/browse/SPARK-52019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-52019: Description: In the following query we would have min(outer(t2.t2a)) as a name for min(t2a

[jira] [Created] (SPARK-52019) Strips outer reference before creating a name in toPrettySQL

Mihailo Aleksic created SPARK-52019: --- Summary: Strips outer reference before creating a name in toPrettySQL Key: SPARK-52019 URL: https://issues.apache.org/jira/browse/SPARK-52019 Project: Spark

[jira] [Updated] (SPARK-52018) Remove `jar` files from Apache Spark git repository keeping all affected tests enabled

[ https://issues.apache.org/jira/browse/SPARK-52018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vlad Rozov updated SPARK-52018: --- Component/s: Tests > Remove `jar` files from Apache Spark git repository keeping all affected > tes

[jira] [Created] (SPARK-52018) Remove `jar` files from Apache Spark git repository keeping all affected tests enabled

Vlad Rozov created SPARK-52018: -- Summary: Remove `jar` files from Apache Spark git repository keeping all affected tests enabled Key: SPARK-52018 URL: https://issues.apache.org/jira/browse/SPARK-52018 Pr

[jira] [Comment Edited] (SPARK-39386) Flaky Test: BloomFilterAggregateQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-39386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17949732#comment-17949732 ] Ish Nagy edited comment on SPARK-39386 at 5/6/25 1:59 PM: -- Hi a

[jira] [Commented] (SPARK-39386) Flaky Test: BloomFilterAggregateQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-39386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17949732#comment-17949732 ] Ish Nagy commented on SPARK-39386: -- Hi all, I think I identified an important detail r

[jira] [Updated] (SPARK-39386) Flaky Test: BloomFilterAggregateQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-39386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ish Nagy updated SPARK-39386: - Attachment: spark-39386.repro.sh_2025-05-06_0607.log spark-39386.repro.sh > Flaky Test:

[jira] [Resolved] (SPARK-52016) new built-in functions in Spark 4.0

[ https://issues.apache.org/jira/browse/SPARK-52016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52016. - Fix Version/s: 4.0.0 Resolution: Fixed > new built-in functions in Spark 4.0 > --

[jira] [Updated] (SPARK-48168) Add bitwise shifting operators support

[ https://issues.apache.org/jira/browse/SPARK-48168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-48168: Parent: SPARK-52016 Issue Type: Sub-task (was: Improvement) > Add bitwise shifting operat

[jira] [Updated] (SPARK-52017) Enable multiple self-references and self-references from a Subquery inside rCTEs

[ https://issues.apache.org/jira/browse/SPARK-52017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52017: --- Labels: pull-request-available (was: ) > Enable multiple self-references and self-reference

[jira] [Updated] (SPARK-42746) Add the LISTAGG() aggregate function

[ https://issues.apache.org/jira/browse/SPARK-42746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-42746: Parent: SPARK-52016 Issue Type: Sub-task (was: New Feature) > Add the LISTAGG() aggregate

[jira] [Updated] (SPARK-48578) Add new expressions for UTF8 string validation

[ https://issues.apache.org/jira/browse/SPARK-48578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-48578: Parent: (was: SPARK-52016) Issue Type: Improvement (was: Sub-task) > Add new expressi

[jira] [Updated] (SPARK-48578) Add new expressions for UTF8 string validation

[ https://issues.apache.org/jira/browse/SPARK-48578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-48578: Parent: SPARK-52016 Issue Type: Sub-task (was: Bug) > Add new expressions for UTF8 string

[jira] [Created] (SPARK-52017) Enable multiple self-references and self-references from a Subquery inside rCTEs

Pavle Martinović created SPARK-52017: Summary: Enable multiple self-references and self-references from a Subquery inside rCTEs Key: SPARK-52017 URL: https://issues.apache.org/jira/browse/SPARK-52017

[jira] [Updated] (SPARK-48578) Add new expressions for UTF8 string validation

[ https://issues.apache.org/jira/browse/SPARK-48578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-48578: Epic Link: (was: SPARK-46830) > Add new expressions for UTF8 string validation > -

[jira] [Updated] (SPARK-49121) Support from_protobuf and to_protobuf for SQL functions

[ https://issues.apache.org/jira/browse/SPARK-49121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-49121: Parent: SPARK-52016 Issue Type: Sub-task (was: Bug) > Support from_protobuf and to_protob

[jira] [Updated] (SPARK-49306) Create SQL function aliases for 'zeroifnull' and 'nullifzero'

[ https://issues.apache.org/jira/browse/SPARK-49306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-49306: Parent: SPARK-52016 Issue Type: Sub-task (was: Improvement) > Create SQL function aliases

[jira] [Created] (SPARK-52016) new built-in functions in Spark 4.0

Wenchen Fan created SPARK-52016: --- Summary: new built-in functions in Spark 4.0 Key: SPARK-52016 URL: https://issues.apache.org/jira/browse/SPARK-52016 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-52007) Expression IDs shouldn't be present in grouping expressions when using grouping sets

[ https://issues.apache.org/jira/browse/SPARK-52007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52007. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50791 [https://gith

[jira] [Assigned] (SPARK-52007) Expression IDs shouldn't be present in grouping expressions when using grouping sets

[ https://issues.apache.org/jira/browse/SPARK-52007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52007: --- Assignee: Mihailo Aleksic > Expression IDs shouldn't be present in grouping expressions whe

[jira] [Updated] (SPARK-52015) Update OracleDatabaseOnDocker Docker Image Tag to oracle-free:23.7-slim

[ https://issues.apache.org/jira/browse/SPARK-52015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52015: --- Labels: pull-request-available (was: ) > Update OracleDatabaseOnDocker Docker Image Tag to

[jira] [Resolved] (SPARK-51182) DataFrameWriter should throw dataPathNotSpecifiedError when path is not specified

[ https://issues.apache.org/jira/browse/SPARK-51182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51182. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49928 [https://gith

[jira] [Created] (SPARK-52015) Update OracleDatabaseOnDocker Docker Image Tag to oracle-free:23.7-slim

Luca Canali created SPARK-52015: --- Summary: Update OracleDatabaseOnDocker Docker Image Tag to oracle-free:23.7-slim Key: SPARK-52015 URL: https://issues.apache.org/jira/browse/SPARK-52015 Project: Spark

[jira] [Assigned] (SPARK-51182) DataFrameWriter should throw dataPathNotSpecifiedError when path is not specified

[ https://issues.apache.org/jira/browse/SPARK-51182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51182: --- Assignee: Vlad Rozov > DataFrameWriter should throw dataPathNotSpecifiedError when path is

[jira] [Reopened] (SPARK-51905) Disallow NOT ENFORCED CHECK constraint

[ https://issues.apache.org/jira/browse/SPARK-51905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reopened SPARK-51905: -- Assignee: (was: Gengliang Wang) > Disallow NOT ENFORCED CHECK constraint > -

[jira] [Updated] (SPARK-51905) Disallow NOT ENFORCED CHECK constraint

[ https://issues.apache.org/jira/browse/SPARK-51905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-51905: - Fix Version/s: (was: 4.1.0) > Disallow NOT ENFORCED CHECK constraint > -

[jira] [Updated] (SPARK-52014) Support FoldableUnevaluable in HiveGenericUDFEvaluator

[ https://issues.apache.org/jira/browse/SPARK-52014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52014: --- Labels: pull-request-available (was: ) > Support FoldableUnevaluable in HiveGenericUDFEvalu

[jira] [Created] (SPARK-52014) Support FoldableUnevaluable in HiveGenericUDFEvaluator

Wan Kun created SPARK-52014: --- Summary: Support FoldableUnevaluable in HiveGenericUDFEvaluator Key: SPARK-52014 URL: https://issues.apache.org/jira/browse/SPARK-52014 Project: Spark Issue Type: Task