[jira] [Created] (SPARK-50751) Assign appropriate error condition for _LEGACY_ERROR_TEMP_1305: UNSUPPORTED_TABLE_CHANGE_IN_JDBC_CATALOG

2025-01-06 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-50751: --- Summary: Assign appropriate error condition for _LEGACY_ERROR_TEMP_1305: UNSUPPORTED_TABLE_CHANGE_IN_JDBC_CATALOG Key: SPARK-50751 URL: https://issues.apache.org/jira/browse/SPARK-5

[jira] [Created] (SPARK-50750) Improve masking rule for object hash in sql test results

2025-01-06 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-50750: - Summary: Improve masking rule for object hash in sql test results Key: SPARK-50750 URL: https://issues.apache.org/jira/browse/SPARK-50750 Project: Spark Issue Type

[jira] [Resolved] (SPARK-50746) Replace Either with VariantPathSegment

2025-01-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50746. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49385 [https://gith

[jira] [Updated] (SPARK-50749) Fix ordering bug in CommutativeExpression.gatherCommutative method

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50749: --- Labels: pull-request-available (was: ) > Fix ordering bug in CommutativeExpression.gatherCo

[jira] [Updated] (SPARK-50749) Fix ordering bug in CommutativeExpression.gatherCommutative method

2025-01-06 Thread Utkarsh Agarwal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Utkarsh Agarwal updated SPARK-50749: Description: SPARK-49977 introduced a bug in the `CommutativeExpression.gatherCommutative(

[jira] [Created] (SPARK-50749) Fix ordering bug in CommutativeExpression.gatherCommutative method

2025-01-06 Thread Utkarsh Agarwal (Jira)
Utkarsh Agarwal created SPARK-50749: --- Summary: Fix ordering bug in CommutativeExpression.gatherCommutative method Key: SPARK-50749 URL: https://issues.apache.org/jira/browse/SPARK-50749 Project: Spa

[jira] [Updated] (SPARK-46683) Write a subquery generator that generates subqueries of different variations to increase testing coverage in this area

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46683: -- Component/s: Tests > Write a subquery generator that generates subqueries of different variati

[jira] [Updated] (SPARK-46683) Write a subquery generator that generates subqueries of different variations to increase testing coverage in this area

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46683: -- Labels: (was: correctness pull-request-available testing) > Write a subquery generator that

[jira] [Updated] (SPARK-46683) Write a subquery generator that generates subqueries of different variations to increase testing coverage in this area

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46683: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Write a subquery generator tha

[jira] [Created] (SPARK-50748) Fix a flaky test: `SparkSessionE2ESuiteinterrupt all - background queries, foreground interrupt`

2025-01-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50748: - Summary: Fix a flaky test: `SparkSessionE2ESuiteinterrupt all - background queries, foreground interrupt` Key: SPARK-50748 URL: https://issues.apache.org/jira/browse/SPARK-50748

[jira] [Resolved] (SPARK-50744) Add a CTE-related test case involving view name resolution precedence

2025-01-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50744. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49378 [https://gith

[jira] [Assigned] (SPARK-50744) Add a CTE-related test case involving view name resolution precedence

2025-01-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50744: --- Assignee: Vladimir Golubev > Add a CTE-related test case involving view name resolution pre

[jira] [Updated] (SPARK-50332) migrate kafka consumer offset information in spark to new MSK cluster

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50332: -- Parent: (was: SPARK-44111) Issue Type: Improvement (was: Sub-task) > migrate kafk

[jira] [Updated] (SPARK-50332) migrate kafka consumer offset information in spark to new MSK cluster

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50332: -- Affects Version/s: (was: 3.5.2) > migrate kafka consumer offset information in spark to ne

[jira] [Updated] (SPARK-50332) migrate kafka consumer offset information in spark to new MSK cluster

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50332: -- Target Version/s: (was: 4.0.0) > migrate kafka consumer offset information in spark to new M

[jira] [Updated] (SPARK-50332) migrate kafka consumer offset information in spark to new MSK cluster

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50332: -- Priority: Major (was: Blocker) > migrate kafka consumer offset information in spark to new MS

[jira] [Resolved] (SPARK-49783) Resource leak of spark yarn allocator

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49783. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48238 [https://

[jira] [Updated] (SPARK-49783) Resource leak of spark yarn allocator

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49783: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Resource leak of spark yarn all

[jira] [Assigned] (SPARK-49783) Resource leak of spark yarn allocator

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49783: - Assignee: Junfan Zhang > Resource leak of spark yarn allocator > --

[jira] [Created] (SPARK-50747) Fix `DockerJDBCIntegrationSuite` to retry `startContainerCmd` in case of `InternalServerErrorException`

2025-01-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50747: - Summary: Fix `DockerJDBCIntegrationSuite` to retry `startContainerCmd` in case of `InternalServerErrorException` Key: SPARK-50747 URL: https://issues.apache.org/jira/browse/SPAR

[jira] [Updated] (SPARK-50747) Fix `DockerJDBCIntegrationSuite` to retry `startContainerCmd` in case of `InternalServerErrorException`

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50747: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Fix `DockerJDBCIntegrationSuit

[jira] [Assigned] (SPARK-50747) Fix `DockerJDBCIntegrationSuite` to retry `startContainerCmd` in case of `InternalServerErrorException`

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50747: - Assignee: Dongjoon Hyun > Fix `DockerJDBCIntegrationSuite` to retry `startContainerCmd`

[jira] [Updated] (SPARK-50747) Fix `DockerJDBCIntegrationSuite` to retry `startContainerCmd` in case of `InternalServerErrorException`

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50747: --- Labels: pull-request-available (was: ) > Fix `DockerJDBCIntegrationSuite` to retry `startCo

[jira] [Updated] (SPARK-50734) Add catalog API for creating and registering SQL UDFs

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50734: --- Labels: pull-request-available (was: ) > Add catalog API for creating and registering SQL U

[jira] [Assigned] (SPARK-48730) Implement CreateSQLFunctionCommand for SQL Scalar and Table Functions

2025-01-06 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang reassigned SPARK-48730: Assignee: Allison Wang > Implement CreateSQLFunctionCommand for SQL Scalar and Table Func

[jira] [Resolved] (SPARK-48730) Implement CreateSQLFunctionCommand for SQL Scalar and Table Functions

2025-01-06 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved SPARK-48730. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49126 [https://gi

[jira] [Updated] (SPARK-50392) Support DataFrame conversion to table argument in Spark Classic

2025-01-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-50392: - Summary: Support DataFrame conversion to table argument in Spark Classic (was: Support named ar

[jira] [Updated] (SPARK-50391) Support DataFrame conversion to table argument

2025-01-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-50391: - Summary: Support DataFrame conversion to table argument (was: Support DataFrame conversion to t

[jira] [Updated] (SPARK-50391) Support DataFrame conversion to table argument in Spark Classic

2025-01-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-50391: - Summary: Support DataFrame conversion to table argument in Spark Classic (was: DataFrame conver

[jira] [Resolved] (SPARK-50392) Support named argument with df.asTable

2025-01-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-50392. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49055 [https://gi

[jira] [Assigned] (SPARK-50392) Support named argument with df.asTable

2025-01-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-50392: Assignee: Xinrong Meng > Support named argument with df.asTable > ---

[jira] [Commented] (SPARK-48492) batch-read parquet files written by streaming returns non-nullable fields in schema

2025-01-06 Thread Vlad Rozov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17910462#comment-17910462 ] Vlad Rozov commented on SPARK-48492: Taking a look > batch-read parquet files writt

[jira] [Resolved] (SPARK-50742) Remove `spark.hadoop.fs.s3a.connection.establish.timeout` setting

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50742. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49376 [https://

[jira] [Assigned] (SPARK-39903) Reenable TPC-DS q72 in GitHub Actions

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39903: - Assignee: Hyukjin Kwon > Reenable TPC-DS q72 in GitHub Actions > --

[jira] [Assigned] (SPARK-39903) Reenable TPC-DS q72 in GitHub Actions

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39903: - Assignee: Dongjoon Hyun (was: Hyukjin Kwon) > Reenable TPC-DS q72 in GitHub Actions >

[jira] [Updated] (SPARK-39903) Reenable TPC-DS q72 in GitHub Actions

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39903: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Reenable TPC-DS q72 in GitHub

[jira] [Resolved] (SPARK-39903) Reenable TPC-DS q72 in GitHub Actions

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39903. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49382 [https://

[jira] [Resolved] (SPARK-50745) Use `eventually` in `BufferHolderSparkSubmitSuite`

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50745. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49380 [https://

[jira] [Resolved] (SPARK-50741) Upgrade `zstd-jni` to 1.5.6-9

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50741. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49375 [https://

[jira] [Updated] (SPARK-50654) CommitMetadata should set stateUniqueIds to None in V1

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50654: --- Labels: pull-request-available (was: ) > CommitMetadata should set stateUniqueIds to None i

[jira] [Updated] (SPARK-50746) Replace Either with VariantPathSegment

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50746: --- Labels: pull-request-available (was: ) > Replace Either with VariantPathSegment > -

[jira] [Created] (SPARK-50746) Replace Either with VariantPathSegment

2025-01-06 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-50746: -- Summary: Replace Either with VariantPathSegment Key: SPARK-50746 URL: https://issues.apache.org/jira/browse/SPARK-50746 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-39903) Reenable TPC-DS q72 in GitHub Actions

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-39903: --- Labels: pull-request-available (was: ) > Reenable TPC-DS q72 in GitHub Actions > --

[jira] [Resolved] (SPARK-50694) Support renames in subqueries

2025-01-06 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-50694. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49336 [https://

[jira] [Assigned] (SPARK-50694) Support renames in subqueries

2025-01-06 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-50694: - Assignee: Takuya Ueshin > Support renames in subqueries > -

[jira] [Updated] (SPARK-50745) Use `eventually` in `BufferHolderSparkSubmitSuite`

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50745: --- Labels: pull-request-available (was: ) > Use `eventually` in `BufferHolderSparkSubmitSuite`

[jira] [Assigned] (SPARK-50745) Use `eventually` in `BufferHolderSparkSubmitSuite`

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50745: - Assignee: Dongjoon Hyun > Use `eventually` in `BufferHolderSparkSubmitSuite` >

[jira] [Updated] (SPARK-50745) Use `eventually` in `BufferHolderSparkSubmitSuite`

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50745: -- Summary: Use `eventually` in `BufferHolderSparkSubmitSuite` (was: Use `eventually` in BufferH

[jira] [Created] (SPARK-50745) Use `eventually` in BufferHolderSparkSubmitSuite

2025-01-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50745: - Summary: Use `eventually` in BufferHolderSparkSubmitSuite Key: SPARK-50745 URL: https://issues.apache.org/jira/browse/SPARK-50745 Project: Spark Issue Type

[jira] [Updated] (SPARK-50744) Add a CTE-related test case involving view name resolution precedence

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50744: --- Labels: pull-request-available (was: ) > Add a CTE-related test case involving view name re

[jira] [Updated] (SPARK-50742) Remove `spark.hadoop.fs.s3a.connection.establish.timeout` setting

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50742: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Remove `spark.hadoop.fs.s3a.co

[jira] [Created] (SPARK-50744) Add a CTE-related test case involving view name resolution precedence

2025-01-06 Thread Vladimir Golubev (Jira)
Vladimir Golubev created SPARK-50744: Summary: Add a CTE-related test case involving view name resolution precedence Key: SPARK-50744 URL: https://issues.apache.org/jira/browse/SPARK-50744 Project

[jira] [Assigned] (SPARK-50742) Remove `spark.hadoop.fs.s3a.connection.establish.timeout` setting

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50742: - Assignee: Dongjoon Hyun > Remove `spark.hadoop.fs.s3a.connection.establish.timeout` set

[jira] [Updated] (SPARK-50743) Normalize CTERelationDef and CTERelationRef IDs

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50743: --- Labels: pull-request-available (was: ) > Normalize CTERelationDef and CTERelationRef IDs >

[jira] [Created] (SPARK-50743) Normalize CTERelationDef and CTERelationRef IDs

2025-01-06 Thread Vladimir Golubev (Jira)
Vladimir Golubev created SPARK-50743: Summary: Normalize CTERelationDef and CTERelationRef IDs Key: SPARK-50743 URL: https://issues.apache.org/jira/browse/SPARK-50743 Project: Spark Issue

[jira] [Updated] (SPARK-50742) Remove `spark.hadoop.fs.s3a.connection.establish.timeout` setting

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50742: --- Labels: pull-request-available (was: ) > Remove `spark.hadoop.fs.s3a.connection.establish.t

[jira] [Created] (SPARK-50742) Remove `spark.hadoop.fs.s3a.connection.establish.timeout` setting

2025-01-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50742: - Summary: Remove `spark.hadoop.fs.s3a.connection.establish.timeout` setting Key: SPARK-50742 URL: https://issues.apache.org/jira/browse/SPARK-50742 Project: Spark

[jira] [Updated] (SPARK-50741) Upgrade `zstd-jni` to 1.5.6-9

2025-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50741: -- Summary: Upgrade `zstd-jni` to 1.5.6-9 (was: Upgrade zstd-jni to 1.5.6-9) > Upgrade `zstd-jni

[jira] [Updated] (SPARK-50741) Upgrade zstd-jni to 1.5.6-9

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50741: --- Labels: pull-request-available (was: ) > Upgrade zstd-jni to 1.5.6-9 >

[jira] [Created] (SPARK-50741) Upgrade zstd-jni to 1.5.6-9

2025-01-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50741: - Summary: Upgrade zstd-jni to 1.5.6-9 Key: SPARK-50741 URL: https://issues.apache.org/jira/browse/SPARK-50741 Project: Spark Issue Type: Bug Compo

[jira] [Updated] (SPARK-49273) Add support for Origin in Scala Client

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49273: --- Labels: pull-request-available (was: ) > Add support for Origin in Scala Client > -

[jira] [Commented] (SPARK-50654) CommitMetadata should set stateUniqueIds to None in V1

2025-01-06 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17910304#comment-17910304 ] Hudson commented on SPARK-50654: User 'WweiL' has created a pull request for this issue:

[jira] [Resolved] (SPARK-50736) Enable testing module `pyspark-logger`

2025-01-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50736. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49367 [https://

[jira] [Created] (SPARK-50740) Addition of InsertLoops to replace recursive Union with UnionLoop and CTERelationRef referencing itself with UnionLoopRef

2025-01-06 Thread Milan Cupac (Jira)
Milan Cupac created SPARK-50740: --- Summary: Addition of InsertLoops to replace recursive Union with UnionLoop and CTERelationRef referencing itself with UnionLoopRef Key: SPARK-50740 URL: https://issues.apache.org/ji

[jira] [Updated] (SPARK-50735) Infinite lifetime of a query after an exception in ExecuteResponseObserver

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50735: --- Labels: pull-request-available (was: ) > Infinite lifetime of a query after an exception in

[jira] [Created] (SPARK-50739) Changes in ResolveWithCTE.scala to have the analyzer grok recursive anchors

2025-01-06 Thread Milan Cupac (Jira)
Milan Cupac created SPARK-50739: --- Summary: Changes in ResolveWithCTE.scala to have the analyzer grok recursive anchors Key: SPARK-50739 URL: https://issues.apache.org/jira/browse/SPARK-50739 Project: Sp

[jira] [Resolved] (SPARK-50708) Delete Artifact resources on GC of instance

2025-01-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50708. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49341 [https://gi

[jira] [Resolved] (SPARK-50738) Upgrade black to 23.12.1

2025-01-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50738. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49369 [https://gi

[jira] [Commented] (SPARK-50656) JDBC Reader Fails to Handle Complex Types (Array, Map) from Trino

2025-01-06 Thread Narayan Bhawar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17910081#comment-17910081 ] Narayan Bhawar commented on SPARK-50656: Any updates on this > JDBC Reader Fail

[jira] [Created] (SPARK-50738) Upgrade black to 23.12.1

2025-01-06 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-50738: Summary: Upgrade black to 23.12.1 Key: SPARK-50738 URL: https://issues.apache.org/jira/browse/SPARK-50738 Project: Spark Issue Type: Improvement Co

[jira] [Updated] (SPARK-50738) Upgrade black to 23.12.1

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50738: --- Labels: pull-request-available (was: ) > Upgrade black to 23.12.1 > ---

[jira] [Created] (SPARK-50737) Plans for Integrating HMS 4.0 `_req` Methods in Apache Spark

2025-01-06 Thread Anurag Kumar Dwivedi (Jira)
Anurag Kumar Dwivedi created SPARK-50737: Summary: Plans for Integrating HMS 4.0 `_req` Methods in Apache Spark Key: SPARK-50737 URL: https://issues.apache.org/jira/browse/SPARK-50737 Project:

[jira] [Assigned] (SPARK-50736) Enable testing module `pyspark-logger`

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50736: -- Assignee: Apache Spark > Enable testing module `pyspark-logger` > ---

[jira] [Updated] (SPARK-50736) Enable testing module `pyspark-logger`

2025-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50736: --- Labels: pull-request-available (was: ) > Enable testing module `pyspark-logger` > -

[jira] [Created] (SPARK-50736) Enable testing module `pyspark-logger`

2025-01-06 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50736: - Summary: Enable testing module `pyspark-logger` Key: SPARK-50736 URL: https://issues.apache.org/jira/browse/SPARK-50736 Project: Spark Issue Type: Improvem

[jira] [Commented] (SPARK-50735) Infinite lifetime of a query after an exception in ExecuteResponseObserver

2025-01-06 Thread Changgyoo Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17910052#comment-17910052 ] Changgyoo Park commented on SPARK-50735: Possible solution. * When reattaching,

[jira] [Created] (SPARK-50735) Infinite lifetime of a query after an exception in ExecuteResponseObserver

2025-01-06 Thread Changgyoo Park (Jira)
Changgyoo Park created SPARK-50735: -- Summary: Infinite lifetime of a query after an exception in ExecuteResponseObserver Key: SPARK-50735 URL: https://issues.apache.org/jira/browse/SPARK-50735 Projec

[jira] [Assigned] (SPARK-50671) Error compiling spark-protobuf module using user-defined protoc

2025-01-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-50671: Assignee: morvenhuang > Error compiling spark-protobuf module using user-defined protoc > ---

[jira] [Resolved] (SPARK-50671) Error compiling spark-protobuf module using user-defined protoc

2025-01-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-50671. -- Resolution: Fixed Issue resolved by pull request 49296 [https://github.com/apache/spark/pull/49296] >