[jira] [Resolved] (SPARK-50409) Fix set statement to ignore `;` at the end of `SET;`, `SET -v;` and `SET key;`

2024-12-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50409. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48951 [https://gith

[jira] [Assigned] (SPARK-50409) Fix set statement to ignore `;` at the end of `SET;`, `SET -v;` and `SET key;`

2024-12-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50409: --- Assignee: Mihailo Milosevic > Fix set statement to ignore `;` at the end of `SET;`, `SET -v

[jira] [Created] (SPARK-50667) Make jinja2 optional in PySpark Tests

2024-12-24 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50667: - Summary: Make jinja2 optional in PySpark Tests Key: SPARK-50667 URL: https://issues.apache.org/jira/browse/SPARK-50667 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-50667) Make jinja2 optional in PySpark Tests

2024-12-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50667: --- Labels: pull-request-available (was: ) > Make jinja2 optional in PySpark Tests > --

[jira] [Resolved] (SPARK-50659) Refactor Union computation out to reuse it in the single-pass Analyzer

2024-12-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50659. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49284 [https://gith

[jira] [Assigned] (SPARK-50659) Refactor Union computation out to reuse it in the single-pass Analyzer

2024-12-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50659: --- Assignee: Vladimir Golubev > Refactor Union computation out to reuse it in the single-pass

[jira] [Commented] (SPARK-50666) DataFrameReader supporting SQL hint

2024-12-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17908137#comment-17908137 ] Yuming Wang commented on SPARK-50666: - Could you give an example? > DataFrameReader

[jira] [Commented] (SPARK-50666) DataFrameReader supporting SQL hint

2024-12-24 Thread Shaojie Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17908135#comment-17908135 ] Shaojie Wu commented on SPARK-50666: FYI, [~yumwang]  > DataFrameReader supporting

[jira] [Created] (SPARK-50666) DataFrameReader supporting SQL hint

2024-12-24 Thread Shaojie Wu (Jira)
Shaojie Wu created SPARK-50666: -- Summary: DataFrameReader supporting SQL hint Key: SPARK-50666 URL: https://issues.apache.org/jira/browse/SPARK-50666 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-50665) Substitute LocalRelation with ComparableLocalRelation in NormalizePlan

2024-12-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50665: --- Labels: pull-request-available (was: ) > Substitute LocalRelation with ComparableLocalRelat

[jira] [Created] (SPARK-50665) Substitute LocalRelation with ComparableLocalRelation in NormalizePlan

2024-12-24 Thread Vladimir Golubev (Jira)
Vladimir Golubev created SPARK-50665: Summary: Substitute LocalRelation with ComparableLocalRelation in NormalizePlan Key: SPARK-50665 URL: https://issues.apache.org/jira/browse/SPARK-50665 Projec

[jira] [Commented] (SPARK-50547) Provide spark docker images based on ubi-minimal

2024-12-24 Thread Yaniv Kunda (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17908120#comment-17908120 ] Yaniv Kunda commented on SPARK-50547: - If this gets triaged and approved, I can cont

[jira] [Updated] (SPARK-50547) Provide spark docker images based on ubi-minimal

2024-12-24 Thread Yaniv Kunda (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Kunda updated SPARK-50547: Affects Version/s: 3.5.4 (was: 3.5.3) > Provide spark docker images bas

[jira] [Commented] (SPARK-50662) Support ampersand in spark-submit for windows

2024-12-24 Thread Noam Arye Nassi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17908096#comment-17908096 ] Noam Arye Nassi commented on SPARK-50662: - PR: [[SPARK-50662][PYTHON][WINDOWS] E

[jira] [Updated] (SPARK-50662) Support ampersand in spark-submit for windows

2024-12-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50662: --- Labels: pull-request-available (was: ) > Support ampersand in spark-submit for windows > --

[jira] [Created] (SPARK-50664) [M1] Create new exception for EXECUTE IMMEDIATE

2024-12-24 Thread David Milicevic (Jira)
David Milicevic created SPARK-50664: --- Summary: [M1] Create new exception for EXECUTE IMMEDIATE Key: SPARK-50664 URL: https://issues.apache.org/jira/browse/SPARK-50664 Project: Spark Issue T

[jira] [Updated] (SPARK-50663) [M1] ELSEIF fix

2024-12-24 Thread David Milicevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic updated SPARK-50663: Description: By standard keyword for ELSE-IF clause in SQL grammar is ` {code:java} ELSEIF

[jira] [Created] (SPARK-50663) [M1] ELSEIF fix

2024-12-24 Thread David Milicevic (Jira)
David Milicevic created SPARK-50663: --- Summary: [M1] ELSEIF fix Key: SPARK-50663 URL: https://issues.apache.org/jira/browse/SPARK-50663 Project: Spark Issue Type: Sub-task Componen

[jira] [Created] (SPARK-50662) Support ampersand in spark-submit for windows

2024-12-24 Thread Noam Arye Nassi (Jira)
Noam Arye Nassi created SPARK-50662: --- Summary: Support ampersand in spark-submit for windows Key: SPARK-50662 URL: https://issues.apache.org/jira/browse/SPARK-50662 Project: Spark Issue Typ

[jira] [Created] (SPARK-50661) Scala Streaming foreachBatch doesn't work for input type Dataset[T] due to missing encoder for T.

2024-12-24 Thread Haiyang Sun (Jira)
Haiyang Sun created SPARK-50661: --- Summary: Scala Streaming foreachBatch doesn't work for input type Dataset[T] due to missing encoder for T. Key: SPARK-50661 URL: https://issues.apache.org/jira/browse/SPARK-50661

[jira] [Commented] (SPARK-49088) Remove ignoreNulls from UnresolvedFunction and Analyzer

2024-12-24 Thread Pengfei Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17908069#comment-17908069 ] Pengfei Xu commented on SPARK-49088: I wonder if we should remove it from Unresolved

[jira] [Created] (SPARK-50660) Move Union-related errors to QueryCompilationErrors

2024-12-24 Thread Vladimir Golubev (Jira)
Vladimir Golubev created SPARK-50660: Summary: Move Union-related errors to QueryCompilationErrors Key: SPARK-50660 URL: https://issues.apache.org/jira/browse/SPARK-50660 Project: Spark I

[jira] [Updated] (SPARK-50659) Refactor Union computation out to reuse it in the single-pass Analyzer

2024-12-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50659: --- Labels: pull-request-available (was: ) > Refactor Union computation out to reuse it in the

[jira] [Created] (SPARK-50659) Refactor Union computation out to reuse it in the single-pass Analyzer

2024-12-24 Thread Vladimir Golubev (Jira)
Vladimir Golubev created SPARK-50659: Summary: Refactor Union computation out to reuse it in the single-pass Analyzer Key: SPARK-50659 URL: https://issues.apache.org/jira/browse/SPARK-50659 Projec

[jira] [Commented] (SPARK-49088) Remove ignoreNulls from UnresolvedFunction and Analyzer

2024-12-24 Thread Pengfei Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17908049#comment-17908049 ] Pengfei Xu commented on SPARK-49088: Starting on this one. > Remove ignoreNulls fro

[jira] [Created] (SPARK-50658) Move all Connect invocations of system.internal function to the proper namespace (PySpark)

2024-12-24 Thread Pengfei Xu (Jira)
Pengfei Xu created SPARK-50658: -- Summary: Move all Connect invocations of system.internal function to the proper namespace (PySpark) Key: SPARK-50658 URL: https://issues.apache.org/jira/browse/SPARK-50658

[jira] [Updated] (SPARK-50657) Upgrade the minimum version of `pyarrow` to 11.0.0

2024-12-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50657: --- Labels: pull-request-available (was: ) > Upgrade the minimum version of `pyarrow` to 11.0.0

[jira] [Created] (SPARK-50657) Upgrade the minimum version of `pyarrow` to 11.0.0

2024-12-24 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50657: - Summary: Upgrade the minimum version of `pyarrow` to 11.0.0 Key: SPARK-50657 URL: https://issues.apache.org/jira/browse/SPARK-50657 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-50647) Add a daily build for PySpark with old dependencies

2024-12-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50647: -- Assignee: Apache Spark > Add a daily build for PySpark with old dependencies > --

[jira] [Assigned] (SPARK-50647) Add a daily build for PySpark with old dependencies

2024-12-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50647: -- Assignee: (was: Apache Spark) > Add a daily build for PySpark with old dependenci

[jira] [Updated] (SPARK-50656) JDBC Reader Fails to Handle Complex Types (Array, Map) from Trino

2024-12-24 Thread Narayan Bhawar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narayan Bhawar updated SPARK-50656: --- Description: {*}Description{*}: I am encountering an issue when using Spark to read data fr