[jira] [Updated] (SPARK-50515) Add explicit read-only access API to conf in SparkContext

2024-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50515: --- Labels: pull-request-available (was: ) > Add explicit read-only access API to conf in Spark

[jira] [Updated] (SPARK-50517) Group arrow function related tests

2024-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50517: --- Labels: pull-request-available (was: ) > Group arrow function related tests > -

[jira] [Created] (SPARK-50517) Group arrow function related tests

2024-12-06 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50517: - Summary: Group arrow function related tests Key: SPARK-50517 URL: https://issues.apache.org/jira/browse/SPARK-50517 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-50476) Unable to run custom PDF Data Source on Databricks

2024-12-06 Thread Mykola Melnyk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903798#comment-17903798 ] Mykola Melnyk commented on SPARK-50476: --- Hello [~Gengliang.Wang] Thank you for th

[jira] [Resolved] (SPARK-50512) Fix `CREATE TABLE` syntax in `sql-pipe-syntax.md`

2024-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50512. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49096 [https://

[jira] [Assigned] (SPARK-50512) Fix `CREATE TABLE` syntax in `sql-pipe-syntax.md`

2024-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50512: - Assignee: Dongjoon Hyun > Fix `CREATE TABLE` syntax in `sql-pipe-syntax.md` > -

[jira] [Resolved] (SPARK-50514) Add `IDENTIFIER clause` page to `menu-sql.yaml`

2024-12-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-50514. -- Fix Version/s: 3.5.4 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-50514) Add `IDENTIFIER clause` page to `menu-sql.yaml`

2024-12-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-50514: Assignee: Dongjoon Hyun > Add `IDENTIFIER clause` page to `menu-sql.yaml` > -

[jira] [Comment Edited] (SPARK-50476) Unable to run custom PDF Data Source on Databricks

2024-12-06 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903772#comment-17903772 ] Gengliang Wang edited comment on SPARK-50476 at 12/7/24 12:10 AM:

[jira] [Closed] (SPARK-50308) Add .sql file testing to check equality of SQL pipe queries and many regular SQL queries

2024-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-50308. - As reported in the above, this was included by other Jira issues. > Add .sql file testing to check

[jira] [Updated] (SPARK-50516) Fix assert in test for init state metrics

2024-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50516: --- Labels: pull-request-available (was: ) > Fix assert in test for init state metrics > --

[jira] [Updated] (SPARK-50308) Add .sql file testing to check equality of SQL pipe queries and many regular SQL queries

2024-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50308: -- Component/s: Tests > Add .sql file testing to check equality of SQL pipe queries and many regu

[jira] [Assigned] (SPARK-50308) Add .sql file testing to check equality of SQL pipe queries and many regular SQL queries

2024-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50308: - Assignee: Daniel > Add .sql file testing to check equality of SQL pipe queries and many

[jira] [Updated] (SPARK-49122) Add addArtifact API to the Spark SQL Core

2024-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49122: -- Parent: SPARK-44111 Issue Type: Sub-task (was: New Feature) > Add addArtifact API to

[jira] [Created] (SPARK-50516) Fix assert in test for init state metrics

2024-12-06 Thread Anish Shrigondekar (Jira)
Anish Shrigondekar created SPARK-50516: -- Summary: Fix assert in test for init state metrics Key: SPARK-50516 URL: https://issues.apache.org/jira/browse/SPARK-50516 Project: Spark Issue T

[jira] [Created] (SPARK-50515) Add explicit read-only access API to conf in SparkContext

2024-12-06 Thread Prashanth Menon (Jira)
Prashanth Menon created SPARK-50515: --- Summary: Add explicit read-only access API to conf in SparkContext Key: SPARK-50515 URL: https://issues.apache.org/jira/browse/SPARK-50515 Project: Spark

[jira] [Updated] (SPARK-50483) BlockMissingException should be thrown even if ignoreCorruptFiles is enabled

2024-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50483: -- Target Version/s: (was: 4.0.0) > BlockMissingException should be thrown even if ignoreCorrup

[jira] [Resolved] (SPARK-50483) BlockMissingException should be thrown even if ignoreCorruptFiles is enabled

2024-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50483. --- Fix Version/s: 4.0.0 Target Version/s: 4.0.0 Assignee: Yuming Wang

[jira] [Resolved] (SPARK-50350) Avro: add new function `schema_of_avro`

2024-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50350. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48889 [https://

[jira] [Updated] (SPARK-50513) Split encoder implicits and add helper for stateful processor interface

2024-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50513: --- Labels: pull-request-available (was: ) > Split encoder implicits and add helper for statefu

[jira] [Updated] (SPARK-50483) BlockMissingException should be thrown even if ignoreCorruptFiles is enabled

2024-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50483: -- Issue Type: Bug (was: Improvement) > BlockMissingException should be thrown even if ignoreCor

[jira] [Updated] (SPARK-50514) Add `IDENTIFIER clause` page to `menu-sql.yaml`

2024-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50514: --- Labels: pull-request-available (was: ) > Add `IDENTIFIER clause` page to `menu-sql.yaml` >

[jira] [Created] (SPARK-50514) Add `IDENTIFIER clause` page to `menu-sql.yaml`

2024-12-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50514: - Summary: Add `IDENTIFIER clause` page to `menu-sql.yaml` Key: SPARK-50514 URL: https://issues.apache.org/jira/browse/SPARK-50514 Project: Spark Issue Type:

[jira] [Updated] (SPARK-50512) Fix `CREATE TABLE` syntax in `sql-pipe-syntax.md`

2024-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50512: --- Labels: pull-request-available (was: ) > Fix `CREATE TABLE` syntax in `sql-pipe-syntax.md`

[jira] [Created] (SPARK-50512) Fix `CREATE TABLE` syntax in `sql-pipe-syntax.md`

2024-12-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50512: - Summary: Fix `CREATE TABLE` syntax in `sql-pipe-syntax.md` Key: SPARK-50512 URL: https://issues.apache.org/jira/browse/SPARK-50512 Project: Spark Issue Typ

[jira] [Commented] (SPARK-50421) Executor memory config is incorrect when multiple stage level resource profiles works

2024-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903717#comment-17903717 ] Dongjoon Hyun commented on SPARK-50421: --- This is backported to branch-3.5 via the

[jira] [Updated] (SPARK-50421) Executor memory config is incorrect when multiple stage level resource profiles works

2024-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50421: -- Fix Version/s: 3.5.4 > Executor memory config is incorrect when multiple stage level resource

[jira] [Updated] (SPARK-50356) Skipped stages are inconsitent on UI

2024-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50356: --- Labels: pull-request-available (was: ) > Skipped stages are inconsitent on UI > ---

[jira] [Updated] (SPARK-50511) Avoid wrapping Python data source error messages thrown during planning

2024-12-06 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-50511: - Summary: Avoid wrapping Python data source error messages thrown during planning (was: Improve

[jira] [Updated] (SPARK-50511) Avoid wrapping Python data source error messages thrown during planning

2024-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50511: --- Labels: pull-request-available (was: ) > Avoid wrapping Python data source error messages t

[jira] [Created] (SPARK-50511) Improve Python data source error thrown during planning

2024-12-06 Thread Allison Wang (Jira)
Allison Wang created SPARK-50511: Summary: Improve Python data source error thrown during planning Key: SPARK-50511 URL: https://issues.apache.org/jira/browse/SPARK-50511 Project: Spark Issue

[jira] [Assigned] (SPARK-50478) Fix collated string matching

2024-12-06 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-50478: Assignee: Jovan Markovic > Fix collated string matching > > >

[jira] [Resolved] (SPARK-50478) Fix collated string matching

2024-12-06 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50478. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49043 [https://github.com

[jira] [Updated] (SPARK-50483) BlockMissingException should be thrown even if ignoreCorruptFiles is enabled

2024-12-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-50483: Summary: BlockMissingException should be thrown even if ignoreCorruptFiles is enabled (was: Still

[jira] [Created] (SPARK-50510) [3.5] Sporadic ReattachableExecuteSuite failure

2024-12-06 Thread Changgyoo Park (Jira)
Changgyoo Park created SPARK-50510: -- Summary: [3.5] Sporadic ReattachableExecuteSuite failure Key: SPARK-50510 URL: https://issues.apache.org/jira/browse/SPARK-50510 Project: Spark Issue Typ

[jira] [Updated] (SPARK-50483) Still throwing BlockMissingException even with ignoreCorruptFiles enabled

2024-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50483: --- Labels: pull-request-available (was: ) > Still throwing BlockMissingException even with ign