[jira] [Updated] (SPARK-46543) json_tuple throw PySparkValueError for empty fields

2023-12-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46543: --- Labels: pull-request-available (was: ) > json_tuple throw PySparkValueError for empty

[jira] [Created] (SPARK-46543) json_tuple throw PySparkValueError for empty fields

2023-12-28 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46543: - Summary: json_tuple throw PySparkValueError for empty fields Key: SPARK-46543 URL: https://issues.apache.org/jira/browse/SPARK-46543 Project: Spark Issue

[jira] [Updated] (SPARK-46542) Remove the check for `c>=0` from `ExternalCatalogUtils#needsEscaping`

2023-12-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46542: --- Labels: pull-request-available (was: ) > Remove the check for `c>=0` from

[jira] [Created] (SPARK-46542) Remove the check for `c>=0` from `ExternalCatalogUtils#needsEscaping`

2023-12-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-46542: Summary: Remove the check for `c>=0` from `ExternalCatalogUtils#needsEscaping` Key: SPARK-46542 URL: https://issues.apache.org/jira/browse/SPARK-46542 Project: Spark

[jira] [Resolved] (SPARK-45914) Support `commit` and `abort` API for Python data source write

2023-12-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45914. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44497

[jira] [Assigned] (SPARK-45914) Support `commit` and `abort` API for Python data source write

2023-12-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45914: Assignee: Allison Wang > Support `commit` and `abort` API for Python data source write >

[jira] [Resolved] (SPARK-46397) sha2(df.a, 1024) throws a different exception in Spark Connect

2023-12-28 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46397. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44529

[jira] [Assigned] (SPARK-46533) Refine docstring of `array_min/array_max/array_size/array_repeat`

2023-12-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46533: Assignee: Yang Jie > Refine docstring of `array_min/array_max/array_size/array_repeat` >

[jira] [Resolved] (SPARK-46533) Refine docstring of `array_min/array_max/array_size/array_repeat`

2023-12-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46533. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44522

[jira] [Updated] (SPARK-46449) Add ability to create databases via Catalog API

2023-12-28 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46449: - Description: As of Spark 3.5, the only way to create a database is via SQL. The Catalog

[jira] [Updated] (SPARK-46540) Respect column names when Python data source read function outputs named Row objects

2023-12-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46540: --- Labels: pull-request-available (was: ) > Respect column names when Python data source read

[jira] [Updated] (SPARK-46540) Respect column names when Python data source read function outputs named Row objects

2023-12-28 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-46540: - Summary: Respect column names when Python data source read function outputs named Row objects

[jira] [Created] (SPARK-46540) Respects named arguments when Python data source read function outputs Row objects

2023-12-28 Thread Allison Wang (Jira)
Allison Wang created SPARK-46540: Summary: Respects named arguments when Python data source read function outputs Row objects Key: SPARK-46540 URL: https://issues.apache.org/jira/browse/SPARK-46540

[jira] [Updated] (SPARK-46540) Respect named arguments when Python data source read function outputs Row objects

2023-12-28 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-46540: - Summary: Respect named arguments when Python data source read function outputs Row objects

[jira] [Resolved] (SPARK-46538) Fix the ambiguous column reference issue in ALSModel.transform

2023-12-28 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46538. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44526

[jira] [Resolved] (SPARK-46484) Fix missing `plan_id` in`df.melt.groupby`

2023-12-28 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46484. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44462

[jira] [Updated] (SPARK-46397) sha2(df.a, 1024) throws a different exception in Spark Connect

2023-12-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46397: --- Labels: pull-request-available (was: ) > sha2(df.a, 1024) throws a different exception in

[jira] [Assigned] (SPARK-46382) XML: Capture values interspersed between elements

2023-12-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46382: Assignee: Shujing Yang > XML: Capture values interspersed between elements >

[jira] [Resolved] (SPARK-46382) XML: Capture values interspersed between elements

2023-12-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46382. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44318

[jira] [Updated] (SPARK-44812) Push filters through intersect

2023-12-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44812: --- Labels: pull-request-available (was: ) > Push filters through intersect >

[jira] [Updated] (SPARK-46539) SELECT * EXCEPT(all fields from a struct) results in an assertion failure

2023-12-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46539: --- Labels: pull-request-available (was: ) > SELECT * EXCEPT(all fields from a struct) results

[jira] [Created] (SPARK-46539) SELECT * EXCEPT(all fields from a struct) results in an assertion failure

2023-12-28 Thread Stefan Kandic (Jira)
Stefan Kandic created SPARK-46539: - Summary: SELECT * EXCEPT(all fields from a struct) results in an assertion failure Key: SPARK-46539 URL: https://issues.apache.org/jira/browse/SPARK-46539 Project:

[jira] [Resolved] (SPARK-46537) Convert NPE and asserts from commands to internal errors

2023-12-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46537. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44525

[jira] [Commented] (SPARK-46192) failed to insert the table using the default value of union

2023-12-28 Thread Barbara Raciniewska (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17801004#comment-17801004 ] Barbara Raciniewska commented on SPARK-46192: - I am working on it > failed to insert the

[jira] [Updated] (SPARK-46538) Fix the ambiguous column reference issue in ALSModel.transform

2023-12-28 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-46538: -- Summary: Fix the ambiguous column reference issue in ALSModel.transform (was: Fix an

[jira] [Updated] (SPARK-46538) Fix an ambiguous column reference issue in ALSModel.transform

2023-12-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46538: --- Labels: pull-request-available (was: ) > Fix an ambiguous column reference issue in

[jira] [Created] (SPARK-46538) Fix an ambiguous column reference issue in ALSModel.transform

2023-12-28 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46538: - Summary: Fix an ambiguous column reference issue in ALSModel.transform Key: SPARK-46538 URL: https://issues.apache.org/jira/browse/SPARK-46538 Project: Spark

[jira] [Updated] (SPARK-46537) Convert NPE and asserts from commands to internal errors

2023-12-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46537: --- Labels: pull-request-available (was: ) > Convert NPE and asserts from commands to internal

[jira] [Commented] (SPARK-46537) Convert NPE and asserts from commands to internal errors

2023-12-28 Thread Nikita Awasthi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800970#comment-17800970 ] Nikita Awasthi commented on SPARK-46537: User 'MaxGekk' has created a pull request for this

[jira] [Created] (SPARK-46537) Convert NPE and asserts from commands to internal errors

2023-12-28 Thread Max Gekk (Jira)
Max Gekk created SPARK-46537: Summary: Convert NPE and asserts from commands to internal errors Key: SPARK-46537 URL: https://issues.apache.org/jira/browse/SPARK-46537 Project: Spark Issue Type:

[jira] [Created] (SPARK-46536) Support GROUP BY calendar_interval_type

2023-12-28 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46536: --- Summary: Support GROUP BY calendar_interval_type Key: SPARK-46536 URL: https://issues.apache.org/jira/browse/SPARK-46536 Project: Spark Issue Type:

[jira] [Created] (SPARK-46535) NPE when describe extended a column without col stats

2023-12-28 Thread zouxxyy (Jira)
zouxxyy created SPARK-46535: --- Summary: NPE when describe extended a column without col stats Key: SPARK-46535 URL: https://issues.apache.org/jira/browse/SPARK-46535 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-39859) Support v2 `DESCRIBE TABLE EXTENDED` for columns

2023-12-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-39859: --- Labels: pull-request-available (was: ) > Support v2 `DESCRIBE TABLE EXTENDED` for columns

[jira] [Resolved] (SPARK-46532) Pass message parameters in metadata of ErrorInfo

2023-12-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46532. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44468

[jira] [Resolved] (SPARK-46519) Clear unused error classes from error-classes.json file

2023-12-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46519. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44503

[jira] [Assigned] (SPARK-46519) Clear unused error classes from error-classes.json file

2023-12-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46519: Assignee: BingKun Pan > Clear unused error classes from error-classes.json file >