[jira] [Assigned] (SPARK-52540) Support the time type by make_timestamp_ntz()

[ https://issues.apache.org/jira/browse/SPARK-52540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-52540: Assignee: Max Gekk > Support the time type by make_timestamp_ntz() >

[jira] [Created] (SPARK-52549) Disable Recursive CTE self-references from window functions

Pavle Martinović created SPARK-52549: Summary: Disable Recursive CTE self-references from window functions Key: SPARK-52549 URL: https://issues.apache.org/jira/browse/SPARK-52549 Project: Spark

[jira] [Created] (SPARK-52547) Build dry runs against master branch

Hyukjin Kwon created SPARK-52547: Summary: Build dry runs against master branch Key: SPARK-52547 URL: https://issues.apache.org/jira/browse/SPARK-52547 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-52548) Add a test case for when shuffle manager is overridden by a SparkPlugin

Hongze Zhang created SPARK-52548: Summary: Add a test case for when shuffle manager is overridden by a SparkPlugin Key: SPARK-52548 URL: https://issues.apache.org/jira/browse/SPARK-52548 Project: Spar

[jira] [Resolved] (SPARK-52528) Enable divide-by-zero for numeric mod with ANSI enabled

[ https://issues.apache.org/jira/browse/SPARK-52528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52528. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51219 [https://gi

[jira] [Commented] (SPARK-52408) SPIP: Upgrade Apache Hive to 4.x

[ https://issues.apache.org/jira/browse/SPARK-52408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17985476#comment-17985476 ] Kousuke Saruta commented on SPARK-52408: [~dongjoon], [~srowen], I don't think w

[jira] [Resolved] (SPARK-52462) Enforce type coercion before children output deduplication in Union

[ https://issues.apache.org/jira/browse/SPARK-52462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52462. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51172 [https://gith

[jira] [Assigned] (SPARK-52462) Enforce type coercion before children output deduplication in Union

[ https://issues.apache.org/jira/browse/SPARK-52462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52462: --- Assignee: Mihailo Aleksic > Enforce type coercion before children output deduplication in U

[jira] [Commented] (SPARK-52408) SPIP: Upgrade Apache Hive to 4.x

[ https://issues.apache.org/jira/browse/SPARK-52408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17985640#comment-17985640 ] Sean R. Owen commented on SPARK-52408: -- Maybe, maybe not, but if there is already a

[jira] [Updated] (SPARK-52548) Add a test case for when shuffle manager is overridden by a SparkPlugin

[ https://issues.apache.org/jira/browse/SPARK-52548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated SPARK-52548: - Component/s: Spark Core (was: SQL) > Add a test case for when shuffle manag

[jira] [Created] (SPARK-52550) SparkSessionExtensions requires support for DSV2 based extensions which require the classic SparkSession

Jack created SPARK-52550: Summary: SparkSessionExtensions requires support for DSV2 based extensions which require the classic SparkSession Key: SPARK-52550 URL: https://issues.apache.org/jira/browse/SPARK-52550

[jira] [Created] (SPARK-52551) Add a new v2 Predicate BOOLEAN_EXPRESSION

Wenchen Fan created SPARK-52551: --- Summary: Add a new v2 Predicate BOOLEAN_EXPRESSION Key: SPARK-52551 URL: https://issues.apache.org/jira/browse/SPARK-52551 Project: Spark Issue Type: Improveme

[jira] [Updated] (SPARK-52549) Disable Recursive CTE self-references from window functions and inside sorts

[ https://issues.apache.org/jira/browse/SPARK-52549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavle Martinović updated SPARK-52549: - Summary: Disable Recursive CTE self-references from window functions and inside sorts (

[jira] [Commented] (SPARK-52538) Add new method to check if the value is fully extractable

[ https://issues.apache.org/jira/browse/SPARK-52538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17985253#comment-17985253 ] Anastasia Filippova commented on SPARK-52538: - User 'vladimirg-db' has creat

[jira] [Resolved] (SPARK-52542) Use `/nonexistent` instead of nonexistent `/opt/spark`

[ https://issues.apache.org/jira/browse/SPARK-52542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52542. --- Fix Version/s: 4.0.1 Assignee: Dongjoon Hyun Resolution: Fixed This is resol

[jira] [Commented] (SPARK-51717) Possible SST mismatch error for the second snapshot created for a new query

[ https://issues.apache.org/jira/browse/SPARK-51717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17985730#comment-17985730 ] Hudson commented on SPARK-51717: User 'micheal-o' has created a pull request for this is

[jira] [Commented] (SPARK-52515) Approx_top_k SQL function based on Apache DataSketches

[ https://issues.apache.org/jira/browse/SPARK-52515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17985731#comment-17985731 ] Hudson commented on SPARK-52515: User 'yhuang-db' has created a pull request for this is

[jira] [Resolved] (SPARK-52549) Disable Recursive CTE self-references from window functions and inside sorts

[ https://issues.apache.org/jira/browse/SPARK-52549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52549. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51178 [https://gith

[jira] [Assigned] (SPARK-52549) Disable Recursive CTE self-references from window functions and inside sorts

[ https://issues.apache.org/jira/browse/SPARK-52549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52549: --- Assignee: Pavle Martinović > Disable Recursive CTE self-references from window functions an

[jira] [Resolved] (SPARK-52555) Enforce `UnusedLocalVariable` rule

[ https://issues.apache.org/jira/browse/SPARK-52555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52555. --- Fix Version/s: kubernetes-operator-0.4.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-52555) Enforce `UnusedLocalVariable` rule

[ https://issues.apache.org/jira/browse/SPARK-52555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52555: - Assignee: Dongjoon Hyun > Enforce `UnusedLocalVariable` rule >

[jira] [Resolved] (SPARK-52558) Lower `SparkOperatorConfManager` log level to WARN for `FileNotFoundException`

[ https://issues.apache.org/jira/browse/SPARK-52558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52558. --- Fix Version/s: kubernetes-operator-0.4.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-52558) Lower `SparkOperatorConfManager` log level to WARN for `FileNotFoundException`

[ https://issues.apache.org/jira/browse/SPARK-52558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52558: - Assignee: Dongjoon Hyun > Lower `SparkOperatorConfManager` log level to WARN for `FileN

[jira] [Assigned] (SPARK-52559) Synchronize `SparkOperatorConfManager.getValue`

[ https://issues.apache.org/jira/browse/SPARK-52559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52559: - Assignee: Dongjoon Hyun > Synchronize `SparkOperatorConfManager.getValue` > ---

[jira] [Resolved] (SPARK-52559) Synchronize `SparkOperatorConfManager.getValue`

[ https://issues.apache.org/jira/browse/SPARK-52559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52559. --- Fix Version/s: kubernetes-operator-0.4.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-52559) Synchronize `SparkOperatorConfManager.getValue`

Dongjoon Hyun created SPARK-52559: - Summary: Synchronize `SparkOperatorConfManager.getValue` Key: SPARK-52559 URL: https://issues.apache.org/jira/browse/SPARK-52559 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-52547) Build dry runs against master branch

[ https://issues.apache.org/jira/browse/SPARK-52547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52547. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51245 [https://gi

[jira] [Assigned] (SPARK-52547) Build dry runs against master branch

[ https://issues.apache.org/jira/browse/SPARK-52547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52547: Assignee: Hyukjin Kwon > Build dry runs against master branch > -

[jira] [Resolved] (SPARK-52554) Avoid multiple roundtrips for config check in connect

[ https://issues.apache.org/jira/browse/SPARK-52554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52554. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51252 [https://gi

[jira] [Assigned] (SPARK-52554) Avoid multiple roundtrips for config check in connect

[ https://issues.apache.org/jira/browse/SPARK-52554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52554: Assignee: Takuya Ueshin > Avoid multiple roundtrips for config check in connect > ---

[jira] [Assigned] (SPARK-52536) Specify AsyncProfilerLoader.extractionDir to spark local dir

[ https://issues.apache.org/jira/browse/SPARK-52536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52536: Assignee: Zhen Wang > Specify AsyncProfilerLoader.extractionDir to spark local dir >

[jira] [Resolved] (SPARK-52536) Specify AsyncProfilerLoader.extractionDir to spark local dir

[ https://issues.apache.org/jira/browse/SPARK-52536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52536. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51229 [https://gi

[jira] [Resolved] (SPARK-52499) Add more tests for data types

[ https://issues.apache.org/jira/browse/SPARK-52499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52499. - Fix Version/s: 4.1.0 4.0.1 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-52499) Add more tests for data types

[ https://issues.apache.org/jira/browse/SPARK-52499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52499: --- Assignee: Allison Wang > Add more tests for data types > - > >

[jira] [Resolved] (SPARK-52534) Make MLCache and MLHandler thread-safe

[ https://issues.apache.org/jira/browse/SPARK-52534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-52534. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51226 [https://github

[jira] [Resolved] (SPARK-52546) when sparkcontext crashes in executing sql, final state should be "error", but eventually return "finished".

[ https://issues.apache.org/jira/browse/SPARK-52546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52546. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51243 [https://gi

[jira] [Assigned] (SPARK-52546) when sparkcontext crashes in executing sql, final state should be "error", but eventually return "finished".

[ https://issues.apache.org/jira/browse/SPARK-52546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52546: Assignee: xuyu > when sparkcontext crashes in executing sql, final state should be "error

[jira] [Resolved] (SPARK-52540) Support the time type by make_timestamp_ntz()

[ https://issues.apache.org/jira/browse/SPARK-52540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-52540. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51232 [https://github.com

[jira] [Updated] (SPARK-52349) Enable boolean division tests with ANSI enabled

[ https://issues.apache.org/jira/browse/SPARK-52349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52349: - Summary: Enable boolean division tests with ANSI enabled (was: Enable divide-by-zero for boolea

[jira] [Created] (SPARK-52554) Avoid multiple roundtrips for config check in connect

Takuya Ueshin created SPARK-52554: - Summary: Avoid multiple roundtrips for config check in connect Key: SPARK-52554 URL: https://issues.apache.org/jira/browse/SPARK-52554 Project: Spark Issue

[jira] [Created] (SPARK-52555) Enforce `UnusedLocalVariable` rule

Dongjoon Hyun created SPARK-52555: - Summary: Enforce `UnusedLocalVariable` rule Key: SPARK-52555 URL: https://issues.apache.org/jira/browse/SPARK-52555 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-52556) CAST_INVALID_INPUT for Pandas on Spark in ANSI mode

Xinrong Meng created SPARK-52556: Summary: CAST_INVALID_INPUT for Pandas on Spark in ANSI mode Key: SPARK-52556 URL: https://issues.apache.org/jira/browse/SPARK-52556 Project: Spark Issue Typ

[jira] [Created] (SPARK-52557) Avoid CAST_INVALID_INPUT of to_numeric(errors='coerce') in ANSI mode

Xinrong Meng created SPARK-52557: Summary: Avoid CAST_INVALID_INPUT of to_numeric(errors='coerce') in ANSI mode Key: SPARK-52557 URL: https://issues.apache.org/jira/browse/SPARK-52557 Project: Spark

[jira] [Created] (SPARK-52558) Lower `SparkOperatorConfManager` log level to WARN for `FileNotFoundException`

Dongjoon Hyun created SPARK-52558: - Summary: Lower `SparkOperatorConfManager` log level to WARN for `FileNotFoundException` Key: SPARK-52558 URL: https://issues.apache.org/jira/browse/SPARK-52558 Proj

[jira] [Resolved] (SPARK-52553) Fix NumberFormatException when reading v1 changelog

[ https://issues.apache.org/jira/browse/SPARK-52553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-52553. -- Fix Version/s: 4.1.0 4.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-52553) Fix NumberFormatException when reading v1 changelog

[ https://issues.apache.org/jira/browse/SPARK-52553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-52553: Assignee: B. Micheal Okutubo > Fix NumberFormatException when reading v1 changelog >

[jira] [Resolved] (SPARK-48231) Remove unused CodeHaus Jackson dependencies

[ https://issues.apache.org/jira/browse/SPARK-48231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48231. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 46521 [https://github.com

[jira] [Assigned] (SPARK-52349) Enable boolean division tests with ANSI enabled

[ https://issues.apache.org/jira/browse/SPARK-52349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-52349: - Assignee: Xinrong Meng > Enable boolean division tests with ANSI enabled >

[jira] [Created] (SPARK-52552) Skip CHECK constraint enforcement for deletion vector deletes

Gengliang Wang created SPARK-52552: -- Summary: Skip CHECK constraint enforcement for deletion vector deletes Key: SPARK-52552 URL: https://issues.apache.org/jira/browse/SPARK-52552 Project: Spark

[jira] [Updated] (SPARK-51068) CTEs are not canonicalized and resulting in cached result not being used and recomputed

[ https://issues.apache.org/jira/browse/SPARK-51068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nimesh Khandelwal updated SPARK-51068: -- Target Version/s: 3.3.2 (was: 3.3.2, 4.0.0) > CTEs are not canonicalized and resultin

[jira] [Resolved] (SPARK-52349) Enable boolean division tests with ANSI enabled

[ https://issues.apache.org/jira/browse/SPARK-52349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-52349. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51249 [https://

[jira] [Updated] (SPARK-52349) Enable divide-by-zero for boolean division with ANSI enabled

[ https://issues.apache.org/jira/browse/SPARK-52349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52349: - Summary: Enable divide-by-zero for boolean division with ANSI enabled (was: Enable divide-by-ze

[jira] [Created] (SPARK-52553) Fix NumberFormatException when reading v1 changelog

B. Micheal Okutubo created SPARK-52553: -- Summary: Fix NumberFormatException when reading v1 changelog Key: SPARK-52553 URL: https://issues.apache.org/jira/browse/SPARK-52553 Project: Spark