[jira] [Updated] (SPARK-51568) Introduce isSupportedExtract to prevent happening unexpected behavior

[ https://issues.apache.org/jira/browse/SPARK-51568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51568: --- Labels: pull-request-available (was: ) > Introduce isSupportedExtract to prevent happening

[jira] [Created] (SPARK-51568) Introduce isSupportedExtract to prevent happening unexpected behavior

Jiaan Geng created SPARK-51568: -- Summary: Introduce isSupportedExtract to prevent happening unexpected behavior Key: SPARK-51568 URL: https://issues.apache.org/jira/browse/SPARK-51568 Project: Spark

[jira] [Assigned] (SPARK-51544) Add only unique and necessary metadata columns

[ https://issues.apache.org/jira/browse/SPARK-51544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51544: --- Assignee: Mihailo Timotic > Add only unique and necessary metadata columns > --

[jira] [Assigned] (SPARK-51567) Fix DistributedLDAModel.vocabSize

[ https://issues.apache.org/jira/browse/SPARK-51567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-51567: - Assignee: Ruifeng Zheng > Fix DistributedLDAModel.vocabSize > -

[jira] [Assigned] (SPARK-50892) Add UnionLoopExec, physical operator for recursion, to perform execution of recursive queries

[ https://issues.apache.org/jira/browse/SPARK-50892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50892: --- Assignee: Milan Cupac > Add UnionLoopExec, physical operator for recursion, to perform exec

[jira] [Resolved] (SPARK-51565) Support SQL parameters in window frame clause

[ https://issues.apache.org/jira/browse/SPARK-51565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51565. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50328 [https://gith

[jira] [Commented] (SPARK-51555) Add the timediff() function

[ https://issues.apache.org/jira/browse/SPARK-51555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17937009#comment-17937009 ] Senthil Kumar commented on SPARK-51555: --- [~maxgekk] I am working on this along wit

[jira] [Resolved] (SPARK-51527) Make codegen log level configurable via SQLConf

[ https://issues.apache.org/jira/browse/SPARK-51527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51527. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50294 [https://github.com

[jira] [Assigned] (SPARK-50416) load-spark-env.sh test for terminal or pipe broken / non-portable

[ https://issues.apache.org/jira/browse/SPARK-50416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-50416: Assignee: Phil Walker > load-spark-env.sh test for terminal or pipe broken / non-portable > -

[jira] [Assigned] (SPARK-51565) Support SQL parameters in window frame clause

[ https://issues.apache.org/jira/browse/SPARK-51565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51565: --- Assignee: Dusan Tisma > Support SQL parameters in window frame clause > ---

[jira] [Created] (SPARK-51567) Fix DistributedLDAModel.vocabSize

Ruifeng Zheng created SPARK-51567: - Summary: Fix DistributedLDAModel.vocabSize Key: SPARK-51567 URL: https://issues.apache.org/jira/browse/SPARK-51567 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-51271) Python Data Sources Filter Pushdown API

[ https://issues.apache.org/jira/browse/SPARK-51271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved SPARK-51271. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49961 [https://gi

[jira] [Created] (SPARK-51566) Recover Python traceback from JVM error message

Haoyu Weng created SPARK-51566: -- Summary: Recover Python traceback from JVM error message Key: SPARK-51566 URL: https://issues.apache.org/jira/browse/SPARK-51566 Project: Spark Issue Type: Impro

[jira] [Updated] (SPARK-51565) Support SQL parameters in window frame clause

[ https://issues.apache.org/jira/browse/SPARK-51565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51565: --- Labels: pull-request-available (was: ) > Support SQL parameters in window frame clause > --

[jira] [Resolved] (SPARK-51559) Make max broadcast table size configurable

[ https://issues.apache.org/jira/browse/SPARK-51559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-51559. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50327 [https://github.com

[jira] [Updated] (SPARK-51565) Support SQL parameters in window frame clause

[ https://issues.apache.org/jira/browse/SPARK-51565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dusan Tisma updated SPARK-51565: Description: SQL parameters should be supported in window frame clauses, but are currently not. E

[jira] [Updated] (SPARK-51565) Support SQL parameters in window frame clause

[ https://issues.apache.org/jira/browse/SPARK-51565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dusan Tisma updated SPARK-51565: Description: SQL parameters should be supported in window frame clauses, but are currently not. E

[jira] [Updated] (SPARK-51565) Support SQL parameters in window frame clause

[ https://issues.apache.org/jira/browse/SPARK-51565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dusan Tisma updated SPARK-51565: Description: SQL parameters should be supported in window frame clauses, but are currently not. E

[jira] [Updated] (SPARK-51563) Support fully qualified type name TIME(n) WITHOUT TIME ZONE

[ https://issues.apache.org/jira/browse/SPARK-51563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-51563: - Labels: starter (was: ) > Support fully qualified type name TIME(n) WITHOUT TIME ZONE > ---

[jira] [Updated] (SPARK-51562) Add the time() function

[ https://issues.apache.org/jira/browse/SPARK-51562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-51562: - Labels: starter (was: ) > Add the time() function > --- > > Key: SP

[jira] [Assigned] (SPARK-51556) Add the try_to_time() function

[ https://issues.apache.org/jira/browse/SPARK-51556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-51556: Assignee: (was: Max Gekk) > Add the try_to_time() function > -- >

[jira] [Updated] (SPARK-51556) Add the try_to_time() function

[ https://issues.apache.org/jira/browse/SPARK-51556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-51556: - Labels: starter (was: ) > Add the try_to_time() function > -- > >

[jira] [Created] (SPARK-51563) Support fully qualified type name TIME(n) WITHOUT TIME ZONE

Max Gekk created SPARK-51563: Summary: Support fully qualified type name TIME(n) WITHOUT TIME ZONE Key: SPARK-51563 URL: https://issues.apache.org/jira/browse/SPARK-51563 Project: Spark Issue Ty

[jira] [Updated] (SPARK-51455) Time literal generator in tests

[ https://issues.apache.org/jira/browse/SPARK-51455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-51455: - Labels: starter (was: ) > Time literal generator in tests > --- > >

[jira] [Created] (SPARK-51564) TIME literals in the 12hr clock format

Max Gekk created SPARK-51564: Summary: TIME literals in the 12hr clock format Key: SPARK-51564 URL: https://issues.apache.org/jira/browse/SPARK-51564 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-51562) Add the time() function

Max Gekk created SPARK-51562: Summary: Add the time() function Key: SPARK-51562 URL: https://issues.apache.org/jira/browse/SPARK-51562 Project: Spark Issue Type: Sub-task Components: SQ

[jira] [Resolved] (SPARK-51561) Upgrade `gRPC Swift` to `2.1.2` and `gRPC Swift NIO Transport` to `1.0.2`

[ https://issues.apache.org/jira/browse/SPARK-51561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51561. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 2

[jira] [Assigned] (SPARK-51560) Support `cache/persist/unpersist` for `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-51560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51560: - Assignee: Dongjoon Hyun > Support `cache/persist/unpersist` for `DataFrame` > -

[jira] [Updated] (SPARK-51561) Upgrade `gRPC Swift` to `2.1.2` and `gRPC Swift NIO Transport` to `1.0.2`

[ https://issues.apache.org/jira/browse/SPARK-51561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51561: --- Labels: pull-request-available (was: ) > Upgrade `gRPC Swift` to `2.1.2` and `gRPC Swift NI

[jira] [Created] (SPARK-51561) Upgrade `gRPC Swift` to `2.1.2` and `gRPC Swift NIO Transport` to `1.0.2`

Dongjoon Hyun created SPARK-51561: - Summary: Upgrade `gRPC Swift` to `2.1.2` and `gRPC Swift NIO Transport` to `1.0.2` Key: SPARK-51561 URL: https://issues.apache.org/jira/browse/SPARK-51561 Project:

[jira] [Updated] (SPARK-51560) Support `cache/persist/unpersist` for `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-51560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51560: --- Labels: pull-request-available (was: ) > Support `cache/persist/unpersist` for `DataFrame`

[jira] [Created] (SPARK-51560) Support `cache/persist/unpersist` for `DataFrame`

Dongjoon Hyun created SPARK-51560: - Summary: Support `cache/persist/unpersist` for `DataFrame` Key: SPARK-51560 URL: https://issues.apache.org/jira/browse/SPARK-51560 Project: Spark Issue Typ

[jira] [Updated] (SPARK-51559) Make max broadcast table size configurable

[ https://issues.apache.org/jira/browse/SPARK-51559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51559: --- Labels: pull-request-available (was: ) > Make max broadcast table size configurable > -

[jira] [Created] (SPARK-51558) Automatically set env OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES when testing on macOS

Yang Jie created SPARK-51558: Summary: Automatically set env OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES when testing on macOS Key: SPARK-51558 URL: https://issues.apache.org/jira/browse/SPARK-51558 Project:

[jira] [Created] (SPARK-51557) Add test for TIME data type in Java API

Max Gekk created SPARK-51557: Summary: Add test for TIME data type in Java API Key: SPARK-51557 URL: https://issues.apache.org/jira/browse/SPARK-51557 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-51556) Add the try_to_time() function

[ https://issues.apache.org/jira/browse/SPARK-51556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-51556: - Description: Add the try_to_time() function which returns expr cast to a time using an optional formatt

[jira] [Updated] (SPARK-51556) Add the try_to_time() function

[ https://issues.apache.org/jira/browse/SPARK-51556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-51556: - Description: Add the try_to_time() function which returns expr cast to a time using an optional formatt

[jira] [Resolved] (SPARK-50892) Add UnionLoopExec, physical operator for recursion, to perform execution of recursive queries

[ https://issues.apache.org/jira/browse/SPARK-50892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50892. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49955 [https://gith

[jira] [Created] (SPARK-51556) Add the try_to_time() function

Max Gekk created SPARK-51556: Summary: Add the try_to_time() function Key: SPARK-51556 URL: https://issues.apache.org/jira/browse/SPARK-51556 Project: Spark Issue Type: Sub-task Compone

[jira] [Created] (SPARK-51553) Modify EXTRACT to support TIME data type

Max Gekk created SPARK-51553: Summary: Modify EXTRACT to support TIME data type Key: SPARK-51553 URL: https://issues.apache.org/jira/browse/SPARK-51553 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-51187) Implement the graceful deprecation of incorrect config introduced in SPARK-49699

[ https://issues.apache.org/jira/browse/SPARK-51187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51187. - Fix Version/s: 4.0.0 (was: 3.5.5) Resolution: Fixed Issue resolved

[jira] [Created] (SPARK-51555) Add the timediff() function

Max Gekk created SPARK-51555: Summary: Add the timediff() function Key: SPARK-51555 URL: https://issues.apache.org/jira/browse/SPARK-51555 Project: Spark Issue Type: Sub-task Components

[jira] [Updated] (SPARK-51554) Add the time_trunc() function

[ https://issues.apache.org/jira/browse/SPARK-51554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-51554: - Description: The time_trunc() function returns time truncated to the unit specified in unit. h4. Syntax

[jira] [Updated] (SPARK-51554) Add the time_trunc() function

[ https://issues.apache.org/jira/browse/SPARK-51554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-51554: - Summary: Add the time_trunc() function (was: Add time_trunc() function) > Add the time_trunc() function

[jira] [Created] (SPARK-51554) Add time_trunc() function

Max Gekk created SPARK-51554: Summary: Add time_trunc() function Key: SPARK-51554 URL: https://issues.apache.org/jira/browse/SPARK-51554 Project: Spark Issue Type: Sub-task Components:

[jira] [Updated] (SPARK-51552) Disable temporary variables in persisted views

[ https://issues.apache.org/jira/browse/SPARK-51552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51552: --- Labels: pull-request-available (was: ) > Disable temporary variables in persisted views > -

[jira] [Updated] (SPARK-51433) Change release script to release pyspark-client

[ https://issues.apache.org/jira/browse/SPARK-51433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51433: --- Labels: pull-request-available (was: ) > Change release script to release pyspark-client >

[jira] [Updated] (SPARK-51551) For tuning algorithm, allow using save / load to replace cache

[ https://issues.apache.org/jira/browse/SPARK-51551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51551: --- Labels: pull-request-available (was: ) > For tuning algorithm, allow using save / load to r

[jira] [Created] (SPARK-51552) Disable temporary variables in persisted views

Mihailo Aleksic created SPARK-51552: --- Summary: Disable temporary variables in persisted views Key: SPARK-51552 URL: https://issues.apache.org/jira/browse/SPARK-51552 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-51550) Upgrade pyarrow to 19 for PySpark on macOS

[ https://issues.apache.org/jira/browse/SPARK-51550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-51550. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50322 [https://

[jira] [Updated] (SPARK-51187) Implement the graceful deprecation of incorrect config introduced in SPARK-49699

[ https://issues.apache.org/jira/browse/SPARK-51187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-51187: - Fix Version/s: 3.5.5 > Implement the graceful deprecation of incorrect config introduced in > S

[jira] [Updated] (SPARK-51551) For tuning algorithm, allow using save / load to replace cache

[ https://issues.apache.org/jira/browse/SPARK-51551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-51551: --- Summary: For tuning algorithm, allow using save / load to replace cache (was: For tuning algorithm

[jira] [Updated] (SPARK-51544) Add only unique and necessary metadata columns

[ https://issues.apache.org/jira/browse/SPARK-51544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51544: --- Labels: pull-request-available (was: ) > Add only unique and necessary metadata columns > -

[jira] [Created] (SPARK-51551) For tuning algorithm, allow using save / load to replace persist

Weichen Xu created SPARK-51551: -- Summary: For tuning algorithm, allow using save / load to replace persist Key: SPARK-51551 URL: https://issues.apache.org/jira/browse/SPARK-51551 Project: Spark

[jira] [Resolved] (SPARK-51536) whitelist VectorAssembler

[ https://issues.apache.org/jira/browse/SPARK-51536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-51536. Resolution: Not A Problem > whitelist VectorAssembler > - > >

[jira] [Assigned] (SPARK-51340) Model size estimation for linear classification & regression models

[ https://issues.apache.org/jira/browse/SPARK-51340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-51340: -- Assignee: Weichen Xu > Model size estimation for linear classification & regression models >

[jira] [Resolved] (SPARK-51340) Model size estimation for linear classification & regression models

[ https://issues.apache.org/jira/browse/SPARK-51340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-51340. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50278 [https://github

[jira] [Updated] (SPARK-51541) Support the TIME data type in Literal methods

[ https://issues.apache.org/jira/browse/SPARK-51541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51541: --- Labels: pull-request-available (was: ) > Support the TIME data type in Literal methods > --

[jira] [Commented] (SPARK-51464) Unable-to-stop-spark-application-after-enabling-authentication

[ https://issues.apache.org/jira/browse/SPARK-51464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17936714#comment-17936714 ] prikshit commented on SPARK-51464: -- Hi Team, As this is my first ticket, so may be miss