[jira] [Resolved] (SPARK-51451) Regression: [UNSUPPORTED_GENERATOR.NESTED_IN_EXPRESSIONS] The generator is not supported: nested in expressions "unresolvedstarwithcolumns(explode(array(0, 1, 2, 3, 4,

[ https://issues.apache.org/jira/browse/SPARK-51451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51451. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50286 [https://gith

[jira] [Commented] (SPARK-50992) OOMs and performance issues with AQE in large plans

[ https://issues.apache.org/jira/browse/SPARK-50992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17936379#comment-17936379 ] Ángel Álvarez Pascua commented on SPARK-50992: -- I've just published the fin

[jira] [Updated] (SPARK-51540) Best practice for distributed-sequence misalignment case

[ https://issues.apache.org/jira/browse/SPARK-51540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51540: --- Labels: pull-request-available (was: ) > Best practice for distributed-sequence misalignmen

[jira] [Resolved] (SPARK-51539) Refactor `SparkConnectClient` to use `analyze` helper function

[ https://issues.apache.org/jira/browse/SPARK-51539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51539. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 2

[jira] [Assigned] (SPARK-51539) Refactor `SparkConnectClient` to use `analyze` helper function

[ https://issues.apache.org/jira/browse/SPARK-51539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51539: - Assignee: Dongjoon Hyun > Refactor `SparkConnectClient` to use `analyze` helper functio

[jira] [Created] (SPARK-51540) Best practice for distributed-sequence misalignment case

Haejoon Lee created SPARK-51540: --- Summary: Best practice for distributed-sequence misalignment case Key: SPARK-51540 URL: https://issues.apache.org/jira/browse/SPARK-51540 Project: Spark Issue

[jira] [Assigned] (SPARK-51349) QueryTest thinks ["null", null] and [null, "null"] are different

[ https://issues.apache.org/jira/browse/SPARK-51349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51349: --- Assignee: Harsh Motwani > QueryTest thinks ["null", null] and [null, "null"] are different

[jira] [Resolved] (SPARK-51349) QueryTest thinks ["null", null] and [null, "null"] are different

[ https://issues.apache.org/jira/browse/SPARK-51349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51349. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50108 [https://gith

[jira] [Created] (SPARK-51539) Refactor to use `analyze` helper function

Dongjoon Hyun created SPARK-51539: - Summary: Refactor to use `analyze` helper function Key: SPARK-51539 URL: https://issues.apache.org/jira/browse/SPARK-51539 Project: Spark Issue Type: Sub-t

[jira] [Updated] (SPARK-51539) Refactor `SparkConnectClient` to use `analyze` helper function

[ https://issues.apache.org/jira/browse/SPARK-51539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51539: --- Labels: pull-request-available (was: ) > Refactor `SparkConnectClient` to use `analyze` hel

[jira] [Updated] (SPARK-51539) Refactor `SparkConnectClient` to use `analyze` helper function

[ https://issues.apache.org/jira/browse/SPARK-51539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51539: -- Summary: Refactor `SparkConnectClient` to use `analyze` helper function (was: Refactor to use

[jira] [Assigned] (SPARK-51538) Add `spark-connect-server-with-spark-cluster.yaml` example

[ https://issues.apache.org/jira/browse/SPARK-51538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51538: - Assignee: Dongjoon Hyun > Add `spark-connect-server-with-spark-cluster.yaml` example >

[jira] [Resolved] (SPARK-51538) Add `spark-connect-server-with-spark-cluster.yaml` example

[ https://issues.apache.org/jira/browse/SPARK-51538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51538. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Updated] (SPARK-51538) Add `spark-connect-server-with-spark-cluster.yaml` example

[ https://issues.apache.org/jira/browse/SPARK-51538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51538: --- Labels: pull-request-available (was: ) > Add `spark-connect-server-with-spark-cluster.yaml`

[jira] [Created] (SPARK-51538) Add `Spark spark-connect-server-with-spark-cluster.yaml` example

Dongjoon Hyun created SPARK-51538: - Summary: Add `Spark spark-connect-server-with-spark-cluster.yaml` example Key: SPARK-51538 URL: https://issues.apache.org/jira/browse/SPARK-51538 Project: Spark

[jira] [Assigned] (SPARK-51536) whitelist VectorAssembler

[ https://issues.apache.org/jira/browse/SPARK-51536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-51536: -- Assignee: Weichen Xu > whitelist VectorAssembler > - > >

[jira] [Created] (SPARK-51536) whitelist VectorAssembler

Weichen Xu created SPARK-51536: -- Summary: whitelist VectorAssembler Key: SPARK-51536 URL: https://issues.apache.org/jira/browse/SPARK-51536 Project: Spark Issue Type: Sub-task Componen

[jira] [Resolved] (SPARK-51456) Add the to_time() function

[ https://issues.apache.org/jira/browse/SPARK-51456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-51456. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50287 [https://github.com

[jira] [Resolved] (SPARK-51525) Add collation field in Desc As JSON type

[ https://issues.apache.org/jira/browse/SPARK-51525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51525. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50290 [https://gith

[jira] [Assigned] (SPARK-51525) Add collation field in Desc As JSON type

[ https://issues.apache.org/jira/browse/SPARK-51525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51525: --- Assignee: Amanda Liu > Add collation field in Desc As JSON type > -

[jira] [Assigned] (SPARK-51535) Don't hard-code hash codes in ProtobufCatalystDataConversionSuite (followup)

[ https://issues.apache.org/jira/browse/SPARK-51535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51535: Assignee: Vladimir Golubev > Don't hard-code hash codes in ProtobufCatalystDataConversion

[jira] [Resolved] (SPARK-51535) Don't hard-code hash codes in ProtobufCatalystDataConversionSuite (followup)

[ https://issues.apache.org/jira/browse/SPARK-51535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51535. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50298 [https://gi

[jira] [Resolved] (SPARK-51521) Add `integral/floating/string/date' type test and answer files

[ https://issues.apache.org/jira/browse/SPARK-51521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51521. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Resolved] (SPARK-51532) Restore the installation of Python 3.11 in macOS daily test

[ https://issues.apache.org/jira/browse/SPARK-51532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51532. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50293 [https://

[jira] [Assigned] (SPARK-51532) Restore the installation of Python 3.11 in macOS daily test

[ https://issues.apache.org/jira/browse/SPARK-51532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51532: - Assignee: Yang Jie > Restore the installation of Python 3.11 in macOS daily test >

[jira] [Resolved] (SPARK-51526) Upgrade Gradle shadow plugin to 8.3.6

[ https://issues.apache.org/jira/browse/SPARK-51526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51526. --- Resolution: Fixed Issue resolved by pull request 168 [https://github.com/apache/spark-kubern

[jira] [Updated] (SPARK-51522) Disable lazy union children test in single-pass Analyzer

[ https://issues.apache.org/jira/browse/SPARK-51522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51522: --- Labels: pull-request-available (was: ) > Disable lazy union children test in single-pass An

[jira] [Created] (SPARK-51527) Make codegen log level configurable via SQLConf

Cheng Pan created SPARK-51527: - Summary: Make codegen log level configurable via SQLConf Key: SPARK-51527 URL: https://issues.apache.org/jira/browse/SPARK-51527 Project: Spark Issue Type: Improve

[jira] [Resolved] (SPARK-51528) Don't hard-code hash codes in ProtobufCatalystDataConversionSuite

[ https://issues.apache.org/jira/browse/SPARK-51528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51528. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50295 [https://gith

[jira] [Created] (SPARK-51535) Don't hard-code hash codes in ProtobufCatalystDataConversionSuite (followup)

Vladimir Golubev created SPARK-51535: Summary: Don't hard-code hash codes in ProtobufCatalystDataConversionSuite (followup) Key: SPARK-51535 URL: https://issues.apache.org/jira/browse/SPARK-51535

[jira] [Updated] (SPARK-51535) Don't hard-code hash codes in ProtobufCatalystDataConversionSuite (followup)

[ https://issues.apache.org/jira/browse/SPARK-51535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51535: --- Labels: pull-request-available (was: ) > Don't hard-code hash codes in ProtobufCatalystData

[jira] [Assigned] (SPARK-51522) Disable lazy union children test in single-pass Analyzer

[ https://issues.apache.org/jira/browse/SPARK-51522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51522: --- Assignee: Vladimir Golubev > Disable lazy union children test in single-pass Analyzer > ---

[jira] [Resolved] (SPARK-51522) Disable lazy union children test in single-pass Analyzer

[ https://issues.apache.org/jira/browse/SPARK-51522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51522. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50289 [https://gith

[jira] [Assigned] (SPARK-51528) Don't hard-code hash codes in ProtobufCatalystDataConversionSuite

[ https://issues.apache.org/jira/browse/SPARK-51528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51528: --- Assignee: Vladimir Golubev > Don't hard-code hash codes in ProtobufCatalystDataConversionSu

[jira] [Resolved] (SPARK-51428) Implicit aliases of collated trees are assigned non-deterministically

[ https://issues.apache.org/jira/browse/SPARK-51428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51428. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50192 [https://gith

[jira] [Created] (SPARK-51533) Performance Degradation with mapInPandas in Spark 3.5.*

Jesuino created SPARK-51533: --- Summary: Performance Degradation with mapInPandas in Spark 3.5.* Key: SPARK-51533 URL: https://issues.apache.org/jira/browse/SPARK-51533 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-51428) Implicit aliases of collated trees are assigned non-deterministically

[ https://issues.apache.org/jira/browse/SPARK-51428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51428: --- Assignee: Vladimir Golubev > Implicit aliases of collated trees are assigned non-determinis

[jira] [Created] (SPARK-51532) Restore the installation of Python 3.11 in macOS daily test

Yang Jie created SPARK-51532: Summary: Restore the installation of Python 3.11 in macOS daily test Key: SPARK-51532 URL: https://issues.apache.org/jira/browse/SPARK-51532 Project: Spark Issue Ty

[jira] [Updated] (SPARK-51532) Restore the installation of Python 3.11 in macOS daily test

[ https://issues.apache.org/jira/browse/SPARK-51532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51532: --- Labels: pull-request-available (was: ) > Restore the installation of Python 3.11 in macOS d

[jira] [Updated] (SPARK-51532) Restore the installation of Python 3.11 in macOS daily test

[ https://issues.apache.org/jira/browse/SPARK-51532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-51532: - Affects Version/s: 4.1.0 (was: 4.0.0) > Restore the installation of Python 3.

[jira] [Commented] (SPARK-51420) Get minutes of time

[ https://issues.apache.org/jira/browse/SPARK-51420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17936153#comment-17936153 ] Sakthi commented on SPARK-51420: Thanks [~maxgekk] ! [PR|https://github.com/apache/spark

[jira] [Updated] (SPARK-51420) Get minutes of time

[ https://issues.apache.org/jira/browse/SPARK-51420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51420: --- Labels: pull-request-available starter (was: starter) > Get minutes of time > -

[jira] [Resolved] (SPARK-51524) Fix Package Author information to `Apache Spark project`

[ https://issues.apache.org/jira/browse/SPARK-51524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51524. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 2

[jira] [Updated] (SPARK-51456) Add the to_time() function

[ https://issues.apache.org/jira/browse/SPARK-51456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51456: --- Labels: pull-request-available (was: ) > Add the to_time() function > -

[jira] [Created] (SPARK-51529) Support for TLS connections

Martin Grund created SPARK-51529: Summary: Support for TLS connections Key: SPARK-51529 URL: https://issues.apache.org/jira/browse/SPARK-51529 Project: Spark Issue Type: Sub-task Co

[jira] [Created] (SPARK-51530) Client should support re-attachable execution

Martin Grund created SPARK-51530: Summary: Client should support re-attachable execution Key: SPARK-51530 URL: https://issues.apache.org/jira/browse/SPARK-51530 Project: Spark Issue Type: Sub

[jira] [Updated] (SPARK-51525) Add collation field in Desc As JSON type

[ https://issues.apache.org/jira/browse/SPARK-51525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amanda Liu updated SPARK-51525: --- Description: Before: {"table_name":"table","catalog_name":"spark_catalog","namespace":["ns"],"schem

[jira] [Updated] (SPARK-51528) Don't hard-code hash codes in ProtobufCatalystDataConversionSuite

[ https://issues.apache.org/jira/browse/SPARK-51528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51528: --- Labels: pull-request-available (was: ) > Don't hard-code hash codes in ProtobufCatalystData

[jira] [Created] (SPARK-51528) Don't hard-code hash codes in ProtobufCatalystDataConversionSuite

Vladimir Golubev created SPARK-51528: Summary: Don't hard-code hash codes in ProtobufCatalystDataConversionSuite Key: SPARK-51528 URL: https://issues.apache.org/jira/browse/SPARK-51528 Project: Sp

[jira] [Assigned] (SPARK-51520) Switch to JRE to reduce image size

[ https://issues.apache.org/jira/browse/SPARK-51520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51520: - Assignee: Jacob Salway > Switch to JRE to reduce image size > -