[jira] [Updated] (SPARK-51848) XML failed to be parsed with a defined schema of array/struct of Variant fields

[ https://issues.apache.org/jira/browse/SPARK-51848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaonan Yang updated SPARK-51848: - Summary: XML failed to be parsed with a defined schema of array/struct of Variant fields (was:

[jira] [Updated] (SPARK-51848) Variant field parsing fails in nested structures (arrays/structs)

[ https://issues.apache.org/jira/browse/SPARK-51848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaonan Yang updated SPARK-51848: - Description: {code:java} $i $i ${i + 1} $i $i

[jira] [Created] (SPARK-51848) Variant field parsing fails in nested structures (arrays/structs)

Xiaonan Yang created SPARK-51848: Summary: Variant field parsing fails in nested structures (arrays/structs) Key: SPARK-51848 URL: https://issues.apache.org/jira/browse/SPARK-51848 Project: Spark

[jira] [Updated] (SPARK-51837) Support `inputFiles` for `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-51837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51837: --- Labels: pull-request-available (was: ) > Support `inputFiles` for `DataFrame` > ---

[jira] [Updated] (SPARK-51745) Enforce State Machine for RocksDBStateStore

[ https://issues.apache.org/jira/browse/SPARK-51745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51745: --- Labels: pull-request-available (was: ) > Enforce State Machine for RocksDBStateStore >

[jira] [Updated] (SPARK-51834) Support end-to-end table constraint management

[ https://issues.apache.org/jira/browse/SPARK-51834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51834: --- Labels: pull-request-available (was: ) > Support end-to-end table constraint management > -

[jira] [Assigned] (SPARK-51846) Upgrade `gRPC Swift Protobuf` to 1.2 and `gRPC Swift NIO Transport` to 1.0.3

[ https://issues.apache.org/jira/browse/SPARK-51846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51846: - Assignee: Dongjoon Hyun > Upgrade `gRPC Swift Protobuf` to 1.2 and `gRPC Swift NIO Tran

[jira] [Commented] (SPARK-51831) No Column Pruning while using ExistJoin and datasource v2

[ https://issues.apache.org/jira/browse/SPARK-51831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17945263#comment-17945263 ] Yang Jie commented on SPARK-51831: -- cc [~cloud_fan] FYI > No Column Pruning while usin

[jira] [Updated] (SPARK-51822) Throwing classified error when disallowed functions are called during StatefulProcessor.init()

[ https://issues.apache.org/jira/browse/SPARK-51822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51822: --- Labels: pull-request-available (was: ) > Throwing classified error when disallowed function

[jira] [Assigned] (SPARK-51824) Force to clean up the ML cache after each test

[ https://issues.apache.org/jira/browse/SPARK-51824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-51824: - Assignee: Ruifeng Zheng > Force to clean up the ML cache after each test >

[jira] [Updated] (SPARK-51847) Extend PySpark testing framework util functions with basic data tests

[ https://issues.apache.org/jira/browse/SPARK-51847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51847: --- Labels: pull-request-available (was: ) > Extend PySpark testing framework util functions wi

[jira] [Updated] (SPARK-51847) Extend PySpark testing framework util functions with basic data tests

[ https://issues.apache.org/jira/browse/SPARK-51847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stan Lochtenberg updated SPARK-51847: - Description: *Background* The PySpark testing framework currently provides utilities li

[jira] [Updated] (SPARK-51847) Extend PySpark testing framework util functions with basic data tests

[ https://issues.apache.org/jira/browse/SPARK-51847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stan Lochtenberg updated SPARK-51847: - Description: *Background* The PySpark testing framework currently provides utilities li

[jira] [Created] (SPARK-51847) Extend PySpark testing framework util functions with basic data tests

Stan Lochtenberg created SPARK-51847: Summary: Extend PySpark testing framework util functions with basic data tests Key: SPARK-51847 URL: https://issues.apache.org/jira/browse/SPARK-51847 Project

[jira] [Resolved] (SPARK-51801) Upgrade ORC Format to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-51801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51801. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50588 [https://

[jira] [Resolved] (SPARK-51846) Upgrade `gRPC Swift Protobuf` to 1.2 and `gRPC Swift NIO Transport` to 1.0.3

[ https://issues.apache.org/jira/browse/SPARK-51846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51846. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 7

[jira] [Created] (SPARK-51846) Upgrade `gRPC Swift Protobuf` to 1.2 and `gRPC Swift NIO Transport` to 1.0.3

Dongjoon Hyun created SPARK-51846: - Summary: Upgrade `gRPC Swift Protobuf` to 1.2 and `gRPC Swift NIO Transport` to 1.0.3 Key: SPARK-51846 URL: https://issues.apache.org/jira/browse/SPARK-51846 Projec

[jira] [Updated] (SPARK-51846) Upgrade `gRPC Swift Protobuf` to 1.2 and `gRPC Swift NIO Transport` to 1.0.3

[ https://issues.apache.org/jira/browse/SPARK-51846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51846: --- Labels: pull-request-available (was: ) > Upgrade `gRPC Swift Protobuf` to 1.2 and `gRPC Swi

[jira] [Commented] (SPARK-51727) SPIP: Declarative Pipelines

[ https://issues.apache.org/jira/browse/SPARK-51727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17945643#comment-17945643 ] Yang Jie commented on SPARK-51727: -- Should this ticket be turned into an umbrella? > S

[jira] [Updated] (SPARK-51845) Add proto message `Clean` to clean up all ml cache

[ https://issues.apache.org/jira/browse/SPARK-51845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51845: --- Labels: pull-request-available (was: ) > Add proto message `Clean` to clean up all ml cache

[jira] [Created] (SPARK-51845) Add proto message `Clean` to clean up all ml cache

Ruifeng Zheng created SPARK-51845: - Summary: Add proto message `Clean` to clean up all ml cache Key: SPARK-51845 URL: https://issues.apache.org/jira/browse/SPARK-51845 Project: Spark Issue Ty

[jira] [Reopened] (SPARK-51691) SerializationDebugger should swallow exception when try to find the reason of serialization problem

[ https://issues.apache.org/jira/browse/SPARK-51691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reopened SPARK-51691: -- > SerializationDebugger should swallow exception when try to find the reason of > serialization problem >

[jira] [Updated] (SPARK-51844) Add ReusedMixedTestCase for test env with both classic and connect

[ https://issues.apache.org/jira/browse/SPARK-51844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-51844: -- Summary: Add ReusedMixedTestCase for test env with both classic and connect (was: Introduce R

[jira] [Updated] (SPARK-51844) Add ReusedMixedTestCase for test env with both classic and connect

[ https://issues.apache.org/jira/browse/SPARK-51844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51844: --- Labels: pull-request-available (was: ) > Add ReusedMixedTestCase for test env with both cla

[jira] [Created] (SPARK-51844) Introduce ReusedMixedTestCase for test env with both classic and connect

Ruifeng Zheng created SPARK-51844: - Summary: Introduce ReusedMixedTestCase for test env with both classic and connect Key: SPARK-51844 URL: https://issues.apache.org/jira/browse/SPARK-51844 Project: S

[jira] [Updated] (SPARK-51843) Avoid per-test classic session start/stop

[ https://issues.apache.org/jira/browse/SPARK-51843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51843: --- Labels: pull-request-available (was: ) > Avoid per-test classic session start/stop > --

[jira] [Created] (SPARK-51843) Avoid per-test classic session start/stop

Ruifeng Zheng created SPARK-51843: - Summary: Avoid per-test classic session start/stop Key: SPARK-51843 URL: https://issues.apache.org/jira/browse/SPARK-51843 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-51824) Force to clean up the ML cache after each test

Ruifeng Zheng created SPARK-51824: - Summary: Force to clean up the ML cache after each test Key: SPARK-51824 URL: https://issues.apache.org/jira/browse/SPARK-51824 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-51832) Simplify maven version evaluation in the build tool

[ https://issues.apache.org/jira/browse/SPARK-51832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-51832. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50620 [https://github.com

[jira] [Updated] (SPARK-51840) HiveExternalCatalog alterTable misses partition columns

[ https://issues.apache.org/jira/browse/SPARK-51840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51840: --- Labels: pull-request-available (was: ) > HiveExternalCatalog alterTable misses partition co

[jira] [Created] (SPARK-51842) Remove unnecessary judgement from fillDefaultValue

Jiaan Geng created SPARK-51842: -- Summary: Remove unnecessary judgement from fillDefaultValue Key: SPARK-51842 URL: https://issues.apache.org/jira/browse/SPARK-51842 Project: Spark Issue Type: Im

[jira] [Updated] (SPARK-51842) Remove unnecessary judgement from fillDefaultValue

[ https://issues.apache.org/jira/browse/SPARK-51842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51842: --- Labels: pull-request-available (was: ) > Remove unnecessary judgement from fillDefaultValue

[jira] [Assigned] (SPARK-51841) Support `isLocal` and `isStreaming` for `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-51841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51841: - Assignee: Dongjoon Hyun > Support `isLocal` and `isStreaming` for `DataFrame` > ---

[jira] [Resolved] (SPARK-51841) Support `isLocal` and `isStreaming` for `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-51841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51841. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 6

[jira] [Updated] (SPARK-51841) Support `isLocal` and `isStreaming` for `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-51841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51841: --- Labels: pull-request-available (was: ) > Support `isLocal` and `isStreaming` for `DataFrame

[jira] [Created] (SPARK-51841) Support `isLocal` and `isStreaming` for `DataFrame`

Dongjoon Hyun created SPARK-51841: - Summary: Support `isLocal` and `isStreaming` for `DataFrame` Key: SPARK-51841 URL: https://issues.apache.org/jira/browse/SPARK-51841 Project: Spark Issue T