[jira] [Resolved] (SPARK-51688) Use Unix Domain Socket between Python and JVM communication

[ https://issues.apache.org/jira/browse/SPARK-51688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51688. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50466 [https://gi

[jira] [Assigned] (SPARK-51688) Use Unix Domain Socket between Python and JVM communication

[ https://issues.apache.org/jira/browse/SPARK-51688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51688: Assignee: Hyukjin Kwon > Use Unix Domain Socket between Python and JVM communication > --

[jira] [Created] (SPARK-51800) Set up the CI for UDS in PySpark

Hyukjin Kwon created SPARK-51800: Summary: Set up the CI for UDS in PySpark Key: SPARK-51800 URL: https://issues.apache.org/jira/browse/SPARK-51800 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-51800) Set up the CI for UDS in PySpark

[ https://issues.apache.org/jira/browse/SPARK-51800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51800: --- Labels: pull-request-available (was: ) > Set up the CI for UDS in PySpark > ---

[jira] [Resolved] (SPARK-51791) ImputerModel stores coefficients with arrays instead of dataframe

[ https://issues.apache.org/jira/browse/SPARK-51791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-51791. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50578 [https://

[jira] [Resolved] (SPARK-51800) Set up the CI for UDS in PySpark

[ https://issues.apache.org/jira/browse/SPARK-51800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51800. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50585 [https://gi

[jira] [Assigned] (SPARK-51800) Set up the CI for UDS in PySpark

[ https://issues.apache.org/jira/browse/SPARK-51800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51800: Assignee: Hyukjin Kwon > Set up the CI for UDS in PySpark > -

[jira] [Assigned] (SPARK-51799) Support user-specified schema in `DataFrameReader`

[ https://issues.apache.org/jira/browse/SPARK-51799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51799: - Assignee: Dongjoon Hyun > Support user-specified schema in `DataFrameReader` >

[jira] [Resolved] (SPARK-51799) Support user-specified schema in `DataFrameReader`

[ https://issues.apache.org/jira/browse/SPARK-51799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51799. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 5

[jira] [Updated] (SPARK-51799) Support user-specified schema in `DataFrameReader`

[ https://issues.apache.org/jira/browse/SPARK-51799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51799: --- Labels: pull-request-available (was: ) > Support user-specified schema in `DataFrameReader`

[jira] [Resolved] (SPARK-51793) Support `ddlParse` and `jsonToDdl` in `SparkConnectClient`

[ https://issues.apache.org/jira/browse/SPARK-51793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51793. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 5

[jira] [Created] (SPARK-51799) Support user-specified schema in `DataFrameReader`

Dongjoon Hyun created SPARK-51799: - Summary: Support user-specified schema in `DataFrameReader` Key: SPARK-51799 URL: https://issues.apache.org/jira/browse/SPARK-51799 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-51793) Support `ddlParse` and `jsonToDdl` in `SparkConnectClient`

[ https://issues.apache.org/jira/browse/SPARK-51793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51793: - Assignee: Dongjoon Hyun > Support `ddlParse` and `jsonToDdl` in `SparkConnectClient` >

[jira] [Resolved] (SPARK-51778) Close SQL test gaps discovered during single-pass Analyzer implementation

[ https://issues.apache.org/jira/browse/SPARK-51778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51778. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50568 [https://gith

[jira] [Created] (SPARK-51798) Non-deterministic property of UDF not respected when used in orderBy

Ahmad Humayun created SPARK-51798: - Summary: Non-deterministic property of UDF not respected when used in orderBy Key: SPARK-51798 URL: https://issues.apache.org/jira/browse/SPARK-51798 Project: Spark

[jira] [Resolved] (SPARK-50550) [Connect] Support sc.broadcast on Connect

[ https://issues.apache.org/jira/browse/SPARK-50550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Dvorzhak resolved SPARK-50550. --- Resolution: Duplicate > [Connect] Support sc.broadcast on Connect > ---

[jira] [Updated] (SPARK-51795) Upgrade critical parquet CVE

[ https://issues.apache.org/jira/browse/SPARK-51795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51795: --- Labels: CVE pull-request-available (was: CVE) > Upgrade critical parquet CVE >

[jira] [Updated] (SPARK-51797) Add table name to TableConstraint and remove parser dependencies

[ https://issues.apache.org/jira/browse/SPARK-51797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-51797: --- Summary: Add table name to TableConstraint and remove parser dependencies (was: Code cleanu

[jira] [Created] (SPARK-51797) Code cleanup in table constraints

Gengliang Wang created SPARK-51797: -- Summary: Code cleanup in table constraints Key: SPARK-51797 URL: https://issues.apache.org/jira/browse/SPARK-51797 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-51792) Support `saveAsTable` and `insertInto`

[ https://issues.apache.org/jira/browse/SPARK-51792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51792: - Assignee: Dongjoon Hyun > Support `saveAsTable` and `insertInto` >

[jira] [Created] (SPARK-51793) Support `ddlParse` and `jsonToDdl` in `SparkConnectClient`

Dongjoon Hyun created SPARK-51793: - Summary: Support `ddlParse` and `jsonToDdl` in `SparkConnectClient` Key: SPARK-51793 URL: https://issues.apache.org/jira/browse/SPARK-51793 Project: Spark

[jira] [Updated] (SPARK-51793) Support `ddlParse` and `jsonToDdl` in `SparkConnectClient`

[ https://issues.apache.org/jira/browse/SPARK-51793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51793: --- Labels: pull-request-available (was: ) > Support `ddlParse` and `jsonToDdl` in `SparkConnec

[jira] [Updated] (SPARK-51796) Disallow Sort order expressions under non-Sort operators

[ https://issues.apache.org/jira/browse/SPARK-51796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-51796: Summary: Disallow Sort order expressions under non-Sort operators (was: Disable Sort orde

[jira] [Updated] (SPARK-51796) Disallow Sort order expressions under non-Sort operators

[ https://issues.apache.org/jira/browse/SPARK-51796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51796: --- Labels: pull-request-available (was: ) > Disallow Sort order expressions under non-Sort ope

[jira] [Resolved] (SPARK-51775) Normalize LogicalRelation and HiveTableRelation in NormalizePlan

[ https://issues.apache.org/jira/browse/SPARK-51775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51775. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50563 [https://gith

[jira] [Created] (SPARK-51792) Support `saveAsTable` and `insertInto`

Dongjoon Hyun created SPARK-51792: - Summary: Support `saveAsTable` and `insertInto` Key: SPARK-51792 URL: https://issues.apache.org/jira/browse/SPARK-51792 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-51796) Disable Sort order expressions under non-Sort operators

Mihailo Aleksic created SPARK-51796: --- Summary: Disable Sort order expressions under non-Sort operators Key: SPARK-51796 URL: https://issues.apache.org/jira/browse/SPARK-51796 Project: Spark

[jira] [Created] (SPARK-51795) Upgrade critical parquet CVE

Jonathan Hart created SPARK-51795: - Summary: Upgrade critical parquet CVE Key: SPARK-51795 URL: https://issues.apache.org/jira/browse/SPARK-51795 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-51797) Add table name to TableConstraint and remove parser dependencies

[ https://issues.apache.org/jira/browse/SPARK-51797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51797: --- Labels: pull-request-available (was: ) > Add table name to TableConstraint and remove parse

[jira] [Updated] (SPARK-51796) Disable Sort order expressions under non-Sort operators

[ https://issues.apache.org/jira/browse/SPARK-51796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-51796: Description: Sort order expressions shouldn't be found under operators besides Sort (ORDER

[jira] [Created] (SPARK-51794) Install arm64 Python for MacOS daily test

Yang Jie created SPARK-51794: Summary: Install arm64 Python for MacOS daily test Key: SPARK-51794 URL: https://issues.apache.org/jira/browse/SPARK-51794 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-51778) Close SQL test gaps discovered during single-pass Analyzer implementation

[ https://issues.apache.org/jira/browse/SPARK-51778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51778: --- Assignee: Vladimir Golubev > Close SQL test gaps discovered during single-pass Analyzer imp

[jira] [Resolved] (SPARK-51792) Support `saveAsTable` and `insertInto`

[ https://issues.apache.org/jira/browse/SPARK-51792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51792. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 5

[jira] [Updated] (SPARK-51792) Support `saveAsTable` and `insertInto`

[ https://issues.apache.org/jira/browse/SPARK-51792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51792: --- Labels: pull-request-available (was: ) > Support `saveAsTable` and `insertInto` > -

[jira] [Updated] (SPARK-43782) Support log level configuration with static Spark conf

[ https://issues.apache.org/jira/browse/SPARK-43782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43782: --- Labels: pull-request-available (was: ) > Support log level configuration with static Spark

[jira] [Assigned] (SPARK-51775) Normalize LogicalRelation and HiveTableRelation in NormalizePlan

[ https://issues.apache.org/jira/browse/SPARK-51775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51775: --- Assignee: Vladimir Golubev > Normalize LogicalRelation and HiveTableRelation in NormalizePl

[jira] [Updated] (SPARK-51633) The sequential testing of ExecutorSuite and ExternalShuffleServiceSuite will cause ExternalShuffleServiceSuite test fail on macOs

[ https://issues.apache.org/jira/browse/SPARK-51633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51633: --- Labels: pull-request-available (was: ) > The sequential testing of ExecutorSuite and Extern

[jira] [Assigned] (SPARK-51633) The sequential testing of ExecutorSuite and ExternalShuffleServiceSuite will cause ExternalShuffleServiceSuite test fail on macOs

[ https://issues.apache.org/jira/browse/SPARK-51633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-51633: Assignee: Yang Jie > The sequential testing of ExecutorSuite and ExternalShuffleServiceSuite will

[jira] [Resolved] (SPARK-51633) The sequential testing of ExecutorSuite and ExternalShuffleServiceSuite will cause ExternalShuffleServiceSuite test fail on macOs

[ https://issues.apache.org/jira/browse/SPARK-51633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51633. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50580 [https://github.com

[jira] [Updated] (SPARK-51794) Install arm64 Python for MacOS daily test

[ https://issues.apache.org/jira/browse/SPARK-51794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51794: --- Labels: pull-request-available (was: ) > Install arm64 Python for MacOS daily test > --

[jira] [Updated] (SPARK-51802) OSS PySpark User Guide Docs

[ https://issues.apache.org/jira/browse/SPARK-51802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amanda Liu updated SPARK-51802: --- Summary: OSS PySpark User Guide Docs (was: OSS PySpark User Guide) > OSS PySpark User Guide Docs >

[jira] [Updated] (SPARK-51802) OSS PySpark User Guide Docs

[ https://issues.apache.org/jira/browse/SPARK-51802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51802: --- Labels: pull-request-available (was: ) > OSS PySpark User Guide Docs >

[jira] [Assigned] (SPARK-51716) Support serializing Variant as XML

[ https://issues.apache.org/jira/browse/SPARK-51716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51716: Assignee: Xiaonan Yang > Support serializing Variant as XML > ---

[jira] [Assigned] (SPARK-51794) Install arm64 Python for MacOS daily test

[ https://issues.apache.org/jira/browse/SPARK-51794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-51794: Assignee: Yang Jie > Install arm64 Python for MacOS daily test >

[jira] [Commented] (SPARK-51798) Non-deterministic property of UDF not respected when used in orderBy

[ https://issues.apache.org/jira/browse/SPARK-51798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17944592#comment-17944592 ] Ahmad Humayun commented on SPARK-51798: --- Similar to [SPARK-38485|https://issues.ap

[jira] [Resolved] (SPARK-51790) Register UTF8String to KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-51790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-51790. -- Assignee: Kent Yao Resolution: Fixed > Register UTF8String to KryoSerializer > -