[jira] [Created] (SPARK-44604) Upgrade Netty to 4.1.96.Final

BingKun Pan created SPARK-44604: --- Summary: Upgrade Netty to 4.1.96.Final Key: SPARK-44604 URL: https://issues.apache.org/jira/browse/SPARK-44604 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-44603) Add pyspark.testing to setup.py

[ https://issues.apache.org/jira/browse/SPARK-44603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amanda Liu updated SPARK-44603: --- Summary: Add pyspark.testing to setup.py (was: Add pyspark.testing.utils to setup.py) > Add

[jira] [Created] (SPARK-44603) Add pyspark.testing.utils to Python Setup

Amanda Liu created SPARK-44603: -- Summary: Add pyspark.testing.utils to Python Setup Key: SPARK-44603 URL: https://issues.apache.org/jira/browse/SPARK-44603 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-44603) Add pyspark.testing.utils to setup.py

[ https://issues.apache.org/jira/browse/SPARK-44603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amanda Liu updated SPARK-44603: --- Summary: Add pyspark.testing.utils to setup.py (was: Add pyspark.testing.utils to Python Setup) >

[jira] [Updated] (SPARK-38852) Better Data Source V2 operator pushdown framework

[ https://issues.apache.org/jira/browse/SPARK-38852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38852: --- Description: Currently, Spark supports push down Filters and Aggregates to data source. However,

[jira] [Updated] (SPARK-44602) Make WidenSetOperationTypes retains the Plan_ID_TAG

[ https://issues.apache.org/jira/browse/SPARK-44602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44602: -- Component/s: Connect > Make WidenSetOperationTypes retains the Plan_ID_TAG >

[jira] [Created] (SPARK-44602) Make WidenSetOperationTypes retains the Plan_ID_TAG

Ruifeng Zheng created SPARK-44602: - Summary: Make WidenSetOperationTypes retains the Plan_ID_TAG Key: SPARK-44602 URL: https://issues.apache.org/jira/browse/SPARK-44602 Project: Spark Issue

[jira] [Assigned] (SPARK-44542) eagerly load SparkExitCode class in SparkUncaughtExceptionHandler

[ https://issues.apache.org/jira/browse/SPARK-44542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-44542: Assignee: YE > eagerly load SparkExitCode class in SparkUncaughtExceptionHandler >

[jira] [Resolved] (SPARK-44542) eagerly load SparkExitCode class in SparkUncaughtExceptionHandler

[ https://issues.apache.org/jira/browse/SPARK-44542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-44542. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42195

[jira] [Updated] (SPARK-44542) eagerly load SparkExitCode class in SparkUncaughtExceptionHandler

[ https://issues.apache.org/jira/browse/SPARK-44542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-44542: - Priority: Trivial (was: Major) > eagerly load SparkExitCode class in

[jira] [Commented] (SPARK-29497) Cannot assign instance of java.lang.invoke.SerializedLambda to field

[ https://issues.apache.org/jira/browse/SPARK-29497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749003#comment-17749003 ] Herman van Hövell commented on SPARK-29497: --- This all seems to boil down to the fact that you

[jira] [Created] (SPARK-44601) Make `hive-thriftserver` module daily test pass

Yang Jie created SPARK-44601: Summary: Make `hive-thriftserver` module daily test pass Key: SPARK-44601 URL: https://issues.apache.org/jira/browse/SPARK-44601 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-43646) Make `connect` module daily test pass

[ https://issues.apache.org/jira/browse/SPARK-43646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749002#comment-17749002 ] Yang Jie commented on SPARK-43646: --

[jira] [Updated] (SPARK-43646) Make `connect` module daily test pass

[ https://issues.apache.org/jira/browse/SPARK-43646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-43646: - Summary: Make `connect` module daily test pass (was: Maven test failed:

[jira] [Updated] (SPARK-43646) Maven test failed: `from_protobuf_messageClassName` and `from_protobuf_messageClassName_options`

[ https://issues.apache.org/jira/browse/SPARK-43646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-43646: - Parent: SPARK-44566 Issue Type: Sub-task (was: Bug) > Maven test failed:

[jira] [Updated] (SPARK-43646) Maven test failed: `from_protobuf_messageClassName` and `from_protobuf_messageClassName_options`

[ https://issues.apache.org/jira/browse/SPARK-43646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-43646: - Epic Link: (was: SPARK-43745) > Maven test failed: `from_protobuf_messageClassName` and >

[jira] [Resolved] (SPARK-43402) FileSourceScanExec supports push down data filter with scalar subquery

[ https://issues.apache.org/jira/browse/SPARK-43402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You resolved SPARK-43402. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 41088

[jira] [Assigned] (SPARK-43402) FileSourceScanExec supports push down data filter with scalar subquery

[ https://issues.apache.org/jira/browse/SPARK-43402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You reassigned SPARK-43402: - Assignee: XiDuo You > FileSourceScanExec supports push down data filter with scalar subquery >

[jira] [Created] (SPARK-44600) Make `repl` module daily test pass

Yang Jie created SPARK-44600: Summary: Make `repl` module daily test pass Key: SPARK-44600 URL: https://issues.apache.org/jira/browse/SPARK-44600 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-44524) Balancing pyspark-pandas-connect and pyspark-pandas-slow-connect GA testing time

[ https://issues.apache.org/jira/browse/SPARK-44524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44524. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42115

[jira] [Assigned] (SPARK-44524) Balancing pyspark-pandas-connect and pyspark-pandas-slow-connect GA testing time

[ https://issues.apache.org/jira/browse/SPARK-44524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44524: - Assignee: BingKun Pan > Balancing pyspark-pandas-connect and

[jira] [Commented] (SPARK-44599) Python client for reattaching to existing execute in Spark Connect (server mechanism)

[ https://issues.apache.org/jira/browse/SPARK-44599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17748985#comment-17748985 ] Hyukjin Kwon commented on SPARK-44599: -- I am working on this   > Python client for reattaching to

[jira] [Updated] (SPARK-44599) Python client for reattaching to existing execute in Spark Connect (server mechanism)

[ https://issues.apache.org/jira/browse/SPARK-44599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-44599: - Issue Type: New Feature (was: Task) > Python client for reattaching to existing execute in

[jira] [Created] (SPARK-44599) Python client for reattaching to existing execute in Spark Connect (server mechanism)

Hyukjin Kwon created SPARK-44599: Summary: Python client for reattaching to existing execute in Spark Connect (server mechanism) Key: SPARK-44599 URL: https://issues.apache.org/jira/browse/SPARK-44599

[jira] [Resolved] (SPARK-44587) Increase Protobuf Marshaller Recursion Limit

[ https://issues.apache.org/jira/browse/SPARK-44587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44587. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-44587) Increase Protobuf Marshaller Recursion Limit

[ https://issues.apache.org/jira/browse/SPARK-44587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44587: Assignee: Yihong He > Increase Protobuf Marshaller Recursion Limit >

[jira] [Assigned] (SPARK-44597) Migrate test_sql assert_eq to use assertDataFrameEqual

[ https://issues.apache.org/jira/browse/SPARK-44597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44597: Assignee: Amanda Liu > Migrate test_sql assert_eq to use assertDataFrameEqual >

[jira] [Resolved] (SPARK-44597) Migrate test_sql assert_eq to use assertDataFrameEqual

[ https://issues.apache.org/jira/browse/SPARK-44597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44597. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-29497) Cannot assign instance of java.lang.invoke.SerializedLambda to field

[ https://issues.apache.org/jira/browse/SPARK-29497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17748966#comment-17748966 ] Herman van Hövell commented on SPARK-29497: --- [~jaysen] Thanks for the reaction. The scala

[jira] [Commented] (SPARK-29497) Cannot assign instance of java.lang.invoke.SerializedLambda to field

[ https://issues.apache.org/jira/browse/SPARK-29497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17748964#comment-17748964 ] Herman van Hövell commented on SPARK-29497: --- I have also tried the following code (inspired by

[jira] [Commented] (SPARK-29497) Cannot assign instance of java.lang.invoke.SerializedLambda to field

[ https://issues.apache.org/jira/browse/SPARK-29497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17748963#comment-17748963 ] Jay Sen commented on SPARK-29497: - In Java, This looks like by design. I was able to make it

[jira] [Comment Edited] (SPARK-29497) Cannot assign instance of java.lang.invoke.SerializedLambda to field

[ https://issues.apache.org/jira/browse/SPARK-29497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17748961#comment-17748961 ] Herman van Hövell edited comment on SPARK-29497 at 7/30/23 7:07 PM:

[jira] [Commented] (SPARK-29497) Cannot assign instance of java.lang.invoke.SerializedLambda to field

[ https://issues.apache.org/jira/browse/SPARK-29497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17748961#comment-17748961 ] Herman van Hövell commented on SPARK-29497: --- We have seen the same problem with SparkConnect.