[jira] [Resolved] (SPARK-48212) Fully enable PandasUDFParityTests. test_udf_wrong_arg

[ https://issues.apache.org/jira/browse/SPARK-48212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48212. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46498

[jira] [Resolved] (SPARK-47365) Add toArrow() DataFrame method to PySpark

[ https://issues.apache.org/jira/browse/SPARK-47365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47365. -- Resolution: Fixed Issue resolved by pull request 45481

[jira] [Assigned] (SPARK-47365) Add toArrow() DataFrame method to PySpark

[ https://issues.apache.org/jira/browse/SPARK-47365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47365: Assignee: Ian Cook > Add toArrow() DataFrame method to PySpark >

[jira] [Resolved] (SPARK-47986) [CONNECT][PYTHON] Unable to create a new session when the default session is closed by the server

[ https://issues.apache.org/jira/browse/SPARK-47986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47986. -- Resolution: Fixed Issue resolved by pull request 46435

[jira] [Commented] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844808#comment-17844808 ] Hyukjin Kwon commented on SPARK-48094: -- Woohoo! > Reduce GitHub Action usage according to ASF

[jira] [Resolved] (SPARK-48205) Remove the private[sql] modifier for Python data sources

[ https://issues.apache.org/jira/browse/SPARK-48205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48205. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46487

[jira] [Assigned] (SPARK-48205) Remove the private[sql] modifier for Python data sources

[ https://issues.apache.org/jira/browse/SPARK-48205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48205: Assignee: Allison Wang > Remove the private[sql] modifier for Python data sources >

[jira] [Assigned] (SPARK-48087) Python UDTF incompatibility in 3.5 client <> 4.0 server

[ https://issues.apache.org/jira/browse/SPARK-48087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48087: Assignee: Hyukjin Kwon > Python UDTF incompatibility in 3.5 client <> 4.0 server >

[jira] [Resolved] (SPARK-48087) Python UDTF incompatibility in 3.5 client <> 4.0 server

[ https://issues.apache.org/jira/browse/SPARK-48087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48087. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46473

[jira] [Resolved] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48094. -- Assignee: Dongjoon Hyun Resolution: Done Seems like we're done :-)? I will resolve this

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48094: - Fix Version/s: 4.0.0 > Reduce GitHub Action usage according to ASF project allowance >

[jira] [Updated] (SPARK-48163) Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48163: - Fix Version/s: (was: 4.0.0) > Disable `SparkConnectServiceSuite.SPARK-43923: commands send

[jira] [Reopened] (SPARK-48163) Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-48163: -- Assignee: (was: Dongjoon Hyun) > Disable `SparkConnectServiceSuite.SPARK-43923:

[jira] [Commented] (SPARK-48163) Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844618#comment-17844618 ] Hyukjin Kwon commented on SPARK-48163: -- reverted in

[jira] [Resolved] (SPARK-48164) Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

[ https://issues.apache.org/jira/browse/SPARK-48164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48164. -- Resolution: Invalid > Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events -

[jira] [Updated] (SPARK-48164) Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

[ https://issues.apache.org/jira/browse/SPARK-48164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48164: - Target Version/s: (was: 4.0.0) > Re-enable `SparkConnectServiceSuite.SPARK-43923: commands

[jira] [Resolved] (SPARK-48193) Make `maven-deploy-plugin` retry 3 times

[ https://issues.apache.org/jira/browse/SPARK-48193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48193. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46471

[jira] [Assigned] (SPARK-48193) Make `maven-deploy-plugin` retry 3 times

[ https://issues.apache.org/jira/browse/SPARK-48193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48193: Assignee: BingKun Pan > Make `maven-deploy-plugin` retry 3 times >

[jira] [Resolved] (SPARK-48192) Enable TPC-DS tests in forked repository

[ https://issues.apache.org/jira/browse/SPARK-48192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48192. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46470

[jira] [Assigned] (SPARK-48192) Enable TPC-DS tests in forked repository

[ https://issues.apache.org/jira/browse/SPARK-48192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48192: Assignee: Hyukjin Kwon > Enable TPC-DS tests in forked repository >

[jira] [Created] (SPARK-48192) Enable TPC-DS tests in forked repository

Hyukjin Kwon created SPARK-48192: Summary: Enable TPC-DS tests in forked repository Key: SPARK-48192 URL: https://issues.apache.org/jira/browse/SPARK-48192 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-48045) Pandas API groupby with multi-agg-relabel ignores as_index=False

[ https://issues.apache.org/jira/browse/SPARK-48045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48045: Assignee: Saidatt Sinai Amonkar > Pandas API groupby with multi-agg-relabel ignores

[jira] [Resolved] (SPARK-48045) Pandas API groupby with multi-agg-relabel ignores as_index=False

[ https://issues.apache.org/jira/browse/SPARK-48045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48045. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46391

[jira] [Resolved] (SPARK-48086) Different Arrow versions in client and server

[ https://issues.apache.org/jira/browse/SPARK-48086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48086. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46431

[jira] [Assigned] (SPARK-48086) Different Arrow versions in client and server

[ https://issues.apache.org/jira/browse/SPARK-48086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48086: Assignee: Hyukjin Kwon > Different Arrow versions in client and server >

[jira] [Resolved] (SPARK-48113) Allow Plugins to integrate with Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-48113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48113. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46364

[jira] [Resolved] (SPARK-48167) Skip known behaviour change by SPARK-46122

[ https://issues.apache.org/jira/browse/SPARK-48167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48167. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46430

[jira] [Assigned] (SPARK-48167) Skip known behaviour change by SPARK-46122

[ https://issues.apache.org/jira/browse/SPARK-48167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48167: Assignee: Hyukjin Kwon > Skip known behaviour change by SPARK-46122 >

[jira] [Updated] (SPARK-48167) Skip known behaviour change by SPARK-46122

[ https://issues.apache.org/jira/browse/SPARK-48167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48167: - Affects Version/s: 3.5.2 (was: 4.0.0) > Skip known behaviour change

[jira] [Created] (SPARK-48167) Skip known behaviour change by SPARK-46122

Hyukjin Kwon created SPARK-48167: Summary: Skip known behaviour change by SPARK-46122 Key: SPARK-48167 URL: https://issues.apache.org/jira/browse/SPARK-48167 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-48090) Streaming exception catch failure in 3.5 client <> 4.0 server

[ https://issues.apache.org/jira/browse/SPARK-48090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48090. -- Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-48090) Streaming exception catch failure in 3.5 client <> 4.0 server

[ https://issues.apache.org/jira/browse/SPARK-48090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48090: Assignee: Hyukjin Kwon > Streaming exception catch failure in 3.5 client <> 4.0 server >

[jira] [Assigned] (SPARK-48084) pyspark.ml.connect.evaluation not working in 3.5 client <> 4.0 server

[ https://issues.apache.org/jira/browse/SPARK-48084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48084: Assignee: Weichen Xu > pyspark.ml.connect.evaluation not working in 3.5 client <> 4.0

[jira] [Assigned] (SPARK-48083) session.copyFromLocalToFs failure with 3.5 client <> 4.0 server

[ https://issues.apache.org/jira/browse/SPARK-48083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48083: Assignee: Weichen Xu > session.copyFromLocalToFs failure with 3.5 client <> 4.0 server >

[jira] [Resolved] (SPARK-48083) session.copyFromLocalToFs failure with 3.5 client <> 4.0 server

[ https://issues.apache.org/jira/browse/SPARK-48083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48083. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46419

[jira] [Resolved] (SPARK-48084) pyspark.ml.connect.evaluation not working in 3.5 client <> 4.0 server

[ https://issues.apache.org/jira/browse/SPARK-48084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48084. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46419

[jira] [Updated] (SPARK-48090) Streaming exception catch failure in 3.5 client <> 4.0 server

[ https://issues.apache.org/jira/browse/SPARK-48090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48090: - Description: {code} == FAIL

[jira] [Resolved] (SPARK-48147) Remove all client listeners when local spark session is deleted

[ https://issues.apache.org/jira/browse/SPARK-48147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48147. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46406

[jira] [Assigned] (SPARK-48035) try_add/try_multiply should not be semantic equal to add/multiply

[ https://issues.apache.org/jira/browse/SPARK-48035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48035: Assignee: Gengliang Wang > try_add/try_multiply should not be semantic equal to

[jira] [Resolved] (SPARK-48035) try_add/try_multiply should not be semantic equal to add/multiply

[ https://issues.apache.org/jira/browse/SPARK-48035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48035. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46307

[jira] [Resolved] (SPARK-48112) Expose session in SparkConnectPlanner to plugin developers

[ https://issues.apache.org/jira/browse/SPARK-48112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48112. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46363

[jira] [Assigned] (SPARK-47777) Add spark connect test for python streaming data source

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-4: Assignee: (was: Chaoqin Li) > Add spark connect test for python streaming data

[jira] [Reopened] (SPARK-47777) Add spark connect test for python streaming data source

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-4: -- Reverted at https://github.com/apache/spark/commit/4e69857195a6f95c22f962e3eed950876036c04f >

[jira] [Updated] (SPARK-47777) Add spark connect test for python streaming data source

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-4: - Fix Version/s: (was: 4.0.0) > Add spark connect test for python streaming data source >

[jira] [Created] (SPARK-48111) Move tpcds-1g and docker-integration-tests to daily scheduled jobs

Hyukjin Kwon created SPARK-48111: Summary: Move tpcds-1g and docker-integration-tests to daily scheduled jobs Key: SPARK-48111 URL: https://issues.apache.org/jira/browse/SPARK-48111 Project: Spark

[jira] [Assigned] (SPARK-48088) Skip tests being failed in client 3.5 <> server 4.0

[ https://issues.apache.org/jira/browse/SPARK-48088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48088: Assignee: Hyukjin Kwon > Skip tests being failed in client 3.5 <> server 4.0 >

[jira] [Resolved] (SPARK-48088) Skip tests being failed in client 3.5 <> server 4.0

[ https://issues.apache.org/jira/browse/SPARK-48088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48088. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46334

[jira] [Assigned] (SPARK-48054) Backward compatibility test for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-48054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48054: Assignee: Hyukjin Kwon > Backward compatibility test for Spark Connect >

[jira] [Resolved] (SPARK-48054) Backward compatibility test for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-48054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48054. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46298

[jira] [Resolved] (SPARK-48056) [CONNECT][PYTHON] Session not found error should automatically retry during reattach

[ https://issues.apache.org/jira/browse/SPARK-48056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48056. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46297

[jira] [Created] (SPARK-48090) Streaming exception catch failure in 3.5 client <> 4.0 server

Hyukjin Kwon created SPARK-48090: Summary: Streaming exception catch failure in 3.5 client <> 4.0 server Key: SPARK-48090 URL: https://issues.apache.org/jira/browse/SPARK-48090 Project: Spark

[jira] [Created] (SPARK-48089) Streaming query listener not working in 3.5 client <> 4.0 server

Hyukjin Kwon created SPARK-48089: Summary: Streaming query listener not working in 3.5 client <> 4.0 server Key: SPARK-48089 URL: https://issues.apache.org/jira/browse/SPARK-48089 Project: Spark

[jira] [Resolved] (SPARK-48085) ANSI enabled by default brings different results in the tests in 3.5 client <> 4.0 server

[ https://issues.apache.org/jira/browse/SPARK-48085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48085. -- Resolution: Invalid We actually made this all compatible in master branch. I will avoid

[jira] [Updated] (SPARK-48085) ANSI enabled by default brings different results in the tests in 3.5 client <> 4.0 server

[ https://issues.apache.org/jira/browse/SPARK-48085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48085: - Description: {code} == FAIL

[jira] [Updated] (SPARK-48088) Skip tests being failed in client 3.5 <> server 4.0

[ https://issues.apache.org/jira/browse/SPARK-48088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48088: - Affects Version/s: 3.5.2 (was: 4.0.0) > Skip tests being failed in

[jira] [Created] (SPARK-48088) Skip tests being failed in client 3.5 <> server 4.0

Hyukjin Kwon created SPARK-48088: Summary: Skip tests being failed in client 3.5 <> server 4.0 Key: SPARK-48088 URL: https://issues.apache.org/jira/browse/SPARK-48088 Project: Spark Issue

[jira] [Created] (SPARK-48087) Python UDTF incompatibility in 3.5 client <> 4.0 server

Hyukjin Kwon created SPARK-48087: Summary: Python UDTF incompatibility in 3.5 client <> 4.0 server Key: SPARK-48087 URL: https://issues.apache.org/jira/browse/SPARK-48087 Project: Spark

[jira] [Created] (SPARK-48085) ANSI enabled by default brings different results in the tests in 3.5 client <> 4.0 server

Hyukjin Kwon created SPARK-48085: Summary: ANSI enabled by default brings different results in the tests in 3.5 client <> 4.0 server Key: SPARK-48085 URL: https://issues.apache.org/jira/browse/SPARK-48085

[jira] [Created] (SPARK-48084) pyspark.ml.connect.evaluation not working in 3.5 client <> 4.0 server

Hyukjin Kwon created SPARK-48084: Summary: pyspark.ml.connect.evaluation not working in 3.5 client <> 4.0 server Key: SPARK-48084 URL: https://issues.apache.org/jira/browse/SPARK-48084 Project: Spark

[jira] [Created] (SPARK-48083) session.copyFromLocalToFs failure with 3.5 client <> 4.0 server

Hyukjin Kwon created SPARK-48083: Summary: session.copyFromLocalToFs failure with 3.5 client <> 4.0 server Key: SPARK-48083 URL: https://issues.apache.org/jira/browse/SPARK-48083 Project: Spark

[jira] [Created] (SPARK-48086) Different Arrow versions in client and server

Hyukjin Kwon created SPARK-48086: Summary: Different Arrow versions in client and server Key: SPARK-48086 URL: https://issues.apache.org/jira/browse/SPARK-48086 Project: Spark Issue Type:

[jira] [Updated] (SPARK-48054) Backward compatibility test for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-48054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48054: - Parent: SPARK-48082 Issue Type: Sub-task (was: Improvement) > Backward compatibility

[jira] [Created] (SPARK-48082) Recover compatibility with Spark Connect client 3.5 <> Spark Connect server 4.0

Hyukjin Kwon created SPARK-48082: Summary: Recover compatibility with Spark Connect client 3.5 <> Spark Connect server 4.0 Key: SPARK-48082 URL: https://issues.apache.org/jira/browse/SPARK-48082

[jira] [Updated] (SPARK-45988) Fix `pyspark.pandas.tests.computation.test_apply_func` in Python 3.11

[ https://issues.apache.org/jira/browse/SPARK-45988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45988: - Fix Version/s: 3.5.2 > Fix `pyspark.pandas.tests.computation.test_apply_func` in Python 3.11 >

[jira] [Updated] (SPARK-45989) Fix `pyspark.pandas.tests.connect.computation.test_parity_apply_func` in Python 3.11

[ https://issues.apache.org/jira/browse/SPARK-45989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45989: - Fix Version/s: 3.5.2 > Fix `pyspark.pandas.tests.connect.computation.test_parity_apply_func` in

[jira] [Resolved] (SPARK-48075) Enforce type checking in from_avro and to_avro functions

[ https://issues.apache.org/jira/browse/SPARK-48075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48075. -- Fix Version/s: 4.0.0 Resolution: Fixed Fixed in

[jira] [Assigned] (SPARK-48064) Improve error messages for routine related errors

[ https://issues.apache.org/jira/browse/SPARK-48064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48064: Assignee: Allison Wang > Improve error messages for routine related errors >

[jira] [Resolved] (SPARK-48064) Improve error messages for routine related errors

[ https://issues.apache.org/jira/browse/SPARK-48064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48064. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46310

[jira] [Resolved] (SPARK-43727) Parity returnType check in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-43727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43727. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46300

[jira] [Assigned] (SPARK-48058) `UserDefinedFunction.returnType` parse the DDL string

[ https://issues.apache.org/jira/browse/SPARK-48058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48058: Assignee: Ruifeng Zheng > `UserDefinedFunction.returnType` parse the DDL string >

[jira] [Resolved] (SPARK-48058) `UserDefinedFunction.returnType` parse the DDL string

[ https://issues.apache.org/jira/browse/SPARK-48058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48058. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46300

[jira] [Resolved] (SPARK-48062) Add pyspark test for SimpleDataSourceStreamingReader

[ https://issues.apache.org/jira/browse/SPARK-48062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48062. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46306

[jira] [Assigned] (SPARK-48062) Add pyspark test for SimpleDataSourceStreamingReader

[ https://issues.apache.org/jira/browse/SPARK-48062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48062: Assignee: Chaoqin Li > Add pyspark test for SimpleDataSourceStreamingReader >

[jira] [Assigned] (SPARK-46894) Move PySpark error conditions into standalone JSON file

[ https://issues.apache.org/jira/browse/SPARK-46894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46894: Assignee: Nicholas Chammas > Move PySpark error conditions into standalone JSON file >

[jira] [Resolved] (SPARK-46894) Move PySpark error conditions into standalone JSON file

[ https://issues.apache.org/jira/browse/SPARK-46894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46894. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44920

[jira] [Resolved] (SPARK-48052) Recover pyspark-connect CI by parent classes

[ https://issues.apache.org/jira/browse/SPARK-48052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48052. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46294

[jira] [Assigned] (SPARK-48053) SparkSession.createDataFrame should warn for unsupported options

[ https://issues.apache.org/jira/browse/SPARK-48053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48053: Assignee: Hyukjin Kwon > SparkSession.createDataFrame should warn for unsupported

[jira] [Resolved] (SPARK-48053) SparkSession.createDataFrame should warn for unsupported options

[ https://issues.apache.org/jira/browse/SPARK-48053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48053. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46295

[jira] [Created] (SPARK-48054) Backward compatibility test for Spark Connect

Hyukjin Kwon created SPARK-48054: Summary: Backward compatibility test for Spark Connect Key: SPARK-48054 URL: https://issues.apache.org/jira/browse/SPARK-48054 Project: Spark Issue Type:

[jira] [Created] (SPARK-48053) SparkSession.createDataFrame should warn for unsupported options

Hyukjin Kwon created SPARK-48053: Summary: SparkSession.createDataFrame should warn for unsupported options Key: SPARK-48053 URL: https://issues.apache.org/jira/browse/SPARK-48053 Project: Spark

[jira] [Created] (SPARK-48052) Recover pyspark-connect CI by parent classes

Hyukjin Kwon created SPARK-48052: Summary: Recover pyspark-connect CI by parent classes Key: SPARK-48052 URL: https://issues.apache.org/jira/browse/SPARK-48052 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-48039) Update the error class for `group.apply`

[ https://issues.apache.org/jira/browse/SPARK-48039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48039. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46277

[jira] [Resolved] (SPARK-47292) safeMapToJValue should consider when map is null

[ https://issues.apache.org/jira/browse/SPARK-47292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47292. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46260

[jira] [Assigned] (SPARK-48014) Change the makeFromJava error in EvaluatePython to a user-facing error

[ https://issues.apache.org/jira/browse/SPARK-48014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48014: Assignee: Allison Wang > Change the makeFromJava error in EvaluatePython to a

[jira] [Resolved] (SPARK-48014) Change the makeFromJava error in EvaluatePython to a user-facing error

[ https://issues.apache.org/jira/browse/SPARK-48014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48014. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46250

[jira] [Resolved] (SPARK-48024) Enable `UDFParityTests.test_udf_timestamp_ntz`

[ https://issues.apache.org/jira/browse/SPARK-48024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48024. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46257

[jira] [Resolved] (SPARK-48002) Add Observed metrics test in PySpark StreamingQueryListeners

[ https://issues.apache.org/jira/browse/SPARK-48002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48002. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46237

[jira] [Assigned] (SPARK-48002) Add Observed metrics test in PySpark StreamingQueryListeners

[ https://issues.apache.org/jira/browse/SPARK-48002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48002: Assignee: Wei Liu > Add Observed metrics test in PySpark StreamingQueryListeners >

[jira] [Resolved] (SPARK-47993) Drop Python 3.8 support

[ https://issues.apache.org/jira/browse/SPARK-47993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47993. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46228

[jira] [Updated] (SPARK-47993) Drop Python 3.8 support

[ https://issues.apache.org/jira/browse/SPARK-47993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47993: - Labels: release-notes (was: release-note) > Drop Python 3.8 support > ---

[jira] [Resolved] (SPARK-47962) Improve doc test in pyspark dataframe

[ https://issues.apache.org/jira/browse/SPARK-47962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47962. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46189

[jira] [Resolved] (SPARK-47965) Avoid orNull in TypedConfigBuilder and OptionalConfigEntry

[ https://issues.apache.org/jira/browse/SPARK-47965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47965. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46197

[jira] [Assigned] (SPARK-47965) Avoid orNull in TypedConfigBuilder and OptionalConfigEntry

[ https://issues.apache.org/jira/browse/SPARK-47965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47965: Assignee: Hyukjin Kwon > Avoid orNull in TypedConfigBuilder and OptionalConfigEntry >

[jira] [Resolved] (SPARK-47964) Hide SQLContext and HiveContext

[ https://issues.apache.org/jira/browse/SPARK-47964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47964. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46194

[jira] [Updated] (SPARK-47965) Avoid orNull in TypedConfigBuilder

[ https://issues.apache.org/jira/browse/SPARK-47965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47965: - Issue Type: Improvement (was: Bug) > Avoid orNull in TypedConfigBuilder >

[jira] [Updated] (SPARK-47965) Avoid orNull in TypedConfigBuilder and OptionalConfigEntry

[ https://issues.apache.org/jira/browse/SPARK-47965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47965: - Summary: Avoid orNull in TypedConfigBuilder and OptionalConfigEntry (was: Avoid orNull in

[jira] [Updated] (SPARK-47965) Avoid orNull in TypedConfigBuilder

[ https://issues.apache.org/jira/browse/SPARK-47965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47965: - Priority: Minor (was: Major) > Avoid orNull in TypedConfigBuilder >

[jira] [Created] (SPARK-47965) Avoid orNull in TypedConfigBuilder

Hyukjin Kwon created SPARK-47965: Summary: Avoid orNull in TypedConfigBuilder Key: SPARK-47965 URL: https://issues.apache.org/jira/browse/SPARK-47965 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-47933) Parent Column class for Spark Connect and Spark Classic

[ https://issues.apache.org/jira/browse/SPARK-47933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47933: Assignee: Hyukjin Kwon > Parent Column class for Spark Connect and Spark Classic >

[jira] [Resolved] (SPARK-47933) Parent Column class for Spark Connect and Spark Classic

[ https://issues.apache.org/jira/browse/SPARK-47933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47933. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46155

  1   2   3   4   5   6   7   8   9   10   >