[jira] [Assigned] (SPARK-48319) Test `assert_true` and `raise_error` with the same error class as Spark Classic

2024-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48319: Assignee: Ruifeng Zheng > Test `assert_true` and `raise_error` with the same error class

[jira] [Resolved] (SPARK-48319) Test `assert_true` and `raise_error` with the same error class as Spark Classic

2024-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48319. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46633

[jira] [Assigned] (SPARK-48317) Enable test_udtf_with_analyze_using_archive and test_udtf_with_analyze_using_file

2024-05-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48317: Assignee: Hyukjin Kwon > Enable test_udtf_with_analyze_using_archive and >

[jira] [Resolved] (SPARK-48317) Enable test_udtf_with_analyze_using_archive and test_udtf_with_analyze_using_file

2024-05-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48317. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46632

[jira] [Assigned] (SPARK-48316) Fix comments for SparkFrameMethodsParityTests.test_coalesce and test_repartition

2024-05-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48316: Assignee: Hyukjin Kwon > Fix comments for SparkFrameMethodsParityTests.test_coalesce and

[jira] [Resolved] (SPARK-48316) Fix comments for SparkFrameMethodsParityTests.test_coalesce and test_repartition

2024-05-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48316. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46629

[jira] [Updated] (SPARK-48316) Fix comments for SparkFrameMethodsParityTests.test_coalesce and test_repartition

2024-05-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48316: - Summary: Fix comments for SparkFrameMethodsParityTests.test_coalesce and test_repartition

[jira] [Created] (SPARK-48317) Enable test_udtf_with_analyze_using_archive and test_udtf_with_analyze_using_file

2024-05-16 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48317: Summary: Enable test_udtf_with_analyze_using_archive and test_udtf_with_analyze_using_file Key: SPARK-48317 URL: https://issues.apache.org/jira/browse/SPARK-48317

[jira] [Updated] (SPARK-48238) Spark fail to start due to class o.a.h.yarn.server.webproxy.amfilter.AmIpFilter is not a jakarta.servlet.Filter

2024-05-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48238: - Parent: (was: SPARK-47970) Issue Type: Bug (was: Sub-task) > Spark fail to start

[jira] [Created] (SPARK-48316) Enable SparkFrameMethodsParityTests.test_coalesce and test_repartition

2024-05-16 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48316: Summary: Enable SparkFrameMethodsParityTests.test_coalesce and test_repartition Key: SPARK-48316 URL: https://issues.apache.org/jira/browse/SPARK-48316 Project:

[jira] [Resolved] (SPARK-48310) Cached Properties Should return copies instead of values

2024-05-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48310. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46621

[jira] [Resolved] (SPARK-48268) Add a configuration for SparkContext.setCheckpointDir

2024-05-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48268. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46571

[jira] [Assigned] (SPARK-48268) Add a configuration for SparkContext.setCheckpointDir

2024-05-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48268: Assignee: Hyukjin Kwon > Add a configuration for SparkContext.setCheckpointDir >

[jira] [Resolved] (SPARK-48295) Turn on compute.ops_on_diff_frames by default

2024-05-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48295. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46602

[jira] [Assigned] (SPARK-48295) Turn on compute.ops_on_diff_frames by default

2024-05-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48295: Assignee: Ruifeng Zheng > Turn on compute.ops_on_diff_frames by default >

[jira] [Assigned] (SPARK-48100) [SQL][XML] Fix issues in skipping nested structure fields not selected in schema

2024-05-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48100: Assignee: Shujing Yang > [SQL][XML] Fix issues in skipping nested structure fields not

[jira] [Resolved] (SPARK-48100) [SQL][XML] Fix issues in skipping nested structure fields not selected in schema

2024-05-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48100. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46348

[jira] [Resolved] (SPARK-48247) Use all values in a python dict when inferring MapType schema

2024-05-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48247. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46547

[jira] [Assigned] (SPARK-48247) Use all values in a python dict when inferring MapType schema

2024-05-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48247: Assignee: Hyukjin Kwon > Use all values in a python dict when inferring MapType schema >

[jira] [Resolved] (SPARK-48266) Move o.a.spark.sql.connect.dsl to test dir

2024-05-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48266. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46567

[jira] [Created] (SPARK-48268) Add a configuration for SparkContext.setCheckpointDir

2024-05-13 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48268: Summary: Add a configuration for SparkContext.setCheckpointDir Key: SPARK-48268 URL: https://issues.apache.org/jira/browse/SPARK-48268 Project: Spark Issue

[jira] [Created] (SPARK-48258) Implement DataFrame.checkpoint and DataFrame.localCheckpoint

2024-05-13 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48258: Summary: Implement DataFrame.checkpoint and DataFrame.localCheckpoint Key: SPARK-48258 URL: https://issues.apache.org/jira/browse/SPARK-48258 Project: Spark

[jira] [Resolved] (SPARK-48254) Enhance Guava version extraction rule in dev/test-dependencies.sh

2024-05-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48254. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46555

[jira] [Assigned] (SPARK-48254) Enhance Guava version extraction rule in dev/test-dependencies.sh

2024-05-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48254: Assignee: Cheng Pan > Enhance Guava version extraction rule in dev/test-dependencies.sh

[jira] [Assigned] (SPARK-48248) Fix nested array to respect legacy conf of inferArrayTypeFromFirstElement

2024-05-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48248: Assignee: Hyukjin Kwon > Fix nested array to respect legacy conf of

[jira] [Resolved] (SPARK-48248) Fix nested array to respect legacy conf of inferArrayTypeFromFirstElement

2024-05-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48248. -- Fix Version/s: 3.4.4 3.5.2 4.0.0 Resolution:

[jira] [Resolved] (SPARK-48250) Enable array inference tests at test_parity_types.py

2024-05-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48250. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46550

[jira] [Updated] (SPARK-48238) Spark fail to start due to class o.a.h.yarn.server.webproxy.amfilter.AmIpFilter is not a jakarta.servlet.Filter

2024-05-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48238: - Parent: SPARK-47970 Issue Type: Sub-task (was: Bug) > Spark fail to start due to class

[jira] [Updated] (SPARK-48250) Enable array inference tests at test_parity_types.py

2024-05-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48250: - Issue Type: Test (was: Bug) > Enable array inference tests at test_parity_types.py >

[jira] [Updated] (SPARK-48250) Enable array inference tests at test_parity_types.py

2024-05-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48250: - Priority: Minor (was: Major) > Enable array inference tests at test_parity_types.py >

[jira] [Created] (SPARK-48250) Enable array inference tests at test_parity_types.py

2024-05-12 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48250: Summary: Enable array inference tests at test_parity_types.py Key: SPARK-48250 URL: https://issues.apache.org/jira/browse/SPARK-48250 Project: Spark Issue

[jira] [Deleted] (SPARK-48249) Use non-null value for legacy conf of inferArrayTypeFromFirstElement

2024-05-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-48249: - > Use non-null value for legacy conf of inferArrayTypeFromFirstElement >

[jira] [Updated] (SPARK-48249) Use non-null value for legacy conf of inferArrayTypeFromFirstElement

2024-05-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48249: - Description: {code} >>>

[jira] [Created] (SPARK-48249) Use non-null value for legacy conf of inferArrayTypeFromFirstElement

2024-05-12 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48249: Summary: Use non-null value for legacy conf of inferArrayTypeFromFirstElement Key: SPARK-48249 URL: https://issues.apache.org/jira/browse/SPARK-48249 Project: Spark

[jira] [Created] (SPARK-48248) Fix nested array to respect legacy conf of inferArrayTypeFromFirstElement

2024-05-12 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48248: Summary: Fix nested array to respect legacy conf of inferArrayTypeFromFirstElement Key: SPARK-48248 URL: https://issues.apache.org/jira/browse/SPARK-48248 Project:

[jira] [Created] (SPARK-48247) Use all values in a python dict when inferring MapType schema

2024-05-12 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48247: Summary: Use all values in a python dict when inferring MapType schema Key: SPARK-48247 URL: https://issues.apache.org/jira/browse/SPARK-48247 Project: Spark

[jira] [Resolved] (SPARK-48245) Typo in `BadRecordException` class doc

2024-05-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48245. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46542

[jira] [Assigned] (SPARK-48245) Typo in `BadRecordException` class doc

2024-05-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48245: Assignee: Vladimir Golubev > Typo in `BadRecordException` class doc >

[jira] [Resolved] (SPARK-48239) Update the release docker image to follow what we use in Github Action jobs

2024-05-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48239. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46534

[jira] [Commented] (SPARK-44265) Built-in XML data source support

2024-05-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845752#comment-17845752 ] Hyukjin Kwon commented on SPARK-44265: -- https://issues.apache.org/jira/browse/SPARK-45190 is not

[jira] [Assigned] (SPARK-48240) Replace `Local[..]` with `"Local[...]"` in the docs

2024-05-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48240: Assignee: BingKun Pan > Replace `Local[..]` with `"Local[...]"` in the docs >

[jira] [Resolved] (SPARK-48240) Replace `Local[..]` with `"Local[...]"` in the docs

2024-05-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48240. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46535

[jira] [Assigned] (SPARK-48232) Fix 'pyspark.sql.tests.connect.test_connect_session' in Python 3.12 build

2024-05-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48232: Assignee: Hyukjin Kwon > Fix 'pyspark.sql.tests.connect.test_connect_session' in Python

[jira] [Resolved] (SPARK-48232) Fix 'pyspark.sql.tests.connect.test_connect_session' in Python 3.12 build

2024-05-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48232. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46522

[jira] [Created] (SPARK-48232) Fix 'pyspark.sql.tests.connect.test_connect_session' in Python 3.12 build

2024-05-10 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48232: Summary: Fix 'pyspark.sql.tests.connect.test_connect_session' in Python 3.12 build Key: SPARK-48232 URL: https://issues.apache.org/jira/browse/SPARK-48232 Project:

[jira] [Assigned] (SPARK-48176) Fix name of FIELD_ALREADY_EXISTS error condition

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48176: Assignee: Nicholas Chammas > Fix name of FIELD_ALREADY_EXISTS error condition >

[jira] [Resolved] (SPARK-48176) Fix name of FIELD_ALREADY_EXISTS error condition

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48176. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46510

[jira] [Assigned] (SPARK-48180) Analyzer bug with multiple ORDER BY items for input table argument

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48180: Assignee: Daniel > Analyzer bug with multiple ORDER BY items for input table argument >

[jira] [Resolved] (SPARK-48180) Analyzer bug with multiple ORDER BY items for input table argument

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48180. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46451

[jira] [Assigned] (SPARK-48148) JSON objects should not be modified when read as STRING

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48148: Assignee: Eric Maynard > JSON objects should not be modified when read as STRING >

[jira] [Resolved] (SPARK-48148) JSON objects should not be modified when read as STRING

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48148. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46408

[jira] [Resolved] (SPARK-48089) Streaming query listener not working in 3.5 client <> 4.0 server

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48089. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46513

[jira] [Assigned] (SPARK-48089) Streaming query listener not working in 3.5 client <> 4.0 server

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48089: Assignee: Wei Liu > Streaming query listener not working in 3.5 client <> 4.0 server >

[jira] [Resolved] (SPARK-48082) Recover compatibility with Spark Connect client 3.5 <> Spark Connect server 4.0

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48082. -- Assignee: Hyukjin Kwon Resolution: Done > Recover compatibility with Spark Connect

[jira] [Resolved] (SPARK-48212) Fully enable PandasUDFParityTests. test_udf_wrong_arg

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48212. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46498

[jira] [Resolved] (SPARK-47365) Add toArrow() DataFrame method to PySpark

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47365. -- Resolution: Fixed Issue resolved by pull request 45481

[jira] [Assigned] (SPARK-47365) Add toArrow() DataFrame method to PySpark

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47365: Assignee: Ian Cook > Add toArrow() DataFrame method to PySpark >

[jira] [Resolved] (SPARK-47986) [CONNECT][PYTHON] Unable to create a new session when the default session is closed by the server

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47986. -- Resolution: Fixed Issue resolved by pull request 46435

[jira] [Commented] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844808#comment-17844808 ] Hyukjin Kwon commented on SPARK-48094: -- Woohoo! > Reduce GitHub Action usage according to ASF

[jira] [Resolved] (SPARK-48205) Remove the private[sql] modifier for Python data sources

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48205. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46487

[jira] [Assigned] (SPARK-48205) Remove the private[sql] modifier for Python data sources

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48205: Assignee: Allison Wang > Remove the private[sql] modifier for Python data sources >

[jira] [Assigned] (SPARK-48087) Python UDTF incompatibility in 3.5 client <> 4.0 server

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48087: Assignee: Hyukjin Kwon > Python UDTF incompatibility in 3.5 client <> 4.0 server >

[jira] [Resolved] (SPARK-48087) Python UDTF incompatibility in 3.5 client <> 4.0 server

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48087. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46473

[jira] [Resolved] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48094. -- Assignee: Dongjoon Hyun Resolution: Done Seems like we're done :-)? I will resolve this

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48094: - Fix Version/s: 4.0.0 > Reduce GitHub Action usage according to ASF project allowance >

[jira] [Updated] (SPARK-48163) Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48163: - Fix Version/s: (was: 4.0.0) > Disable `SparkConnectServiceSuite.SPARK-43923: commands send

[jira] [Reopened] (SPARK-48163) Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-48163: -- Assignee: (was: Dongjoon Hyun) > Disable `SparkConnectServiceSuite.SPARK-43923:

[jira] [Commented] (SPARK-48163) Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844618#comment-17844618 ] Hyukjin Kwon commented on SPARK-48163: -- reverted in

[jira] [Resolved] (SPARK-48164) Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48164. -- Resolution: Invalid > Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events -

[jira] [Updated] (SPARK-48164) Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48164: - Target Version/s: (was: 4.0.0) > Re-enable `SparkConnectServiceSuite.SPARK-43923: commands

[jira] [Resolved] (SPARK-48193) Make `maven-deploy-plugin` retry 3 times

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48193. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46471

[jira] [Assigned] (SPARK-48193) Make `maven-deploy-plugin` retry 3 times

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48193: Assignee: BingKun Pan > Make `maven-deploy-plugin` retry 3 times >

[jira] [Resolved] (SPARK-48192) Enable TPC-DS tests in forked repository

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48192. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46470

[jira] [Assigned] (SPARK-48192) Enable TPC-DS tests in forked repository

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48192: Assignee: Hyukjin Kwon > Enable TPC-DS tests in forked repository >

[jira] [Created] (SPARK-48192) Enable TPC-DS tests in forked repository

2024-05-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48192: Summary: Enable TPC-DS tests in forked repository Key: SPARK-48192 URL: https://issues.apache.org/jira/browse/SPARK-48192 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-48045) Pandas API groupby with multi-agg-relabel ignores as_index=False

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48045: Assignee: Saidatt Sinai Amonkar > Pandas API groupby with multi-agg-relabel ignores

[jira] [Resolved] (SPARK-48045) Pandas API groupby with multi-agg-relabel ignores as_index=False

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48045. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46391

[jira] [Resolved] (SPARK-48086) Different Arrow versions in client and server

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48086. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46431

[jira] [Assigned] (SPARK-48086) Different Arrow versions in client and server

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48086: Assignee: Hyukjin Kwon > Different Arrow versions in client and server >

[jira] [Resolved] (SPARK-48113) Allow Plugins to integrate with Spark Connect

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48113. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46364

[jira] [Resolved] (SPARK-48167) Skip known behaviour change by SPARK-46122

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48167. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46430

[jira] [Assigned] (SPARK-48167) Skip known behaviour change by SPARK-46122

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48167: Assignee: Hyukjin Kwon > Skip known behaviour change by SPARK-46122 >

[jira] [Updated] (SPARK-48167) Skip known behaviour change by SPARK-46122

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48167: - Affects Version/s: 3.5.2 (was: 4.0.0) > Skip known behaviour change

[jira] [Created] (SPARK-48167) Skip known behaviour change by SPARK-46122

2024-05-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48167: Summary: Skip known behaviour change by SPARK-46122 Key: SPARK-48167 URL: https://issues.apache.org/jira/browse/SPARK-48167 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-48090) Streaming exception catch failure in 3.5 client <> 4.0 server

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48090. -- Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-48090) Streaming exception catch failure in 3.5 client <> 4.0 server

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48090: Assignee: Hyukjin Kwon > Streaming exception catch failure in 3.5 client <> 4.0 server >

[jira] [Assigned] (SPARK-48084) pyspark.ml.connect.evaluation not working in 3.5 client <> 4.0 server

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48084: Assignee: Weichen Xu > pyspark.ml.connect.evaluation not working in 3.5 client <> 4.0

[jira] [Assigned] (SPARK-48083) session.copyFromLocalToFs failure with 3.5 client <> 4.0 server

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48083: Assignee: Weichen Xu > session.copyFromLocalToFs failure with 3.5 client <> 4.0 server >

[jira] [Resolved] (SPARK-48083) session.copyFromLocalToFs failure with 3.5 client <> 4.0 server

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48083. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46419

[jira] [Resolved] (SPARK-48084) pyspark.ml.connect.evaluation not working in 3.5 client <> 4.0 server

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48084. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46419

[jira] [Updated] (SPARK-48090) Streaming exception catch failure in 3.5 client <> 4.0 server

2024-05-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48090: - Description: {code} == FAIL

[jira] [Resolved] (SPARK-48147) Remove all client listeners when local spark session is deleted

2024-05-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48147. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46406

[jira] [Assigned] (SPARK-48035) try_add/try_multiply should not be semantic equal to add/multiply

2024-05-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48035: Assignee: Gengliang Wang > try_add/try_multiply should not be semantic equal to

[jira] [Resolved] (SPARK-48035) try_add/try_multiply should not be semantic equal to add/multiply

2024-05-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48035. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46307

[jira] [Resolved] (SPARK-48112) Expose session in SparkConnectPlanner to plugin developers

2024-05-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48112. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46363

[jira] [Assigned] (SPARK-47777) Add spark connect test for python streaming data source

2024-05-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-4: Assignee: (was: Chaoqin Li) > Add spark connect test for python streaming data

[jira] [Reopened] (SPARK-47777) Add spark connect test for python streaming data source

2024-05-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-4: -- Reverted at https://github.com/apache/spark/commit/4e69857195a6f95c22f962e3eed950876036c04f >

[jira] [Updated] (SPARK-47777) Add spark connect test for python streaming data source

2024-05-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-4: - Fix Version/s: (was: 4.0.0) > Add spark connect test for python streaming data source >

[jira] [Created] (SPARK-48111) Move tpcds-1g and docker-integration-tests to daily scheduled jobs

2024-05-03 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48111: Summary: Move tpcds-1g and docker-integration-tests to daily scheduled jobs Key: SPARK-48111 URL: https://issues.apache.org/jira/browse/SPARK-48111 Project: Spark

[jira] [Assigned] (SPARK-48088) Skip tests being failed in client 3.5 <> server 4.0

2024-05-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48088: Assignee: Hyukjin Kwon > Skip tests being failed in client 3.5 <> server 4.0 >

  1   2   3   4   5   6   7   8   9   10   >