[jira] [Commented] (SPARK-41980) Enable test_functions_broadcast

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17664890#comment-17664890 ] Apache Spark commented on SPARK-41980: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-41980) Enable test_functions_broadcast

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41980: Assignee: (was: Apache Spark) > Enable test_functions_broadcast >

[jira] [Resolved] (SPARK-41887) Support DataFrame hint parameter to be list

2023-01-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41887. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39491

[jira] [Assigned] (SPARK-41887) Support DataFrame hint parameter to be list

2023-01-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41887: - Assignee: Ruifeng Zheng > Support DataFrame hint parameter to be list >

[jira] [Assigned] (SPARK-41980) Enable test_functions_broadcast

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41980: Assignee: Apache Spark > Enable test_functions_broadcast >

[jira] [Commented] (SPARK-41975) Improve error message for `INDEX_ALREADY_EXISTS`

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17661590#comment-17661590 ] Apache Spark commented on SPARK-41975: -- User 'itholic' has created a pull request for this issue:

[jira] [Created] (SPARK-41980) Enable test_functions_broadcast

2023-01-10 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41980: Summary: Enable test_functions_broadcast Key: SPARK-41980 URL: https://issues.apache.org/jira/browse/SPARK-41980 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41978) SparkSession.range to take float as arguments

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41978: Assignee: (was: Apache Spark) > SparkSession.range to take float as arguments >

[jira] [Commented] (SPARK-41977) Enable test_generic_hints

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17662167#comment-17662167 ] Apache Spark commented on SPARK-41977: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-41977) Enable test_generic_hints

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41977: Assignee: Apache Spark > Enable test_generic_hints > - > >

[jira] [Commented] (SPARK-41978) SparkSession.range to take float as arguments

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17662482#comment-17662482 ] Apache Spark commented on SPARK-41978: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-41978) SparkSession.range to take float as arguments

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17662420#comment-17662420 ] Apache Spark commented on SPARK-41978: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-41978) SparkSession.range to take float as arguments

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17662370#comment-17662370 ] Apache Spark commented on SPARK-41978: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-41979) Add missing dots for error messages in error classes.

2023-01-10 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-41979: --- Summary: Add missing dots for error messages in error classes. Key: SPARK-41979 URL: https://issues.apache.org/jira/browse/SPARK-41979 Project: Spark Issue

[jira] [Assigned] (SPARK-41978) SparkSession.range to take float as arguments

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41978: Assignee: Apache Spark > SparkSession.range to take float as arguments >

[jira] [Commented] (SPARK-41979) Add missing dots for error messages in error classes.

2023-01-10 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17662383#comment-17662383 ] Haejoon Lee commented on SPARK-41979: - I'm working on it > Add missing dots for error messages in

[jira] [Commented] (SPARK-41977) Enable test_generic_hints

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17662260#comment-17662260 ] Apache Spark commented on SPARK-41977: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-41977) Enable test_generic_hints

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41977: Assignee: (was: Apache Spark) > Enable test_generic_hints >

[jira] [Commented] (SPARK-41975) Improve error message for `INDEX_ALREADY_EXISTS`

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17661497#comment-17661497 ] Apache Spark commented on SPARK-41975: -- User 'itholic' has created a pull request for this issue:

[jira] [Created] (SPARK-41978) SparkSession.range to take float as arguments

2023-01-10 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41978: Summary: SparkSession.range to take float as arguments Key: SPARK-41978 URL: https://issues.apache.org/jira/browse/SPARK-41978 Project: Spark Issue Type:

[jira] [Created] (SPARK-41977) Enable test_generic_hints

2023-01-10 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41977: Summary: Enable test_generic_hints Key: SPARK-41977 URL: https://issues.apache.org/jira/browse/SPARK-41977 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41976) Improve error message for `INDEX_NOT_FOUND`

2023-01-10 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-41976: --- Summary: Improve error message for `INDEX_NOT_FOUND` Key: SPARK-41976 URL: https://issues.apache.org/jira/browse/SPARK-41976 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-41972) Fix flaky test in StreamingQueryStatusListenerSuite

2023-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41972. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39494

[jira] [Assigned] (SPARK-41975) Improve error message for `INDEX_ALREADY_EXISTS`

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41975: Assignee: Apache Spark > Improve error message for `INDEX_ALREADY_EXISTS` >

[jira] [Assigned] (SPARK-41975) Improve error message for `INDEX_ALREADY_EXISTS`

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41975: Assignee: (was: Apache Spark) > Improve error message for `INDEX_ALREADY_EXISTS` >

[jira] [Commented] (SPARK-41975) Improve error message for `INDEX_ALREADY_EXISTS`

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17658353#comment-17658353 ] Apache Spark commented on SPARK-41975: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-41975) Improve error message for `INDEX_ALREADY_EXISTS`

2023-01-10 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657094#comment-17657094 ] Haejoon Lee commented on SPARK-41975: - I'm working on this > Improve error message for

[jira] [Created] (SPARK-41975) Improve error message for `INDEX_ALREADY_EXISTS`

2023-01-10 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-41975: --- Summary: Improve error message for `INDEX_ALREADY_EXISTS` Key: SPARK-41975 URL: https://issues.apache.org/jira/browse/SPARK-41975 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41974) Turn `INCORRECT_END_OFFSET` into `INTERNAL_ERROR`

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41974: Assignee: (was: Apache Spark) > Turn `INCORRECT_END_OFFSET` into `INTERNAL_ERROR` >

[jira] [Assigned] (SPARK-41974) Turn `INCORRECT_END_OFFSET` into `INTERNAL_ERROR`

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41974: Assignee: Apache Spark > Turn `INCORRECT_END_OFFSET` into `INTERNAL_ERROR` >

[jira] [Commented] (SPARK-41974) Turn `INCORRECT_END_OFFSET` into `INTERNAL_ERROR`

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657091#comment-17657091 ] Apache Spark commented on SPARK-41974: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-41974) Turn `INCORRECT_END_OFFSET` into `INTERNAL_ERROR`

2023-01-10 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657088#comment-17657088 ] Haejoon Lee commented on SPARK-41974: - I'm working on it > Turn `INCORRECT_END_OFFSET` into

[jira] [Created] (SPARK-41974) Turn `INCORRECT_END_OFFSET` into `INTERNAL_ERROR`

2023-01-10 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-41974: --- Summary: Turn `INCORRECT_END_OFFSET` into `INTERNAL_ERROR` Key: SPARK-41974 URL: https://issues.apache.org/jira/browse/SPARK-41974 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41973) Assign name to _LEGACY_ERROR_TEMP_1311

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657085#comment-17657085 ] Apache Spark commented on SPARK-41973: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41973) Assign name to _LEGACY_ERROR_TEMP_1311

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41973: Assignee: (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_1311 >

[jira] [Commented] (SPARK-41973) Assign name to _LEGACY_ERROR_TEMP_1311

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657086#comment-17657086 ] Apache Spark commented on SPARK-41973: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41973) Assign name to _LEGACY_ERROR_TEMP_1311

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41973: Assignee: Apache Spark > Assign name to _LEGACY_ERROR_TEMP_1311 >

[jira] [Created] (SPARK-41973) Assign name to _LEGACY_ERROR_TEMP_1311

2023-01-10 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-41973: --- Summary: Assign name to _LEGACY_ERROR_TEMP_1311 Key: SPARK-41973 URL: https://issues.apache.org/jira/browse/SPARK-41973 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-41589) PyTorch Distributor

2023-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41589. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39490

[jira] [Assigned] (SPARK-41972) Fix flaky test in StreamingQueryStatusListenerSuite

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41972: Assignee: Apache Spark (was: Gengliang Wang) > Fix flaky test in

[jira] [Assigned] (SPARK-41972) Fix flaky test in StreamingQueryStatusListenerSuite

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41972: Assignee: Gengliang Wang (was: Apache Spark) > Fix flaky test in

[jira] [Commented] (SPARK-41972) Fix flaky test in StreamingQueryStatusListenerSuite

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657074#comment-17657074 ] Apache Spark commented on SPARK-41972: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-41972) Fix flaky test in StreamingQueryStatusListenerSuite

2023-01-10 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41972: -- Summary: Fix flaky test in StreamingQueryStatusListenerSuite Key: SPARK-41972 URL: https://issues.apache.org/jira/browse/SPARK-41972 Project: Spark

[jira] [Commented] (SPARK-41965) Add DataFrameWriterV2 to PySpark API references

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657067#comment-17657067 ] Apache Spark commented on SPARK-41965: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-41965) Add DataFrameWriterV2 to PySpark API references

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657066#comment-17657066 ] Apache Spark commented on SPARK-41965: -- User 'zhengruifeng' has created a pull request for this

[jira] [Resolved] (SPARK-41879) `DataFrame.collect` should support nested types

2023-01-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41879. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39462

[jira] [Comment Edited] (SPARK-41971) `toPandas` should support duplicate filed names when arrow-optimization is on

2023-01-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657059#comment-17657059 ] Ruifeng Zheng edited comment on SPARK-41971 at 1/11/23 3:17 AM: I think

[jira] [Updated] (SPARK-41971) `toPandas` should support duplicate filed names when arrow-optimization is on

2023-01-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-41971: -- Issue Type: Bug (was: Improvement) > `toPandas` should support duplicate filed names when

[jira] [Updated] (SPARK-41971) `toPandas` should support duplicate filed names when arrow-optimization is on

2023-01-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-41971: -- Priority: Minor (was: Major) > `toPandas` should support duplicate filed names when

[jira] [Commented] (SPARK-41971) `toPandas` should support duplicate filed names when arrow-optimization is on

2023-01-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657059#comment-17657059 ] Ruifeng Zheng commented on SPARK-41971: --- I think that is due to something is wrong in

[jira] [Created] (SPARK-41971) `toPandas` should support duplicate filed names when arrow-optimization is on

2023-01-10 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41971: - Summary: `toPandas` should support duplicate filed names when arrow-optimization is on Key: SPARK-41971 URL: https://issues.apache.org/jira/browse/SPARK-41971

[jira] [Assigned] (SPARK-41965) Add DataFrameWriterV2 to PySpark API references

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41965: Assignee: (was: Apache Spark) > Add DataFrameWriterV2 to PySpark API references >

[jira] [Assigned] (SPARK-41965) Add DataFrameWriterV2 to PySpark API references

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41965: Assignee: Apache Spark > Add DataFrameWriterV2 to PySpark API references >

[jira] [Updated] (SPARK-41965) Add DataFrameWriterV2 to PySpark API references

2023-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41965: - Fix Version/s: (was: 3.4.0) > Add DataFrameWriterV2 to PySpark API references >

[jira] [Reopened] (SPARK-41965) Add DataFrameWriterV2 to PySpark API references

2023-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-41965: -- Assignee: (was: Ruifeng Zheng) Reverted in

[jira] [Commented] (SPARK-41838) DataFrame.show() fix map printing

2023-01-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657041#comment-17657041 ] jiaan.geng commented on SPARK-41838: I want take a look! > DataFrame.show() fix map printing >

[jira] [Assigned] (SPARK-41876) Implement DataFrame `toLocalIterator`

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41876: Assignee: (was: Apache Spark) > Implement DataFrame `toLocalIterator` >

[jira] [Assigned] (SPARK-41876) Implement DataFrame `toLocalIterator`

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41876: Assignee: Apache Spark > Implement DataFrame `toLocalIterator` >

[jira] (SPARK-41876) Implement DataFrame `toLocalIterator`

2023-01-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41876 ] jiaan.geng deleted comment on SPARK-41876: was (Author: beliefer): I will take a look! > Implement DataFrame `toLocalIterator` > - > >

[jira] [Commented] (SPARK-41876) Implement DataFrame `toLocalIterator`

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657040#comment-17657040 ] Apache Spark commented on SPARK-41876: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-41887) Support DataFrame hint parameter to be list

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657032#comment-17657032 ] Apache Spark commented on SPARK-41887: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41887) Support DataFrame hint parameter to be list

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41887: Assignee: (was: Apache Spark) > Support DataFrame hint parameter to be list >

[jira] [Commented] (SPARK-41887) Support DataFrame hint parameter to be list

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657031#comment-17657031 ] Apache Spark commented on SPARK-41887: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41887) Support DataFrame hint parameter to be list

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41887: Assignee: Apache Spark > Support DataFrame hint parameter to be list >

[jira] [Commented] (SPARK-41589) PyTorch Distributor

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657029#comment-17657029 ] Apache Spark commented on SPARK-41589: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-41876) Implement DataFrame `toLocalIterator`

2023-01-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657028#comment-17657028 ] jiaan.geng commented on SPARK-41876: I will take a look! > Implement DataFrame `toLocalIterator` >

[jira] [Resolved] (SPARK-41965) Add DataFrameWriterV2 to PySpark API references

2023-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41965. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39485

[jira] [Assigned] (SPARK-41965) Add DataFrameWriterV2 to PySpark API references

2023-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41965: Assignee: Ruifeng Zheng > Add DataFrameWriterV2 to PySpark API references >

[jira] [Resolved] (SPARK-41966) Add `CharType` and `TimestampNTZType` to PySpark API references

2023-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41966. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39486

[jira] [Resolved] (SPARK-41964) Add the unsupported function list

2023-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41964. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39484

[jira] [Assigned] (SPARK-41964) Add the unsupported function list

2023-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41964: Assignee: Ruifeng Zheng > Add the unsupported function list >

[jira] [Commented] (SPARK-41752) UI improvement for nested SQL executions

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657015#comment-17657015 ] Apache Spark commented on SPARK-41752: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-41970) SparkPath

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17656988#comment-17656988 ] Apache Spark commented on SPARK-41970: -- User 'databricks-david-lewis' has created a pull request

[jira] [Assigned] (SPARK-41970) SparkPath

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41970: Assignee: Apache Spark > SparkPath > - > > Key: SPARK-41970 >

[jira] [Assigned] (SPARK-41970) SparkPath

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41970: Assignee: (was: Apache Spark) > SparkPath > - > > Key:

[jira] [Commented] (SPARK-41970) SparkPath

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17656986#comment-17656986 ] Apache Spark commented on SPARK-41970: -- User 'databricks-david-lewis' has created a pull request

[jira] [Created] (SPARK-41970) SparkPath

2023-01-10 Thread David Lewis (Jira)
David Lewis created SPARK-41970: --- Summary: SparkPath Key: SPARK-41970 URL: https://issues.apache.org/jira/browse/SPARK-41970 Project: Spark Issue Type: Improvement Components: Spark

[jira] [Updated] (SPARK-38173) Quoted column cannot be recognized correctly when quotedRegexColumnNames is true

2023-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38173: -- Fix Version/s: 3.2.4 > Quoted column cannot be recognized correctly when

[jira] [Updated] (SPARK-41969) Flaky Test: StreamingQueryStatusListenerSuite.test small retained queries

2023-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41969: -- Description: I saw this failures on master branch frequently.

[jira] [Updated] (SPARK-41969) Flaky Test: StreamingQueryStatusListenerSuite.test small retained queries

2023-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41969: -- Description: I saw this failures on master branch frequently.

[jira] [Updated] (SPARK-41969) Flaky Test: StreamingQueryStatusListenerSuite.test small retained queries

2023-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41969: -- Description: I saw this failures on master branch frequently.

[jira] [Created] (SPARK-41969) Flaky Test: StreamingQueryStatusListenerSuite.test small retained queries

2023-01-10 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-41969: - Summary: Flaky Test: StreamingQueryStatusListenerSuite.test small retained queries Key: SPARK-41969 URL: https://issues.apache.org/jira/browse/SPARK-41969 Project:

[jira] [Commented] (SPARK-40588) Sorting issue with partitioned-writing and AQE turned on

2023-01-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17656705#comment-17656705 ] Erik Krogen commented on SPARK-40588: - Labeling with 'correctness' since this breaks correctness of

[jira] [Updated] (SPARK-40588) Sorting issue with partitioned-writing and AQE turned on

2023-01-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated SPARK-40588: Labels: correctness (was: ) > Sorting issue with partitioned-writing and AQE turned on >

[jira] [Assigned] (SPARK-41968) Refactor ProtobufSerDe to ProtobufSerDe[T]

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41968: Assignee: (was: Apache Spark) > Refactor ProtobufSerDe to ProtobufSerDe[T] >

[jira] [Commented] (SPARK-41968) Refactor ProtobufSerDe to ProtobufSerDe[T]

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17656700#comment-17656700 ] Apache Spark commented on SPARK-41968: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-41968) Refactor ProtobufSerDe to ProtobufSerDe[T]

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17656701#comment-17656701 ] Apache Spark commented on SPARK-41968: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41968) Refactor ProtobufSerDe to ProtobufSerDe[T]

2023-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41968: Assignee: Apache Spark > Refactor ProtobufSerDe to ProtobufSerDe[T] >

[jira] [Created] (SPARK-41968) Refactor ProtobufSerDe to ProtobufSerDe[T]

2023-01-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-41968: Summary: Refactor ProtobufSerDe to ProtobufSerDe[T] Key: SPARK-41968 URL: https://issues.apache.org/jira/browse/SPARK-41968 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41886) `DataFrame.intersect` doctest output has different order

2023-01-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41886: - Assignee: jiaan.geng > `DataFrame.intersect` doctest output has different order >

[jira] [Resolved] (SPARK-41886) `DataFrame.intersect` doctest output has different order

2023-01-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41886. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39483

[jira] [Assigned] (SPARK-41877) SparkSession.createDataFrame error parity

2023-01-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41877: - Assignee: Hyukjin Kwon > SparkSession.createDataFrame error parity >

[jira] [Resolved] (SPARK-41877) SparkSession.createDataFrame error parity

2023-01-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41877. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39482

[jira] [Assigned] (SPARK-41822) Setup Scala/JVM Client Connection

2023-01-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41822: - Assignee: Venkata Sai Akhil Gudesa > Setup Scala/JVM Client Connection >

[jira] [Resolved] (SPARK-41822) Setup Scala/JVM Client Connection

2023-01-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41822. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39361

[jira] [Created] (SPARK-41967) SBT unable to resolve particular packages from the imported maven build

2023-01-10 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-41967: Summary: SBT unable to resolve particular packages from the imported maven build Key: SPARK-41967 URL: https://issues.apache.org/jira/browse/SPARK-41967

[jira] [Resolved] (SPARK-41575) Assign name to _LEGACY_ERROR_TEMP_2054

2023-01-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41575. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39394

[jira] [Assigned] (SPARK-41575) Assign name to _LEGACY_ERROR_TEMP_2054

2023-01-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41575: Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_2054 >

[jira] [Resolved] (SPARK-41949) Make stage scheduling support local-cluster mode

2023-01-10 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-41949. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39424

[jira] [Assigned] (SPARK-41949) Make stage scheduling support local-cluster mode

2023-01-10 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-41949: -- Assignee: Weichen Xu > Make stage scheduling support local-cluster mode >

  1   2   >