[jira] [Resolved] (SPARK-41721) Enable doctests in pyspark.sql.connect.catalog

2022-12-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41721. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39224 [https://gi

[jira] [Assigned] (SPARK-41721) Enable doctests in pyspark.sql.connect.catalog

2022-12-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41721: Assignee: Hyukjin Kwon > Enable doctests in pyspark.sql.connect.catalog > ---

[jira] [Commented] (SPARK-41717) Implement the command logic for print and _repr_html_

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652184#comment-17652184 ] Apache Spark commented on SPARK-41717: -- User 'HyukjinKwon' has created a pull reque

[jira] [Resolved] (SPARK-41529) Implement SparkSession.stop

2022-12-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41529. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39231 [https://

[jira] [Assigned] (SPARK-41529) Implement SparkSession.stop

2022-12-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41529: - Assignee: Hyukjin Kwon > Implement SparkSession.stop > --- > >

[jira] [Commented] (SPARK-41068) Implement `DataFrame.stat.corr`

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652181#comment-17652181 ] Apache Spark commented on SPARK-41068: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-41068) Implement `DataFrame.stat.corr`

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652182#comment-17652182 ] Apache Spark commented on SPARK-41068: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-41068) Implement `DataFrame.stat.corr`

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41068: Assignee: Apache Spark (was: Ruifeng Zheng) > Implement `DataFrame.stat.corr` >

[jira] [Assigned] (SPARK-41068) Implement `DataFrame.stat.corr`

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41068: Assignee: Ruifeng Zheng (was: Apache Spark) > Implement `DataFrame.stat.corr` >

[jira] [Commented] (SPARK-41729) Assign name to _LEGACY_ERROR_TEMP_0011

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652177#comment-17652177 ] Apache Spark commented on SPARK-41729: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-41729) Assign name to _LEGACY_ERROR_TEMP_0011

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41729: Assignee: Apache Spark > Assign name to _LEGACY_ERROR_TEMP_0011 > --

[jira] [Assigned] (SPARK-41729) Assign name to _LEGACY_ERROR_TEMP_0011

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41729: Assignee: (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_0011 > ---

[jira] [Updated] (SPARK-41729) Assign name to _LEGACY_ERROR_TEMP_0011

2022-12-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41729: - Parent: SPARK-37935 Issue Type: Sub-task (was: Improvement) > Assign name to _LEGACY_ERROR_TEM

[jira] [Commented] (SPARK-41068) Implement `DataFrame.stat.corr`

2022-12-26 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652173#comment-17652173 ] jiaan.geng commented on SPARK-41068: I will try. > Implement `DataFrame.stat.corr`

[jira] [Created] (SPARK-41729) Assign name to _LEGACY_ERROR_TEMP_0011

2022-12-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-41729: Summary: Assign name to _LEGACY_ERROR_TEMP_0011 Key: SPARK-41729 URL: https://issues.apache.org/jira/browse/SPARK-41729 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-41728) Implement `unwrap_udt` function

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41728: Assignee: Apache Spark > Implement `unwrap_udt` function > --

[jira] [Commented] (SPARK-41728) Implement `unwrap_udt` function

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652163#comment-17652163 ] Apache Spark commented on SPARK-41728: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-41728) Implement `unwrap_udt` function

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652164#comment-17652164 ] Apache Spark commented on SPARK-41728: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41728) Implement `unwrap_udt` function

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41728: Assignee: (was: Apache Spark) > Implement `unwrap_udt` function > ---

[jira] [Created] (SPARK-41728) Implement `unwrap_udt` function

2022-12-26 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41728: - Summary: Implement `unwrap_udt` function Key: SPARK-41728 URL: https://issues.apache.org/jira/browse/SPARK-41728 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41676) Protobuf serializer for StreamingQueryData

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41676: Assignee: (was: Apache Spark) > Protobuf serializer for StreamingQueryData >

[jira] [Assigned] (SPARK-41676) Protobuf serializer for StreamingQueryData

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41676: Assignee: Apache Spark > Protobuf serializer for StreamingQueryData > ---

[jira] [Commented] (SPARK-41676) Protobuf serializer for StreamingQueryData

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652155#comment-17652155 ] Apache Spark commented on SPARK-41676: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-41676) Protobuf serializer for StreamingQueryData

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652154#comment-17652154 ] Apache Spark commented on SPARK-41676: -- User 'LuciferYang' has created a pull reque

[jira] [Resolved] (SPARK-41706) pyspark_types_to_proto_types should supports MapType

2022-12-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41706. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39213 [https://

[jira] [Assigned] (SPARK-41706) pyspark_types_to_proto_types should supports MapType

2022-12-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41706: - Assignee: jiaan.geng > pyspark_types_to_proto_types should supports MapType > -

[jira] [Resolved] (SPARK-41724) Implement `call_udf` function

2022-12-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41724. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39230 [https://

[jira] [Assigned] (SPARK-41724) Implement `call_udf` function

2022-12-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41724: - Assignee: Ruifeng Zheng > Implement `call_udf` function > -

[jira] [Assigned] (SPARK-41473) Implement `functions.format_number`

2022-12-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41473: - Assignee: Ruifeng Zheng > Implement `functions.format_number` > ---

[jira] [Resolved] (SPARK-41473) Implement `functions.format_number`

2022-12-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41473. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39229 [https://

[jira] [Assigned] (SPARK-41723) Implement `sequence` function

2022-12-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41723: - Assignee: Ruifeng Zheng > Implement `sequence` function > -

[jira] [Resolved] (SPARK-41723) Implement `sequence` function

2022-12-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41723. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39228 [https://

[jira] [Commented] (SPARK-41378) Support Column Stats in DS V2

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652137#comment-17652137 ] Apache Spark commented on SPARK-41378: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-41378) Support Column Stats in DS V2

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652136#comment-17652136 ] Apache Spark commented on SPARK-41378: -- User 'LuciferYang' has created a pull reque

[jira] [Updated] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17

2022-12-26 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-41727: -- Attachment: hms-init-error.txt > ClassCastException when config spark.sql.hive.metastore* properties u

[jira] [Updated] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17

2022-12-26 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-41727: -- Description: Apache spark3.3.1 \ HDP3.1.5 with hive 3.1.0 when config properties about spark.sql.hive

[jira] [Created] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17

2022-12-26 Thread kevinshin (Jira)
kevinshin created SPARK-41727: - Summary: ClassCastException when config spark.sql.hive.metastore* properties under jdk17 Key: SPARK-41727 URL: https://issues.apache.org/jira/browse/SPARK-41727 Project: Sp

[jira] [Created] (SPARK-41726) Remove OptimizedCreateHiveTableAsSelectCommand

2022-12-26 Thread XiDuo You (Jira)
XiDuo You created SPARK-41726: - Summary: Remove OptimizedCreateHiveTableAsSelectCommand Key: SPARK-41726 URL: https://issues.apache.org/jira/browse/SPARK-41726 Project: Spark Issue Type: Improvem

[jira] [Commented] (SPARK-41529) Implement SparkSession.stop

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652127#comment-17652127 ] Apache Spark commented on SPARK-41529: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-41529) Implement SparkSession.stop

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41529: Assignee: (was: Apache Spark) > Implement SparkSession.stop > ---

[jira] [Assigned] (SPARK-41529) Implement SparkSession.stop

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41529: Assignee: Apache Spark > Implement SparkSession.stop > --- > >

[jira] [Commented] (SPARK-41529) Implement SparkSession.stop

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652126#comment-17652126 ] Apache Spark commented on SPARK-41529: -- User 'HyukjinKwon' has created a pull reque

[jira] [Created] (SPARK-41725) Remove the workaround of sql(...).collect back in PySpark tests

2022-12-26 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41725: Summary: Remove the workaround of sql(...).collect back in PySpark tests Key: SPARK-41725 URL: https://issues.apache.org/jira/browse/SPARK-41725 Project: Spark

[jira] [Resolved] (SPARK-41722) Implement time window functions

2022-12-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41722. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39227 [https://

[jira] [Assigned] (SPARK-41722) Implement time window functions

2022-12-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41722: - Assignee: Ruifeng Zheng > Implement time window functions > ---

[jira] [Commented] (SPARK-41653) Test parity: enable doctests in Spark Connect

2022-12-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652119#comment-17652119 ] Hyukjin Kwon commented on SPARK-41653: -- Please go ahead. Thanks for taking a look [

[jira] [Commented] (SPARK-41724) Implement `call_udf` function

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652117#comment-17652117 ] Apache Spark commented on SPARK-41724: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41724) Implement `call_udf` function

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41724: Assignee: Apache Spark > Implement `call_udf` function > - >

[jira] [Assigned] (SPARK-41724) Implement `call_udf` function

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41724: Assignee: (was: Apache Spark) > Implement `call_udf` function > -

[jira] [Created] (SPARK-41724) Implement `call_udf` function

2022-12-26 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41724: - Summary: Implement `call_udf` function Key: SPARK-41724 URL: https://issues.apache.org/jira/browse/SPARK-41724 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-41473) Implement `functions.format_number`

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652108#comment-17652108 ] Apache Spark commented on SPARK-41473: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41473) Implement `functions.format_number`

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41473: Assignee: (was: Apache Spark) > Implement `functions.format_number` > ---

[jira] [Assigned] (SPARK-41473) Implement `functions.format_number`

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41473: Assignee: Apache Spark > Implement `functions.format_number` > --

[jira] [Commented] (SPARK-41473) Implement `functions.format_number`

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652107#comment-17652107 ] Apache Spark commented on SPARK-41473: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41235) High-order function: array_compact

2022-12-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41235: --- Assignee: Sandeep Katta > High-order function: array_compact >

[jira] [Resolved] (SPARK-41235) High-order function: array_compact

2022-12-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41235. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38874 [https://gith

[jira] [Assigned] (SPARK-41723) Implement `sequence` function

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41723: Assignee: (was: Apache Spark) > Implement `sequence` function > -

[jira] [Assigned] (SPARK-41723) Implement `sequence` function

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41723: Assignee: Apache Spark > Implement `sequence` function > - >

[jira] [Commented] (SPARK-41723) Implement `sequence` function

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652105#comment-17652105 ] Apache Spark commented on SPARK-41723: -- User 'zhengruifeng' has created a pull requ

[jira] [Created] (SPARK-41723) Implement `sequence` function

2022-12-26 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41723: - Summary: Implement `sequence` function Key: SPARK-41723 URL: https://issues.apache.org/jira/browse/SPARK-41723 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-41690) Introduce AgnosticEncoders

2022-12-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41690. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39186 [https://gith

[jira] [Updated] (SPARK-41722) Implement time window functions

2022-12-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-41722: -- Summary: Implement time window functions (was: Implement 3 missing time window functions) >

[jira] [Commented] (SPARK-41722) Implement 3 missing time window functions

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652099#comment-17652099 ] Apache Spark commented on SPARK-41722: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41722) Implement 3 missing time window functions

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41722: Assignee: Apache Spark > Implement 3 missing time window functions >

[jira] [Commented] (SPARK-41722) Implement 3 missing time window functions

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652098#comment-17652098 ] Apache Spark commented on SPARK-41722: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41722) Implement 3 missing time window functions

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41722: Assignee: (was: Apache Spark) > Implement 3 missing time window functions > -

[jira] [Assigned] (SPARK-41694) Add new config to clean up `spark.ui.store.path` directory when SparkContext.stop()

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41694: Assignee: Apache Spark > Add new config to clean up `spark.ui.store.path` directory when

[jira] [Assigned] (SPARK-41694) Add new config to clean up `spark.ui.store.path` directory when SparkContext.stop()

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41694: Assignee: (was: Apache Spark) > Add new config to clean up `spark.ui.store.path` dire

[jira] [Commented] (SPARK-41694) Add new config to clean up `spark.ui.store.path` directory when SparkContext.stop()

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652096#comment-17652096 ] Apache Spark commented on SPARK-41694: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-41694) Add new config to clean up `spark.ui.store.path` directory when SparkContext.stop()

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652095#comment-17652095 ] Apache Spark commented on SPARK-41694: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-41722) Implement 3 missing time window functions

2022-12-26 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41722: - Summary: Implement 3 missing time window functions Key: SPARK-41722 URL: https://issues.apache.org/jira/browse/SPARK-41722 Project: Spark Issue Type: Sub-t

[jira] [Commented] (SPARK-41653) Test parity: enable doctests in Spark Connect

2022-12-26 Thread Sandeep Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652074#comment-17652074 ] Sandeep Singh commented on SPARK-41653: --- [~gurwls223] I can work on some of these

[jira] [Assigned] (SPARK-41654) Enable doctests in pyspark.sql.connect.window

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41654: Assignee: (was: Apache Spark) > Enable doctests in pyspark.sql.connect.window > -

[jira] [Assigned] (SPARK-41654) Enable doctests in pyspark.sql.connect.window

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41654: Assignee: Apache Spark > Enable doctests in pyspark.sql.connect.window >

[jira] [Commented] (SPARK-41654) Enable doctests in pyspark.sql.connect.window

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652073#comment-17652073 ] Apache Spark commented on SPARK-41654: -- User 'techaddict' has created a pull reques

[jira] [Assigned] (SPARK-41717) Implement the command logic for print and _repr_html_

2022-12-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41717: Assignee: Hyukjin Kwon > Implement the command logic for print and _repr_html_ >

[jira] [Resolved] (SPARK-41717) Implement the command logic for print and _repr_html_

2022-12-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41717. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39223 [https://gi

[jira] [Assigned] (SPARK-41721) Enable doctests in pyspark.sql.connect.catalog

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41721: Assignee: (was: Apache Spark) > Enable doctests in pyspark.sql.connect.catalog >

[jira] [Commented] (SPARK-41721) Enable doctests in pyspark.sql.connect.catalog

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652071#comment-17652071 ] Apache Spark commented on SPARK-41721: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-41721) Enable doctests in pyspark.sql.connect.catalog

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41721: Assignee: Apache Spark > Enable doctests in pyspark.sql.connect.catalog > ---

[jira] [Created] (SPARK-41721) Enable doctests in pyspark.sql.connect.catalog

2022-12-26 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41721: Summary: Enable doctests in pyspark.sql.connect.catalog Key: SPARK-41721 URL: https://issues.apache.org/jira/browse/SPARK-41721 Project: Spark Issue Type: Su

[jira] [Assigned] (SPARK-41720) Rename UnresolvedFunc to UnresolvedFunctionName

2022-12-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41720: Assignee: Wenchen Fan > Rename UnresolvedFunc to UnresolvedFunctionName > ---

[jira] [Resolved] (SPARK-41720) Rename UnresolvedFunc to UnresolvedFunctionName

2022-12-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41720. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39222 [https://gi

[jira] [Assigned] (SPARK-41711) Upgrade protobuf-java to 3.21.12

2022-12-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41711: Assignee: Yang Jie > Upgrade protobuf-java to 3.21.12 >

[jira] [Resolved] (SPARK-41711) Upgrade protobuf-java to 3.21.12

2022-12-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41711. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39217 [https://gi

[jira] [Resolved] (SPARK-41707) Implement initial Catalog.* API

2022-12-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41707. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39214 [https://gi

[jira] [Assigned] (SPARK-41717) Implement the command logic for print and _repr_html_

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41717: Assignee: (was: Apache Spark) > Implement the command logic for print and _repr_html_

[jira] [Commented] (SPARK-41717) Implement the command logic for print and _repr_html_

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652018#comment-17652018 ] Apache Spark commented on SPARK-41717: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-41717) Implement the command logic for print and _repr_html_

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41717: Assignee: Apache Spark > Implement the command logic for print and _repr_html_ >

[jira] [Commented] (SPARK-41717) Implement the command logic for print and _repr_html_

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652017#comment-17652017 ] Apache Spark commented on SPARK-41717: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-41720) Rename UnresolvedFunc to UnresolvedFunctionName

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652016#comment-17652016 ] Apache Spark commented on SPARK-41720: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-41720) Rename UnresolvedFunc to UnresolvedFunctionName

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652015#comment-17652015 ] Apache Spark commented on SPARK-41720: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-41720) Rename UnresolvedFunc to UnresolvedFunctionName

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41720: Assignee: Apache Spark > Rename UnresolvedFunc to UnresolvedFunctionName > --

[jira] [Assigned] (SPARK-41720) Rename UnresolvedFunc to UnresolvedFunctionName

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41720: Assignee: (was: Apache Spark) > Rename UnresolvedFunc to UnresolvedFunctionName > ---

[jira] [Assigned] (SPARK-41719) Spark SSLOptions sub settings should be set only when ssl is enabled

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41719: Assignee: (was: Apache Spark) > Spark SSLOptions sub settings should be set only when

[jira] [Assigned] (SPARK-41719) Spark SSLOptions sub settings should be set only when ssl is enabled

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41719: Assignee: Apache Spark > Spark SSLOptions sub settings should be set only when ssl is ena

[jira] [Commented] (SPARK-41719) Spark SSLOptions sub settings should be set only when ssl is enabled

2022-12-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652014#comment-17652014 ] Apache Spark commented on SPARK-41719: -- User 'shrprasa' has created a pull request

[jira] [Created] (SPARK-41720) Rename UnresolvedFunc to UnresolvedFunctionName

2022-12-26 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41720: --- Summary: Rename UnresolvedFunc to UnresolvedFunctionName Key: SPARK-41720 URL: https://issues.apache.org/jira/browse/SPARK-41720 Project: Spark Issue Type: Imp

[jira] [Updated] (SPARK-41719) Spark SSLOptions sub settings should be set only when ssl is enabled

2022-12-26 Thread Shrikant Prasad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shrikant Prasad updated SPARK-41719: Description: If ${ns}.enabled is false, there is no use of setting rest of ${ns}.* setting

[jira] [Updated] (SPARK-41719) Spark SSLOptions sub settings should be set only when ssl is enabled

2022-12-26 Thread Shrikant Prasad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shrikant Prasad updated SPARK-41719: Summary: Spark SSLOptions sub settings should be set only when ssl is enabled (was: Spark

  1   2   >