[jira] [Created] (SPARK-40226) ps.DataFrame should support MultiIndex with a Distributed Dataset

2022-08-25 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40226: - Summary: ps.DataFrame should support MultiIndex with a Distributed Dataset Key: SPARK-40226 URL: https://issues.apache.org/jira/browse/SPARK-40226 Project: Spark

[jira] [Resolved] (SPARK-40225) PySpark rdd.takeOrdered should check num and numPartitions

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40225. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37669 [https://gi

[jira] [Assigned] (SPARK-40225) PySpark rdd.takeOrdered should check num and numPartitions

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40225: Assignee: Ruifeng Zheng > PySpark rdd.takeOrdered should check num and numPartitions > --

[jira] [Assigned] (SPARK-40225) PySpark rdd.takeOrdered should check num and numPartitions

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40225: Assignee: (was: Apache Spark) > PySpark rdd.takeOrdered should check num and numParti

[jira] [Commented] (SPARK-40225) PySpark rdd.takeOrdered should check num and numPartitions

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585148#comment-17585148 ] Apache Spark commented on SPARK-40225: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-40225) PySpark rdd.takeOrdered should check num and numPartitions

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585146#comment-17585146 ] Apache Spark commented on SPARK-40225: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-40225) PySpark rdd.takeOrdered should check num and numPartitions

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40225: Assignee: Apache Spark > PySpark rdd.takeOrdered should check num and numPartitions > ---

[jira] [Resolved] (SPARK-40206) Spark SQL Predict Pushdown for Hive Bucketed Table

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40206. -- Resolution: Invalid > Spark SQL Predict Pushdown for Hive Bucketed Table > ---

[jira] [Updated] (SPARK-40204) Whether it is possible to support querying the status of a specific application in a subsequent version

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40204: - Flags: (was: Important) > Whether it is possible to support querying the status of a specific

[jira] [Commented] (SPARK-40206) Spark SQL Predict Pushdown for Hive Bucketed Table

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585135#comment-17585135 ] Hyukjin Kwon commented on SPARK-40206: -- [~raymond.tang] Let;s probably ask the ques

[jira] [Created] (SPARK-40225) PySpark rdd.takeOrdered should check num and numPartitions

2022-08-25 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40225: - Summary: PySpark rdd.takeOrdered should check num and numPartitions Key: SPARK-40225 URL: https://issues.apache.org/jira/browse/SPARK-40225 Project: Spark

[jira] [Updated] (SPARK-39656) Fix wrong namespace in DescribeNamespaceExec

2022-08-25 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-39656: -- Fix Version/s: 3.1.4 3.4.0 3.3.1 3.2.3 > Fix

[jira] [Commented] (SPARK-40224) Make ObjectHashAggregateExec release memory eagerly when fallback to sort-based

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585109#comment-17585109 ] Apache Spark commented on SPARK-40224: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-40224) Make ObjectHashAggregateExec release memory eagerly when fallback to sort-based

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40224: Assignee: (was: Apache Spark) > Make ObjectHashAggregateExec release memory eagerly w

[jira] [Assigned] (SPARK-40224) Make ObjectHashAggregateExec release memory eagerly when fallback to sort-based

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40224: Assignee: Apache Spark > Make ObjectHashAggregateExec release memory eagerly when fallbac

[jira] [Comment Edited] (SPARK-26568) Too many partitions may cause thriftServer frequently Full GC

2022-08-25 Thread gglinux (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585103#comment-17585103 ] gglinux edited comment on SPARK-26568 at 8/26/22 2:46 AM: -- We e

[jira] [Created] (SPARK-40224) Make ObjectHashAggregateExec release memory eagerly when fallback to sort-based

2022-08-25 Thread XiDuo You (Jira)
XiDuo You created SPARK-40224: - Summary: Make ObjectHashAggregateExec release memory eagerly when fallback to sort-based Key: SPARK-40224 URL: https://issues.apache.org/jira/browse/SPARK-40224 Project: Sp

[jira] [Comment Edited] (SPARK-26568) Too many partitions may cause thriftServer frequently Full GC

2022-08-25 Thread gglinux (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585104#comment-17585104 ] gglinux edited comment on SPARK-26568 at 8/26/22 2:46 AM: -- {cod

[jira] [Assigned] (SPARK-40153) Unify the logic of resolve functions and table-valued functions

2022-08-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40153: --- Assignee: Allison Wang > Unify the logic of resolve functions and table-valued functions >

[jira] [Resolved] (SPARK-40153) Unify the logic of resolve functions and table-valued functions

2022-08-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40153. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37586 [https://gith

[jira] [Commented] (SPARK-26568) Too many partitions may cause thriftServer frequently Full GC

2022-08-25 Thread gglinux (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585104#comment-17585104 ] gglinux commented on SPARK-26568: - {code:java} //代码占位符 at org.apache.spark.sql.catalyst.

[jira] [Commented] (SPARK-26568) Too many partitions may cause thriftServer frequently Full GC

2022-08-25 Thread gglinux (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585103#comment-17585103 ] gglinux commented on SPARK-26568: - We encountered the same problem and can be reproduced

[jira] [Updated] (SPARK-26568) Too many partitions may cause thriftServer frequently Full GC

2022-08-25 Thread gglinux (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gglinux updated SPARK-26568: Attachment: error.log > Too many partitions may cause thriftServer frequently Full GC > --

[jira] [Updated] (SPARK-40223) Cannot alter table with locale tr

2022-08-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40223: Description: How to reproduce this issue: {code:scala} test("Test update stats with locale tr")

[jira] [Created] (SPARK-40223) Cannot alter table with locale tr

2022-08-25 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40223: --- Summary: Cannot alter table with locale tr Key: SPARK-40223 URL: https://issues.apache.org/jira/browse/SPARK-40223 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-40221) Not able to format using scalafmt

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585077#comment-17585077 ] Hyukjin Kwon commented on SPARK-40221: -- Does this still happen in the latest master

[jira] [Resolved] (SPARK-40049) Add adaptive plan case in ReplaceNullWithFalseInPredicateEndToEndSuite

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40049. -- Resolution: Invalid > Add adaptive plan case in ReplaceNullWithFalseInPredicateEndToEndSuite >

[jira] [Updated] (SPARK-40049) Add adaptive plan case in ReplaceNullWithFalseInPredicateEndToEndSuite

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40049: - Fix Version/s: (was: 3.4.0) > Add adaptive plan case in ReplaceNullWithFalseInPredicateEndTo

[jira] [Reopened] (SPARK-40049) Add adaptive plan case in ReplaceNullWithFalseInPredicateEndToEndSuite

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-40049: -- Assignee: (was: Kazuyuki Tanimura) > Add adaptive plan case in ReplaceNullWithFalseInPre

[jira] [Reopened] (SPARK-40088) Add SparkPlanWIthAQESuite

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-40088: -- Assignee: (was: Kazuyuki Tanimura) > Add SparkPlanWIthAQESuite > ---

[jira] [Resolved] (SPARK-40088) Add SparkPlanWIthAQESuite

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40088. -- Resolution: Invalid > Add SparkPlanWIthAQESuite > - > >

[jira] [Updated] (SPARK-40088) Add SparkPlanWIthAQESuite

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40088: - Fix Version/s: (was: 3.4.0) > Add SparkPlanWIthAQESuite > - > >

[jira] [Resolved] (SPARK-40110) Add JDBCWithAQESuite

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40110. -- Resolution: Invalid Marking it as an invalid for now since we're not going to go this way. >

[jira] [Updated] (SPARK-40110) Add JDBCWithAQESuite

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40110: - Fix Version/s: (was: 3.4.0) > Add JDBCWithAQESuite > > >

[jira] [Reopened] (SPARK-40110) Add JDBCWithAQESuite

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-40110: -- > Add JDBCWithAQESuite > > > Key: SPARK-40110 >

[jira] [Commented] (SPARK-40088) Add SparkPlanWIthAQESuite

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585070#comment-17585070 ] Apache Spark commented on SPARK-40088: -- User 'kazuyukitanimura' has created a pull

[jira] [Commented] (SPARK-40110) Add JDBCWithAQESuite

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585068#comment-17585068 ] Apache Spark commented on SPARK-40110: -- User 'kazuyukitanimura' has created a pull

[jira] [Commented] (SPARK-40088) Add SparkPlanWIthAQESuite

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585067#comment-17585067 ] Apache Spark commented on SPARK-40088: -- User 'kazuyukitanimura' has created a pull

[jira] [Commented] (SPARK-40049) Add adaptive plan case in ReplaceNullWithFalseInPredicateEndToEndSuite

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585066#comment-17585066 ] Apache Spark commented on SPARK-40049: -- User 'kazuyukitanimura' has created a pull

[jira] [Commented] (SPARK-40222) Numeric try_add/try_divide/try_subtract/try_multiply should throw error from their children

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585047#comment-17585047 ] Apache Spark commented on SPARK-40222: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-40222) Numeric try_add/try_divide/try_subtract/try_multiply should throw error from their children

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40222: Assignee: Gengliang Wang (was: Apache Spark) > Numeric try_add/try_divide/try_subtract/t

[jira] [Commented] (SPARK-40222) Numeric try_add/try_divide/try_subtract/try_multiply should throw error from their children

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585048#comment-17585048 ] Apache Spark commented on SPARK-40222: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-40222) Numeric try_add/try_divide/try_subtract/try_multiply should throw error from their children

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40222: Assignee: Apache Spark (was: Gengliang Wang) > Numeric try_add/try_divide/try_subtract/t

[jira] [Created] (SPARK-40222) Numeric try_add/try_divide/try_subtract/try_multiply should throw error from their children

2022-08-25 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40222: -- Summary: Numeric try_add/try_divide/try_subtract/try_multiply should throw error from their children Key: SPARK-40222 URL: https://issues.apache.org/jira/browse/SPARK-40222

[jira] [Commented] (SPARK-40142) Make pyspark.sql.functions examples self-contained

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585035#comment-17585035 ] Apache Spark commented on SPARK-40142: -- User 'khalidmammadov' has created a pull re

[jira] [Commented] (SPARK-40142) Make pyspark.sql.functions examples self-contained

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585036#comment-17585036 ] Apache Spark commented on SPARK-40142: -- User 'khalidmammadov' has created a pull re

[jira] [Assigned] (SPARK-40211) Allow executeTake() / collectLimit's number of starting partitions to be customized

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40211: Assignee: Apache Spark > Allow executeTake() / collectLimit's number of starting partitio

[jira] [Commented] (SPARK-40211) Allow executeTake() / collectLimit's number of starting partitions to be customized

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584995#comment-17584995 ] Apache Spark commented on SPARK-40211: -- User 'liuzqt' has created a pull request fo

[jira] [Assigned] (SPARK-40211) Allow executeTake() / collectLimit's number of starting partitions to be customized

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40211: Assignee: (was: Apache Spark) > Allow executeTake() / collectLimit's number of starti

[jira] [Updated] (SPARK-40221) Not able to format using scalafmt

2022-08-25 Thread Ziqi Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ziqi Liu updated SPARK-40221: - Description: I'm following the guidance in [https://spark.apache.org/developer-tools.html] using  {code

[jira] [Created] (SPARK-40221) Not able to format using scalafmt

2022-08-25 Thread Ziqi Liu (Jira)
Ziqi Liu created SPARK-40221: Summary: Not able to format using scalafmt Key: SPARK-40221 URL: https://issues.apache.org/jira/browse/SPARK-40221 Project: Spark Issue Type: Question Comp

[jira] [Updated] (SPARK-40131) Support NumPy ndarray in built-in functions

2022-08-25 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40131: - Description: Support NumPy ndarray in built-in functions(`pyspark.sql.functions`) by introducing

[jira] [Resolved] (SPARK-40130) Support NumPy scalars in built-in functions

2022-08-25 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-40130. -- Assignee: Xinrong Meng Resolution: Fixed > Support NumPy scalars in built-in functions >

[jira] [Assigned] (SPARK-39483) Construct the schema from `np.dtype` when `createDataFrame` from a NumPy array

2022-08-25 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-39483: Assignee: Xinrong Meng > Construct the schema from `np.dtype` when `createDataFrame` fro

[jira] [Commented] (SPARK-40130) Support NumPy scalars in built-in functions

2022-08-25 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584975#comment-17584975 ] Xinrong Meng commented on SPARK-40130: -- Resolved by https://github.com/apache/spark

[jira] [Commented] (SPARK-40220) Don't output the empty map of error message parameters

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584892#comment-17584892 ] Apache Spark commented on SPARK-40220: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-40220) Don't output the empty map of error message parameters

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40220: Assignee: Max Gekk (was: Apache Spark) > Don't output the empty map of error message par

[jira] [Assigned] (SPARK-40220) Don't output the empty map of error message parameters

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40220: Assignee: Apache Spark (was: Max Gekk) > Don't output the empty map of error message par

[jira] [Created] (SPARK-40220) Don't output the empty map of error message parameters

2022-08-25 Thread Max Gekk (Jira)
Max Gekk created SPARK-40220: Summary: Don't output the empty map of error message parameters Key: SPARK-40220 URL: https://issues.apache.org/jira/browse/SPARK-40220 Project: Spark Issue Type: Su

[jira] [Commented] (SPARK-40212) SparkSQL castPartValue does not properly handle byte & short

2022-08-25 Thread Brennan Stein (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584884#comment-17584884 ] Brennan Stein commented on SPARK-40212: --- Is a PR with unit test adequate reproduct

[jira] [Commented] (SPARK-33760) Extend Dynamic Partition Pruning Support to DataSources

2022-08-25 Thread Willi Raschkowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584882#comment-17584882 ] Willi Raschkowski commented on SPARK-33760: --- Is this related to SPARK-35779?

[jira] [Assigned] (SPARK-40212) SparkSQL castPartValue does not properly handle byte & short

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40212: Assignee: Apache Spark > SparkSQL castPartValue does not properly handle byte & short > -

[jira] [Assigned] (SPARK-40212) SparkSQL castPartValue does not properly handle byte & short

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40212: Assignee: (was: Apache Spark) > SparkSQL castPartValue does not properly handle byte

[jira] [Commented] (SPARK-40212) SparkSQL castPartValue does not properly handle byte & short

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584880#comment-17584880 ] Apache Spark commented on SPARK-40212: -- User 'BrennanStein' has created a pull requ

[jira] [Resolved] (SPARK-40192) Remove redundant groupby

2022-08-25 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40192. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37628 [https://gi

[jira] [Assigned] (SPARK-40192) Remove redundant groupby

2022-08-25 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40192: Assignee: deshanxiao > Remove redundant groupby > > >

[jira] [Updated] (SPARK-40192) Remove redundant groupby

2022-08-25 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40192: - Priority: Trivial (was: Minor) > Remove redundant groupby > > >

[jira] [Commented] (SPARK-40219) resolved view plan should hold the schema to avoid redundant lookup

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584833#comment-17584833 ] Apache Spark commented on SPARK-40219: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-40219) resolved view plan should hold the schema to avoid redundant lookup

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40219: Assignee: (was: Apache Spark) > resolved view plan should hold the schema to avoid re

[jira] [Assigned] (SPARK-40219) resolved view plan should hold the schema to avoid redundant lookup

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40219: Assignee: Apache Spark > resolved view plan should hold the schema to avoid redundant loo

[jira] [Commented] (SPARK-40219) resolved view plan should hold the schema to avoid redundant lookup

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584830#comment-17584830 ] Apache Spark commented on SPARK-40219: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-40219) resolved view plan should hold the schema to avoid redundant lookup

2022-08-25 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-40219: --- Summary: resolved view plan should hold the schema to avoid redundant lookup Key: SPARK-40219 URL: https://issues.apache.org/jira/browse/SPARK-40219 Project: Spark

[jira] [Commented] (SPARK-40010) Make pyspark.sql.window examples self-contained

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584826#comment-17584826 ] Apache Spark commented on SPARK-40010: -- User 'dcoliversun' has created a pull reque

[jira] [Commented] (SPARK-39562) Make hive-thrift server module passes in IPv6 environment

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584770#comment-17584770 ] Apache Spark commented on SPARK-39562: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-39562) Make hive-thrift server module passes in IPv6 environment

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584769#comment-17584769 ] Apache Spark commented on SPARK-39562: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-40218) GROUPING SETS should preserve the grouping columns

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584756#comment-17584756 ] Apache Spark commented on SPARK-40218: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-40218) GROUPING SETS should preserve the grouping columns

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584754#comment-17584754 ] Apache Spark commented on SPARK-40218: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-40218) GROUPING SETS should preserve the grouping columns

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40218: Assignee: Wenchen Fan (was: Apache Spark) > GROUPING SETS should preserve the grouping c

[jira] [Assigned] (SPARK-40218) GROUPING SETS should preserve the grouping columns

2022-08-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40218: Assignee: Apache Spark (was: Wenchen Fan) > GROUPING SETS should preserve the grouping c

[jira] [Created] (SPARK-40218) GROUPING SETS should preserve the grouping columns

2022-08-25 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-40218: --- Summary: GROUPING SETS should preserve the grouping columns Key: SPARK-40218 URL: https://issues.apache.org/jira/browse/SPARK-40218 Project: Spark Issue Type:

[jira] [Created] (SPARK-40217) Support java.math.BigDecimal as an external type of Decimal128 type

2022-08-25 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-40217: -- Summary: Support java.math.BigDecimal as an external type of Decimal128 type Key: SPARK-40217 URL: https://issues.apache.org/jira/browse/SPARK-40217 Project: Spark

[jira] [Resolved] (SPARK-40205) Provide a query context of ELEMENT_AT_BY_INDEX_ZERO

2022-08-25 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40205. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37645 [https://github.com

[jira] [Resolved] (SPARK-40209) Incorrect value in the error message of NUMERIC_VALUE_OUT_OF_RANGE

2022-08-25 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40209. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37649 [https://github.com

[jira] [Resolved] (SPARK-40053) HiveExternalCatalogVersionsSuite will test all spark versions and aborted when Python 2.7 is used

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40053. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37487 [https://gi

[jira] [Assigned] (SPARK-40053) HiveExternalCatalogVersionsSuite will test all spark versions and aborted when Python 2.7 is used

2022-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40053: Assignee: Yang Jie > HiveExternalCatalogVersionsSuite will test all spark versions and ab