[jira] [Created] (SPARK-39445) Remove the window if windowExpressions is empty in column pruning

Yuming Wang created SPARK-39445: --- Summary: Remove the window if windowExpressions is empty in column pruning Key: SPARK-39445 URL: https://issues.apache.org/jira/browse/SPARK-39445 Project: Spark

[jira] [Updated] (SPARK-39444) Add OptimizeSubqueries into nonExcludableRules list

[ https://issues.apache.org/jira/browse/SPARK-39444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-39444: Issue Type: Bug (was: Improvement) > Add OptimizeSubqueries into nonExcludableRules list > --

[jira] [Assigned] (SPARK-39444) Add OptimizeSubqueries into nonExcludableRules list

[ https://issues.apache.org/jira/browse/SPARK-39444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39444: Assignee: (was: Apache Spark) > Add OptimizeSubqueries into nonExcludableRules list >

[jira] [Commented] (SPARK-39444) Add OptimizeSubqueries into nonExcludableRules list

[ https://issues.apache.org/jira/browse/SPARK-39444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17553034#comment-17553034 ] Apache Spark commented on SPARK-39444: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-39444) Add OptimizeSubqueries into nonExcludableRules list

[ https://issues.apache.org/jira/browse/SPARK-39444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39444: Assignee: Apache Spark > Add OptimizeSubqueries into nonExcludableRules list > --

[jira] [Assigned] (SPARK-39444) Add OptimizeSubqueries into nonExcludableRules list

[ https://issues.apache.org/jira/browse/SPARK-39444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39444: Assignee: Apache Spark > Add OptimizeSubqueries into nonExcludableRules list > --

[jira] [Created] (SPARK-39444) Add OptimizeSubqueries into nonExcludableRules list

Yuming Wang created SPARK-39444: --- Summary: Add OptimizeSubqueries into nonExcludableRules list Key: SPARK-39444 URL: https://issues.apache.org/jira/browse/SPARK-39444 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-39440) Add a config to disable event timeline

[ https://issues.apache.org/jira/browse/SPARK-39440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-39440: -- Assignee: Yuming Wang > Add a config to disable event timeline >

[jira] [Resolved] (SPARK-39440) Add a config to disable event timeline

[ https://issues.apache.org/jira/browse/SPARK-39440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39440. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36833 [https:

[jira] [Resolved] (SPARK-39442) Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE

[ https://issues.apache.org/jira/browse/SPARK-39442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39442. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36839 [https://

[jira] [Assigned] (SPARK-39442) Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE

[ https://issues.apache.org/jira/browse/SPARK-39442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39442: - Assignee: Dongjoon Hyun > Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE >

[jira] [Assigned] (SPARK-39443) Improve docstring of pyspark.sql.functions.col/first

[ https://issues.apache.org/jira/browse/SPARK-39443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39443: Assignee: (was: Apache Spark) > Improve docstring of pyspark.sql.functions.col/first

[jira] [Assigned] (SPARK-39443) Improve docstring of pyspark.sql.functions.col/first

[ https://issues.apache.org/jira/browse/SPARK-39443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39443: Assignee: Apache Spark > Improve docstring of pyspark.sql.functions.col/first > -

[jira] [Commented] (SPARK-39443) Improve docstring of pyspark.sql.functions.col/first

[ https://issues.apache.org/jira/browse/SPARK-39443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17553003#comment-17553003 ] Apache Spark commented on SPARK-39443: -- User 'xinrong-databricks' has created a pul

[jira] [Comment Edited] (SPARK-39419) When the comparator of ArraySort returns null, it should fail.

[ https://issues.apache.org/jira/browse/SPARK-39419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17553002#comment-17553002 ] Dongjoon Hyun edited comment on SPARK-39419 at 6/10/22 11:52 PM: -

[jira] [Resolved] (SPARK-39419) When the comparator of ArraySort returns null, it should fail.

[ https://issues.apache.org/jira/browse/SPARK-39419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39419. --- Fix Version/s: 3.2.2 3.3.1 Assignee: Takuya Ueshin Resolut

[jira] [Created] (SPARK-39443) Improve docstring of pyspark.sql.functions.col/first

Xinrong Meng created SPARK-39443: Summary: Improve docstring of pyspark.sql.functions.col/first Key: SPARK-39443 URL: https://issues.apache.org/jira/browse/SPARK-39443 Project: Spark Issue Ty

[jira] [Commented] (SPARK-39442) Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE

[ https://issues.apache.org/jira/browse/SPARK-39442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552998#comment-17552998 ] Apache Spark commented on SPARK-39442: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-39442) Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE

[ https://issues.apache.org/jira/browse/SPARK-39442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552996#comment-17552996 ] Apache Spark commented on SPARK-39442: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-39442) Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE

[ https://issues.apache.org/jira/browse/SPARK-39442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39442: Assignee: Apache Spark > Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE > ---

[jira] [Assigned] (SPARK-39442) Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE

[ https://issues.apache.org/jira/browse/SPARK-39442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39442: Assignee: (was: Apache Spark) > Update PlanStabilitySuite comment with SPARK_ANSI_SQL

[jira] [Created] (SPARK-39442) Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE

Dongjoon Hyun created SPARK-39442: - Summary: Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE Key: SPARK-39442 URL: https://issues.apache.org/jira/browse/SPARK-39442 Project: Spark

[jira] [Commented] (SPARK-39437) normalize plan id separately in PlanStabilitySuite

[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552992#comment-17552992 ] Apache Spark commented on SPARK-39437: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-39437) normalize plan id separately in PlanStabilitySuite

[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552991#comment-17552991 ] Apache Spark commented on SPARK-39437: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-39441) Speed up DeduplicateRelations

[ https://issues.apache.org/jira/browse/SPARK-39441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39441: Assignee: (was: Apache Spark) > Speed up DeduplicateRelations > -

[jira] [Assigned] (SPARK-39441) Speed up DeduplicateRelations

[ https://issues.apache.org/jira/browse/SPARK-39441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39441: Assignee: Apache Spark > Speed up DeduplicateRelations > - >

[jira] [Commented] (SPARK-39441) Speed up DeduplicateRelations

[ https://issues.apache.org/jira/browse/SPARK-39441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552990#comment-17552990 ] Apache Spark commented on SPARK-39441: -- User 'allisonwang-db' has created a pull re

[jira] [Created] (SPARK-39441) Speed up DeduplicateRelations

Allison Wang created SPARK-39441: Summary: Speed up DeduplicateRelations Key: SPARK-39441 URL: https://issues.apache.org/jira/browse/SPARK-39441 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-39437) normalize plan id separately in PlanStabilitySuite

[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552957#comment-17552957 ] Apache Spark commented on SPARK-39437: -- User 'dongjoon-hyun' has created a pull req

[jira] [Updated] (SPARK-39437) normalize plan id separately in PlanStabilitySuite

[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39437: -- Fix Version/s: 3.4.0 > normalize plan id separately in PlanStabilitySuite > --

[jira] [Updated] (SPARK-39437) normalize plan id separately in PlanStabilitySuite

[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39437: -- Affects Version/s: 3.2.1 3.3.0 > normalize plan id separately in PlanSt

[jira] [Commented] (SPARK-39419) When the comparator of ArraySort returns null, it should fail.

[ https://issues.apache.org/jira/browse/SPARK-39419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552912#comment-17552912 ] Apache Spark commented on SPARK-39419: -- User 'ueshin' has created a pull request fo

[jira] [Commented] (SPARK-39419) When the comparator of ArraySort returns null, it should fail.

[ https://issues.apache.org/jira/browse/SPARK-39419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552910#comment-17552910 ] Apache Spark commented on SPARK-39419: -- User 'ueshin' has created a pull request fo

[jira] [Updated] (SPARK-39434) Provide runtime error query context when array index is out of bound

[ https://issues.apache.org/jira/browse/SPARK-39434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39434: --- Affects Version/s: 3.4.0 (was: 3.3.0) > Provide runtime error que

[jira] [Resolved] (SPARK-39434) Provide runtime error query context when array index is out of bound

[ https://issues.apache.org/jira/browse/SPARK-39434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39434. Resolution: Fixed Resolved in https://github.com/apache/spark/pull/36826 > Provide runtim

[jira] [Assigned] (SPARK-39437) normalize plan id separately in PlanStabilitySuite

[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39437: --- Assignee: Wenchen Fan > normalize plan id separately in PlanStabilitySuite > --

[jira] [Resolved] (SPARK-39437) normalize plan id separately in PlanStabilitySuite

[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39437. - Fix Version/s: 3.2.2 Resolution: Fixed Issue resolved by pull request 36828 [https://gith

[jira] [Commented] (SPARK-39440) Add a config to disable event timeline

[ https://issues.apache.org/jira/browse/SPARK-39440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552750#comment-17552750 ] Apache Spark commented on SPARK-39440: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-39440) Add a config to disable event timeline

[ https://issues.apache.org/jira/browse/SPARK-39440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39440: Assignee: Apache Spark > Add a config to disable event timeline > ---

[jira] [Assigned] (SPARK-39440) Add a config to disable event timeline

[ https://issues.apache.org/jira/browse/SPARK-39440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39440: Assignee: (was: Apache Spark) > Add a config to disable event timeline >

[jira] [Commented] (SPARK-39440) Add a config to disable event timeline

[ https://issues.apache.org/jira/browse/SPARK-39440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552749#comment-17552749 ] Apache Spark commented on SPARK-39440: -- User 'wangyum' has created a pull request f

[jira] [Created] (SPARK-39440) Add a config to disable event timeline

Yuming Wang created SPARK-39440: --- Summary: Add a config to disable event timeline Key: SPARK-39440 URL: https://issues.apache.org/jira/browse/SPARK-39440 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-37281) Support DayTimeIntervalType in Py4J

[ https://issues.apache.org/jira/browse/SPARK-37281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37281: Assignee: Hyukjin Kwon (was: Hyukjin Kwon) > Support DayTimeIntervalType in Py4J > -

[jira] [Assigned] (SPARK-37525) Timedelta support in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37525: Assignee: Xinrong Meng > Timedelta support in pandas API on Spark > -

[jira] [Commented] (SPARK-39439) Suppress error log for in-progress event log not found

[ https://issues.apache.org/jira/browse/SPARK-39439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552711#comment-17552711 ] Apache Spark commented on SPARK-39439: -- User 'pan3793' has created a pull request f

[jira] [Assigned] (SPARK-39439) Suppress error log for in-progress event log not found

[ https://issues.apache.org/jira/browse/SPARK-39439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39439: Assignee: Apache Spark > Suppress error log for in-progress event log not found > ---

[jira] [Assigned] (SPARK-39439) Suppress error log for in-progress event log not found

[ https://issues.apache.org/jira/browse/SPARK-39439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39439: Assignee: (was: Apache Spark) > Suppress error log for in-progress event log not foun

[jira] [Created] (SPARK-39439) Suppress error log for in-progress event log not found

Cheng Pan created SPARK-39439: - Summary: Suppress error log for in-progress event log not found Key: SPARK-39439 URL: https://issues.apache.org/jira/browse/SPARK-39439 Project: Spark Issue Type:

[jira] [Commented] (SPARK-39126) After eliminating join to one side, that side should take advantage of LocalShuffleRead optimization

[ https://issues.apache.org/jira/browse/SPARK-39126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552696#comment-17552696 ] Apache Spark commented on SPARK-39126: -- User 'mcdull-zhang' has created a pull requ

[jira] [Commented] (SPARK-39126) After eliminating join to one side, that side should take advantage of LocalShuffleRead optimization

[ https://issues.apache.org/jira/browse/SPARK-39126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552697#comment-17552697 ] Apache Spark commented on SPARK-39126: -- User 'mcdull-zhang' has created a pull requ

[jira] [Commented] (SPARK-38761) DS V2 supports push down misc non-aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-38761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552670#comment-17552670 ] Apache Spark commented on SPARK-38761: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-38761) DS V2 supports push down misc non-aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-38761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552669#comment-17552669 ] Apache Spark commented on SPARK-38761: -- User 'beliefer' has created a pull request

[jira] [Resolved] (SPARK-39425) Add migration guide for PS behavior changes

[ https://issues.apache.org/jira/browse/SPARK-39425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39425. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36816 [https://gi

[jira] [Assigned] (SPARK-39425) Add migration guide for PS behavior changes

[ https://issues.apache.org/jira/browse/SPARK-39425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39425: Assignee: Yikun Jiang > Add migration guide for PS behavior changes > ---

[jira] [Assigned] (SPARK-39428) use code block for `Coalesce Hints for SQL Queries`

[ https://issues.apache.org/jira/browse/SPARK-39428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-39428: --- Assignee: qian > use code block for `Coalesce Hints for SQL Queries` >

[jira] [Resolved] (SPARK-39428) use code block for `Coalesce Hints for SQL Queries`

[ https://issues.apache.org/jira/browse/SPARK-39428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39428. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36820 [https://gith