[jira] [Assigned] (SPARK-39444) Add OptimizeSubqueries into nonExcludableRules list
[ https://issues.apache.org/jira/browse/SPARK-39444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39444: Assignee: (was: Apache Spark) > Add OptimizeSubqueries into nonExcludableRules list > --- > > Key: SPARK-39444 > URL: https://issues.apache.org/jira/browse/SPARK-39444 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.4.0 >Reporter: Yuming Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39444) Add OptimizeSubqueries into nonExcludableRules list
[ https://issues.apache.org/jira/browse/SPARK-39444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553034#comment-17553034 ] Apache Spark commented on SPARK-39444: -- User 'wangyum' has created a pull request for this issue: https://github.com/apache/spark/pull/36841 > Add OptimizeSubqueries into nonExcludableRules list > --- > > Key: SPARK-39444 > URL: https://issues.apache.org/jira/browse/SPARK-39444 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.4.0 >Reporter: Yuming Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39444) Add OptimizeSubqueries into nonExcludableRules list
[ https://issues.apache.org/jira/browse/SPARK-39444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39444: Assignee: Apache Spark > Add OptimizeSubqueries into nonExcludableRules list > --- > > Key: SPARK-39444 > URL: https://issues.apache.org/jira/browse/SPARK-39444 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.4.0 >Reporter: Yuming Wang >Assignee: Apache Spark >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39444) Add OptimizeSubqueries into nonExcludableRules list
[ https://issues.apache.org/jira/browse/SPARK-39444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39444: Assignee: Apache Spark > Add OptimizeSubqueries into nonExcludableRules list > --- > > Key: SPARK-39444 > URL: https://issues.apache.org/jira/browse/SPARK-39444 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.4.0 >Reporter: Yuming Wang >Assignee: Apache Spark >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-39444) Add OptimizeSubqueries into nonExcludableRules list
Yuming Wang created SPARK-39444: --- Summary: Add OptimizeSubqueries into nonExcludableRules list Key: SPARK-39444 URL: https://issues.apache.org/jira/browse/SPARK-39444 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 3.4.0 Reporter: Yuming Wang -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39440) Add a config to disable event timeline
[ https://issues.apache.org/jira/browse/SPARK-39440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-39440: -- Assignee: Yuming Wang > Add a config to disable event timeline > -- > > Key: SPARK-39440 > URL: https://issues.apache.org/jira/browse/SPARK-39440 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.4.0 >Reporter: Yuming Wang >Assignee: Yuming Wang >Priority: Major > Fix For: 3.4.0 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-39440) Add a config to disable event timeline
[ https://issues.apache.org/jira/browse/SPARK-39440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39440. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36833 [https://github.com/apache/spark/pull/36833] > Add a config to disable event timeline > -- > > Key: SPARK-39440 > URL: https://issues.apache.org/jira/browse/SPARK-39440 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.4.0 >Reporter: Yuming Wang >Priority: Major > Fix For: 3.4.0 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-39442) Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE
[ https://issues.apache.org/jira/browse/SPARK-39442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39442. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36839 [https://github.com/apache/spark/pull/36839] > Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE > -- > > Key: SPARK-39442 > URL: https://issues.apache.org/jira/browse/SPARK-39442 > Project: Spark > Issue Type: Test > Components: SQL, Tests >Affects Versions: 3.3.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Minor > Fix For: 3.3.0 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39442) Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE
[ https://issues.apache.org/jira/browse/SPARK-39442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39442: - Assignee: Dongjoon Hyun > Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE > -- > > Key: SPARK-39442 > URL: https://issues.apache.org/jira/browse/SPARK-39442 > Project: Spark > Issue Type: Test > Components: SQL, Tests >Affects Versions: 3.3.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39443) Improve docstring of pyspark.sql.functions.col/first
[ https://issues.apache.org/jira/browse/SPARK-39443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39443: Assignee: (was: Apache Spark) > Improve docstring of pyspark.sql.functions.col/first > > > Key: SPARK-39443 > URL: https://issues.apache.org/jira/browse/SPARK-39443 > Project: Spark > Issue Type: Improvement > Components: Documentation, PySpark >Affects Versions: 3.4.0 >Reporter: Xinrong Meng >Priority: Major > > Improve docstring of pyspark.sql.functions.col/first. > `col` is malformatted. > `first` misses examples. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39443) Improve docstring of pyspark.sql.functions.col/first
[ https://issues.apache.org/jira/browse/SPARK-39443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39443: Assignee: Apache Spark > Improve docstring of pyspark.sql.functions.col/first > > > Key: SPARK-39443 > URL: https://issues.apache.org/jira/browse/SPARK-39443 > Project: Spark > Issue Type: Improvement > Components: Documentation, PySpark >Affects Versions: 3.4.0 >Reporter: Xinrong Meng >Assignee: Apache Spark >Priority: Major > > Improve docstring of pyspark.sql.functions.col/first. > `col` is malformatted. > `first` misses examples. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39443) Improve docstring of pyspark.sql.functions.col/first
[ https://issues.apache.org/jira/browse/SPARK-39443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553003#comment-17553003 ] Apache Spark commented on SPARK-39443: -- User 'xinrong-databricks' has created a pull request for this issue: https://github.com/apache/spark/pull/36840 > Improve docstring of pyspark.sql.functions.col/first > > > Key: SPARK-39443 > URL: https://issues.apache.org/jira/browse/SPARK-39443 > Project: Spark > Issue Type: Improvement > Components: Documentation, PySpark >Affects Versions: 3.4.0 >Reporter: Xinrong Meng >Priority: Major > > Improve docstring of pyspark.sql.functions.col/first. > `col` is malformatted. > `first` misses examples. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Comment Edited] (SPARK-39419) When the comparator of ArraySort returns null, it should fail.
[
https://issues.apache.org/jira/browse/SPARK-39419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553002#comment-17553002
]
Dongjoon Hyun edited comment on SPARK-39419 at 6/10/22 11:52 PM:
-
This is resolved via
[https://github.com/apache/spark/pull/36812] (master)
[https://github.com/apache/spark/pull/36834] (branch-3.3)
[https://github.com/apache/spark/pull/36835] (branch-3.2)
was (Author: dongjoon):
This is resolved via https://github.com/apache/spark/pull/36835
> When the comparator of ArraySort returns null, it should fail.
> --
>
> Key: SPARK-39419
> URL: https://issues.apache.org/jira/browse/SPARK-39419
> Project: Spark
> Issue Type: Bug
> Components: SQL
>Affects Versions: 3.3.0
>Reporter: Takuya Ueshin
>Assignee: Takuya Ueshin
>Priority: Major
> Fix For: 3.2.2, 3.3.1
>
>
> When the comparator of {{ArraySort}} returns {{null}}, currently it handles
> it as {{0}} (equal).
> According to the doc,
> {quote}
> It returns -1, 0, or 1 as the first element is less than, equal to, or
> greater than the second element. If the comparator function returns other
> values (including null), the function will fail and raise an error.
> {quote}
> It's fine to return non -1, 0, 1 integers to follow the Java convention
> (still need to update the doc, though), but it should throw an exception for
> {{null}} result.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-39419) When the comparator of ArraySort returns null, it should fail.
[
https://issues.apache.org/jira/browse/SPARK-39419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-39419.
---
Fix Version/s: 3.2.2
3.3.1
Assignee: Takuya Ueshin
Resolution: Fixed
This is resolved via https://github.com/apache/spark/pull/36835
> When the comparator of ArraySort returns null, it should fail.
> --
>
> Key: SPARK-39419
> URL: https://issues.apache.org/jira/browse/SPARK-39419
> Project: Spark
> Issue Type: Bug
> Components: SQL
>Affects Versions: 3.3.0
>Reporter: Takuya Ueshin
>Assignee: Takuya Ueshin
>Priority: Major
> Fix For: 3.2.2, 3.3.1
>
>
> When the comparator of {{ArraySort}} returns {{null}}, currently it handles
> it as {{0}} (equal).
> According to the doc,
> {quote}
> It returns -1, 0, or 1 as the first element is less than, equal to, or
> greater than the second element. If the comparator function returns other
> values (including null), the function will fail and raise an error.
> {quote}
> It's fine to return non -1, 0, 1 integers to follow the Java convention
> (still need to update the doc, though), but it should throw an exception for
> {{null}} result.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-39443) Improve docstring of pyspark.sql.functions.col/first
Xinrong Meng created SPARK-39443: Summary: Improve docstring of pyspark.sql.functions.col/first Key: SPARK-39443 URL: https://issues.apache.org/jira/browse/SPARK-39443 Project: Spark Issue Type: Improvement Components: Documentation, PySpark Affects Versions: 3.4.0 Reporter: Xinrong Meng Improve docstring of pyspark.sql.functions.col/first. `col` is malformatted. `first` misses examples. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39442) Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE
[ https://issues.apache.org/jira/browse/SPARK-39442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552998#comment-17552998 ] Apache Spark commented on SPARK-39442: -- User 'dongjoon-hyun' has created a pull request for this issue: https://github.com/apache/spark/pull/36839 > Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE > -- > > Key: SPARK-39442 > URL: https://issues.apache.org/jira/browse/SPARK-39442 > Project: Spark > Issue Type: Test > Components: SQL, Tests >Affects Versions: 3.3.0 >Reporter: Dongjoon Hyun >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39442) Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE
[ https://issues.apache.org/jira/browse/SPARK-39442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552996#comment-17552996 ] Apache Spark commented on SPARK-39442: -- User 'dongjoon-hyun' has created a pull request for this issue: https://github.com/apache/spark/pull/36839 > Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE > -- > > Key: SPARK-39442 > URL: https://issues.apache.org/jira/browse/SPARK-39442 > Project: Spark > Issue Type: Test > Components: SQL, Tests >Affects Versions: 3.3.0 >Reporter: Dongjoon Hyun >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39442) Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE
[ https://issues.apache.org/jira/browse/SPARK-39442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39442: Assignee: Apache Spark > Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE > -- > > Key: SPARK-39442 > URL: https://issues.apache.org/jira/browse/SPARK-39442 > Project: Spark > Issue Type: Test > Components: SQL, Tests >Affects Versions: 3.3.0 >Reporter: Dongjoon Hyun >Assignee: Apache Spark >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39442) Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE
[ https://issues.apache.org/jira/browse/SPARK-39442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39442: Assignee: (was: Apache Spark) > Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE > -- > > Key: SPARK-39442 > URL: https://issues.apache.org/jira/browse/SPARK-39442 > Project: Spark > Issue Type: Test > Components: SQL, Tests >Affects Versions: 3.3.0 >Reporter: Dongjoon Hyun >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-39442) Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE
Dongjoon Hyun created SPARK-39442: - Summary: Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE Key: SPARK-39442 URL: https://issues.apache.org/jira/browse/SPARK-39442 Project: Spark Issue Type: Test Components: SQL, Tests Affects Versions: 3.3.0 Reporter: Dongjoon Hyun -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39437) normalize plan id separately in PlanStabilitySuite
[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552992#comment-17552992 ] Apache Spark commented on SPARK-39437: -- User 'dongjoon-hyun' has created a pull request for this issue: https://github.com/apache/spark/pull/36838 > normalize plan id separately in PlanStabilitySuite > -- > > Key: SPARK-39437 > URL: https://issues.apache.org/jira/browse/SPARK-39437 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.2.0, 3.2.1, 3.3.0 >Reporter: Wenchen Fan >Assignee: Wenchen Fan >Priority: Major > Fix For: 3.2.2, 3.4.0 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39437) normalize plan id separately in PlanStabilitySuite
[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552991#comment-17552991 ] Apache Spark commented on SPARK-39437: -- User 'dongjoon-hyun' has created a pull request for this issue: https://github.com/apache/spark/pull/36838 > normalize plan id separately in PlanStabilitySuite > -- > > Key: SPARK-39437 > URL: https://issues.apache.org/jira/browse/SPARK-39437 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.2.0, 3.2.1, 3.3.0 >Reporter: Wenchen Fan >Assignee: Wenchen Fan >Priority: Major > Fix For: 3.2.2, 3.4.0 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39441) Speed up DeduplicateRelations
[ https://issues.apache.org/jira/browse/SPARK-39441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39441: Assignee: (was: Apache Spark) > Speed up DeduplicateRelations > - > > Key: SPARK-39441 > URL: https://issues.apache.org/jira/browse/SPARK-39441 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.3.1 >Reporter: Allison Wang >Priority: Major > > Speed up the Analyzer rule DeduplicateRelations -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39441) Speed up DeduplicateRelations
[ https://issues.apache.org/jira/browse/SPARK-39441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39441: Assignee: Apache Spark > Speed up DeduplicateRelations > - > > Key: SPARK-39441 > URL: https://issues.apache.org/jira/browse/SPARK-39441 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.3.1 >Reporter: Allison Wang >Assignee: Apache Spark >Priority: Major > > Speed up the Analyzer rule DeduplicateRelations -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39441) Speed up DeduplicateRelations
[ https://issues.apache.org/jira/browse/SPARK-39441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552990#comment-17552990 ] Apache Spark commented on SPARK-39441: -- User 'allisonwang-db' has created a pull request for this issue: https://github.com/apache/spark/pull/36837 > Speed up DeduplicateRelations > - > > Key: SPARK-39441 > URL: https://issues.apache.org/jira/browse/SPARK-39441 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.3.1 >Reporter: Allison Wang >Priority: Major > > Speed up the Analyzer rule DeduplicateRelations -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-39441) Speed up DeduplicateRelations
Allison Wang created SPARK-39441: Summary: Speed up DeduplicateRelations Key: SPARK-39441 URL: https://issues.apache.org/jira/browse/SPARK-39441 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 3.3.1 Reporter: Allison Wang Speed up the Analyzer rule DeduplicateRelations -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39437) normalize plan id separately in PlanStabilitySuite
[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552957#comment-17552957 ] Apache Spark commented on SPARK-39437: -- User 'dongjoon-hyun' has created a pull request for this issue: https://github.com/apache/spark/pull/36836 > normalize plan id separately in PlanStabilitySuite > -- > > Key: SPARK-39437 > URL: https://issues.apache.org/jira/browse/SPARK-39437 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.2.0, 3.2.1, 3.3.0 >Reporter: Wenchen Fan >Assignee: Wenchen Fan >Priority: Major > Fix For: 3.2.2, 3.4.0 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-39437) normalize plan id separately in PlanStabilitySuite
[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39437: -- Fix Version/s: 3.4.0 > normalize plan id separately in PlanStabilitySuite > -- > > Key: SPARK-39437 > URL: https://issues.apache.org/jira/browse/SPARK-39437 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.2.0 >Reporter: Wenchen Fan >Assignee: Wenchen Fan >Priority: Major > Fix For: 3.2.2, 3.4.0 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-39437) normalize plan id separately in PlanStabilitySuite
[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39437: -- Affects Version/s: 3.2.1 3.3.0 > normalize plan id separately in PlanStabilitySuite > -- > > Key: SPARK-39437 > URL: https://issues.apache.org/jira/browse/SPARK-39437 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.2.0, 3.2.1, 3.3.0 >Reporter: Wenchen Fan >Assignee: Wenchen Fan >Priority: Major > Fix For: 3.2.2, 3.4.0 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39419) When the comparator of ArraySort returns null, it should fail.
[
https://issues.apache.org/jira/browse/SPARK-39419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552912#comment-17552912
]
Apache Spark commented on SPARK-39419:
--
User 'ueshin' has created a pull request for this issue:
https://github.com/apache/spark/pull/36835
> When the comparator of ArraySort returns null, it should fail.
> --
>
> Key: SPARK-39419
> URL: https://issues.apache.org/jira/browse/SPARK-39419
> Project: Spark
> Issue Type: Bug
> Components: SQL
>Affects Versions: 3.3.0
>Reporter: Takuya Ueshin
>Priority: Major
>
> When the comparator of {{ArraySort}} returns {{null}}, currently it handles
> it as {{0}} (equal).
> According to the doc,
> {quote}
> It returns -1, 0, or 1 as the first element is less than, equal to, or
> greater than the second element. If the comparator function returns other
> values (including null), the function will fail and raise an error.
> {quote}
> It's fine to return non -1, 0, 1 integers to follow the Java convention
> (still need to update the doc, though), but it should throw an exception for
> {{null}} result.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39419) When the comparator of ArraySort returns null, it should fail.
[
https://issues.apache.org/jira/browse/SPARK-39419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552910#comment-17552910
]
Apache Spark commented on SPARK-39419:
--
User 'ueshin' has created a pull request for this issue:
https://github.com/apache/spark/pull/36834
> When the comparator of ArraySort returns null, it should fail.
> --
>
> Key: SPARK-39419
> URL: https://issues.apache.org/jira/browse/SPARK-39419
> Project: Spark
> Issue Type: Bug
> Components: SQL
>Affects Versions: 3.3.0
>Reporter: Takuya Ueshin
>Priority: Major
>
> When the comparator of {{ArraySort}} returns {{null}}, currently it handles
> it as {{0}} (equal).
> According to the doc,
> {quote}
> It returns -1, 0, or 1 as the first element is less than, equal to, or
> greater than the second element. If the comparator function returns other
> values (including null), the function will fail and raise an error.
> {quote}
> It's fine to return non -1, 0, 1 integers to follow the Java convention
> (still need to update the doc, though), but it should throw an exception for
> {{null}} result.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-39434) Provide runtime error query context when array index is out of bound
[ https://issues.apache.org/jira/browse/SPARK-39434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39434: --- Affects Version/s: 3.4.0 (was: 3.3.0) > Provide runtime error query context when array index is out of bound > > > Key: SPARK-39434 > URL: https://issues.apache.org/jira/browse/SPARK-39434 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.4.0 >Reporter: Gengliang Wang >Assignee: Gengliang Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-39434) Provide runtime error query context when array index is out of bound
[ https://issues.apache.org/jira/browse/SPARK-39434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39434. Resolution: Fixed Resolved in https://github.com/apache/spark/pull/36826 > Provide runtime error query context when array index is out of bound > > > Key: SPARK-39434 > URL: https://issues.apache.org/jira/browse/SPARK-39434 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.4.0 >Reporter: Gengliang Wang >Assignee: Gengliang Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39437) normalize plan id separately in PlanStabilitySuite
[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39437: --- Assignee: Wenchen Fan > normalize plan id separately in PlanStabilitySuite > -- > > Key: SPARK-39437 > URL: https://issues.apache.org/jira/browse/SPARK-39437 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.2.0 >Reporter: Wenchen Fan >Assignee: Wenchen Fan >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-39437) normalize plan id separately in PlanStabilitySuite
[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39437. - Fix Version/s: 3.2.2 Resolution: Fixed Issue resolved by pull request 36828 [https://github.com/apache/spark/pull/36828] > normalize plan id separately in PlanStabilitySuite > -- > > Key: SPARK-39437 > URL: https://issues.apache.org/jira/browse/SPARK-39437 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.2.0 >Reporter: Wenchen Fan >Assignee: Wenchen Fan >Priority: Major > Fix For: 3.2.2 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39440) Add a config to disable event timeline
[ https://issues.apache.org/jira/browse/SPARK-39440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552750#comment-17552750 ] Apache Spark commented on SPARK-39440: -- User 'wangyum' has created a pull request for this issue: https://github.com/apache/spark/pull/36833 > Add a config to disable event timeline > -- > > Key: SPARK-39440 > URL: https://issues.apache.org/jira/browse/SPARK-39440 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.4.0 >Reporter: Yuming Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39440) Add a config to disable event timeline
[ https://issues.apache.org/jira/browse/SPARK-39440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39440: Assignee: Apache Spark > Add a config to disable event timeline > -- > > Key: SPARK-39440 > URL: https://issues.apache.org/jira/browse/SPARK-39440 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.4.0 >Reporter: Yuming Wang >Assignee: Apache Spark >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39440) Add a config to disable event timeline
[ https://issues.apache.org/jira/browse/SPARK-39440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39440: Assignee: (was: Apache Spark) > Add a config to disable event timeline > -- > > Key: SPARK-39440 > URL: https://issues.apache.org/jira/browse/SPARK-39440 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.4.0 >Reporter: Yuming Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39440) Add a config to disable event timeline
[ https://issues.apache.org/jira/browse/SPARK-39440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552749#comment-17552749 ] Apache Spark commented on SPARK-39440: -- User 'wangyum' has created a pull request for this issue: https://github.com/apache/spark/pull/36833 > Add a config to disable event timeline > -- > > Key: SPARK-39440 > URL: https://issues.apache.org/jira/browse/SPARK-39440 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.4.0 >Reporter: Yuming Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-39440) Add a config to disable event timeline
Yuming Wang created SPARK-39440: --- Summary: Add a config to disable event timeline Key: SPARK-39440 URL: https://issues.apache.org/jira/browse/SPARK-39440 Project: Spark Issue Type: Improvement Components: Spark Core Affects Versions: 3.4.0 Reporter: Yuming Wang -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-37281) Support DayTimeIntervalType in Py4J
[ https://issues.apache.org/jira/browse/SPARK-37281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37281: Assignee: Hyukjin Kwon (was: Hyukjin Kwon) > Support DayTimeIntervalType in Py4J > --- > > Key: SPARK-37281 > URL: https://issues.apache.org/jira/browse/SPARK-37281 > Project: Spark > Issue Type: Sub-task > Components: PySpark, SQL >Affects Versions: 3.3.0 >Reporter: Hyukjin Kwon >Assignee: Hyukjin Kwon >Priority: Major > Fix For: 3.3.0 > > > This PR adds the support of YearMonthIntervalType in Py4J. For example, > functions.lit(DayTimeIntervalType) should work. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-37525) Timedelta support in pandas API on Spark
[ https://issues.apache.org/jira/browse/SPARK-37525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37525: Assignee: Xinrong Meng > Timedelta support in pandas API on Spark > > > Key: SPARK-37525 > URL: https://issues.apache.org/jira/browse/SPARK-37525 > Project: Spark > Issue Type: Umbrella > Components: PySpark >Affects Versions: 3.3.0 >Reporter: Xinrong Meng >Assignee: Xinrong Meng >Priority: Major > Labels: release-notes > > Since DayTimeIntervalType is supported in PySpark, we may add TimedeltaIndex > support in pandas API on Spark accordingly. > We shall approach it in steps below: > - introduce > - properties > - functions and basic operations > - creation (from Series/Index, generic methods) > - type conversion (astype) -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39439) Suppress error log for in-progress event log not found
[ https://issues.apache.org/jira/browse/SPARK-39439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552711#comment-17552711 ] Apache Spark commented on SPARK-39439: -- User 'pan3793' has created a pull request for this issue: https://github.com/apache/spark/pull/36832 > Suppress error log for in-progress event log not found > -- > > Key: SPARK-39439 > URL: https://issues.apache.org/jira/browse/SPARK-39439 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.3.0 >Reporter: Cheng Pan >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39439) Suppress error log for in-progress event log not found
[ https://issues.apache.org/jira/browse/SPARK-39439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39439: Assignee: Apache Spark > Suppress error log for in-progress event log not found > -- > > Key: SPARK-39439 > URL: https://issues.apache.org/jira/browse/SPARK-39439 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.3.0 >Reporter: Cheng Pan >Assignee: Apache Spark >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39439) Suppress error log for in-progress event log not found
[ https://issues.apache.org/jira/browse/SPARK-39439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39439: Assignee: (was: Apache Spark) > Suppress error log for in-progress event log not found > -- > > Key: SPARK-39439 > URL: https://issues.apache.org/jira/browse/SPARK-39439 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.3.0 >Reporter: Cheng Pan >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-39439) Suppress error log for in-progress event log not found
Cheng Pan created SPARK-39439: - Summary: Suppress error log for in-progress event log not found Key: SPARK-39439 URL: https://issues.apache.org/jira/browse/SPARK-39439 Project: Spark Issue Type: Improvement Components: Spark Core Affects Versions: 3.3.0 Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39126) After eliminating join to one side, that side should take advantage of LocalShuffleRead optimization
[ https://issues.apache.org/jira/browse/SPARK-39126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552696#comment-17552696 ] Apache Spark commented on SPARK-39126: -- User 'mcdull-zhang' has created a pull request for this issue: https://github.com/apache/spark/pull/36831 > After eliminating join to one side, that side should take advantage of > LocalShuffleRead optimization > > > Key: SPARK-39126 > URL: https://issues.apache.org/jira/browse/SPARK-39126 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.2.1 >Reporter: mcdull_zhang >Assignee: Apache Spark >Priority: Minor > > PropagateEmptyRelation can simplify Join. For example, if the right side of > LEFT JOIN is empty, then it can eliminate join to its left side. > If there is a shuffle on the left side, it can be considered that the shuffle > is meaningless, and the shuffle can be optimized by using LocalRead. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39126) After eliminating join to one side, that side should take advantage of LocalShuffleRead optimization
[ https://issues.apache.org/jira/browse/SPARK-39126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552697#comment-17552697 ] Apache Spark commented on SPARK-39126: -- User 'mcdull-zhang' has created a pull request for this issue: https://github.com/apache/spark/pull/36831 > After eliminating join to one side, that side should take advantage of > LocalShuffleRead optimization > > > Key: SPARK-39126 > URL: https://issues.apache.org/jira/browse/SPARK-39126 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.2.1 >Reporter: mcdull_zhang >Assignee: Apache Spark >Priority: Minor > > PropagateEmptyRelation can simplify Join. For example, if the right side of > LEFT JOIN is empty, then it can eliminate join to its left side. > If there is a shuffle on the left side, it can be considered that the shuffle > is meaningless, and the shuffle can be optimized by using LocalRead. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-38761) DS V2 supports push down misc non-aggregate functions
[ https://issues.apache.org/jira/browse/SPARK-38761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552670#comment-17552670 ] Apache Spark commented on SPARK-38761: -- User 'beliefer' has created a pull request for this issue: https://github.com/apache/spark/pull/36830 > DS V2 supports push down misc non-aggregate functions > - > > Key: SPARK-38761 > URL: https://issues.apache.org/jira/browse/SPARK-38761 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.4.0 >Reporter: jiaan.geng >Assignee: jiaan.geng >Priority: Major > Fix For: 3.3.0 > > > Currently, Spark have a lot misc non-aggregate functions of ANSI standard. > abs, > coalesce, > nullif, > when > DS V2 should supports push down these misc non-aggregate functions -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-38761) DS V2 supports push down misc non-aggregate functions
[ https://issues.apache.org/jira/browse/SPARK-38761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552669#comment-17552669 ] Apache Spark commented on SPARK-38761: -- User 'beliefer' has created a pull request for this issue: https://github.com/apache/spark/pull/36830 > DS V2 supports push down misc non-aggregate functions > - > > Key: SPARK-38761 > URL: https://issues.apache.org/jira/browse/SPARK-38761 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.4.0 >Reporter: jiaan.geng >Assignee: jiaan.geng >Priority: Major > Fix For: 3.3.0 > > > Currently, Spark have a lot misc non-aggregate functions of ANSI standard. > abs, > coalesce, > nullif, > when > DS V2 should supports push down these misc non-aggregate functions -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-39425) Add migration guide for PS behavior changes
[ https://issues.apache.org/jira/browse/SPARK-39425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39425. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36816 [https://github.com/apache/spark/pull/36816] > Add migration guide for PS behavior changes > --- > > Key: SPARK-39425 > URL: https://issues.apache.org/jira/browse/SPARK-39425 > Project: Spark > Issue Type: Sub-task > Components: Documentation, Pandas API on Spark >Affects Versions: 3.4.0 >Reporter: Yikun Jiang >Assignee: Yikun Jiang >Priority: Major > Fix For: 3.4.0 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39425) Add migration guide for PS behavior changes
[ https://issues.apache.org/jira/browse/SPARK-39425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39425: Assignee: Yikun Jiang > Add migration guide for PS behavior changes > --- > > Key: SPARK-39425 > URL: https://issues.apache.org/jira/browse/SPARK-39425 > Project: Spark > Issue Type: Sub-task > Components: Documentation, Pandas API on Spark >Affects Versions: 3.4.0 >Reporter: Yikun Jiang >Assignee: Yikun Jiang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39428) use code block for `Coalesce Hints for SQL Queries`
[ https://issues.apache.org/jira/browse/SPARK-39428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-39428: --- Assignee: qian > use code block for `Coalesce Hints for SQL Queries` > --- > > Key: SPARK-39428 > URL: https://issues.apache.org/jira/browse/SPARK-39428 > Project: Spark > Issue Type: Improvement > Components: Documentation >Affects Versions: 3.0.0, 3.0.1, 3.0.2, 3.1.0, 3.1.1, 3.1.2, 3.2.0, 3.2.1 >Reporter: qian >Assignee: qian >Priority: Minor > Attachments: Coalesce.png > > > Use code block for `Coalesce Hints for SQL Queries`, now it is plain block. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-39428) use code block for `Coalesce Hints for SQL Queries`
[ https://issues.apache.org/jira/browse/SPARK-39428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39428. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36820 [https://github.com/apache/spark/pull/36820] > use code block for `Coalesce Hints for SQL Queries` > --- > > Key: SPARK-39428 > URL: https://issues.apache.org/jira/browse/SPARK-39428 > Project: Spark > Issue Type: Improvement > Components: Documentation >Affects Versions: 3.0.0, 3.0.1, 3.0.2, 3.1.0, 3.1.1, 3.1.2, 3.2.0, 3.2.1 >Reporter: qian >Assignee: qian >Priority: Minor > Fix For: 3.4.0 > > Attachments: Coalesce.png > > > Use code block for `Coalesce Hints for SQL Queries`, now it is plain block. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39438) Add a threshold to not in line CTE
[ https://issues.apache.org/jira/browse/SPARK-39438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39438: Assignee: (was: Apache Spark) > Add a threshold to not in line CTE > -- > > Key: SPARK-39438 > URL: https://issues.apache.org/jira/browse/SPARK-39438 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.4.0 >Reporter: Yuming Wang >Priority: Major > > To reduce file scan. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39438) Add a threshold to not in line CTE
[ https://issues.apache.org/jira/browse/SPARK-39438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552584#comment-17552584 ] Apache Spark commented on SPARK-39438: -- User 'wangyum' has created a pull request for this issue: https://github.com/apache/spark/pull/36829 > Add a threshold to not in line CTE > -- > > Key: SPARK-39438 > URL: https://issues.apache.org/jira/browse/SPARK-39438 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.4.0 >Reporter: Yuming Wang >Priority: Major > > To reduce file scan. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-39438) Add a threshold to not in line CTE
[ https://issues.apache.org/jira/browse/SPARK-39438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39438: Assignee: Apache Spark > Add a threshold to not in line CTE > -- > > Key: SPARK-39438 > URL: https://issues.apache.org/jira/browse/SPARK-39438 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.4.0 >Reporter: Yuming Wang >Assignee: Apache Spark >Priority: Major > > To reduce file scan. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-39437) normalize plan id separately in PlanStabilitySuite
Wenchen Fan created SPARK-39437: --- Summary: normalize plan id separately in PlanStabilitySuite Key: SPARK-39437 URL: https://issues.apache.org/jira/browse/SPARK-39437 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 3.2.0 Reporter: Wenchen Fan -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
