[jira] [Updated] (SPARK-39873) Remove OptimizeLimitZero and merge it into EliminateLimits

2022-07-27 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39873: --- Affects Version/s: 3.4.0 (was: 2.4.0) > Remove OptimizeLimitZero and merg

[jira] [Created] (SPARK-39894) Combine the similar binary comparison in boolean expression.

2022-07-27 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-39894: -- Summary: Combine the similar binary comparison in boolean expression. Key: SPARK-39894 URL: https://issues.apache.org/jira/browse/SPARK-39894 Project: Spark Iss

[jira] [Updated] (SPARK-39893) Remove redundant aggregate if it is group only and all grouping and aggregate expressions are foldable

2022-07-27 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-39893: Summary: Remove redundant aggregate if it is group only and all grouping and aggregate expressions are fol

[jira] [Updated] (SPARK-39893) Remove Aggregate if it is group only and all grouping and aggregate expressions are foldable

2022-07-27 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-39893: Summary: Remove Aggregate if it is group only and all grouping and aggregate expressions are foldable (wa

[jira] [Updated] (SPARK-39893) Remote Aggregate if it is group only and all grouping and aggregate expressions are foldable

2022-07-27 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-39893: Description: If all groupingExpressions and aggregateExpressions in a aggregate are foldable, we can remo

[jira] [Created] (SPARK-39893) Remote Aggregate if it is group only and all grouping and aggregate expressions are foldable

2022-07-27 Thread Wan Kun (Jira)
Wan Kun created SPARK-39893: --- Summary: Remote Aggregate if it is group only and all grouping and aggregate expressions are foldable Key: SPARK-39893 URL: https://issues.apache.org/jira/browse/SPARK-39893 Pr

[jira] [Resolved] (SPARK-39834) Include the origin stats and constraints for LogicalRDD if it comes from DataFrame

2022-07-27 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-39834. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37248 [https://gi

[jira] [Assigned] (SPARK-39834) Include the origin stats and constraints for LogicalRDD if it comes from DataFrame

2022-07-27 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-39834: Assignee: Jungtaek Lim > Include the origin stats and constraints for LogicalRDD if it co

[jira] [Assigned] (SPARK-39892) Use ArrowType.Decimal(precision, scale, bitWidth) instead of ArrowType.Decimal(precision, scale)

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39892: Assignee: Apache Spark > Use ArrowType.Decimal(precision, scale, bitWidth) instead of >

[jira] [Assigned] (SPARK-39892) Use ArrowType.Decimal(precision, scale, bitWidth) instead of ArrowType.Decimal(precision, scale)

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39892: Assignee: (was: Apache Spark) > Use ArrowType.Decimal(precision, scale, bitWidth) ins

[jira] [Commented] (SPARK-39892) Use ArrowType.Decimal(precision, scale, bitWidth) instead of ArrowType.Decimal(precision, scale)

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571780#comment-17571780 ] Apache Spark commented on SPARK-39892: -- User 'panbingkun' has created a pull reques

[jira] [Commented] (SPARK-39892) Use ArrowType.Decimal(precision, scale, bitWidth) instead of ArrowType.Decimal(precision, scale)

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571779#comment-17571779 ] Apache Spark commented on SPARK-39892: -- User 'panbingkun' has created a pull reques

[jira] [Updated] (SPARK-39892) Use ArrowType.Decimal(precision, scale, bitWidth) instead of ArrowType.Decimal(precision, scale)

2022-07-27 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-39892: Summary: Use ArrowType.Decimal(precision, scale, bitWidth) instead of ArrowType.Decimal(precision,

[jira] [Created] (SPARK-39892) Use ArrowType.Decimal(int precision, int scale, int bitWidth) instead of ArrowType.Decimal(int precision, int scale)

2022-07-27 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-39892: --- Summary: Use ArrowType.Decimal(int precision, int scale, int bitWidth) instead of ArrowType.Decimal(int precision, int scale) Key: SPARK-39892 URL: https://issues.apache.org/jira/br

[jira] [Commented] (SPARK-39833) Filtered parquet data frame count() and show() produce inconsistent results when spark.sql.parquet.filterPushdown is true

2022-07-27 Thread Ivan Sadikov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571768#comment-17571768 ] Ivan Sadikov commented on SPARK-39833: -- Interesting, I will take a look. > Filtere

<    1   2