Asif created SPARK-33152:
Summary: Constraint Propagation code causes OOM issues or
increasing compilation time to hours
Key: SPARK-33152
URL: https://issues.apache.org/jira/browse/SPARK-33152
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214298#comment-17214298
]
Asif commented on SPARK-33152:
--
I will be generating a PR for the same..
> Constraint Propagation code
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214738#comment-17214738
]
Asif commented on SPARK-33152:
--
Possible. As the EliminateOuterJoin rule does reference the constraints &
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214927#comment-17214927
]
Asif commented on SPARK-33152:
--
sure. working on the PR
> Constraint Propagation code causes OOM issues or
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215645#comment-17215645
]
Asif commented on SPARK-33152:
--
[~yumwang], Hi. I need some help.
I started the tests run via
[
https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238411#comment-17238411
]
Asif edited comment on SPARK-19875 at 11/25/20, 6:02 PM:
-
[~maropu], [~sameerag]
[
https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238411#comment-17238411
]
Asif edited comment on SPARK-19875 at 11/24/20, 11:42 PM:
--
[~maropu],
[
https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238411#comment-17238411
]
Asif edited comment on SPARK-19875 at 11/24/20, 11:43 PM:
--
[~maropu],
[
https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238411#comment-17238411
]
Asif commented on SPARK-19875:
--
[~maropu] I have generated a PR for SPARK-3152 which fixes the OOM or
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Affects Version/s: 3.0.1
> Constraint Propagation code causes OOM issues or increasing compilation time
> to
[
https://issues.apache.org/jira/browse/SPARK-29606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224007#comment-17224007
]
Asif commented on SPARK-29606:
--
Have proposed following PR which completely solves the issue.
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223387#comment-17223387
]
Asif commented on SPARK-33152:
--
PR opened:
[pr-33152|https://github.com/apache/spark/pull/30185]
>
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Labels: SPIP (was: )
> SPIP: Constraint Propagation code causes OOM issues or increasing compilation
> time
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Summary: SPIP: Constraint Propagation code causes OOM issues or increasing
compilation time to hours (was:
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Description:
h2. Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.
Asif created SPARK-36786:
Summary: Improving the compile time performance, by improving a
couple of rules, from 24 hrs to under 8 minutes
Key: SPARK-36786
URL: https://issues.apache.org/jira/browse/SPARK-36786
[
https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-36786:
-
Labels: SPIP (was: )
Summary: SPIP: Improving the compile time performance, by improving a
couple of
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Affects Version/s: 3.1.2
Issue Type: Improvement (was: Bug)
> Constraint Propagation code causes
[
https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-36786:
-
Description:
h2. Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.
The
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Description:
h2. Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Description:
h2. Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.
[
https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-36786:
-
Description:
h2. Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.
The
Asif created SPARK-36878:
Summary: Optimization in PushDownPredicates to push all filters in
a single iteration has broken some optimizations in PruneFilter rule
Key: SPARK-36878
URL:
[
https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-36786:
-
Description:
h2. Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.
The
[
https://issues.apache.org/jira/browse/SPARK-36878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif resolved SPARK-36878.
--
Resolution: Not A Bug
Further inputs from my company colleague, who pointed out that there might be
some
[
https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-36786:
-
Description:
h2. Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.
The
[
https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781976#comment-17781976
]
Asif commented on SPARK-36786:
--
I had put this on back burner as my changes were on 3.2, so I have to do a
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Affects Version/s: 3.5.1
(was: 3.3.3)
> SPIP: Improving performance of
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Attachment: perf results broadcast var pushdown - Partitioned TPCDS.pdf
> SPIP: Improving performance of
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782927#comment-17782927
]
Asif commented on SPARK-44662:
--
The majority of file changes are due to additional tpcds tests for iceberg.
[
https://issues.apache.org/jira/browse/SPARK-45658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45658:
-
Priority: Major (was: Critical)
> Canonicalization of DynamicPruningSubquery is broken
>
[
https://issues.apache.org/jira/browse/SPARK-45658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45658:
-
Description:
The canonicalization of (buildKeys: Seq[Expression]) in the class
DynamicPruningSubquery is
Asif created SPARK-45658:
Summary: Canonicalization of DynamicPruningSubquery is broken
Key: SPARK-45658
URL: https://issues.apache.org/jira/browse/SPARK-45658
Project: Spark
Issue Type: Bug
Asif created SPARK-45373:
Summary: Minimizing calls to HiveMetaStore layer for getting
partitions, when tables are repeated
Key: SPARK-45373
URL: https://issues.apache.org/jira/browse/SPARK-45373
Project:
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770220#comment-17770220
]
Asif commented on SPARK-45373:
--
Will be generating a PR for this.
> Minimizing calls to HiveMetaStore
[ https://issues.apache.org/jira/browse/SPARK-45373 ]
Asif deleted comment on SPARK-45373:
--
was (Author: ashahid7):
Will be generating a PR for this.
> Minimizing calls to HiveMetaStore layer for getting partitions, when tables
> are repeated
>
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45373:
-
Description:
In the rule PruneFileSourcePartitions where the CatalogFileIndex gets converted
to
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45373:
-
Affects Version/s: 4.0.0
(was: 3.5.1)
> Minimizing calls to HiveMetaStore layer for
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45373:
-
Affects Version/s: 3.5.0
(was: 4.0.0)
> Minimizing calls to HiveMetaStore layer for
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Affects Version/s: 3.5.0
(was: 3.5.1)
> SPIP: Improving performance of
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Affects Version/s: 3.5.0
(was: 2.4.0)
(was: 3.0.1)
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45373:
-
Shepherd: (was: Peter Toth)
> Minimizing calls to HiveMetaStore layer for getting partitions, when tables
>
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17784282#comment-17784282
]
Asif commented on SPARK-44662:
--
The changes for iceberg which support broadcast-var-pushdown are present in
Asif created SPARK-45866:
Summary: Reuse of exchange in AQE does not happen when run time
filters are pushed down to the underlying Scan ( like iceberg )
Key: SPARK-45866
URL:
[
https://issues.apache.org/jira/browse/SPARK-45658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17784567#comment-17784567
]
Asif commented on SPARK-45658:
--
I also think that during canonicalization of DynamicPruningSubquery, the
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601067#comment-17601067
]
Asif commented on SPARK-40362:
--
will be generating a PR tomorrow..
> Bug in Canonicalization of
Asif created SPARK-40362:
Summary: Bug in Canonicalization of expressions like Add &
Multiply i.e Commutative Operators
Key: SPARK-40362
URL: https://issues.apache.org/jira/browse/SPARK-40362
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601066#comment-17601066
]
Asif edited comment on SPARK-40362 at 9/7/22 12:43 AM:
---
I have added locally test
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601066#comment-17601066
]
Asif edited comment on SPARK-40362 at 9/7/22 12:42 AM:
---
I have added locally test
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601066#comment-17601066
]
Asif edited comment on SPARK-40362 at 9/7/22 12:42 AM:
---
I have added locally test
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601066#comment-17601066
]
Asif commented on SPARK-40362:
--
I have added locally test for
&&, ||, &, | and * and they all fail for
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-40362:
-
Shepherd: Wenchen Fan (was: Tanel Kiis)
> Bug in Canonicalization of expressions like Add & Multiply i.e
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-40362:
-
Description:
In the canonicalization code which is now in two stages, canonicalization
involving Commutative
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-40362:
-
Description:
In the canonicalization code which is now in two stages, canonicalization
involving Commutative
[ https://issues.apache.org/jira/browse/SPARK-40362 ]
Asif deleted comment on SPARK-40362:
--
was (Author: ashahid7):
will be generating a PR tomorrow..
> Bug in Canonicalization of expressions like Add & Multiply i.e Commutative
> Operators
>
[ https://issues.apache.org/jira/browse/SPARK-40362 ]
Asif deleted comment on SPARK-40362:
--
was (Author: ashahid7):
I have added locally test for
&&, ||, &, | and * and they all fail for the same reason..
in process of adding tests for xor,
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17606817#comment-17606817
]
Asif commented on SPARK-33152:
--
Added a test *CompareNewAndOldConstraintsSuite* in the PR which when run on
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Shepherd: Wenchen Fan (was: Arnaud Doucet)
Description:
h2. Q1. What are you trying to do? Articulate
[
https://issues.apache.org/jira/browse/SPARK-41141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-41141:
-
Priority: Minor (was: Major)
> avoid introducing a new aggregate expression in the analysis phase when
>
[
https://issues.apache.org/jira/browse/SPARK-41141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635989#comment-17635989
]
Asif commented on SPARK-41141:
--
Opened the following PR
Asif created SPARK-41141:
Summary: avoid introducing a new aggregate expression in the
analysis phase when subquery is referencing it
Key: SPARK-41141
URL: https://issues.apache.org/jira/browse/SPARK-41141
[
https://issues.apache.org/jira/browse/SPARK-41141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-41141:
-
Description:
Currently the analyzer phase rules on subquery referencing the aggregate
expression in outer
[
https://issues.apache.org/jira/browse/SPARK-43112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711607#comment-17711607
]
Asif commented on SPARK-43112:
--
Open a WIP PR [SPARK-43112|https://github.com/apache/spark/pull/40765/]
[
https://issues.apache.org/jira/browse/SPARK-43112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-43112:
-
Description:
The class org.apache.spark.sql.catalyst.catalog.HiveTableRelation has its
output method
Asif created SPARK-43112:
Summary: Spark may use a column other than the actual specified
partitioning column for partitioning, for Hive format tables
Key: SPARK-43112
URL:
[
https://issues.apache.org/jira/browse/SPARK-43112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif resolved SPARK-43112.
--
Resolution: Not A Bug
> Spark may use a column other than the actual specified partitioning column
> for
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
Asif created SPARK-44662:
Summary: SPIP: Improving performance of BroadcastHashJoin queries
with stream side join key on non partition columns
Key: SPARK-44662
URL: https://issues.apache.org/jira/browse/SPARK-44662
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On
Asif created SPARK-46671:
Summary: InferFiltersFromConstraint rule is creating a redundant
filter
Key: SPARK-46671
URL: https://issues.apache.org/jira/browse/SPARK-46671
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-46671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif resolved SPARK-46671.
--
Resolution: Not A Bug
> InferFiltersFromConstraint rule is creating a redundant filter
>
[
https://issues.apache.org/jira/browse/SPARK-46671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805435#comment-17805435
]
Asif commented on SPARK-46671:
--
so closing the ticket
> InferFiltersFromConstraint rule is creating a
[
https://issues.apache.org/jira/browse/SPARK-46671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805434#comment-17805434
]
Asif commented on SPARK-46671:
--
on further thoughts , I am wrong.. There should be 2 separate isNotNull
[
https://issues.apache.org/jira/browse/SPARK-46671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif reopened SPARK-46671:
--
After further analysis , I believe , that what I said originally in the ticket
is valid and that the code Does
[
https://issues.apache.org/jira/browse/SPARK-46671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-46671:
-
Description:
while bring my old PR which uses a different approach to the
ConstraintPropagation algorithm (
[
https://issues.apache.org/jira/browse/SPARK-45959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45959:
-
Summary: SPIP: Abusing DataSet.withColumn can cause huge tree with severe
perf degradation (was: Abusing
[
https://issues.apache.org/jira/browse/SPARK-45959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45959:
-
Description:
Though documentation clearly recommends to add all columns in a single shot,
but in reality is
[
https://issues.apache.org/jira/browse/SPARK-45925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif resolved SPARK-45925.
--
Resolution: Not A Problem
> SubqueryBroadcastExec is not equivalent with SubqueryAdaptiveBroadcastExec
>
[
https://issues.apache.org/jira/browse/SPARK-45924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif resolved SPARK-45924.
--
Resolution: Not A Bug
> Canonicalization of SubqueryAdaptiveBroadcastExec is broken and is not
> equivalent
Asif created SPARK-45943:
Summary: DataSourceV2Relation.computeStats throws
IllegalStateException in test mode
Key: SPARK-45943
URL: https://issues.apache.org/jira/browse/SPARK-45943
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-45925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif closed SPARK-45925.
this is not an issue
> SubqueryBroadcastExec is not equivalent with SubqueryAdaptiveBroadcastExec
> causing re-use
[
https://issues.apache.org/jira/browse/SPARK-45924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif closed SPARK-45924.
this is not a bug
> Canonicalization of SubqueryAdaptiveBroadcastExec is broken and is not
> equivalent with
[
https://issues.apache.org/jira/browse/SPARK-45866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45866:
-
Labels: pull-request-available (was: )
> Reuse of exchange in AQE does not happen when run time filters are
[
https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786652#comment-17786652
]
Asif commented on SPARK-45943:
--
thanks [~wforget] for the input.. if you have solution pls open PR, else I
[
https://issues.apache.org/jira/browse/SPARK-45959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786941#comment-17786941
]
Asif commented on SPARK-45959:
--
will create a PR for the same..
> Abusing DataSet.withColumn can cause
1 - 100 of 137 matches
Mail list logo
