[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781976#comment-17781976
]
Asif commented on SPARK-36786:
--
I had put this on back burner as my changes were on 3.2, so
[
https://issues.apache.org/jira/browse/SPARK-45658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45658:
-
Description:
The canonicalization of (buildKeys: Seq[Expression]) in the class
DynamicPruningSubquery is broken
[
https://issues.apache.org/jira/browse/SPARK-45658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45658:
-
Priority: Major (was: Critical)
> Canonicalization of DynamicPruningSubquery is broken
> --
Asif created SPARK-45658:
Summary: Canonicalization of DynamicPruningSubquery is broken
Key: SPARK-45658
URL: https://issues.apache.org/jira/browse/SPARK-45658
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45373:
-
Affects Version/s: 4.0.0
(was: 3.5.1)
> Minimizing calls to HiveMetaStore layer for g
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45373:
-
Description:
In the rule PruneFileSourcePartitions where the CatalogFileIndex gets converted
to InMemoryFileInd
[ https://issues.apache.org/jira/browse/SPARK-45373 ]
Asif deleted comment on SPARK-45373:
--
was (Author: ashahid7):
Will be generating a PR for this.
> Minimizing calls to HiveMetaStore layer for getting partitions, when tables
> are repeated
>
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17770220#comment-17770220
]
Asif commented on SPARK-45373:
--
Will be generating a PR for this.
> Minimizing calls to Hi
Asif created SPARK-45373:
Summary: Minimizing calls to HiveMetaStore layer for getting
partitions, when tables are repeated
Key: SPARK-45373
URL: https://issues.apache.org/jira/browse/SPARK-45373
Project: Sp
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
Asif created SPARK-44662:
Summary: SPIP: Improving performance of BroadcastHashJoin queries
with stream side join key on non partition columns
Key: SPARK-44662
URL: https://issues.apache.org/jira/browse/SPARK-44662
[
https://issues.apache.org/jira/browse/SPARK-43112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif resolved SPARK-43112.
--
Resolution: Not A Bug
> Spark may use a column other than the actual specified partitioning column
> for par
[
https://issues.apache.org/jira/browse/SPARK-43112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711607#comment-17711607
]
Asif commented on SPARK-43112:
--
Open a WIP PR [SPARK-43112|https://github.com/apache/spark/
[
https://issues.apache.org/jira/browse/SPARK-43112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-43112:
-
Description:
The class org.apache.spark.sql.catalyst.catalog.HiveTableRelation has its
output method implemente
Asif created SPARK-43112:
Summary: Spark may use a column other than the actual specified
partitioning column for partitioning, for Hive format tables
Key: SPARK-43112
URL: https://issues.apache.org/jira/browse/SPARK-431
[
https://issues.apache.org/jira/browse/SPARK-41141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635989#comment-17635989
]
Asif commented on SPARK-41141:
--
Opened the following PR
[SPARK-41141-PR|https://github.com
[
https://issues.apache.org/jira/browse/SPARK-41141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-41141:
-
Priority: Minor (was: Major)
> avoid introducing a new aggregate expression in the analysis phase when
> subqu
[
https://issues.apache.org/jira/browse/SPARK-41141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-41141:
-
Description:
Currently the analyzer phase rules on subquery referencing the aggregate
expression in outer quer
Asif created SPARK-41141:
Summary: avoid introducing a new aggregate expression in the
analysis phase when subquery is referencing it
Key: SPARK-41141
URL: https://issues.apache.org/jira/browse/SPARK-41141
Pr
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17606817#comment-17606817
]
Asif commented on SPARK-33152:
--
Added a test *CompareNewAndOldConstraintsSuite* in the PR w
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Shepherd: Wenchen Fan (was: Arnaud Doucet)
Description:
h2. Q1. What are you trying to do? Articulate yo
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-40362:
-
Description:
In the canonicalization code which is now in two stages, canonicalization
involving Commutative op
[ https://issues.apache.org/jira/browse/SPARK-40362 ]
Asif deleted comment on SPARK-40362:
--
was (Author: ashahid7):
I have added locally test for
&&, ||, &, | and * and they all fail for the same reason..
in process of adding tests for xor, greates
[ https://issues.apache.org/jira/browse/SPARK-40362 ]
Asif deleted comment on SPARK-40362:
--
was (Author: ashahid7):
will be generating a PR tomorrow..
> Bug in Canonicalization of expressions like Add & Multiply i.e Commutative
> Operators
>
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-40362:
-
Description:
In the canonicalization code which is now in two stages, canonicalization
involving Commutative op
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-40362:
-
Shepherd: Wenchen Fan (was: Tanel Kiis)
> Bug in Canonicalization of expressions like Add & Multiply i.e Commut
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601067#comment-17601067
]
Asif commented on SPARK-40362:
--
will be generating a PR tomorrow..
> Bug in Canonicalizati
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601066#comment-17601066
]
Asif edited comment on SPARK-40362 at 9/7/22 12:43 AM:
---
I have add
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601066#comment-17601066
]
Asif edited comment on SPARK-40362 at 9/7/22 12:42 AM:
---
I have add
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601066#comment-17601066
]
Asif edited comment on SPARK-40362 at 9/7/22 12:42 AM:
---
I have add
[
https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601066#comment-17601066
]
Asif commented on SPARK-40362:
--
I have added locally test for
&&, ||, &, | and * and the
Asif created SPARK-40362:
Summary: Bug in Canonicalization of expressions like Add &
Multiply i.e Commutative Operators
Key: SPARK-40362
URL: https://issues.apache.org/jira/browse/SPARK-40362
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Description:
h2. Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.
Proposi
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Description:
h2. Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.
Proposi
[
https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-36786:
-
Description:
h2. Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.
The aim
[
https://issues.apache.org/jira/browse/SPARK-36878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif resolved SPARK-36878.
--
Resolution: Not A Bug
Further inputs from my company colleague, who pointed out that there might be
some othe
[
https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-36786:
-
Description:
h2. Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.
The aim
[
https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-36786:
-
Description:
h2. Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.
The aim
Asif created SPARK-36878:
Summary: Optimization in PushDownPredicates to push all filters in
a single iteration has broken some optimizations in PruneFilter rule
Key: SPARK-36878
URL: https://issues.apache.org/jira/brows
[
https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-36786:
-
Description:
h2. Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.
The aim
[
https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-36786:
-
Labels: SPIP (was: )
Summary: SPIP: Improving the compile time performance, by improving a
couple of rule
Asif created SPARK-36786:
Summary: Improving the compile time performance, by improving a
couple of rules, from 24 hrs to under 8 minutes
Key: SPARK-36786
URL: https://issues.apache.org/jira/browse/SPARK-36786
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Description:
h2. Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.
Proposi
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Labels: SPIP (was: )
> SPIP: Constraint Propagation code causes OOM issues or increasing compilation
> time to
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Summary: SPIP: Constraint Propagation code causes OOM issues or increasing
compilation time to hours (was: Cons
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Affects Version/s: 3.1.2
Issue Type: Improvement (was: Bug)
> Constraint Propagation code causes OOM
[
https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238411#comment-17238411
]
Asif edited comment on SPARK-19875 at 11/25/20, 6:02 PM:
-
[~maro
[
https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238411#comment-17238411
]
Asif edited comment on SPARK-19875 at 11/24/20, 11:43 PM:
--
[~ma
[
https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238411#comment-17238411
]
Asif commented on SPARK-19875:
--
[~maropu] I have generated a PR for SPARK-3152 which fixes
[
https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238411#comment-17238411
]
Asif edited comment on SPARK-19875 at 11/24/20, 11:42 PM:
--
[~ma
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Affects Version/s: 3.0.1
> Constraint Propagation code causes OOM issues or increasing compilation time
> to ho
[
https://issues.apache.org/jira/browse/SPARK-29606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17224007#comment-17224007
]
Asif commented on SPARK-29606:
--
Have proposed following PR which completely solves the issu
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223387#comment-17223387
]
Asif commented on SPARK-33152:
--
PR opened:
[pr-33152|https://github.com/apache/spark/pull/
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17215645#comment-17215645
]
Asif commented on SPARK-33152:
--
[~yumwang], Hi. I need some help.
I started the tests run
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214927#comment-17214927
]
Asif commented on SPARK-33152:
--
sure. working on the PR
> Constraint Propagation code caus
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214738#comment-17214738
]
Asif commented on SPARK-33152:
--
Possible. As the EliminateOuterJoin rule does reference the
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214298#comment-17214298
]
Asif commented on SPARK-33152:
--
I will be generating a PR for the same..
> Constraint Prop
Asif created SPARK-33152:
Summary: Constraint Propagation code causes OOM issues or
increasing compilation time to hours
Key: SPARK-33152
URL: https://issues.apache.org/jira/browse/SPARK-33152
Project: Spark
101 - 172 of 172 matches
Mail list logo
