[jira] [Updated] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-40362: - Description: In the canonicalization code which is now in two stages, canonicalization involving Commutative

[jira] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

[ https://issues.apache.org/jira/browse/SPARK-40362 ] Asif deleted comment on SPARK-40362: -- was (Author: ashahid7): I have added locally test for  &&, ||, &, | and *  and they all fail for the same reason.. in process of adding tests for xor,

[jira] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

[ https://issues.apache.org/jira/browse/SPARK-40362 ] Asif deleted comment on SPARK-40362: -- was (Author: ashahid7): will be generating a PR tomorrow.. > Bug in Canonicalization of expressions like Add & Multiply i.e Commutative > Operators >

[jira] [Updated] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-40362: - Description: In the canonicalization code which is now in two stages, canonicalization involving Commutative

[jira] [Updated] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-40362: - Shepherd: Wenchen Fan (was: Tanel Kiis) > Bug in Canonicalization of expressions like Add & Multiply i.e

[jira] [Commented] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601067#comment-17601067 ] Asif commented on SPARK-40362: -- will be generating a PR tomorrow.. > Bug in Canonicalization of

[jira] [Comment Edited] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601066#comment-17601066 ] Asif edited comment on SPARK-40362 at 9/7/22 12:43 AM: --- I have added locally test

[jira] [Comment Edited] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601066#comment-17601066 ] Asif edited comment on SPARK-40362 at 9/7/22 12:42 AM: --- I have added locally test

[jira] [Comment Edited] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601066#comment-17601066 ] Asif edited comment on SPARK-40362 at 9/7/22 12:42 AM: --- I have added locally test

[jira] [Commented] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601066#comment-17601066 ] Asif commented on SPARK-40362: -- I have added locally test for  &&, ||, &, | and *  and they all fail for

[jira] [Created] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

Asif created SPARK-40362: Summary: Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators Key: SPARK-40362 URL: https://issues.apache.org/jira/browse/SPARK-40362 Project: Spark

[jira] [Updated] (SPARK-33152) SPIP: Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-33152: - Description: h2. Q1. What are you trying to do? Articulate your objectives using absolutely no jargon.

[jira] [Updated] (SPARK-33152) SPIP: Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-33152: - Description: h2. Q1. What are you trying to do? Articulate your objectives using absolutely no jargon.

[jira] [Updated] (SPARK-36786) SPIP: Improving the compile time performance, by improving a couple of rules, from 24 hrs to under 8 minutes

[ https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-36786: - Description: h2. Q1. What are you trying to do? Articulate your objectives using absolutely no jargon. The

[jira] [Resolved] (SPARK-36878) Optimization in PushDownPredicates to push all filters in a single iteration has broken some optimizations in PruneFilter rule

[ https://issues.apache.org/jira/browse/SPARK-36878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif resolved SPARK-36878. -- Resolution: Not A Bug Further inputs from my company colleague, who pointed out that there might be some

[jira] [Updated] (SPARK-36786) SPIP: Improving the compile time performance, by improving a couple of rules, from 24 hrs to under 8 minutes

[ https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-36786: - Description: h2. Q1. What are you trying to do? Articulate your objectives using absolutely no jargon. The

[jira] [Updated] (SPARK-36786) SPIP: Improving the compile time performance, by improving a couple of rules, from 24 hrs to under 8 minutes

[ https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-36786: - Description: h2. Q1. What are you trying to do? Articulate your objectives using absolutely no jargon. The

[jira] [Created] (SPARK-36878) Optimization in PushDownPredicates to push all filters in a single iteration has broken some optimizations in PruneFilter rule

Asif created SPARK-36878: Summary: Optimization in PushDownPredicates to push all filters in a single iteration has broken some optimizations in PruneFilter rule Key: SPARK-36878 URL:

[jira] [Updated] (SPARK-36786) SPIP: Improving the compile time performance, by improving a couple of rules, from 24 hrs to under 8 minutes

[ https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-36786: - Description: h2. Q1. What are you trying to do? Articulate your objectives using absolutely no jargon. The

[jira] [Updated] (SPARK-36786) SPIP: Improving the compile time performance, by improving a couple of rules, from 24 hrs to under 8 minutes

[ https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-36786: - Labels: SPIP (was: ) Summary: SPIP: Improving the compile time performance, by improving a couple of

[jira] [Created] (SPARK-36786) Improving the compile time performance, by improving a couple of rules, from 24 hrs to under 8 minutes

Asif created SPARK-36786: Summary: Improving the compile time performance, by improving a couple of rules, from 24 hrs to under 8 minutes Key: SPARK-36786 URL: https://issues.apache.org/jira/browse/SPARK-36786

[jira] [Updated] (SPARK-33152) SPIP: Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-33152: - Description: h2. Q1. What are you trying to do? Articulate your objectives using absolutely no jargon.

[jira] [Updated] (SPARK-33152) SPIP: Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-33152: - Labels: SPIP (was: ) > SPIP: Constraint Propagation code causes OOM issues or increasing compilation > time

[jira] [Updated] (SPARK-33152) SPIP: Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-33152: - Summary: SPIP: Constraint Propagation code causes OOM issues or increasing compilation time to hours (was:

[jira] [Updated] (SPARK-33152) Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-33152: - Affects Version/s: 3.1.2 Issue Type: Improvement (was: Bug) > Constraint Propagation code causes

[jira] [Comment Edited] (SPARK-19875) Map->filter on many columns gets stuck in constraint inference optimization code

[ https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238411#comment-17238411 ] Asif edited comment on SPARK-19875 at 11/25/20, 6:02 PM: - [~maropu], [~sameerag] 

[jira] [Comment Edited] (SPARK-19875) Map->filter on many columns gets stuck in constraint inference optimization code

[ https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238411#comment-17238411 ] Asif edited comment on SPARK-19875 at 11/24/20, 11:43 PM: -- [~maropu],

[jira] [Commented] (SPARK-19875) Map->filter on many columns gets stuck in constraint inference optimization code

[ https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238411#comment-17238411 ] Asif commented on SPARK-19875: -- [~maropu] I have generated a PR for SPARK-3152 which fixes the OOM or

[jira] [Comment Edited] (SPARK-19875) Map->filter on many columns gets stuck in constraint inference optimization code

[ https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238411#comment-17238411 ] Asif edited comment on SPARK-19875 at 11/24/20, 11:42 PM: -- [~maropu],

[jira] [Updated] (SPARK-33152) Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-33152: - Affects Version/s: 3.0.1 > Constraint Propagation code causes OOM issues or increasing compilation time > to

[jira] [Commented] (SPARK-29606) Improve EliminateOuterJoin performance

[ https://issues.apache.org/jira/browse/SPARK-29606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224007#comment-17224007 ] Asif commented on SPARK-29606: -- Have proposed following PR which completely solves the issue.  

[jira] [Commented] (SPARK-33152) Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223387#comment-17223387 ] Asif commented on SPARK-33152: -- PR opened: [pr-33152|https://github.com/apache/spark/pull/30185] >

[jira] [Commented] (SPARK-33152) Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215645#comment-17215645 ] Asif commented on SPARK-33152: -- [~yumwang], Hi. I need some help. I started the tests run via 

[jira] [Commented] (SPARK-33152) Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214927#comment-17214927 ] Asif commented on SPARK-33152: -- sure. working on the PR > Constraint Propagation code causes OOM issues or

[jira] [Commented] (SPARK-33152) Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214738#comment-17214738 ] Asif commented on SPARK-33152: -- Possible. As the EliminateOuterJoin rule does reference the constraints &

[jira] [Commented] (SPARK-33152) Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214298#comment-17214298 ] Asif commented on SPARK-33152: -- I will be generating a PR for the same.. > Constraint Propagation code

[jira] [Created] (SPARK-33152) Constraint Propagation code causes OOM issues or increasing compilation time to hours

Asif created SPARK-33152: Summary: Constraint Propagation code causes OOM issues or increasing compilation time to hours Key: SPARK-33152 URL: https://issues.apache.org/jira/browse/SPARK-33152 Project: Spark

<    1   2