[jira] [Updated] (SPARK-32291) COALESCE should not reduce the child parallelism if it is Join
[ https://issues.apache.org/jira/browse/SPARK-32291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32291: Attachment: coalesce.png > COALESCE should not reduce the child parallelism if it is Join > -- > > Key: SPARK-32291 > URL: https://issues.apache.org/jira/browse/SPARK-32291 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.1.0 >Reporter: Yuming Wang >Priority: Major > Attachments: COALESCE.png, coalesce.png, repartition.png > > > How to reproduce this issue: > {code:scala} > spark.range(100).createTempView("t1") > spark.range(200).createTempView("t2") > spark.sql("set spark.sql.autoBroadcastJoinThreshold=0") > spark.sql("select /*+ COALESCE(1) */ t1.* from t1 join t2 on (t1.id = > t2.id)").show > {code} > The dag is: -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-32291) COALESCE should not reduce the child parallelism if it is Join
[ https://issues.apache.org/jira/browse/SPARK-32291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32291: Description: How to reproduce this issue: {code:scala} spark.range(100).createTempView("t1") spark.range(200).createTempView("t2") spark.sql("set spark.sql.autoBroadcastJoinThreshold=0") spark.sql("select /*+ COALESCE(1) */ t1.* from t1 join t2 on (t1.id = t2.id)").show {code} The dag is: !COALESCE.png! A real case: !coalesce.png! !repartition.png! was: How to reproduce this issue: {code:scala} spark.range(100).createTempView("t1") spark.range(200).createTempView("t2") spark.sql("set spark.sql.autoBroadcastJoinThreshold=0") spark.sql("select /*+ COALESCE(1) */ t1.* from t1 join t2 on (t1.id = t2.id)").show {code} The dag is: > COALESCE should not reduce the child parallelism if it is Join > -- > > Key: SPARK-32291 > URL: https://issues.apache.org/jira/browse/SPARK-32291 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.1.0 >Reporter: Yuming Wang >Priority: Major > Attachments: COALESCE.png, coalesce.png, repartition.png > > > How to reproduce this issue: > {code:scala} > spark.range(100).createTempView("t1") > spark.range(200).createTempView("t2") > spark.sql("set spark.sql.autoBroadcastJoinThreshold=0") > spark.sql("select /*+ COALESCE(1) */ t1.* from t1 join t2 on (t1.id = > t2.id)").show > {code} > The dag is: > !COALESCE.png! > A real case: > !coalesce.png! > !repartition.png! -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-32291) COALESCE should not reduce the child parallelism if it is Join
[ https://issues.apache.org/jira/browse/SPARK-32291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32291: Attachment: repartition.png > COALESCE should not reduce the child parallelism if it is Join > -- > > Key: SPARK-32291 > URL: https://issues.apache.org/jira/browse/SPARK-32291 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.1.0 >Reporter: Yuming Wang >Priority: Major > Attachments: COALESCE.png, repartition.png > > > How to reproduce this issue: > {code:scala} > spark.range(100).createTempView("t1") > spark.range(200).createTempView("t2") > spark.sql("set spark.sql.autoBroadcastJoinThreshold=0") > spark.sql("select /*+ COALESCE(1) */ t1.* from t1 join t2 on (t1.id = > t2.id)").show > {code} > The dag is: -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-32291) COALESCE should not reduce the child parallelism if it is Join
[ https://issues.apache.org/jira/browse/SPARK-32291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32291: Attachment: COALESCE.png > COALESCE should not reduce the child parallelism if it is Join > -- > > Key: SPARK-32291 > URL: https://issues.apache.org/jira/browse/SPARK-32291 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.1.0 >Reporter: Yuming Wang >Priority: Major > Attachments: COALESCE.png > > > How to reproduce this issue: > {code:scala} > spark.range(100).createTempView("t1") > spark.range(200).createTempView("t2") > spark.sql("set spark.sql.autoBroadcastJoinThreshold=0") > spark.sql("select /*+ COALESCE(1) */ t1.* from t1 join t2 on (t1.id = > t2.id)").show > {code} > The dag is: -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org