Github user yucai commented on a diff in the pull request:
https://github.com/apache/spark/pull/21156#discussion_r227268021
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/JoinUtils.scala ---
@@ -0,0 +1,63 @@
+/*
+ * Licensed to the Apache Software
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21156#discussion_r227253732
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/JoinUtils.scala ---
@@ -0,0 +1,63 @@
+/*
+ * Licensed to the Apache
GitHub user yucai reopened a pull request:
https://github.com/apache/spark/pull/21156
[SPARK-24087][SQL] Avoid shuffle when join keys are a super-set of bucket
keys
## What changes were proposed in this pull request?
To improve the bucket join, when join keys are a
Github user yucai closed the pull request at:
https://github.com/apache/spark/pull/21156
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21156#discussion_r200947380
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala
---
@@ -76,8 +76,36 @@ case class SortMergeJoinExec(
Github user yucai commented on a diff in the pull request:
https://github.com/apache/spark/pull/21156#discussion_r200945621
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala
---
@@ -76,8 +76,36 @@ case class SortMergeJoinExec(
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21156#discussion_r200941904
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala
---
@@ -76,8 +76,36 @@ case class SortMergeJoinExec(
Github user yucai commented on a diff in the pull request:
https://github.com/apache/spark/pull/21156#discussion_r200940424
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala
---
@@ -76,8 +76,36 @@ case class SortMergeJoinExec(
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21156#discussion_r200940409
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala
---
@@ -76,8 +76,36 @@ case class SortMergeJoinExec(
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21156#discussion_r200938314
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala
---
@@ -76,8 +76,36 @@ case class SortMergeJoinExec(
Github user yucai commented on a diff in the pull request:
https://github.com/apache/spark/pull/21156#discussion_r200937190
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala
---
@@ -76,8 +76,36 @@ case class SortMergeJoinExec(
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21156#discussion_r200934272
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/sources/BucketedReadSuite.scala ---
@@ -334,8 +334,7 @@ abstract class BucketedReadSuite extends
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21156#discussion_r200933998
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala
---
@@ -76,8 +76,36 @@ case class SortMergeJoinExec(
GitHub user yucai opened a pull request:
https://github.com/apache/spark/pull/21156
[SPARK-24087][SQL] Avoid shuffle when join keys are a super-set of bucket
keys
## What changes were proposed in this pull request?
To improve the bucket join, when join keys are a super-set
14 matches
Mail list logo