Github user maryannxue commented on the issue:
https://github.com/apache/spark/pull/21156
The idea is good. Is it possible to make it an optimization rule? Another
suggestion is we need more test cases.
---
-
To
Github user maryannxue commented on the issue:
https://github.com/apache/spark/pull/21156
Sorry for the delay. Iâll take another look today.
On Mon, Oct 22, 2018 at 7:50 AM UCB AMPLab wrote:
> Can one of the admins verify this patch?
>
> â
> You are
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #97872 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97872/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #97855 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97855/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #97825 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97825/testReport)**
for PR 21156 at commit
Github user wangshisan commented on the issue:
https://github.com/apache/spark/pull/21156
What is the status now? I think this is of great value, since this gives
users more possibility to leverage bucket join, all joins which take the bucket
key as the prefix of join keys will
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93601/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #93601 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93601/testReport)**
for PR 21156 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #93601 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93601/testReport)**
for PR 21156 at commit
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/21156
closed by mistake, reopen it.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92909/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92909 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92909/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92909 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92909/testReport)**
for PR 21156 at commit
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/21156
@maryannxue how about this way? Any better idea?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92822/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92822 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92822/testReport)**
for PR 21156 at commit
Github user maryannxue commented on the issue:
https://github.com/apache/spark/pull/21156
IMHO, this ShuffledJoin is basically join + known distribution info. So
instead of adding another join node (which doesn't map to any specific join
algorithm), we should base this on
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92822 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92822/testReport)**
for PR 21156 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92809/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92809 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92809/testReport)**
for PR 21156 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92810/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92810 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92810/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92810 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92810/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92809 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92809/testReport)**
for PR 21156 at commit
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/21156
A classic scenario could be like below:
```
SELECT
...
FROM
lstg_item item,
lstg_item_vrtn v
WHERE
item.auct_end_dt = CAST(SUBSTR('2018-04-19 00:00:00',1,10) AS
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/21156
@cloud-fan For bucket table, the user will do the bucket on the primary
key, so in this case, they will not have the parallelism and data skew issue
and we can see good benefit from avoiding shuffle.
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21156
A high-level question: will we hit perf regression here? It seems to me
that, using fewer join keys can lead to less parallelism or data skewness.
---
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21156
cc @maryannxue
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92754/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92754 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92754/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92754 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92754/testReport)**
for PR 21156 at commit
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/21156
@mgaido91 with this way, seems like we don't need `reorderJoinPredicates`
anymore, any thoughts?
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92682/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92682 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92682/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92682 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92682/testReport)**
for PR 21156 at commit
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/21156
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92674/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92674 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92674/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92674 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92674/testReport)**
for PR 21156 at commit
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/21156
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/21156
@cloud-fan @gatorsmile @mgaido91 @viirya Could you help review this feature?
---
-
To unsubscribe, e-mail:
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/21156
I run the failed commands locally, no issue, retest again.
```
info] SHA-1: 4e68a043f1e9aa75e4395aba7892196e90cca1f4
[info] Packaging
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92669/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92669 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92669/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #92669 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92669/testReport)**
for PR 21156 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91436/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91435/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #91435 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91435/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #91436 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91436/testReport)**
for PR 21156 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91434/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #91434 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91434/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #91436 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91436/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #91435 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91435/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #91434 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91434/testReport)**
for PR 21156 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89875/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #89875 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89875/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #89875 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89875/testReport)**
for PR 21156 at commit
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/21156
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89869/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #89869 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89869/testReport)**
for PR 21156 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89867/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #89867 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89867/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #89869 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89869/testReport)**
for PR 21156 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #89867 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89867/testReport)**
for PR 21156 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21156
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21156
**[Test build #89847 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89847/testReport)**
for PR 21156 at commit
84 matches
Mail list logo
