Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
This PR grows too much. Sometime, scrolling is lack. I close this and open
a new one https://github.com/apache/spark/pull/14426 .
---
If your project is set up for it, you can reply to this e
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Hi, @cloud-fan .
Could you review this PR again please?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62975/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62975 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62975/consoleFull)**
for PR 14132 at commit
[`4023d97`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62975 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62975/consoleFull)**
for PR 14132 at commit
[`4023d97`](https://github.com/apache/spark/commit/4
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Oh, the one failure is due to a new MAPJOIN testcase in the master branch
(I added yesterday.)
I'll rebase and update that, too.
---
If your project is set up for it, you can reply to thi
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62966/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62966 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62966/consoleFull)**
for PR 14132 at commit
[`bd13473`](https://github.com/apache/spark/commit/
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Hi, the followings are updated.
- Hints are not propagated into subqueries.
- Add new testcases
- `SELECT /*+ MAPJOIN(t1) */ * FROM t1 JOIN t1 JOIN t1 JOIN t1` (First
`t1`)
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62966 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62966/consoleFull)**
for PR 14132 at commit
[`bd13473`](https://github.com/apache/spark/commit/b
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Thank you for guidance, @cloud-fan !
I'll implement like that.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your proje
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/14132
`SELECT /*+ MAPJOIN(t1) */ * FROM (SELECT * FROM t1) x JOIN t2;`
yea I think this one should be noop
---
If your project is set up for it, you can reply to this email and have your
reply appea
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
At the implementation side, blocking all subqueries are easiest.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Thank you, @hvanhovell .
Then should we block all subquery or allow the following cases?
* SELECT /*+ MAPJOIN(t1) */ * FROM (SELECT * FROM t1) x JOIN t2;
---
If your project is set up
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/14132
I agree with @cloud-fan. It is confusing that the hint defined in the
top-level query gets applied to a subquery.
---
If your project is set up for it, you can reply to this email and have your
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Hmm, maybe more sophisticate method is needed for both the following cases.
* SELECT /*+ MAPJOIN(t1) */ * FROM (SELECT * FROM t1) x JOIN t1
* SELECT /*+ MAPJOIN(t1) */ * FROM (SELEC
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
For @cloud-fan 's choice, I think I can block the subqueries which are
aliased by users.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
For old hives, I can get the binary after Hive 1.0.
http://www-us.apache.org/dist/hive/
The above result was Hive 2.0 and 1.2. I think Hive 1.0 and 1.1 will be the
same as expected
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Thank you for giving opinion.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/14132
cc @rxin @hvanhovell what do you think of this case?
`SELECT /*+ MAPJOIN(t1) */ * FROM (SELECT * FROM t1) x JOIN t1`
Applying the hint to the `t1` after JOIN looks more intuitive to me.
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
For `Table-Level Optimizer Hints` of MySQL, it applied to all table with
the same name.
> The hint applies to all tables that it names
http://dev.mysql.com/doc/refman/5.7/en/optimizer-h
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
For the first case, I intentionally turn off the option to see the effect
of the hint only.
---
If your project is set up for it, you can reply to this email and have your
reply appear on Git
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/14132
For current hive, the `MAP_JOIN` hint is ignored totally right? How about
old hive(or other databases that support MAP_JOIN or BROADCAST_JOIN hint)? I
just wanna check the common rule to apply rel
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Since `set hive.auto.convert.join=true;` is default, I think mapjoin hint
seems to work.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
When we turn on the option `true`, `t1` is broadcasted.
```
hive> set hive.auto.convert.join=true;
hive> EXPLAIN SELECT /*+ MAPJOIN(t1) */ * FROM (select * from t1) x, t2;
Warnin
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
The difference of JOIN[5] and JOIN[5] is just due to the following.
* JOIN[5]
```
TableScan
alias: t1
Statistics: Num rows: 1 Data size: 1 B
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Oh, thank you, @cloud-fan . For current Hive, it is ignored. The followings
have the same plans.
- SELECT * FROM (SELECT * FROM t1) x, t1;
- SELECT /*+ MAPJOIN(t1) */ * FROM (SELECT * F
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/14132
for case 2, what does hive(or other databases that support sql hint) do?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your pro
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62951/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62951 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62951/consoleFull)**
for PR 14132 at commit
[`d733393`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62951 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62951/consoleFull)**
for PR 14132 at commit
[`d733393`](https://github.com/apache/spark/commit/d
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62946/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62946 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62946/consoleFull)**
for PR 14132 at commit
[`381045d`](https://github.com/apache/spark/commit/
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Hi, @cloud-fan , @yhuai , @hvanhovell , and @rxin .
The remaining comment is about matching algorithm. While digging Hive's
dead code, I suddenly feel it's useless because Hive does no
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62946 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62946/consoleFull)**
for PR 14132 at commit
[`381045d`](https://github.com/apache/spark/commit/3
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62832/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62832 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62832/consoleFull)**
for PR 14132 at commit
[`d3df3fb`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62832 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62832/consoleFull)**
for PR 14132 at commit
[`d3df3fb`](https://github.com/apache/spark/commit/d
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Hi, @cloud-fan .
Could you review this `Hint` PR again when you have some time?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as we
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62806/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62806 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62806/consoleFull)**
for PR 14132 at commit
[`beb1c6d`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62806 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62806/consoleFull)**
for PR 14132 at commit
[`beb1c6d`](https://github.com/apache/spark/commit/b
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Hi, @cloud-fan .
Now, it wraps the whole query.
This should be done at your first comment.
Sorry for delay.
---
If your project is set up for it, you can reply to this email and ha
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62762/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62762 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62762/consoleFull)**
for PR 14132 at commit
[`3fa276d`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62762 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62762/consoleFull)**
for PR 14132 at commit
[`3fa276d`](https://github.com/apache/spark/commit/3
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62714 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62714/consoleFull)**
for PR 14132 at commit
[`2ee7d21`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62714/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62714 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62714/consoleFull)**
for PR 14132 at commit
[`2ee7d21`](https://github.com/apache/spark/commit/2
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/14132
Thank you for the great work by @dongjoon-hyun !
Although the code changes are a lot, but most are test cases. The code is
ready to review! @rxin @hvanhovell
Also cc @cloud-fan
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62675/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62675 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62675/consoleFull)**
for PR 14132 at commit
[`ad10ed6`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62675 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62675/consoleFull)**
for PR 14132 at commit
[`ad10ed6`](https://github.com/apache/spark/commit/a
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Thank you for review always, @gatorsmile .
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this fe
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/14132
Thanks for your work! Will try to review it again when the comments are
addressed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62578/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62578 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62578/consoleFull)**
for PR 14132 at commit
[`9021975`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62577/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62577 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62577/consoleFull)**
for PR 14132 at commit
[`e8b7bf0`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62578 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62578/consoleFull)**
for PR 14132 at commit
[`9021975`](https://github.com/apache/spark/commit/9
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62577 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62577/consoleFull)**
for PR 14132 at commit
[`e8b7bf0`](https://github.com/apache/spark/commit/e
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/14132
Yeah, just answered the JIRA. Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
en
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62564/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62564 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62564/consoleFull)**
for PR 14132 at commit
[`94aaf6b`](https://github.com/apache/spark/commit/
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
There is also related issue you might be interested.
https://issues.apache.org/jira/browse/SPARK-16601
---
If your project is set up for it, you can reply to this email and have your
repl
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62564 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62564/consoleFull)**
for PR 14132 at commit
[`94aaf6b`](https://github.com/apache/spark/commit/9
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Hive and Spark will raise `ParseException`. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have thi
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/14132
@dongjoon-hyun Finished the fourth pass. Sorry, it took a long time to
review it. So many meetings...
Just a question, what is the output from Hive when users use a fully
qualified name
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Thank you every time, @gatorsmile . I'll start to work on your comments now.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Hi, @rxin and @gatorsmile .
Now, it's ready for review again.
- `SubstituteHints` is minimized.
- `MetastoreRelation` is supported.
- This PR originally handles all the tables
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62525/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62525 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62525/consoleFull)**
for PR 14132 at commit
[`3e1fcf6`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62526/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62526 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62526/consoleFull)**
for PR 14132 at commit
[`d9793f3`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62526 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62526/consoleFull)**
for PR 14132 at commit
[`d9793f3`](https://github.com/apache/spark/commit/d
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62525 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62525/consoleFull)**
for PR 14132 at commit
[`3e1fcf6`](https://github.com/apache/spark/commit/3
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62502/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62502 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62502/consoleFull)**
for PR 14132 at commit
[`404a322`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14132
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62500/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62500 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62500/consoleFull)**
for PR 14132 at commit
[`5ba2ad7`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62502 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62502/consoleFull)**
for PR 14132 at commit
[`404a322`](https://github.com/apache/spark/commit/4
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Right, there is `table` API, too. Thank you, I'll add that, too.
By the way, I still in the downtown. I need to go home for dinner. I'll
take care that tonight.
Thank you again.
---
I
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/14132
For your reference, below is a simple case if users want to do it using
dataframe
```Scala
sql("CREATE TABLE tab1(c1 int)")
val df = spark.read.table("tab1")
df.join(broadcast(df))
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14132
Yep. I made that case. Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enable
1 - 100 of 223 matches
Mail list logo
