[GitHub] spark issue #6751: [SPARK-8300] DataFrame hint for broadcast join.

[fjh100456]

Github user fjh100456 commented on the issue:

https://github.com/apache/spark/pull/6751
  
With `/*+ broadcast(table) */`, it works well, thank you very much.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #6751: [SPARK-8300] DataFrame hint for broadcast join.

[sridharsubramanian62]

Github user sridharsubramanian62 commented on the issue:

https://github.com/apache/spark/pull/6751
  
 Let me know if this does not help
[SPARK-16475] Broadcast Hint for SQL Queries - ASF JIRA


| 
| 
|  | 
[SPARK-16475] Broadcast Hint for SQL Queries - ASF JIRA


 |

 |

 |




On Tuesday, October 10, 2017, 6:25:57 PM PDT, fjh100456 
 wrote:  
 
 
Is there an example?
I use broadcast like the following, but it perform an error.Would you be so 
kind as to show me an example?


spark-sql> select a.* from tableA a left outer join broadcast(tableB) b on 
a.a=b.a;
17/10/11 09:06:40 INFO HiveMetaStore: 0: get_table : db=default tbl=tablea
17/10/11 09:06:40 INFO audit: ugi=root ip=unknown-ip-addr cmd=get_table : 
db=default tbl=tablea

Error in query: cannot resolve 'tableB' given input columns: []; line 1 pos 
51;

'Project [ArrayBuffer(a).*]
+- 'Join LeftOuter, ('a.a = 'b.a)
:- SubqueryAlias a
: +- SubqueryAlias tablea
: +- HiveTableRelation default.tablea, 
org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, [a#94, b#95, c#96]
+- 'SubqueryAlias b
+- 'UnresolvedTableValuedFunction broadcast, ['tableB]


—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.



---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #6751: [SPARK-8300] DataFrame hint for broadcast join.

[fjh100456]

Github user fjh100456 commented on the issue:

https://github.com/apache/spark/pull/6751
  
Is there an example?
I use broadcast like the following, but it perform an error.Would you be so 
kind as to show me an example?

>spark-sql> select a.* from tableA a left outer join broadcast(tableB) b on 
a.a=b.a;
>17/10/11 09:06:40 INFO HiveMetaStore: 0: get_table : db=default tbl=tablea
>17/10/11 09:06:40 INFO audit: ugi=root ip=unknown-ip-addr  
cmd=get_table : db=default tbl=tablea   
>  **Error in query: cannot resolve '`tableB`' given input columns: []; 
line 1 pos 51;**
>'Project [ArrayBuffer(a).*]
>+- 'Join LeftOuter, ('a.a = 'b.a)
>   :- SubqueryAlias a
>   :  +- SubqueryAlias tablea
>   : +- HiveTableRelation `default`.`tablea`, 
org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, [a#94, b#95, c#96]
>   +- 'SubqueryAlias b
>  +- 'UnresolvedTableValuedFunction broadcast, ['tableB]


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #6751: [SPARK-8300] DataFrame hint for broadcast join.

[sridharsubramanian62]

Github user sridharsubramanian62 commented on the issue:

https://github.com/apache/spark/pull/6751
  
 Its available from spark 2.2.0.
On Tuesday, October 10, 2017, 1:46:27 PM PDT, Reynold Xin 
 wrote:  
 
 
Isn't the hint available in SQL?

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.



---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #6751: [SPARK-8300] DataFrame hint for broadcast join.

[rxin]

Github user rxin commented on the issue:

https://github.com/apache/spark/pull/6751
  
Isn't the hint available in SQL?



---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #6751: [SPARK-8300] DataFrame hint for broadcast join.

[fjh100456]

Github user fjh100456 commented on the issue:

https://github.com/apache/spark/pull/6751
  
@rxin  @marmbrus 
Is there another way to broadcast table with the spark-sql now, except by 
`spark.sql.autoBroadcastJoinThreshold`?
And if no, is it a good way to broadcast table by user conf,such as 
`spark.sql.autoBroadcastJoin.mytable=true` to broadcast a table named `mytable`.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org