[ https://issues.apache.org/jira/browse/SPARK-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742036#comment-14742036 ]
Maciej Bryński edited comment on SPARK-10577 at 9/12/15 12:29 PM: ------------------------------------------------------------------ [~rxin] I can find broadcast in functions.scala. Is it possible to use it in SQL ? select * from t1 join broadcast(t2) on t1.k1 = t2.k2 doesn't work. {code} Py4JJavaError: An error occurred while calling o31.sql. : org.apache.spark.sql.AnalysisException: missing EOF at '(' near 'broadcast'; line 1 pos 41 at org.apache.spark.sql.hive.HiveQl$.createPlan(HiveQl.scala:296) at org.apache.spark.sql.hive.ExtendedHiveQlParser$$anonfun$hiveQl$1.apply(ExtendedHiveQlParser.scala:41) at org.apache.spark.sql.hive.ExtendedHiveQlParser$$anonfun$hiveQl$1.apply(ExtendedHiveQlParser.scala:40) at scala.util.parsing.combinator.Parsers$Success.map(Parsers.scala:136) at scala.util.parsing.combinator.Parsers$Success.map(Parsers.scala:135) {code} was (Author: maver1ck): [~rxin] I can find broadcast in functions.scala. Is it possible to use it in SQL ? select * from t1 join broadcast(t2) on t1.k1 = t2.k2 doesn't work. > [PySpark, SQL] DataFrame hint for broadcast join > ------------------------------------------------ > > Key: SPARK-10577 > URL: https://issues.apache.org/jira/browse/SPARK-10577 > Project: Spark > Issue Type: Improvement > Components: PySpark, SQL > Affects Versions: 1.5.0 > Reporter: Maciej Bryński > > As in https://issues.apache.org/jira/browse/SPARK-8300 > there should by possibility to add hint for broadcast join in: > - Spark SQL > - Pyspark -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org