Also make sure to call |hiveContext.sql| within the same thread where
|hiveContext| is created, because Hive uses thread-local variable to
initialize the |Driver.conf|.
On 10/3/14 4:52 PM, Michael Armbrust wrote:
Are you running master? There was briefly a regression here that is
hopefully fixed by spark#2635 <https://github.com/apache/spark/pull/2635>.
On Fri, Oct 3, 2014 at 1:43 AM, Kevin Paul <kevinpaulap...@gmail.com
<mailto:kevinpaulap...@gmail.com>> wrote:
Hi all, I tried to launch my application with spark-submit, the
command I use is:
bin/spark-submit --class ${MY_CLASS} --jars ${MY_JARS} --master
local myApplicationJar.jar
I've buillt spark with SPARK_HIVE=true, and was able to start
HiveContext, and was able to run command like,
hiveContext.sql("select * from myTable")
or hiveContext.sql("select count(*) from myTable")
myTable is a table on my hive database. However, when I run the
command: hiveContext.sql("show tables"), I got the following error:
java.lang.NullPointerException
at
org.apache.hadoop.hive.ql.Driver.validateConfVariables(Driver.java:1057)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:948)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:888)
at
org.apache.spark.sql.hive.HiveContext.runHive(HiveContext.scala:298)
at
org.apache.spark.sql.hive.HiveContext.runSqlHive(HiveContext.scala:272)
at
org.apache.spark.sql.hive.execution.NativeCommand.sideEffectResult$lzycompute(NativeCommand.scala:35)
at
org.apache.spark.sql.hive.execution.NativeCommand.sideEffectResult(NativeCommand.scala:35)
at
org.apache.spark.sql.hive.execution.NativeCommand.execute(NativeCommand.scala:38)
at
org.apache.spark.sql.hive.HiveContext$QueryExecution.toRdd$lzycompute(HiveContext.scala:360)
at
org.apache.spark.sql.hive.HiveContext$QueryExecution.toRdd(HiveContext.scala:360)
Thanks,
Kelvin Paul
