Are you running master? There was briefly a regression here that is
hopefully fixed by spark#2635 <https://github.com/apache/spark/pull/2635>.
On Fri, Oct 3, 2014 at 1:43 AM, Kevin Paul <kevinpaulap...@gmail.com> wrote:
> Hi all, I tried to launch my application with spark-submit, the command I
> use is:
>
> bin/spark-submit --class ${MY_CLASS} --jars ${MY_JARS} --master local
> myApplicationJar.jar
>
> I've buillt spark with SPARK_HIVE=true, and was able to start HiveContext,
> and was able to run command like,
> hiveContext.sql("select * from myTable")
> or hiveContext.sql("select count(*) from myTable")
> myTable is a table on my hive database. However, when I run the command:
> hiveContext.sql("show tables"), I got the following error:
>
> java.lang.NullPointerException
>
> at org.apache.hadoop.hive.ql.Driver.validateConfVariables(Driver.java:1057)
>
> at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:948)
>
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:888)
>
> at org.apache.spark.sql.hive.HiveContext.runHive(HiveContext.scala:298)
>
> at org.apache.spark.sql.hive.HiveContext.runSqlHive(HiveContext.scala:272)
>
> at
> org.apache.spark.sql.hive.execution.NativeCommand.sideEffectResult$lzycompute(NativeCommand.scala:35)
>
> at
> org.apache.spark.sql.hive.execution.NativeCommand.sideEffectResult(NativeCommand.scala:35)
>
> at
> org.apache.spark.sql.hive.execution.NativeCommand.execute(NativeCommand.scala:38)
>
> at
> org.apache.spark.sql.hive.HiveContext$QueryExecution.toRdd$lzycompute(HiveContext.scala:360)
>
> at
> org.apache.spark.sql.hive.HiveContext$QueryExecution.toRdd(HiveContext.scala:360)
>
>
> Thanks,
> Kelvin Paul
>
