Re: [Spark SQL - Scala] TestHive not working in Spark 2

2017-01-13 Thread Xin Wu
In terms of the nullPointerException, i think it is bug. since the test data directories might be moved already. so it failed to load the test data to create the test tables. You may create a jira for this. On Fri, Jan 13, 2017 at 11:44 AM, Xin Wu <xwu0...@gmail.com> wrote: > If you

Re: [Spark SQL - Scala] TestHive not working in Spark 2

2017-01-13 Thread Xin Wu
ot do. > > > > Also it doesn’t seem to allow me to directly create a table from a > DataFrame, as follow: > > > > TestHive.createDataFrame[MyType](rows).write.saveAsTable("a_table") > > > > *From:* Xin Wu [mailto:xwu0...@gmail.com] > *Sent:* 13 janv

Re: [Spark SQL - Scala] TestHive not working in Spark 2

2017-01-13 Thread Xin Wu
> > at org.apache.spark.sql.hive.test.TestHiveContext.( > TestHive.scala:80) > > at org.apache.spark.sql.hive.test.TestHive$.( > TestHive.scala:47) > > at org.apache.spark.sql.hive.test.TestHive$.( > TestHive.scala) > > > > I’m using Spark 2.1.0 in this case. > > > > Am I missing something or should I create a bug in Jira? > -- Xin Wu (650)392-9799