GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/20196
[SPARK-23000] Fix Flaky test suite DataSourceWithHiveMetastoreCatalogSuite
in Spark 2.3
## What changes were proposed in this pull request?
https://amplab.cs.berkeley.edu/jenkins/job/spark-branch-2.3-test-sbt-hadoop-2.6/
The test suite DataSourceWithHiveMetastoreCatalogSuite of Branch 2.3 always
failed in hadoop 2.6
The table `t` exists in `default`, but `runSQLHive` reported the table does
not exist. Obviously, Hive client's default database is different. The fix is
to clean the environment and use `DEFAULT` as the database.
```
org.apache.spark.sql.execution.QueryExecutionException: FAILED:
SemanticException [Error 10001]: Line 1:14 Table not found 't'
Stacktrace
sbt.ForkMain$ForkError:
org.apache.spark.sql.execution.QueryExecutionException: FAILED:
SemanticException [Error 10001]: Line 1:14 Table not found 't'
at
org.apache.spark.sql.hive.client.HiveClientImpl$$anonfun$runHive$1.apply(HiveClientImpl.scala:699)
at
org.apache.spark.sql.hive.client.HiveClientImpl$$anonfun$runHive$1.apply(HiveClientImpl.scala:683)
at
org.apache.spark.sql.hive.client.HiveClientImpl$$anonfun$withHiveState$1.apply(HiveClientImpl.scala:272)
at
org.apache.spark.sql.hive.client.HiveClientImpl.liftedTree1$1(HiveClientImpl.scala:210)
at
org.apache.spark.sql.hive.client.HiveClientImpl.retryLocked(HiveClientImpl.scala:209)
at
org.apache.spark.sql.hive.client.HiveClientImpl.withHiveState(HiveClientImpl.scala:255)
at
org.apache.spark.sql.hive.client.HiveClientImpl.runHive(HiveClientImpl.scala:683)
at
org.apache.spark.sql.hive.client.HiveClientImpl.runSqlHive(HiveClientImpl.scala:673)
```
## How was this patch tested?
N/A
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gatorsmile/spark testFix
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20196.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20196
----
commit 63a734e27aee87f7dcd79d0f7a0e1576405cf27d
Author: gatorsmile <gatorsmile@...>
Date: 2018-01-09T04:26:22Z
fix.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
