Repository: spark Updated Branches: refs/heads/master 10be01848 -> 72b738d8d
[SPARK-21790][TESTS] Fix Docker-based Integration Test errors. ## What changes were proposed in this pull request? [SPARK-17701](https://github.com/apache/spark/pull/18600/files#diff-b9f96d092fb3fea76bcf75e016799678L77) removed `metadata` function, this PR removed the Docker-based Integration module that has been relevant to `SparkPlan.metadata`. ## How was this patch tested? manual tests Author: Yuming Wang <wgy...@gmail.com> Closes #19000 from wangyum/SPARK-21709. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/72b738d8 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/72b738d8 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/72b738d8 Branch: refs/heads/master Commit: 72b738d8dcdb7893003c81bf1c73bbe262852d1a Parents: 10be018 Author: Yuming Wang <wgy...@gmail.com> Authored: Sat Aug 19 11:41:32 2017 -0700 Committer: gatorsmile <gatorsm...@gmail.com> Committed: Sat Aug 19 11:41:32 2017 -0700 ---------------------------------------------------------------------- external/docker-integration-tests/pom.xml | 7 +++++++ .../org/apache/spark/sql/jdbc/OracleIntegrationSuite.scala | 9 --------- 2 files changed, 7 insertions(+), 9 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/72b738d8/external/docker-integration-tests/pom.xml ---------------------------------------------------------------------- diff --git a/external/docker-integration-tests/pom.xml b/external/docker-integration-tests/pom.xml index 0fa87a6..485b562 100644 --- a/external/docker-integration-tests/pom.xml +++ b/external/docker-integration-tests/pom.xml @@ -82,6 +82,13 @@ </dependency> <dependency> <groupId>org.apache.spark</groupId> + <artifactId>spark-catalyst_${scala.binary.version}</artifactId> + <version>${project.version}</version> + <type>test-jar</type> + <scope>test</scope> + </dependency> + <dependency> + <groupId>org.apache.spark</groupId> <artifactId>spark-sql_${scala.binary.version}</artifactId> <version>${project.version}</version> <scope>test</scope> http://git-wip-us.apache.org/repos/asf/spark/blob/72b738d8/external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/OracleIntegrationSuite.scala ---------------------------------------------------------------------- diff --git a/external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/OracleIntegrationSuite.scala b/external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/OracleIntegrationSuite.scala index e14810a..80a129a 100644 --- a/external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/OracleIntegrationSuite.scala +++ b/external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/OracleIntegrationSuite.scala @@ -255,15 +255,6 @@ class OracleIntegrationSuite extends DockerJDBCIntegrationSuite with SharedSQLCo val df = dfRead.filter(dfRead.col("date_type").lt(dt)) .filter(dfRead.col("timestamp_type").lt(ts)) - val metadata = df.queryExecution.sparkPlan.metadata - // The "PushedFilters" part should be exist in Datafrome's - // physical plan and the existence of right literals in - // "PushedFilters" is used to prove that the predicates - // pushing down have been effective. - assert(metadata.get("PushedFilters").ne(None)) - assert(metadata("PushedFilters").contains(dt.toString)) - assert(metadata("PushedFilters").contains(ts.toString)) - val row = df.collect()(0) assert(row.getDate(0).equals(dateVal)) assert(row.getTimestamp(1).equals(timestampVal)) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org