Github user wangyum commented on a diff in the pull request:
https://github.com/apache/spark/pull/23027#discussion_r234521489
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/FilterPushdownBenchmark.scala
---
@@ -104,6 +107,10 @@ object FilterPushdownBenchmark extends BenchmarkBase
with SQLHelper {
df.write.mode("overwrite")
.option("parquet.block.size", blockSize).parquet(parquetPath)
spark.read.parquet(parquetPath).createOrReplaceTempView("parquetTable")
+
+ df.write.mode("overwrite").save(inMemoryTablePath)
--- End diff --
Cache `inMemoryTable` from file to avoid the performance issue:
https://github.com/apache/spark/pull/23027#pullrequestreview-175054485
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
