Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22614#discussion_r223459567
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -544,6 +544,15 @@ object SQLConf {
.booleanConf
.createWithDefault(true)
+ val HIVE_METASTORE_PARTITION_PRUNING_FALLBACK_ENABLED =
+ buildConf("spark.sql.hive.metastorePartitionPruning.fallback.enabled")
+ .doc("When true, enable fallback to fetch all partitions if Hive
metastore partition " +
+ "push down fails. This is applicable only if partition pruning
is enabled (see " +
+ s" ${HIVE_METASTORE_PARTITION_PRUNING.key}). Enabling this may
degrade performance " +
+ "if there are a large number of partitions." )
--- End diff --
"if there is"
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
