Andrew Sherman has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/21028


Change subject: IMPALA-12805: Avoid problems of HIVE-27114 without 
configuration changes
......................................................................

IMPALA-12805: Avoid problems of HIVE-27114 without configuration changes

HIVE-27114 adds a new property, with name
"hive.metastore.partitions.parameters.exclude.pattern", which defaults
to "impala_intermediate_stats_chunk%". This default excludes the Impala
incremental stats from the results returned from the HMS client. I think
this was done to help Hive performance. It means however that Impala
cannot retrieve its own partition stats, which will negatively impact
the performance of many workloads.

One fix for this was IMPALA-12743 which sets a non-empty non-default
value for the new Hive property in the development environment’s
hive-site.xml file. In some customer situations this would require a
configuration change that cannot be deployed simultaneously with the
possible HMS upgrade which introduces the regression.

Fix this by setting a non-empty non-default value for the new Hive
property in the configurations in the MetaStoreClientPool. This avoids
the regression. The natural thing would be to set an empty string as the
value, but this is not enough to override the default. Instead we set
the string “do_not_match” which should never be used for as the name of
any partition stats.

Change-Id: I3c13efd0d1619930461829fd8ee1fea66fa764f5
---
M fe/src/main/java/org/apache/impala/catalog/MetaStoreClientPool.java
1 file changed, 4 insertions(+), 0 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/28/21028/1
--
To view, visit http://gerrit.cloudera.org:8080/21028
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I3c13efd0d1619930461829fd8ee1fea66fa764f5
Gerrit-Change-Number: 21028
Gerrit-PatchSet: 1
Gerrit-Owner: Andrew Sherman <asher...@cloudera.com>

Reply via email to