k.venureddy2...@gmail.com has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/21106


Change subject: [WIP]IMPALA-12832: Implicit invalidate metadata on event 
failures
......................................................................

[WIP]IMPALA-12832: Implicit invalidate metadata on event failures

At present, failure in event processing needs manual invalidate
metadata. This patch implicitly invalidates the table upon failures
in processing of table events with new 'process_event_failure' flag.
And a new 'auto_global_invalidate_metadata' flag is added to global
invalidate metadata automatically when event processor goes to
non-active state.

Note: Also introduced a config
'inject_process_event_failure_event_types' for automated tests to
simulate event processor failures. This config is used to specify what
event types can be intentionally failed. This config should only be
used for testing purpose.

Testing:
- Added end-to-end tests to mimic failures in event processor and verified
that event processor is active
- Passed FE tests

Change-Id: Ib11c554f5692e4fb8a4c63ef5ba8f8ae0e787826
---
M be/src/catalog/catalog-server.cc
M fe/src/compat-hive-3/java/org/apache/impala/compat/MetastoreShim.java
M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java
M fe/src/main/java/org/apache/impala/catalog/events/MetastoreEvents.java
M 
fe/src/main/java/org/apache/impala/catalog/events/MetastoreEventsProcessor.java
6 files changed, 52 insertions(+), 59 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/06/21106/1
--
To view, visit http://gerrit.cloudera.org:8080/21106
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: Ib11c554f5692e4fb8a4c63ef5ba8f8ae0e787826
Gerrit-Change-Number: 21106
Gerrit-PatchSet: 1
Gerrit-Owner: Anonymous Coward <k.venureddy2...@gmail.com>

Reply via email to