Laszlo Gaal has uploaded a new patch set (#4) to the change originally created
by k.venureddy2...@gmail.com. ( http://gerrit.cloudera.org:8080/20486 )
Change subject: IMPALA-12356: Alter partition event from hive is treated as
self event
......................................................................
IMPALA-12356: Alter partition event from hive is treated as self event
When a non-transactional table is created and a partition is added using
insert from impala, alter partition event from hive is treated as self
event and ignored processing. Self event check for add partition event
is done only for the transactional tables with IMPALA-10502 fix. It was
missed to avoid the addition of version number to partition's
inFlightEvents_ when a partition is added to non-transactional table.
Thus the version number in inFlightEvents_ is detecting the next alter
partition event from hive as self event.
Another issue found during test:
After the IMPALA-12399 fix, certain event types like OPEN_TXN are not
fetched with get_next_notification() as an optimization. It can cause a
deadloop in MetastoreEventsProcessor#getNextMetastoreEventsInBatches()
when skipped events are present after currentEventId.
Need to return when events received in response is empty.
Testing:
- Manually tested in cluster and added a testcase
Change-Id: I23c2affa3fe32c0b3843bff5e4c0018dce9060d3
---
M fe/src/main/java/org/apache/impala/catalog/HdfsPartition.java
M
fe/src/main/java/org/apache/impala/catalog/events/MetastoreEventsProcessor.java
M
fe/src/test/java/org/apache/impala/catalog/events/MetastoreEventsProcessorTest.java
3 files changed, 77 insertions(+), 0 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/86/20486/4
--
To view, visit http://gerrit.cloudera.org:8080/20486
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I23c2affa3fe32c0b3843bff5e4c0018dce9060d3
Gerrit-Change-Number: 20486
Gerrit-PatchSet: 4
Gerrit-Owner: Anonymous Coward <k.venureddy2...@gmail.com>
Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Gerrit-Reviewer: Quanlong Huang <huangquanl...@gmail.com>
Gerrit-Reviewer: Sai Hemanth Gantasala <saihema...@cloudera.com>
