Hello Quanlong Huang, Sai Hemanth Gantasala, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/22956
to look at the new patch set (#2).
Change subject: IMPALA-14107: Obtain partition early in
HdfsTable.getPartialInfo()
......................................................................
IMPALA-14107: Obtain partition early in HdfsTable.getPartialInfo()
test_reload_events_with_transient_partitions can get stuck when running
in local catalog mode. From the catalod.INFO, it looks like catalog keep
looking for non-existent partition id.
The root cause seems to come from the gap between gathering partition
ids vs the partition itself in HdfsTable.getPartialInfo(). If
partitionMap_ is cleared or mutated in between the two gather, a missing
partition warning will be printed and
CatalogLookupStatus.PARTITION_NOT_FOUND will be returned.
This patch attempt to fix the issue by directly gathering all partitions
when Coordinator does not request for specific partitions.
Testing:
Split test_reload_events_with_transient_partitions into two setup:
legacy catalog mode and local catalog mode. Confirm that both tests
pass.
Change-Id: I1bc91023d46a0b57916202d2b64e2cf07b687b74
---
M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java
M tests/custom_cluster/test_events_custom_configs.py
2 files changed, 37 insertions(+), 16 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/56/22956/2
--
To view, visit http://gerrit.cloudera.org:8080/22956
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I1bc91023d46a0b57916202d2b64e2cf07b687b74
Gerrit-Change-Number: 22956
Gerrit-PatchSet: 2
Gerrit-Owner: Riza Suminto <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Quanlong Huang <[email protected]>
Gerrit-Reviewer: Riza Suminto <[email protected]>
Gerrit-Reviewer: Sai Hemanth Gantasala <[email protected]>
