Quanlong Huang has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/17538 )
Change subject: IMPALA-10724: Add mutable validWriteIdList ...................................................................... IMPALA-10724: Add mutable validWriteIdList In this patch, we add a new class for manually updating writeIdList. In terms of updating writeIdList, we introduce three methods including addOpenWriteId, addAbortedWriteIds, and addCommittedWriteIds. We will use this class in MetastoreEventProcessor for fine-grained table refreshing. With the control of writeIdList, we will be able to update the transactional table partially and keep it consistent. There are some restrictions for MutableValidWriteIdList. 1. We need to mark a writeId open before mark it committed/aborted. 2. We only allow two writeId state transitions, open -> committed or open -> aborted. Any other transition is NOT allowed. Change-Id: I28e60db0afd5d4398af24449b72abc928421f7c6 Reviewed-on: http://gerrit.cloudera.org:8080/17538 Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Reviewed-by: Quanlong Huang <huangquanl...@gmail.com> --- M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java A fe/src/main/java/org/apache/impala/hive/common/MutableValidReaderWriteIdList.java A fe/src/main/java/org/apache/impala/hive/common/MutableValidWriteIdList.java A fe/src/test/java/org/apache/impala/hive/common/MutableValidReaderWriteIdListTest.java 4 files changed, 573 insertions(+), 4 deletions(-) Approvals: Impala Public Jenkins: Verified Quanlong Huang: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/17538 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I28e60db0afd5d4398af24449b72abc928421f7c6 Gerrit-Change-Number: 17538 Gerrit-PatchSet: 7 Gerrit-Owner: Yu-Wen Lai <yu-wen....@cloudera.com> Gerrit-Reviewer: Anonymous Coward <kis...@cloudera.com> Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Quanlong Huang <huangquanl...@gmail.com> Gerrit-Reviewer: Yu-Wen Lai <yu-wen....@cloudera.com>
