Riza Suminto has posted comments on this change. ( http://gerrit.cloudera.org:8080/22956 )
Change subject: IMPALA-14107: Invalidate partition list if PARTITION_NOT_FOUND ...................................................................... Patch Set 5: (1 comment) http://gerrit.cloudera.org:8080/#/c/22956/4//COMMIT_MSG Commit Message: http://gerrit.cloudera.org:8080/#/c/22956/4//COMMIT_MSG@12 PS4, Line 12: : In local catalog mode, CatalogLookupStatus.PARTITION_NOT_FOUND response : from CatalogD will be followed by Coordinator invalidating table : metadata cache and table list of database. However, it does not : invalidate the partition list of requested table. This cause Coordinator : to re-request the same partition id that is not exist anymore in : CatalogD. This patch fix the issue by invalidating the partition list of : the table as well. > In the run that I did, Table version stays the same, but partition list is To be more specific, when I enable TRACE log over CatalogdMetaProvider, I can see it Table lookup miss, and it correctly reload from CatalogD. But when it lookup Table's partitions, it got cache hit (potentially a stale one compared to one living in CatalogD). I think this is incorrect behavior. If Table cache entry is invalidated in local cache, it's partition lists should also be invalidated. -- To view, visit http://gerrit.cloudera.org:8080/22956 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I1bc91023d46a0b57916202d2b64e2cf07b687b74 Gerrit-Change-Number: 22956 Gerrit-PatchSet: 5 Gerrit-Owner: Riza Suminto <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Riza Suminto <[email protected]> Gerrit-Reviewer: Sai Hemanth Gantasala <[email protected]> Gerrit-Comment-Date: Fri, 30 May 2025 16:01:00 +0000 Gerrit-HasComments: Yes
