Quanlong Huang has posted comments on this change. ( http://gerrit.cloudera.org:8080/22956 )
Change subject: IMPALA-14107: Invalidate partition list if PARTITION_NOT_FOUND ...................................................................... Patch Set 5: (1 comment) http://gerrit.cloudera.org:8080/#/c/22956/4//COMMIT_MSG Commit Message: http://gerrit.cloudera.org:8080/#/c/22956/4//COMMIT_MSG@12 PS4, Line 12: : In local catalog mode, CatalogLookupStatus.PARTITION_NOT_FOUND response : from CatalogD will be followed by Coordinator invalidating table : metadata cache and table list of database. However, it does not : invalidate the partition list of requested table. This cause Coordinator : to re-request the same partition id that is not exist anymore in : CatalogD. This patch fix the issue by invalidating the partition list of : the table as well. > This is the root cause. The partition list is cached using a cache key with the table version: https://github.com/apache/impala/blob/58fd45f20c22f8a062f603d6b96f62ee57d85ca9/fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java#L2107 I think if the table version changes, the partition list won't be reused. Isn't CatalogLookupStatus.PARTITION_NOT_FOUND indicating the table version changed? -- To view, visit http://gerrit.cloudera.org:8080/22956 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I1bc91023d46a0b57916202d2b64e2cf07b687b74 Gerrit-Change-Number: 22956 Gerrit-PatchSet: 5 Gerrit-Owner: Riza Suminto <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Riza Suminto <[email protected]> Gerrit-Reviewer: Sai Hemanth Gantasala <[email protected]> Gerrit-Comment-Date: Fri, 30 May 2025 15:38:30 +0000 Gerrit-HasComments: Yes
