924060929 commented on PR #66530: URL: https://github.com/apache/doris/pull/66530#issuecomment-5673005680
Fixed P1 review threads #8 (Paimon) and #9 (Hudi) in commit 134d0bfc42e. **Paimon (Thread 8)**: The `PaimonScanReuseKey` now includes a `generation` field (latestSnapshotId from the resolved Table). The Table is resolved once at the statement scope via `resolvePaimonGeneration()` and cached, so both `planScan` and `getScanNodeProperties` observe the same generation. `resolveScanTableConsistent()` checks the scope cache first before resolving fresh. **Hudi (Thread 9)**: The `HudiScanReuseKey` now includes a `generation` field (latest completed instant timestamp from the HoodieTableMetaClient). The metaClient is resolved once at the statement scope via `resolveHudiGeneration()` and cached, so both `doPlanScan` and `getScanNodeProperties` observe the same generation. `resolveMetaClientConsistent()` checks the scope cache first before resolving fresh. Both fixes ensure that same-path table recreation produces different reuse keys (different generation tokens), preventing generation-A ranges from being paired with generation-B schema dictionaries. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
