AtharvUrunkar opened a new pull request, #38408: URL: https://github.com/apache/beam/pull/38408
## Summary Fixes #38337 This change updates `AssignDestinationsAndPartitions` to periodically refresh cached Iceberg partition specs instead of loading them only once per worker instance. Previously, `PartitionKey` and `BeamRowWrapper` instances were cached indefinitely, which could result in stale partition specs being used after table spec updates. ## Changes * Added periodic refresh logic using a refresh interval * Added refresh timestamp tracking per table * Reloaded partition specs after refresh interval expiration * Preserved existing caching behavior between refreshes * Added explicit non-null validation for cached objects before usage ## Testing * `./gradlew spotlessApply` * `./gradlew :sdks:java:io:iceberg:test` Note: Local Iceberg test execution on Windows encountered unrelated environment/runtime issues (`URISyntaxException` / `Unsafe` initialization errors) likely tied to Windows + Java toolchain compatibility rather than this isolated change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
