wombatu-kun commented on issue #20449: URL: https://github.com/apache/hudi/issues/20449#issuecomment-6654220058
Follow-up from the #20519 review: `TimeZoneShiftRule` now needs a fixed-offset zone, so region zones whose offset last changed decades ago stop pruning too, such as `Asia/Shanghai` (1991), `Asia/Tokyo` (1951) and `Asia/Kolkata` (1945). Once #19474 keeps files on NULL verdicts, a `fileGuard` can restore pruning for zones without transition rules: past the zone's last transition the shift is a constant offset, so the guard only needs the file's `lo` to be after it (as an instant for `from_utc_timestamp`, as a wall-clock time for `to_utc_timestamp`). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
