yihua opened a new pull request, #892:
URL: https://github.com/apache/hudi-rs/pull/892
## Description
closes #891
Each record-level index entry computed `instant_time_millis` from the
commit's instant string and the table's timeline time zone, once per record.
The six writers that build these entries (append, the copy-on-write and
merge-on-read rewrites, merge-on-read deletes) now compute it once before their
loop and reuse it. The value is identical for every record of a commit, so the
written entries do not change.
Appending 2.5M rows with the record index off went from about 2.2 s to about
1.1 s locally, since the append path builds these entries either way.
## How are the changes test-covered
- [ ] N/A
- [x] Automated tests (unit and/or integration tests)
- [ ] Manual tests
- [ ] Details are described below
Behavior-preserving; the existing write and record index suites cover the
entries' contents and pass unchanged.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
