yihua opened a new pull request, #709:
URL: https://github.com/apache/hudi-rs/pull/709
## Description
Two statements in `README.md` and `docs/reader-spec.md` no longer match the
code. Both say every `hoodie.read.*` config is dropped at table construction,
which stopped being true when read configs gained a scope in #660: only the
`ReadOnly` ones (query type, as-of/start/end timestamps) are dropped, while
`TableOrRead` ones survive on the table and are overridden per read. Both also
say a MOR slice with log files streams as a single merged batch, which now
describes file group reader version 1 only; version 2 has been the default
since #677 and streams a bounded merged chunk at a time.
The rest of the diff fills gaps those commits opened: a read config table in
the README (including `hoodie.read.file.group.reader.version` and the escape
hatch its CUSTOM merge mode error points at), the `spill-rocksdb` default
feature and what dropping it costs, Lance base files, and row-group pruning in
the spec's filter section.
## How are the changes test-covered
- [x] N/A
- [ ] Automated tests (unit and/or integration tests)
- [ ] Manual tests
- [ ] Details are described below
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]