yihua opened a new pull request, #720:
URL: https://github.com/apache/hudi-rs/pull/720
## Description
The `hudi[datafusion]` extra pinned `datafusion==54.0.0` exactly. The FFI
contract between the wheel and the Python `datafusion` package is per major
version, so bound the extra to the 54.x major instead. This is forward-looking
rather than a fix for a current skew: 54.0.0 is the only published 54.x on
PyPI, so the range resolves identically today, but a future 54.x Python release
no longer requires a hudi release to consume. Also rewords the source comment
in `datafusion_internal.rs` that described the extra as pinned.
Tradeoff acknowledged: the exact pin meant a new datafusion minor arrived as
a reviewable dependabot bump, while the range lets local installs float within
the major; `test_datafusion_ffi.py` is the compensating guard, and an
incompatibility across majors still cannot slip in.
## How are the changes test-covered
- [ ] N/A
- [ ] Automated tests (unit and/or integration tests)
- [x] Manual tests
- [x] Details are described below
Verified the range resolves to the same 54.0.0 currently installed, and the
DataFusion Python integration examples pass against it (register the table
provider, run SQL, compare row counts).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
