yihua commented on PR #698: URL: https://github.com/apache/hudi-rs/pull/698#issuecomment-5531625465
@wirybeaver After rebasing, there is one issue suffaced, downstream of arrow 59: no Lance release can be paired with it (11.0.0 and even lance main's 12.0.0-beta are still on arrow 58), so putting Lance behind an off-by-default feature now fails 24 Lance tests on main and cannot compile at all under CI's `--all-features`; and there is no `datafusion-python` matching DataFusion 55 (54.0.0 is the newest, on datafusion-ffi 54), so the `hudi[datafusion]` FFI extra has no valid pin. This means we cannot upgrade DataFusion to 55 in the next release. To unblock hudi-rs 0.5.0 release, I've opened a PR for DataFusion 54 / arrow 58 / Lance 11 instead, which keeps everything green, and I'd suggest landing that first and revisiting 55 once Lance and datafusion-python catch up. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
