robtandy opened a new pull request, #67:
URL: https://github.com/apache/datafusion-ray/pull/67
Fixes #63
Update dependencies of the project, notably:
- DataFusion to 45
- pyo3 to 0.23
- Rust to 1.85
- Pull in `datafusion.proto` and `datafusion_common.proto` from DataFusion
45
- multiple changes related to those dependencies
Small changes included:
- removed unused `stage_id()` method left over in `StageHandlerInner` no
longer necessary after preallocating `RayStages`
- Address a few small lints that clippy found.
All tpch queries validate using the cmd line:
```bash
DATAFUSION_RAY_LOG_LEVEL=info RAY_COLOR_PREFIX=1 RAY_DEDUP_LOGS=0 python
tpcbench.py --data='file:///Users/rob.tandy/tmp/tpch_single/' --concurrency 3
--partitions-per-worker 2 --batch-size=8192 --worker-pool-min=10 --validate
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
