guan404ming opened a new issue, #683:
URL: https://github.com/apache/mahout/issues/683
### Summary
A brief description of the feature.
### Proposed Implementation
QDP (Rust Core)
1. Add dependencies - Add arrow and parquet crates to workspace dependencies
in Cargo.toml
2. Create I/O module - New qdp-core/src/io.rs for Arrow/Parquet read/write
functions
3. Data conversion layer - Convert between Arrow arrays and QDP data formats
(Vec, etc.)
4. Add to QdpEngine - Add methods like load_from_parquet() and
save_to_parquet() to QdpEngine
qdp-python (Python Bindings)
5. Add PyArrow integration - Add arrow feature to PyO3 in
qdp-python/Cargo.toml
6. Expose I/O methods - Bind Rust I/O functions in qdp-python/src/lib.rs
using #[pymethods]
7. Python interface - Add methods like:
- engine.load_parquet(path)
- engine.save_parquet(data, path)
- engine.to_arrow_table()
8. Tests - Add integration tests for Arrow/Parquet round-trip
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
