rich7420 opened a new pull request, #945: URL: https://github.com/apache/mahout/pull/945
### Purpose of PR <!-- Describe what this PR does. --> This follows a data-driven approach: establish observability first, collect baseline metrics, then optimize based on real data. This reduces risk and quantifies improvements. What's added: - Pool Metrics — Tracks pinned buffer pool utilization to detect starvation. Uses lock-free atomics for low overhead. - Overlap Tracking — Measures H2D copy/compute overlap using CUDA events. Logs overlap percentage to verify the >60% target. - Integration — Both features are optional via environment variables (QDP_ENABLE_POOL_METRICS, QDP_ENABLE_OVERLAP_TRACKING). Zero overhead when disabled. - Python Support — Python bindings auto-initialize Rust logging, so users just set RUST_LOG. - Documentation — Usage guide with examples for Python and Rust. plz follow docs and try it. ### Related Issues or PRs <!-- Add links to related issues or PRs. --> <!-- - Closes #123 --> <!-- - Related to #123 --> ### Changes Made <!-- Please mark one with an "x" --> - [ ] Bug fix - [x] New feature - [ ] Refactoring - [ ] Documentation - [ ] Test - [ ] CI/CD pipeline - [ ] Other ### Breaking Changes <!-- Does this PR introduce a breaking change? --> - [ ] Yes - [x] No ### Checklist <!-- Please mark each item with an "x" when complete --> <!-- If not all items are complete, please open this as a **Draft PR**. Once all requirements are met, mark as ready for review. --> - [ ] Added or updated unit tests for all changes - [ ] Added or updated documentation for all changes - [ ] Successfully built and ran all unit tests or manual tests locally - [ ] PR title follows "MAHOUT-XXX: Brief Description" format (if related to an issue) - [ ] Code follows ASF guidelines -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
