JingsongLi opened a new pull request, #10769: URL: https://github.com/apache/paimon/pull/10769
## Summary - Dispatch the existing public hybrid `route_builders()` and `rank()` operations to Native execution. Rust captures one authorized snapshot for the routes and performs score fusion. - Keep ordinary, configurable public vector/full-text builders in `route.search_builder`, including their scan/read methods, metadata transport, and empty or retained read views. - Keep `to_route_result()` as shared public result validation, preserving scored result identity and normalizing empty unscored selections. - Preserve pure in-memory ranking without REST/table access, authorization, or validation of unused queries. Supplied results can be empty, reordered, repeated, or externally evaluated; use the current final limit/ranker. - Align Python scores, weights, intermediate arithmetic and accumulation with current Java float32 semantics. Add finite weight boundary and exact Java score fixtures. - Preserve custom abstract builder implementations and backend isolation. Native phase failures are propagated without Python replay. - Update the hybrid search documentation. No public PyPaimon API or dependency changes. ## Verification - 167 focused Python phase, ranker, execution, search filter, authorization and Ray coordinator tests passed. - Arrow 16 focused checks: 23 passed. - 84 real Native joint tests passed against the companion Rust implementation, exercising 59 Native plans. The real SDK was registered inside a Cargo test executable; no Native extension was installed or rebuilt into a Python environment, and the temporary runner is not committed. - Companion Rust: 30 Core hybrid tests and four embedded SDK hybrid tests passed; Rust 1.98.0 all-targets Clippy with warnings denied passed. - Scoped flake8 and diff checks passed. Independent review findings were reproduced and fixed, followed by a clean verification pass. ## Dependency Depends on apache/paimon-rust#1206. Keep this PR draft until the new APIs reach Rust main. Native CI continues to build Rust main; no SDK version probes, old-API compatibility or CI pins are introduced. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
