sunchao commented on PR #7190: URL: https://github.com/apache/datafusion-comet/pull/7190#issuecomment-6504379390
@comphead, both extensions are now tracked as separate follow-ups: - #7317: extend right-key reduction to ordinary left-anti joins and eligible residual conditions. - #7318: evaluate bounded reduction across small shuffle batches, including the memory lifetime and performance tradeoffs of retaining a key set across input pulls. This PR stays scoped to batch-local reduction for unfiltered left-semi joins. The many-map benchmark and documentation of the small-block bypass remain in this PR; current-source benchmark validation is still outstanding. The algorithm extensions will be evaluated in the linked issues. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
