2010YOUY01 commented on issue #318: URL: https://github.com/apache/datafusion/issues/318#issuecomment-4384555670
Here is a PR to make extending specialized joins easier: - https://github.com/apache/datafusion/pull/21983 The gist is that for any specialized join following the buffer-all + probe-one-by-one pattern, we can largely reuse the NLJ code for join semantics (e.g., outer/semi/anti joins). The extension point only needs to define how to build and probe a custom join index. With this, we can implement range joins and ASOF joins much more easily on top. While this approach only supports a variant of the buffer-probe execution model (rather than the optimal implementation for ASOF join, which would require a new executor), it is simple and still delivers significant performance improvements. It also provides an easy extension path for other specialized joins that benefit from runtime indexing (e.g., joins on conditions like `array_intersects()`). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
