Dandandan commented on PR #21240: URL: https://github.com/apache/datafusion/pull/21240#issuecomment-4167579096
The most promising approach would perhaps be to check out the single join (it is also relatively easy to implement) and see what it does when switching to that type - I am wondering if it is able to do more optimization like pushing down the scalar value as a dynamic filter in certain cases (which I imagine would be pretty effective). Also, thinking more about it, in some cases a join should be more effecient in execution as well as it allows doing avoiding materialization of the output if the scalar filter is in the join (I wonder if that's what were seeing). In the scalar subquery case it will materialize the join first and then apply the filter using `FilterExec`? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
