NGA-TRAN commented on PR #10490: URL: https://github.com/apache/datafusion/pull/10490#issuecomment-2108614713
> What is the plan for actually using this code in DataFusion? > > I am hesitant to put code in DataFusion that is not useful to other users of DataFusion as that basically adds maintenance burden to the community for no benefit. > > We should at least have a plan / POC / description of how we are going to use this operator in plans. > > I think perhaps we can use the code added by @suremarc in thttps://github.com/https://github.com/apache/datafusion/issues/7490 to determine conditions when the optimizer can use ProgressiveEval instead of SortPreservingMerge @alamb : My first step after this is merged in to use it in IOx. So it will be used but I understand it won't be visible to DF. Then I am happy to look into https://github.com/apache/datafusion/issues/7490 to see if there is a quick change to use `ProgressiveEval` instead of `SortPreservingMerge` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
