xudong963 commented on PR #23741: URL: https://github.com/apache/datafusion/pull/23741#issuecomment-5213126688
@jonathanc-n Good catch on the candidate scan. I’ll bound candidates examined per poll, preserve the scan cursor, self-wake and return Pending when the budget is exhausted, and add an all-rejected residual-filter regression test. For unbounded inputs, IEJoin already reports Unbounded + EmissionType::Final, which SanityCheckPlan rejects as pipeline-breaking. I’ll add a regression test demonstrating that behavior; let me know if you still prefer an additional guard for callers that bypass the physical optimizer. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
