comphead commented on code in PR #10892:
URL: https://github.com/apache/datafusion/pull/10892#discussion_r1638413831
##########
datafusion/physical-plan/src/joins/sort_merge_join.rs:
##########
@@ -1313,51 +1354,37 @@ impl SMJStream {
streamed_columns
};
+ // Push the streamed/buffered batch joined nulls to
the output
let null_joined_streamed_batch =
RecordBatch::try_new(self.schema.clone(),
columns.clone())?;
self.output_record_batches.push(null_joined_streamed_batch);
- // For full join, we also need to output the null
joined rows from the buffered side
+ // For full join, we also need to output the null
joined rows from the buffered side.
+ // Usually this is done by `freeze_buffered`. However,
if a buffered row is joined with
+ // streamed side, it won't be outputted by
`freeze_buffered`.
+ // We need to check if a buffered row is joined with
streamed side and output.
+ // If it is joined with streamed side, but finally
fails on the join filter,
Review Comment:
```suggestion
// If it is joined with streamed side, but doesn't
match the join filter,
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org
