avantgardnerio opened a new pull request, #2255:
URL: https://github.com/apache/datafusion-ballista/pull/2255
**Purely additive.** No in-tree callers, no behavior change. The type is
defined, serialized, and round-trip tested; wiring lands in follow-ups.
Extracted from #2223 (a working end-to-end parallel-window branch) as
the first slice of the epic to land parallel windows incrementally,
one reviewable piece at a time.
Sibling to `ShuffleReaderExec`: keeps each upstream source alive as its
own stream and feeds all N into a `StreamingMerge` keyed on the child's
declared output ordering. The regular reader concatenates in arrival
order, which breaks the monotonicity RANGE-frame window operators (and
sort-merge-join build sides) require.
## Scope
- `range_shuffle_reader.rs` — operator impl + tests
- proto message + oneof slot 12
- serde encode/decode + roundtrip test
- three `shuffle_reader` helpers promoted to `pub(crate)` so RSR can
reuse them: `local_remote_read_split`, `fetch_partition_local`,
`fetch_partition_remote`
## Test plan
- [x] `cargo clippy --all-targets --workspace` clean
- [x] `cargo fmt --all -- --check` clean
- [x] `cargo test --workspace` — full suite green including new
`test_range_shuffle_reader_exec_roundtrip`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
