tustvold opened a new pull request #1732:
URL: https://github.com/apache/arrow-datafusion/pull/1732
# Which issue does this PR close?
Closes #1731.
# Rationale for this change
Not all operators benefit from additional concurrency, in particular those
that are not CPU-intensive (e.g. `UnionExec`, `ProjectionExec`) or are not
embarrassingly parallel (e.g. `LimitExec`). Introducing additional partitioning
is unlikely to yield a performance benefit for these operators, and may in fact
make execution slower. It also makes the plans harder to follow.
# What changes are included in this PR?
Adds a new trait method `ExecutionPlan::should_repartition_children` that
allows operators to indicate that their direct children should not be
repartitioned.
# Are there any user-facing changes?
There is a new optional `ExecutionPlan` method
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
