This is an automated email from the ASF dual-hosted git repository.
xiangfu0 pushed a change to branch xiangfu0/codex1/sorted-exchange-ordering
in repository https://gitbox.apache.org/repos/asf/pinot.git
omit 986291e47e8 [MSE] Preserve merge test imports after restacking
omit 5283a74fd99 Simplify ordered mailbox test fixtures
omit e6ae1a3ece1 Check cancellation while validating merged ordering
omit 924a137ea31 Stream ORDER BY over confirmed sorted mailbox producers
add dcf319f474a [build] Include Zstd API annotations for compiler
validation
add 7a4465c289c [MSE] Express ordered streams with a k-way merge exchange
add fde1708cf3d Retain complete input for global window receiver sorts
add 8e8d42a1d4d Stream ORDER BY over confirmed sorted mailbox producers
add b65ee617002 Check cancellation while validating merged ordering
add f4e6da91e2a Simplify ordered mailbox test fixtures
add a1f63722713 [MSE] Preserve merge test imports after restacking
add d9a7510ee26 [MSE] Port ordered leaf streaming to the merge plan
contract
add 8e86cc78388 Retain complete input for global window receiver sorts
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (986291e47e8)
\
N -- N -- N refs/heads/xiangfu0/codex1/sorted-exchange-ordering
(8e86cc78388)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../broker/broker/helix/BaseBrokerStarter.java | 8 +
.../requesthandler/KWayMergeSupportPredicate.java | 99 ++++++++
.../MultiStageBrokerRequestHandler.java | 8 +
.../KWayMergeSupportPredicateTest.java | 107 +++++++++
pinot-common/src/main/proto/plan.proto | 13 ++
.../rel/logical/PinotKWayMergeSortExchange.java | 91 ++++++++
.../rel/rules/PinotSortedLeafExchangeRule.java | 108 +++++++++
.../rules/PinotWindowExchangeNodeInsertRule.java | 27 ++-
.../org/apache/pinot/query/QueryEnvironment.java | 20 +-
.../query/planner/explain/PlanNodeMerger.java | 18 +-
.../planner/logical/EquivalentStagesFinder.java | 10 +-
.../planner/logical/PinotLogicalQueryPlanner.java | 15 +-
.../query/planner/logical/PlanFragmenter.java | 74 +-----
.../planner/logical/PlanNodeToRelConverter.java | 14 +-
.../planner/logical/RelToPlanNodeConverter.java | 13 ++
.../pinot/query/planner/plannode/ExchangeNode.java | 2 +-
.../planner/plannode/KWayMergeExchangeNode.java | 75 ++++++
.../planner/plannode/MailboxMergeReceiveNode.java | 87 +++++++
.../query/planner/plannode/MailboxReceiveNode.java | 2 +-
.../query/planner/plannode/MailboxSendNode.java | 12 -
.../query/planner/serde/PlanNodeDeserializer.java | 11 +
.../query/planner/serde/PlanNodeSerializer.java | 12 +
.../PinotWindowExchangeNodeInsertRuleTest.java | 3 +
.../apache/pinot/query/QueryCompilationTest.java | 86 ++++++-
.../pinot/query/QueryEnvironmentTestBase.java | 13 +-
.../query/planner/logical/PlanFragmenterTest.java | 77 +++----
.../query/planner/serde/PlanNodeSerDeTest.java | 22 ++
.../pinot/query/mailbox/GrpcSendingMailbox.java | 23 +-
.../query/mailbox/InMemorySendingMailbox.java | 10 +-
.../apache/pinot/query/mailbox/MailboxService.java | 10 +-
.../pinot/query/mailbox/ReceivingMailbox.java | 52 ++---
.../pinot/query/mailbox/channel/ChannelUtils.java | 4 -
.../mailbox/channel/MailboxContentObserver.java | 5 +-
.../query/runtime/operator/LimitSortOperator.java | 6 +-
.../runtime/operator/MailboxSendOperator.java | 27 +--
.../SortedMailboxMergeReceiveOperator.java | 170 ++++----------
.../utils/BlockingMultiStreamConsumer.java | 10 -
.../query/runtime/operator/utils/SortUtils.java | 16 --
.../query/runtime/plan/PlanNodeToOpChain.java | 10 +-
.../plan/server/ServerPlanRequestVisitor.java | 18 +-
.../pinot/query/mailbox/MailboxServiceTest.java | 18 +-
.../channel/MailboxContentObserverTest.java | 34 ---
.../query/runtime/operator/LeafOperatorTest.java | 8 +-
.../runtime/operator/MailboxSendOperatorTest.java | 19 --
.../query/runtime/operator/OperatorTestUtil.java | 4 -
.../SortedMailboxMergeReceiveOperatorTest.java | 254 +++++++--------------
.../operator/WindowAggregateOperatorTest.java | 46 ++++
.../plan/OpChainConverterDispatcherTest.java | 16 +-
.../plan/server/ServerPlanRequestVisitorTest.java | 13 +-
pinot-segment-local/pom.xml | 7 +
.../apache/pinot/spi/utils/CommonConstants.java | 1 +
51 files changed, 1116 insertions(+), 692 deletions(-)
create mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/requesthandler/KWayMergeSupportPredicate.java
create mode 100644
pinot-broker/src/test/java/org/apache/pinot/broker/requesthandler/KWayMergeSupportPredicateTest.java
create mode 100644
pinot-query-planner/src/main/java/org/apache/pinot/calcite/rel/logical/PinotKWayMergeSortExchange.java
create mode 100644
pinot-query-planner/src/main/java/org/apache/pinot/calcite/rel/rules/PinotSortedLeafExchangeRule.java
create mode 100644
pinot-query-planner/src/main/java/org/apache/pinot/query/planner/plannode/KWayMergeExchangeNode.java
create mode 100644
pinot-query-planner/src/main/java/org/apache/pinot/query/planner/plannode/MailboxMergeReceiveNode.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
