This is an automated email from the ASF dual-hosted git repository.
xiangfu0 pushed a change to branch xiangfu0/codex1/sorted-exchange-leaf
in repository https://gitbox.apache.org/repos/asf/pinot.git
omit dbd31d9681b Share sorted selection setup and trim duplicate coverage
omit e51181c0d1a Check the DESC null-bearing case against fixed rows
instead of MinMax
omit 91ac3279658 Keep frontier pruning for segments flagged non-null.
omit df967f64aa7 Address second-round review on the streaming selection
ORDER BY combine
omit 9445af82df4 Defer tied cursors under a single-column ORDER BY
omit 2e23316739e Address review feedback on the streaming selection ORDER
BY combine
omit 0d767de3666 Add streaming selection ORDER BY combine for physically
sorted segments
omit 986291e47e8 [MSE] Preserve merge test imports after restacking
omit 5283a74fd99 Simplify ordered mailbox test fixtures
omit e6ae1a3ece1 Check cancellation while validating merged ordering
omit 924a137ea31 Stream ORDER BY over confirmed sorted mailbox producers
add dcf319f474a [build] Include Zstd API annotations for compiler
validation
add 7a4465c289c [MSE] Express ordered streams with a k-way merge exchange
add fde1708cf3d Retain complete input for global window receiver sorts
add 8e8d42a1d4d Stream ORDER BY over confirmed sorted mailbox producers
add b65ee617002 Check cancellation while validating merged ordering
add f4e6da91e2a Simplify ordered mailbox test fixtures
add a1f63722713 [MSE] Preserve merge test imports after restacking
add d9a7510ee26 [MSE] Port ordered leaf streaming to the merge plan
contract
add 8e86cc78388 Retain complete input for global window receiver sorts
add 191fa6c3f3e Add streaming selection ORDER BY combine for physically
sorted segments
add 85fbf85c67e Address review feedback on the streaming selection ORDER
BY combine
add 3d605a54a49 Defer tied cursors under a single-column ORDER BY
add 07ef2cf1ac8 Address second-round review on the streaming selection
ORDER BY combine
add 4bc37dc8a77 Keep frontier pruning for segments flagged non-null.
add 04896b31ee7 Check the DESC null-bearing case against fixed rows
instead of MinMax
add a10ab413e38 Share sorted selection setup and trim duplicate coverage
add a791b14a29d [MSE] Port sorted leaf streaming to explicit merge
exchanges
add 55a98e1ba80 [MSE] Preserve complete window input during receiver
sorting
add 693f2f91865 Align shared window rule test setup with the core
dependency
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (dbd31d9681b)
\
N -- N -- N refs/heads/xiangfu0/codex1/sorted-exchange-leaf
(693f2f91865)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../broker/broker/helix/BaseBrokerStarter.java | 8 +
.../requesthandler/KWayMergeSupportPredicate.java | 99 ++++++++
.../MultiStageBrokerRequestHandler.java | 8 +
.../KWayMergeSupportPredicateTest.java | 107 +++++++++
pinot-common/src/main/proto/plan.proto | 13 ++
...reamingSelectionOrderByCombineOperatorTest.java | 37 +++
.../rel/logical/PinotKWayMergeSortExchange.java | 91 ++++++++
.../rel/rules/PinotSortedLeafExchangeRule.java | 108 +++++++++
.../rules/PinotWindowExchangeNodeInsertRule.java | 27 ++-
.../org/apache/pinot/query/QueryEnvironment.java | 20 +-
.../query/planner/explain/PlanNodeMerger.java | 18 +-
.../planner/logical/EquivalentStagesFinder.java | 10 +-
.../planner/logical/PinotLogicalQueryPlanner.java | 15 +-
.../query/planner/logical/PlanFragmenter.java | 74 +-----
.../planner/logical/PlanNodeToRelConverter.java | 14 +-
.../planner/logical/RelToPlanNodeConverter.java | 13 ++
.../pinot/query/planner/plannode/ExchangeNode.java | 2 +-
.../planner/plannode/KWayMergeExchangeNode.java | 75 ++++++
.../planner/plannode/MailboxMergeReceiveNode.java | 87 +++++++
.../query/planner/plannode/MailboxReceiveNode.java | 2 +-
.../query/planner/plannode/MailboxSendNode.java | 12 -
.../query/planner/serde/PlanNodeDeserializer.java | 11 +
.../query/planner/serde/PlanNodeSerializer.java | 12 +
.../PinotWindowExchangeNodeInsertRuleTest.java | 3 +
.../apache/pinot/query/QueryCompilationTest.java | 86 ++++++-
.../pinot/query/QueryEnvironmentTestBase.java | 13 +-
.../query/planner/logical/PlanFragmenterTest.java | 77 +++----
.../query/planner/serde/PlanNodeSerDeTest.java | 22 ++
.../pinot/query/mailbox/GrpcSendingMailbox.java | 23 +-
.../query/mailbox/InMemorySendingMailbox.java | 10 +-
.../apache/pinot/query/mailbox/MailboxService.java | 10 +-
.../pinot/query/mailbox/ReceivingMailbox.java | 52 ++---
.../pinot/query/mailbox/channel/ChannelUtils.java | 4 -
.../mailbox/channel/MailboxContentObserver.java | 5 +-
.../query/runtime/operator/LimitSortOperator.java | 6 +-
.../runtime/operator/MailboxSendOperator.java | 27 +--
.../SortedMailboxMergeReceiveOperator.java | 170 ++++----------
.../utils/BlockingMultiStreamConsumer.java | 10 -
.../query/runtime/operator/utils/SortUtils.java | 16 --
.../query/runtime/plan/PlanNodeToOpChain.java | 10 +-
.../plan/server/ServerPlanRequestVisitor.java | 18 +-
.../pinot/query/mailbox/MailboxServiceTest.java | 18 +-
.../channel/MailboxContentObserverTest.java | 34 ---
.../query/runtime/operator/LeafOperatorTest.java | 8 +-
.../runtime/operator/MailboxSendOperatorTest.java | 19 --
.../query/runtime/operator/OperatorTestUtil.java | 4 -
.../SortedMailboxMergeReceiveOperatorTest.java | 254 +++++++--------------
.../operator/WindowAggregateOperatorTest.java | 46 ++++
.../plan/OpChainConverterDispatcherTest.java | 16 +-
.../plan/server/ServerPlanRequestVisitorTest.java | 13 +-
pinot-segment-local/pom.xml | 7 +
.../apache/pinot/spi/utils/CommonConstants.java | 1 +
52 files changed, 1153 insertions(+), 692 deletions(-)
create mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/requesthandler/KWayMergeSupportPredicate.java
create mode 100644
pinot-broker/src/test/java/org/apache/pinot/broker/requesthandler/KWayMergeSupportPredicateTest.java
create mode 100644
pinot-query-planner/src/main/java/org/apache/pinot/calcite/rel/logical/PinotKWayMergeSortExchange.java
create mode 100644
pinot-query-planner/src/main/java/org/apache/pinot/calcite/rel/rules/PinotSortedLeafExchangeRule.java
create mode 100644
pinot-query-planner/src/main/java/org/apache/pinot/query/planner/plannode/KWayMergeExchangeNode.java
create mode 100644
pinot-query-planner/src/main/java/org/apache/pinot/query/planner/plannode/MailboxMergeReceiveNode.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
