This is an automated email from the ASF dual-hosted git repository.
xiangfu0 pushed a change to branch
xiangfu0/codex/codec-stack/07-integration-docs
in repository https://gitbox.apache.org/repos/asf/pinot.git
discard a76317d2a07 Add codec pipeline integration tests and design doc
discard 9e2503a4f87 Harden codec reload and compression stats
discard 7f446948e16 Support codecSpec on segment reload and enable codecSpec
end to end
discard 3d9bd063d57 Resolve configured codec specs once per reload and add a
V7 write benchmark
discard 8c8ec39984b Validate V7 frames lazily and harden the review follow-ups
discard 7436330fa0d Add V7 raw forward index format for codec pipelines
add 2589860e1de Drop null-valued entries from cluster config snapshots
(#19594)
add 5b650aed3bc Fix Arrow response encoder failing on non-String OBJECT
values (#19591)
add efe37ec91f9 Include nested children in ComplexFieldSpec equality and
hashing (#19592)
add a850af47045 Bump software.amazon.awssdk:bom from 2.54.17 to 2.54.18
(#19598)
add 52bf9e08b75 Bump docker/setup-buildx-action from 4.3.0 to 4.4.0
(#19599)
add e9b9d9bee15 Bump docker/setup-qemu-action from 4.3.0 to 4.4.0 (#19600)
add 3b6be9c8b7e Fix flaky ReceivingMailboxTest.readingUnblocksWriters
(#19597)
add 7f79c65927d Support distinct ARRAY_AGG as a star-tree aggregation
function (#19595)
add 1d85f901241 Bump com.github.jnr:jnr-posix from 3.2.2 to 3.2.4 (#19624)
add d6911dc4619 Bump org.mongodb:bson from 5.11.1 to 5.12.0 (#19623)
add d7690b6ac8e Bump org.jline:jline from 4.4.3 to 4.4.5 (#19622)
add e8a01048f00 Bump com.github.luben:zstd-jni from 1.5.7-16 to 1.5.7-17
(#19619)
add 7cd5bf42576 Bump protobuf.version from 4.36.1 to 4.36.2 (#19618)
add d9f39224e35 Bump com.github.jnr:jnr-ffi from 2.3.1 to 2.3.3 (#19617)
add 4d6d52633ae Bump software.amazon.awssdk:bom from 2.54.18 to 2.55.0
(#19616)
add d722da2f207 Bump io.github.hakky54:ayza-bom from 10.0.7 to 10.1.0
(#19615)
add fec15446ed2 Bump prometheus.metrics.version from 1.8.0 to 1.9.0
(#19614)
add 19a990e8acf Bump com.nimbusds:nimbus-jose-jwt from 10.9.1 to 10.10
(#19613)
add e86f170857a Bump org.apache.fory:fory-json from 1.7.3 to 1.7.4 (#19621)
add 7fafbc638e8 Bump com.github.jnr:jnr-constants from 0.11.0 to 0.11.2
(#19620)
add d22a30034d3 [perf] Reduce allocations in multi-stage grouping and
result conversion (#19601)
add 12e7af1dc18 Skip block copies for spool stages whose workers are all
remote (#19428)
add 96e77eca5b4 Add V7 raw forward index format for codec pipelines
add e34f73a464a Validate V7 frames lazily and harden the review follow-ups
add 01973633547 Resolve configured codec specs once per reload and add a
V7 write benchmark
add a028cb0d2d7 Support codecSpec on segment reload and enable codecSpec
end to end
add 7fb73752349 Harden codec reload and compression stats
add 6e90858fafe Report uncompressed value size for V7 codec-pipeline
columns
add 03550e6b0e0 Add codec pipeline integration tests and design doc
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (a76317d2a07)
\
N -- N -- N
refs/heads/xiangfu0/codex/codec-stack/07-integration-docs (03550e6b0e0)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/build-pinot-docker-image.yml | 4 +-
.github/workflows/build-superset-docker-image.yml | 4 +-
...htly-build-multi-arch-superset-docker-image.yml | 4 +-
.../config/DefaultClusterConfigChangeHandler.java | 2 +-
.../response/encoder/ArrowResponseEncoder.java | 3 +-
.../response/encoder/ArrowResponseEncoderTest.java | 16 +
.../function/AggregationFunctionUtils.java | 9 +
.../array/ArrayAggDistinctBigDecimalFunction.java | 19 +
.../array/ArrayAggDistinctBytesFunction.java | 21 ++
.../array/ArrayAggDistinctDoubleFunction.java | 19 +
.../array/ArrayAggDistinctFloatFunction.java | 19 +
.../array/ArrayAggDistinctIntFunction.java | 19 +
.../array/ArrayAggDistinctLongFunction.java | 19 +
.../array/ArrayAggDistinctStringFunction.java | 19 +
.../array/BaseArrayAggBigDecimalFunction.java | 37 ++
.../function/array/BaseArrayAggBytesFunction.java | 38 ++
.../function/array/BaseArrayAggDoubleFunction.java | 40 ++
.../function/array/BaseArrayAggFloatFunction.java | 40 ++
.../function/array/BaseArrayAggFunction.java | 25 ++
.../function/array/BaseArrayAggIntFunction.java | 40 ++
.../function/array/BaseArrayAggLongFunction.java | 40 ++
.../function/array/BaseArrayAggStringFunction.java | 37 ++
.../aggregation/groupby/utils/DoubleToIdMap.java | 5 +-
.../aggregation/groupby/utils/FloatToIdMap.java | 5 +-
.../aggregation/groupby/utils/IntToIdMap.java | 5 +-
.../aggregation/groupby/utils/LongToIdMap.java | 5 +-
.../aggregation/groupby/utils/ObjectToIdMap.java | 5 +-
.../startree/StarTreePreAggregatedBlockValSet.java | 171 +++++++++
.../apache/pinot/core/startree/StarTreeUtils.java | 18 +
.../groupby/utils/ValueToIdMapTest.java | 85 +++++
...2Test.java => ArrayAggBytesStarTreeV2Test.java} | 29 +-
...TreeV2Test.java => ArrayAggStarTreeV2Test.java} | 28 +-
.../pinot/queries/ArrayAggStarTreeQueriesTest.java | 311 ++++++++++++++++
.../pinot/query/mailbox/GrpcSendingMailbox.java | 9 +-
.../query/mailbox/InMemorySendingMailbox.java | 6 +
.../apache/pinot/query/mailbox/SendingMailbox.java | 31 +-
.../runtime/operator/MailboxSendOperator.java | 3 +-
.../operator/MultistageGroupByExecutor.java | 56 ++-
.../runtime/operator/exchange/BlockExchange.java | 34 ++
.../operator/exchange/BroadcastExchange.java | 32 +-
.../runtime/operator/groupby/GroupIdGenerator.java | 3 +-
.../query/runtime/operator/utils/TypeUtils.java | 8 +-
.../query/mailbox/GrpcSendingMailboxTest.java | 12 +
.../query/mailbox/InMemorySendingMailboxTest.java | 12 +
.../pinot/query/mailbox/ReceivingMailboxTest.java | 1 -
.../operator/MultistageGroupByExecutorTest.java | 173 +++++++++
.../operator/exchange/BlockExchangeTest.java | 22 ++
.../operator/exchange/BroadcastExchangeTest.java | 73 +++-
.../runtime/operator/utils/TypeUtilsTest.java | 87 +++++
.../ArrayAggDistinctValueAggregator.java | 408 +++++++++++++++++++++
.../local/aggregator/ValueAggregatorFactory.java | 4 +
.../fwd/SingleValueFixedByteRawIndexCreator.java | 16 +-
.../startree/v2/builder/BaseSingleTreeBuilder.java | 9 +-
.../ArrayAggDistinctValueAggregatorTest.java | 230 ++++++++++++
.../segment/index/SegmentMetadataImplTest.java | 3 +-
.../forward/ForwardIndexCreatorFactoryTest.java | 6 +-
.../spi/index/metadata/ColumnMetadataImpl.java | 5 +-
.../spi/index/metadata/ColumnMetadataImplTest.java | 7 +-
.../provider/PinotClusterConfigProvider.java | 16 +
.../apache/pinot/spi/data/ComplexFieldSpec.java | 16 +
.../provider/PinotClusterConfigProviderTest.java | 17 +-
.../org/apache/pinot/spi/data/FieldSpecTest.java | 42 +++
pom.xml | 24 +-
63 files changed, 2384 insertions(+), 122 deletions(-)
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/startree/StarTreePreAggregatedBlockValSet.java
create mode 100644
pinot-core/src/test/java/org/apache/pinot/core/query/aggregation/groupby/utils/ValueToIdMapTest.java
copy
pinot-core/src/test/java/org/apache/pinot/core/startree/v2/{DistinctCountRawHLLStarTreeV2Test.java
=> ArrayAggBytesStarTreeV2Test.java} (53%)
copy
pinot-core/src/test/java/org/apache/pinot/core/startree/v2/{DistinctCountRawHLLStarTreeV2Test.java
=> ArrayAggStarTreeV2Test.java} (53%)
create mode 100644
pinot-core/src/test/java/org/apache/pinot/queries/ArrayAggStarTreeQueriesTest.java
create mode 100644
pinot-query-runtime/src/test/java/org/apache/pinot/query/runtime/operator/MultistageGroupByExecutorTest.java
create mode 100644
pinot-query-runtime/src/test/java/org/apache/pinot/query/runtime/operator/utils/TypeUtilsTest.java
create mode 100644
pinot-segment-local/src/main/java/org/apache/pinot/segment/local/aggregator/ArrayAggDistinctValueAggregator.java
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/aggregator/ArrayAggDistinctValueAggregatorTest.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
