Re: [PR] Enhancement: Sketch value aggregator performance [pinot]

2024-05-01 Thread via GitHub
Jackie-Jiang merged PR #13020: URL: https://github.com/apache/pinot/pull/13020 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Enhancement: Sketch value aggregator performance [pinot]

2024-05-01 Thread via GitHub
davecromberge commented on PR #13020: URL: https://github.com/apache/pinot/pull/13020#issuecomment-2088112915 @gortiz as a starting point, here are some empirical measurements that I took from a run in our production environment. The build time refers to the StarTree build time for a

Re: [PR] Enhancement: Sketch value aggregator performance [pinot]

2024-05-01 Thread via GitHub
davecromberge commented on PR #13020: URL: https://github.com/apache/pinot/pull/13020#issuecomment-2088109017 > The PR looks fine to me, but it is a bit strange to approve a performance wise PR without an actual benchmark we can reproduce. Could you include a JMH benchmark as part of the

Re: [PR] Enhancement: Sketch value aggregator performance [pinot]

2024-05-01 Thread via GitHub
davecromberge commented on code in PR #13020: URL: https://github.com/apache/pinot/pull/13020#discussion_r1585986210 ## pinot-segment-local/src/test/java/org/apache/pinot/segment/local/aggregator/DistinctCountCPCSketchValueAggregatorTest.java: ## @@ -34,19 +34,18 @@ public

Re: [PR] Enhancement: Sketch value aggregator performance [pinot]

2024-04-30 Thread via GitHub
gortiz commented on PR #13020: URL: https://github.com/apache/pinot/pull/13020#issuecomment-2084818483 The PR looks fine to me, but it is a bit strange to approve a performance wise PR without an actual benchmark we can reproduce. Could you include a JMH benchmark as part of the PR? --

Re: [PR] Enhancement: Sketch value aggregator performance [pinot]

2024-04-30 Thread via GitHub
gortiz commented on code in PR #13020: URL: https://github.com/apache/pinot/pull/13020#discussion_r1584440068 ## pinot-segment-local/src/test/java/org/apache/pinot/segment/local/aggregator/DistinctCountCPCSketchValueAggregatorTest.java: ## @@ -34,19 +34,18 @@ public class

Re: [PR] Enhancement: Sketch value aggregator performance [pinot]

2024-04-29 Thread via GitHub
codecov-commenter commented on PR #13020: URL: https://github.com/apache/pinot/pull/13020#issuecomment-2082425755 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/13020?dropdown=coverage=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=apache) Report

[PR] Enhancement: Sketch value aggregator performance [pinot]

2024-04-29 Thread via GitHub
davecromberge opened a new pull request, #13020: URL: https://github.com/apache/pinot/pull/13020 This addresses excessive resource consumption and performance problems with the following Apache Datasketches value aggregators: - Theta - CPC - Tuple (Integer) When merging