This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch helix_084_release_branch
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 1ebcfd9 Release branch only:Upgrade helix to 0.8.4 for release
add 8c8c0ae Add config to disable HLC realtime segment completion (#4235)
add be62932 [TE] Change process timeout to 2 minutes (#4255)
add 3ce335a [TE] frontend - harleyjj/application - redirect http to https
(#4238)
add 951a781 Unify controller base url in integration test (#4257)
add 7abfb12 SoC - Separate out Tuning from Translator (#4250)
add 62ce57f Add RealtimeConsumptionCatchupServiceCallback (#4218)
add 3b9ebea [TE] add padding to baseline endpoints (#4260)
add e768195 [TE] add current time series if it's unavailable in
predicted baseline endpoint (#4262)
add 27b61a1 [TE] add padding to graphs in email and Anomalies route
(#4263)
add d540d95 Change ControllerTest default prot to 18998 (#4259)
add f5c19f6 [TE] frontend - remove unnecessary flag for
noExistingSubscriptionGroup (#4256)
add 0c7a20f [TE] frontend - harleyjj/preview - ensure zoom buttons are
over shaded region (#4254)
add 22b56ed Update the documentation for FASTHLL (#4251)
add 00c2204 pinot-connector-kafka-0.9 module (#4252)
add 55a20b2 [TE] detection config semantic validation fix (#4267)
add 69f29c3 [TE] Cube algorithm for ratio metrics (#4246)
add ccab9a1 Fix controller metric (#4274)
add 3ecdc5c Avoid negative sleep time in startupServiceStatusCheck (#4276)
add 4e3c7d9 [TE] Change default auto onboard frequency to 6 hours (#4258)
add 4c9ac58 [TE] pass alertId to preview in Edit Alert (#4275)
add f026f45 Fix the potentail negative sleep time in HelixServerStarter
(#4277)
new dcb261e Release branch only:Upgrade helix to 0.8.4 for release
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (1ebcfd9)
\
N -- N -- N refs/heads/helix_084_release_branch (dcb261e)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.gitignore | 6 -
docs/pql_examples.rst | 6 +-
.../broker/broker/helix/HelixBrokerStarter.java | 34 ++-
pinot-common/pom.xml | 18 --
.../pinot/common/config/TableNameBuilder.java | 7 +
.../apache/pinot/common/utils/CommonConstants.java | 3 +
.../apache/pinot/common/utils/ServiceStatus.java | 107 ++++----
{docs => pinot-connectors}/README.md | 9 +-
.../pinot-connector-kafka-0.9}/README.md | 10 +-
.../pinot-connector-kafka-0.9}/pom.xml | 58 ++---
.../realtime/impl/kafka/ConsumerAndIterator.java | 0
.../impl/kafka/KafkaAvroMessageDecoder.java | 0
.../realtime/impl/kafka/KafkaBrokerWrapper.java | 0
.../impl/kafka/KafkaConnectionHandler.java | 0
.../realtime/impl/kafka/KafkaConsumerFactory.java | 0
.../realtime/impl/kafka/KafkaConsumerManager.java | 0
.../impl/kafka/KafkaHighLevelStreamConfig.java | 0
.../impl/kafka/KafkaJSONMessageDecoder.java | 0
.../impl/kafka/KafkaLowLevelStreamConfig.java | 0
.../impl/kafka/KafkaPartitionLevelConsumer.java | 0
.../impl/kafka/KafkaSimpleConsumerFactory.java | 0
.../impl/kafka/KafkaSimpleConsumerFactoryImpl.java | 0
.../realtime/impl/kafka}/KafkaStarterUtils.java | 3 +-
.../impl/kafka/KafkaStreamConfigProperties.java | 0
.../impl/kafka/KafkaStreamLevelConsumer.java | 0
.../impl/kafka/KafkaStreamMetadataProvider.java | 0
.../realtime/impl/kafka/SimpleConsumerFactory.java | 0
.../impl/kafka/SimpleConsumerMessageBatch.java | 0
.../impl/kafka/KafkaLowLevelStreamConfigTest.java | 0
.../kafka/KafkaPartitionLevelConsumerTest.java | 0
.../pom.xml | 41 +--
.../apache/pinot/controller/ControllerConf.java | 15 +-
.../apache/pinot/controller/ControllerStarter.java | 18 +-
.../helix/core/PinotHelixResourceManager.java | 25 +-
.../pinot/controller/helix/ControllerTest.java | 2 +-
pinot-core/pom.xml | 16 --
.../AvroRecordToPinotRowGenerator.java | 0
.../kafka => stream}/SimpleAvroMessageDecoder.java | 0
.../pinot/core/realtime/stream/StreamConfig.java | 4 +-
.../AvroRecordToPinotRowGeneratorTest.java | 0
pinot-integration-tests/pom.xml | 6 +
.../tests/BaseClusterIntegrationTest.java | 2 +-
.../ControllerPeriodicTasksIntegrationTests.java | 2 +-
.../tests/HybridClusterIntegrationTest.java | 3 +-
...ridClusterIntegrationTestCommandLineRunner.java | 2 +-
.../tests/LLCRealtimeClusterIntegrationTest.java | 40 +++
.../tests/NewConfigApplyIntegrationTest.java | 12 +-
.../tests/OfflineClusterIntegrationTest.java | 38 ++-
.../tests/PinotURIUploadIntegrationTest.java | 2 +-
.../tests/RealtimeClusterIntegrationTest.java | 3 +-
pinot-perf/pom.xml | 6 +
.../perf/BenchmarkRealtimeConsumptionSpeed.java | 2 +-
.../org/apache/pinot/perf/RealtimeStressTest.java | 2 +-
.../server/starter/helix/HelixServerStarter.java | 104 ++++++--
.../request/ScheduledRequestHandlerTest.java | 10 +-
pinot-tools/pom.xml | 6 +
.../org/apache/pinot/tools/HybridQuickstart.java | 2 +-
.../org/apache/pinot/tools/RealtimeQuickStart.java | 2 +-
.../tools/admin/command/StartKafkaCommand.java | 2 +-
.../admin/command/StreamAvroIntoKafkaCommand.java | 2 +-
.../pinot/tools/streams/AirlineDataStream.java | 2 +-
.../pinot/tools/streams/MeetupRsvpStream.java | 2 +-
pom.xml | 16 +-
.../app/pods/application/route.js | 8 +-
.../app/pods/components/alert-details/component.js | 59 ++---
.../app/pods/components/alert-details/template.hbs | 5 +-
.../pods/components/anomaly-summary/component.js | 28 +-
.../pods/components/timeseries-chart/component.js | 57 ++++-
.../app/pods/manage/yaml/controller.js | 31 +--
.../app/pods/manage/yaml/template.hbs | 1 +
.../app/pods/screenshot/controller.js | 21 +-
.../thirdeye-frontend/app/pods/screenshot/route.js | 7 +-
.../anomaly/alert/util/EmailScreenshotHelper.java | 2 +-
.../api/application/ApplicationResource.java | 2 +-
.../auto/onboard/AutoOnboardConfiguration.java | 2 +-
.../thirdeye/cube/additive/AdditiveCubeNode.java | 53 ++--
.../thirdeye/cube/additive/AdditiveDBClient.java | 12 +-
.../pinot/thirdeye/cube/additive/AdditiveRow.java | 7 +-
.../pinot/thirdeye/cube/cost/CostFunction.java | 1 +
.../thirdeye/cube/cost/RatioCostFunction.java | 136 ++++++++++
.../apache/pinot/thirdeye/cube/data/cube/Cube.java | 3 +-
.../pinot/thirdeye/cube/data/cube/CubeUtils.java | 25 ++
.../cube/data/cube/DimNameValueCostEntry.java | 54 ++--
.../cube/data/dbclient/BaseCubePinotClient.java | 12 +
.../pinot/thirdeye/cube/data/dbrow/BaseRow.java | 25 ++
.../thirdeye/cube/data/node/BaseCubeNode.java | 49 +++-
.../pinot/thirdeye/cube/data/node/CubeNode.java | 12 +-
.../thirdeye/cube/data/node/CubeNodeUtils.java | 7 +-
.../MultiDimensionalRatioSummary.java} | 76 ++----
.../MultiDimensionalSummary.java | 38 ++-
.../MultiDimensionalSummaryCLITool.java | 6 +-
.../pinot/thirdeye/cube/entry/SummaryUtils.java | 43 ++++
.../pinot/thirdeye/cube/ratio/RatioCubeNode.java | 285 +++++++++++++++++++++
.../pinot/thirdeye/cube/ratio/RatioDBClient.java | 113 ++++++++
.../apache/pinot/thirdeye/cube/ratio/RatioRow.java | 190 ++++++++++++++
.../thirdeye/cube/summary/BaseResponseRow.java | 7 +-
.../pinot/thirdeye/cube/summary/Summary.java | 43 ++--
.../thirdeye/cube/summary/SummaryResponse.java | 33 +--
.../dashboard/resources/SummaryResource.java | 78 +++++-
.../thirdeye/detection/DetectionPipeline.java | 17 +-
.../thirdeye/detection/DetectionResource.java | 41 ++-
.../pinot/thirdeye/detection/DetectionUtils.java | 18 +-
.../annotation/registry/DetectionRegistry.java | 4 +-
.../components/AbsoluteChangeRuleDetector.java | 5 +-
.../components/PercentageChangeRuleDetector.java | 5 +-
.../detection/components/RuleBaselineProvider.java | 13 +-
.../components/ThresholdRuleDetector.java | 1 -
.../onboard/YamlOnboardingTaskRunner.java | 18 +-
.../detection/validators/ConfigValidator.java | 2 +-
.../validators/SubscriptionConfigValidator.java | 2 +-
.../detection/wrapper/AnomalyDetectorWrapper.java | 2 +-
.../detection/wrapper/AnomalyFilterWrapper.java | 2 +-
.../wrapper/BaselineFillingMergeWrapper.java | 12 +-
.../thirdeye/detection/wrapper/GrouperWrapper.java | 2 +-
.../detection/yaml/DetectionConfigTuner.java | 180 +++++++++++++
.../thirdeye/detection/yaml/YamlResource.java | 36 ++-
.../detection/yaml/YamlTranslationResult.java | 87 -------
.../CompositePipelineConfigTranslator.java | 113 +++-----
.../translator/ConfigTranslator.java} | 42 +--
.../YamlDetectionAlertConfigTranslator.java | 48 ++--
.../YamlDetectionConfigTranslator.java | 57 +----
.../YamlDetectionTranslatorLoader.java | 2 +-
.../thirdeye/rootcause/impl/MetricEntity.java | 13 +
.../MultiDimensionalSummaryCLIToolTest.java | 1 +
.../pinot/thirdeye/cube/data/cube/CubeTest.java | 14 +-
.../cube/data/cube/DimNameValueCostEntryTest.java | 7 +-
.../cube/data/dbrow/DimensionValuesTest.java | 1 -
.../thirdeye/cube/data/dbrow/DimensionsTest.java | 1 -
.../cube/data/node/AdditiveCubeNodeTest.java | 61 +++++
.../thirdeye/cube/data/node/CubeNodeTest.java | 49 ++--
.../thirdeye/cube/data/node/RatioCubeNodeTest.java | 112 ++++++++
.../thirdeye/detection/DetectionUtilsTest.java | 43 ++--
.../components/RuleBaselineProviderTest.java | 6 +-
.../yaml/MockYamlDetectionConfigTranslator.java | 21 --
.../yaml/YamlDetectionConfigTranslatorTest.java | 60 -----
.../CompositePipelineConfigTranslatorTest.java | 38 ++-
.../YamlDetectionAlertConfigTranslatorTest.java | 13 +-
.../yaml/translator/YamlTranslationResult.java} | 36 ++-
.../compositePipelineTranslatorTestResult-1.json | 6 +-
.../compositePipelineTranslatorTestResult-2.json | 0
.../yaml/{ => translator}/pipeline-config-1.yaml | 2 +-
.../yaml/{ => translator}/pipeline-config-2.yaml | 0
.../yaml/{ => translator}/pipeline-config-3.yaml | 0
143 files changed, 2316 insertions(+), 1058 deletions(-)
copy {docs => pinot-connectors}/README.md (67%)
copy {docs => pinot-connectors/pinot-connector-kafka-0.9}/README.md (60%)
copy {pinot-orc => pinot-connectors/pinot-connector-kafka-0.9}/pom.xml (59%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/ConsumerAndIterator.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaAvroMessageDecoder.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaBrokerWrapper.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaConnectionHandler.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaConsumerFactory.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaConsumerManager.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaHighLevelStreamConfig.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaJSONMessageDecoder.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaLowLevelStreamConfig.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaPartitionLevelConsumer.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaSimpleConsumerFactory.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaSimpleConsumerFactoryImpl.java
(100%)
rename {pinot-common/src/main/java/org/apache/pinot/common/utils =>
pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka}/KafkaStarterUtils.java
(98%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamConfigProperties.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamLevelConsumer.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamMetadataProvider.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/SimpleConsumerFactory.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/SimpleConsumerMessageBatch.java
(100%)
rename {pinot-core =>
pinot-connectors/pinot-connector-kafka-0.9}/src/test/java/org/apache/pinot/core/realtime/impl/kafka/KafkaLowLevelStreamConfigTest.java
(100%)
rename {pinot-core/src/test/java/org/apache/pinot/core/realtime =>
pinot-connectors/pinot-connector-kafka-0.9/src/test/java/org/apache/pinot/core/realtime/impl}/kafka/KafkaPartitionLevelConsumerTest.java
(100%)
copy {pinot-azure-filesystem => pinot-connectors}/pom.xml (74%)
rename pinot-core/src/main/java/org/apache/pinot/core/realtime/{impl/kafka =>
stream}/AvroRecordToPinotRowGenerator.java (100%)
rename pinot-core/src/main/java/org/apache/pinot/core/realtime/{impl/kafka =>
stream}/SimpleAvroMessageDecoder.java (100%)
rename pinot-core/src/test/java/org/apache/pinot/core/realtime/{impl/kafka =>
stream}/AvroRecordToPinotRowGeneratorTest.java (100%)
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/cost/RatioCostFunction.java
copy
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/{additive/MultiDimensionalSummary.java
=> entry/MultiDimensionalRatioSummary.java} (56%)
rename
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/{additive
=> entry}/MultiDimensionalSummary.java (80%)
rename
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/{additive
=> entry}/MultiDimensionalSummaryCLITool.java (97%)
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/entry/SummaryUtils.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/ratio/RatioCubeNode.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/ratio/RatioDBClient.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/ratio/RatioRow.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/DetectionConfigTuner.java
delete mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/YamlTranslationResult.java
rename
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{
=> translator}/CompositePipelineConfigTranslator.java (79%)
copy
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/{validators/ConfigValidator.java
=> yaml/translator/ConfigTranslator.java} (50%)
rename
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{
=> translator}/YamlDetectionAlertConfigTranslator.java (83%)
rename
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{
=> translator}/YamlDetectionConfigTranslator.java (54%)
rename
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{
=> translator}/YamlDetectionTranslatorLoader.java (96%)
create mode 100644
thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/cube/data/node/AdditiveCubeNodeTest.java
create mode 100644
thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/cube/data/node/RatioCubeNodeTest.java
copy
pinot-common/src/test/java/org/apache/pinot/common/utils/DataSizeTest.java =>
thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/DetectionUtilsTest.java
(55%)
delete mode 100644
thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/MockYamlDetectionConfigTranslator.java
delete mode 100644
thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/YamlDetectionConfigTranslatorTest.java
rename
thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/{
=> translator}/CompositePipelineConfigTranslatorTest.java (78%)
rename
thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/{
=> translator}/YamlDetectionAlertConfigTranslatorTest.java (88%)
copy
thirdeye/thirdeye-pinot/src/{main/java/org/apache/pinot/thirdeye/anomaly/onboard/ReplayTaskInfo.java
=>
test/java/org/apache/pinot/thirdeye/detection/yaml/translator/YamlTranslationResult.java}
(60%)
rename
thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{
=> translator}/compositePipelineTranslatorTestResult-1.json (96%)
rename
thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{
=> translator}/compositePipelineTranslatorTestResult-2.json (100%)
rename
thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{
=> translator}/pipeline-config-1.yaml (97%)
rename
thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{
=> translator}/pipeline-config-2.yaml (100%)
rename
thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{
=> translator}/pipeline-config-3.yaml (100%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
