[ https://issues.apache.org/jira/browse/AMBARI-23008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370651#comment-16370651 ]
Hudson commented on AMBARI-23008: --------------------------------- FAILURE: Integrated in Jenkins build Ambari-trunk-Commit #8758 (See [https://builds.apache.org/job/Ambari-trunk-Commit/8758/]) [AMBARI-23008] AMS: SUM downsampling function works incorrectly. (avijayan: [https://gitbox.apache.org/repos/asf?p=ambari.git&a=commit&h=f0e05da42df55151ec745ecf445dc7ee941c0379]) * (edit) ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-site.xml * (edit) ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/aggregators/TimelineMetricReadHelper.java * (edit) ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/aggregators/DownSamplerTest.java * (edit) ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/aggregators/DownSamplerUtils.java * (edit) ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/aggregators/TimelineMetricClusterAggregatorSecond.java * (edit) ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TimelineMetricConfiguration.java * (edit) ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/query/PhoenixTransactSQL.java * (edit) ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/aggregators/TopNDownSampler.java * (edit) ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/PhoenixHBaseAccessor.java * (edit) ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/aggregators/AbstractTimelineAggregator.java * (add) ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/aggregators/EventMetricDownSampler.java > AMS: SUM downsampling function works incorrectly > ------------------------------------------------ > > Key: AMBARI-23008 > URL: https://issues.apache.org/jira/browse/AMBARI-23008 > Project: Ambari > Issue Type: Bug > Components: ambari-metrics > Reporter: Aravindan Vijayan > Assignee: Aravindan Vijayan > Priority: Critical > Labels: pull-request-available > Time Spent: 50m > Remaining Estimate: 0h > > AMS, by default does not sum up across time dimension. However, there are > certain metric cases where this is useful. > *Aggregation Scenario - How it should work* > Let's say in Host H1 - the metric values for > 'topology.streamline-2-test-clone.3-KAFKA.TASK1.--emit-count.STREAM1' are > 1,1,0,1,2 in time 10:01 to 10:05 (1 minute values) respectively > And, in Host H2 - the metric values for the same metric are 1,0,2,2,1 > respectively > AMS will first aggregate across hosts. 'Sum' aggregation -> 2,1,2,3,3 (10:01 > - 10:05) and then across time (downsampling) for larger windows. In time > based downsampling, the 'sum' value will be 11 (2 + 1 + 2 + 3 + 3) at 10:05. > Also, such metrics should not be interpolated, because the injected values > will cause wrong summed up values. > * Work* > A new custom downsampler was added which implements the above logic. -- This message was sent by Atlassian JIRA (v7.6.3#76005)