[ 
https://issues.apache.org/jira/browse/AMBARI-23008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370651#comment-16370651
 ] 

Hudson commented on AMBARI-23008:
---------------------------------

FAILURE: Integrated in Jenkins build Ambari-trunk-Commit #8758 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/8758/])
[AMBARI-23008] AMS: SUM downsampling function works incorrectly. (avijayan: 
[https://gitbox.apache.org/repos/asf?p=ambari.git&a=commit&h=f0e05da42df55151ec745ecf445dc7ee941c0379])
* (edit) 
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-site.xml
* (edit) 
ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/aggregators/TimelineMetricReadHelper.java
* (edit) 
ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/aggregators/DownSamplerTest.java
* (edit) 
ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/aggregators/DownSamplerUtils.java
* (edit) 
ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/aggregators/TimelineMetricClusterAggregatorSecond.java
* (edit) 
ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TimelineMetricConfiguration.java
* (edit) 
ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/query/PhoenixTransactSQL.java
* (edit) 
ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/aggregators/TopNDownSampler.java
* (edit) 
ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/PhoenixHBaseAccessor.java
* (edit) 
ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/aggregators/AbstractTimelineAggregator.java
* (add) 
ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/aggregators/EventMetricDownSampler.java


> AMS: SUM downsampling function works incorrectly
> ------------------------------------------------
>
>                 Key: AMBARI-23008
>                 URL: https://issues.apache.org/jira/browse/AMBARI-23008
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-metrics
>            Reporter: Aravindan Vijayan
>            Assignee: Aravindan Vijayan
>            Priority: Critical
>              Labels: pull-request-available
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> AMS, by default does not sum up across time dimension. However, there are 
> certain metric cases where this is useful.
> *Aggregation Scenario - How it should work*
> Let's say in Host H1 - the metric values for 
> 'topology.streamline-2-test-clone.3-KAFKA.TASK1.--emit-count.STREAM1' are 
> 1,1,0,1,2 in time 10:01 to 10:05 (1 minute values) respectively
> And, in Host H2 - the metric values for the same metric are 1,0,2,2,1 
> respectively
> AMS will first aggregate across hosts. 'Sum' aggregation -> 2,1,2,3,3 (10:01 
> - 10:05) and then across time (downsampling) for larger windows. In time 
> based downsampling, the 'sum' value will be 11 (2 + 1 + 2 + 3 + 3) at 10:05.
> Also, such metrics should not be interpolated, because the injected values 
> will cause wrong summed up values.
> * Work*
> A new custom downsampler was added which implements the above logic. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to