[ https://issues.apache.org/jira/browse/AMBARI-17512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xing resolved AMBARI-17512. --------------------------- Resolution: Won't Fix > Failed to Check Ambari Metrics > ------------------------------ > > Key: AMBARI-17512 > URL: https://issues.apache.org/jira/browse/AMBARI-17512 > Project: Ambari > Issue Type: Bug > Components: ambari-agent, ambari-metrics, ambari-server > Affects Versions: 2.2.2 > Reporter: Xing > > stderr: > Traceback (most recent call last): > File > "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/service_check.py", > line 172, in <module> > AMSServiceCheck().execute() > File > "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", > line 219, in execute > method(env) > File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", > line 89, in thunk > return fn(*args, **kwargs) > File > "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/service_check.py", > line 100, in service_check > raise Fail("Metrics were not saved. Service check has failed. " > resource_management.core.exceptions.Fail: Metrics were not saved. Service > check has failed. > Connection failed. > stdout: > 2016-06-30 07:15:36,288 - Using hadoop conf dir: > /usr/hdp/current/hadoop-client/conf > 2016-06-30 07:15:36,297 - Ambari Metrics service check was started. > 2016-06-30 07:15:36,304 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285336000, > "starttime": 1467285336000, > "metrics": { > "1467285336000": 0.415144595584, > "1467285337000": 1467285336000 > } > } > ] > } > 2016-06-30 07:15:36,304 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:15:51,319 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:15:51,322 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285351000, > "starttime": 1467285351000, > "metrics": { > "1467285351000": 0.415144595584, > "1467285352000": 1467285351000 > } > } > ] > } > 2016-06-30 07:15:51,323 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:16:06,338 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:16:06,341 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285366000, > "starttime": 1467285366000, > "metrics": { > "1467285366000": 0.415144595584, > "1467285367000": 1467285366000 > } > } > ] > } > 2016-06-30 07:16:06,341 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:16:21,350 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:16:21,353 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285381000, > "starttime": 1467285381000, > "metrics": { > "1467285381000": 0.415144595584, > "1467285382000": 1467285381000 > } > } > ] > } > 2016-06-30 07:16:21,353 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:16:36,369 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:16:36,372 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285396000, > "starttime": 1467285396000, > "metrics": { > "1467285396000": 0.415144595584, > "1467285397000": 1467285396000 > } > } > ] > } > 2016-06-30 07:16:36,372 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:16:51,388 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:16:51,391 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285411000, > "starttime": 1467285411000, > "metrics": { > "1467285411000": 0.415144595584, > "1467285412000": 1467285411000 > } > } > ] > } > 2016-06-30 07:16:51,391 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:17:06,404 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:17:06,407 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285426000, > "starttime": 1467285426000, > "metrics": { > "1467285426000": 0.415144595584, > "1467285427000": 1467285426000 > } > } > ] > } > 2016-06-30 07:17:06,407 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:17:21,410 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:17:21,413 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285441000, > "starttime": 1467285441000, > "metrics": { > "1467285441000": 0.415144595584, > "1467285442000": 1467285441000 > } > } > ] > } > 2016-06-30 07:17:21,413 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:17:36,429 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:17:36,432 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285456000, > "starttime": 1467285456000, > "metrics": { > "1467285456000": 0.415144595584, > "1467285457000": 1467285456000 > } > } > ] > } > 2016-06-30 07:17:36,432 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:17:51,447 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:17:51,451 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285471000, > "starttime": 1467285471000, > "metrics": { > "1467285471000": 0.415144595584, > "1467285472000": 1467285471000 > } > } > ] > } > 2016-06-30 07:17:51,451 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:18:06,463 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:18:06,468 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285486000, > "starttime": 1467285486000, > "metrics": { > "1467285486000": 0.415144595584, > "1467285487000": 1467285486000 > } > } > ] > } > 2016-06-30 07:18:06,469 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:18:21,486 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:18:21,489 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285501000, > "starttime": 1467285501000, > "metrics": { > "1467285501000": 0.415144595584, > "1467285502000": 1467285501000 > } > } > ] > } > 2016-06-30 07:18:21,489 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:18:36,505 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:18:36,508 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285516000, > "starttime": 1467285516000, > "metrics": { > "1467285516000": 0.415144595584, > "1467285517000": 1467285516000 > } > } > ] > } > 2016-06-30 07:18:36,508 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:18:51,524 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:18:51,527 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285531000, > "starttime": 1467285531000, > "metrics": { > "1467285531000": 0.415144595584, > "1467285532000": 1467285531000 > } > } > ] > } > 2016-06-30 07:18:51,527 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:19:06,541 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:19:06,546 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285546000, > "starttime": 1467285546000, > "metrics": { > "1467285546000": 0.415144595584, > "1467285547000": 1467285546000 > } > } > ] > } > 2016-06-30 07:19:06,546 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:19:21,561 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:19:21,564 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285561000, > "starttime": 1467285561000, > "metrics": { > "1467285561000": 0.415144595584, > "1467285562000": 1467285561000 > } > } > ] > } > 2016-06-30 07:19:21,564 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:19:36,566 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:19:36,572 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285576000, > "starttime": 1467285576000, > "metrics": { > "1467285576000": 0.415144595584, > "1467285577000": 1467285576000 > } > } > ] > } > 2016-06-30 07:19:36,572 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:19:51,587 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:19:51,590 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285591000, > "starttime": 1467285591000, > "metrics": { > "1467285591000": 0.415144595584, > "1467285592000": 1467285591000 > } > } > ] > } > 2016-06-30 07:19:51,590 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:20:06,603 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:20:06,607 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285606000, > "starttime": 1467285606000, > "metrics": { > "1467285606000": 0.415144595584, > "1467285607000": 1467285606000 > } > } > ] > } > 2016-06-30 07:20:06,607 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:20:21,619 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:20:21,623 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285621000, > "starttime": 1467285621000, > "metrics": { > "1467285621000": 0.415144595584, > "1467285622000": 1467285621000 > } > } > ] > } > 2016-06-30 07:20:21,623 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:20:36,638 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:20:36,641 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285636000, > "starttime": 1467285636000, > "metrics": { > "1467285636000": 0.415144595584, > "1467285637000": 1467285636000 > } > } > ] > } > 2016-06-30 07:20:36,641 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:20:51,645 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:20:51,648 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285651000, > "starttime": 1467285651000, > "metrics": { > "1467285651000": 0.415144595584, > "1467285652000": 1467285651000 > } > } > ] > } > 2016-06-30 07:20:51,648 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:21:06,657 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:21:06,660 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285666000, > "starttime": 1467285666000, > "metrics": { > "1467285666000": 0.415144595584, > "1467285667000": 1467285666000 > } > } > ] > } > 2016-06-30 07:21:06,660 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:21:21,664 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:21:21,669 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285681000, > "starttime": 1467285681000, > "metrics": { > "1467285681000": 0.415144595584, > "1467285682000": 1467285681000 > } > } > ] > } > 2016-06-30 07:21:21,669 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:21:36,684 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:21:36,687 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285696000, > "starttime": 1467285696000, > "metrics": { > "1467285696000": 0.415144595584, > "1467285697000": 1467285696000 > } > } > ] > } > 2016-06-30 07:21:36,687 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:21:51,697 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:21:51,700 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285711000, > "starttime": 1467285711000, > "metrics": { > "1467285711000": 0.415144595584, > "1467285712000": 1467285711000 > } > } > ] > } > 2016-06-30 07:21:51,700 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:22:06,715 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:22:06,718 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285726000, > "starttime": 1467285726000, > "metrics": { > "1467285726000": 0.415144595584, > "1467285727000": 1467285726000 > } > } > ] > } > 2016-06-30 07:22:06,719 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:22:21,734 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:22:21,739 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285741000, > "starttime": 1467285741000, > "metrics": { > "1467285741000": 0.415144595584, > "1467285742000": 1467285741000 > } > } > ] > } > 2016-06-30 07:22:21,739 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:22:36,754 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:22:36,757 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285756000, > "starttime": 1467285756000, > "metrics": { > "1467285756000": 0.415144595584, > "1467285757000": 1467285756000 > } > } > ] > } > 2016-06-30 07:22:36,758 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ > 2016-06-30 07:22:51,760 - Connection failed. Next retry in 15 seconds. > 2016-06-30 07:22:51,764 - Generated metrics: > { > "metrics": [ > { > "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric", > "appid": "amssmoketestfake", > "hostname": "host-172-16-1-204", > "timestamp": 1467285771000, > "starttime": 1467285771000, > "metrics": { > "1467285771000": 0.415144595584, > "1467285772000": 1467285771000 > } > } > ] > } > 2016-06-30 07:22:51,764 - Connecting (POST) to > host-172-16-1-204:6188/ws/v1/timeline/metrics/ -- This message was sent by Atlassian JIRA (v6.3.4#6332)