[jira] [Updated] (AMBARI-23478) YARN Cluster CPU Usage Graph Always Shows High CPU Usage

2019-06-19 Thread Krisztian Kasa (JIRA) 


 [ 
https://issues.apache.org/jira/browse/AMBARI-23478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated AMBARI-23478:

Resolution: Fixed
Status: Resolved  (was: Patch Available)

> YARN Cluster CPU Usage Graph Always Shows High CPU Usage
> 
>
> Key: AMBARI-23478
> URL: https://issues.apache.org/jira/browse/AMBARI-23478
> Project: Ambari
>  Issue Type: Bug
>Affects Versions: 2.5.0
>Reporter: Jonathan Hurley
>Assignee: Krisztian Kasa
>Priority: Major
>  Labels: pull-request-available
> Fix For: 2.8.0, 2.7.4
>
> Attachments: image-2018-03-19-20-26-44-325.png, 
> image-2018-03-19-20-27-19-160.png
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> h3. ISSUE
> In Ambari, YARN's Cluster CPU widget always shows relatively high CPU usage, 
> when NodeManager in a cluster is more than one.
>  !image-2018-03-19-20-26-44-325.png|thumbnail! 
>  !image-2018-03-19-20-27-19-160.png|thumbnail! 
> (started another node at around 19:00)
> h3. REPRODUCE STEPS
> # Install a cluster with one NodeManager and AMS.
> # Confirm "Cluster CPU" widget looks OK
> # Add one more node with NodeManager, and wait for a while
> h3. INVESTIGATION
> AMS side looks OK
> {code}
> curl -s -k http://sandbox-hdp.hortonworks.com:6188/ws/v1/timeline/metrics -G 
> --data-urlencode metricNames=cpu_idle._sum --data-urlencode appId=NODEMANAGER 
> --data-urlencode startTime=1521454794 --data-urlencode endTime=1521455394 
> --data-urlencode precision=MINUTES 
> ...
> {
> "metrics": [
> {
> "appid": "nodemanager",
> "metadata": {},
> "metricname": "cpu_idle._sum",
> "metrics": {
> "152145480": 198.990001,
> "152145510": 192.56
> },
> "starttime": 152145480,
> "timestamp": 152145480
> }
> ]
> }
> {code}
> But via Ambari, cpu_idle._sum becomes *{color:#d04437}100 times{color}* 
> smaller
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_idle._sum[1521454950,152140,15]'
> ...(snip)...
>   "metrics" : {
> "cpu" : {
>   "cpu_idle._sum" : [
> [
>   1.8687,
>   1521454950
> ],
> [
>   1.9843,
>   1521454980
> ],
> [
>   1.9,
>   1521455010
> ],
> [
>   1.9844,
>   1521455040
> ],
> [
>   1.8925,
>   1521455070
> ],
> ...(snip)...
> {code}
> Somehow 'cpu_idle._sum' is always wrong for this Widget:
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_nice._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._avg[1521196167,1521199767,15],metrics/cpu/cpu_wio._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._sum[1521196167,1521199767,15],metrics/cpu/cpu_user._sum[1521196167,1521199767,15],metrics/cpu/cpu_system._sum[1521196167,1521199767,15]'
>  -o ./ambari_NODEMANAGER_metrics.json
> [root@sandbox-hdp ~]# grep -E -B1 '"cpu_|152145' 
> ambari_NODEMANAGER_metrics.json | grep -vE -- '(--|\],)'
> "cpu" : {
>   "cpu_idle._avg" : [
>   85.549998,
>   1521199500
>   "cpu_idle._sum" : [
>   1.7106, <<< need to multiply 100
>   1521199500
>   "cpu_nice._sum" : [
>   0.0,
>   1521199500
>   "cpu_system._sum" : [
>   21.902,
>   1521199500
>   "cpu_user._sum" : [
>   6.666,
>   1521199500
>   "cpu_wio._sum" : [
>   0.2,
>   1521199500
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (AMBARI-23478) YARN Cluster CPU Usage Graph Always Shows High CPU Usage

2019-06-13 Thread Krisztian Kasa (JIRA) 


 [ 
https://issues.apache.org/jira/browse/AMBARI-23478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated AMBARI-23478:

Status: Patch Available  (was: Reopened)

> YARN Cluster CPU Usage Graph Always Shows High CPU Usage
> 
>
> Key: AMBARI-23478
> URL: https://issues.apache.org/jira/browse/AMBARI-23478
> Project: Ambari
>  Issue Type: Bug
>Affects Versions: 2.5.0
>Reporter: Jonathan Hurley
>Assignee: Krisztian Kasa
>Priority: Major
>  Labels: pull-request-available
> Fix For: 2.8.0, 2.7.4
>
> Attachments: image-2018-03-19-20-26-44-325.png, 
> image-2018-03-19-20-27-19-160.png
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> h3. ISSUE
> In Ambari, YARN's Cluster CPU widget always shows relatively high CPU usage, 
> when NodeManager in a cluster is more than one.
>  !image-2018-03-19-20-26-44-325.png|thumbnail! 
>  !image-2018-03-19-20-27-19-160.png|thumbnail! 
> (started another node at around 19:00)
> h3. REPRODUCE STEPS
> # Install a cluster with one NodeManager and AMS.
> # Confirm "Cluster CPU" widget looks OK
> # Add one more node with NodeManager, and wait for a while
> h3. INVESTIGATION
> AMS side looks OK
> {code}
> curl -s -k http://sandbox-hdp.hortonworks.com:6188/ws/v1/timeline/metrics -G 
> --data-urlencode metricNames=cpu_idle._sum --data-urlencode appId=NODEMANAGER 
> --data-urlencode startTime=1521454794 --data-urlencode endTime=1521455394 
> --data-urlencode precision=MINUTES 
> ...
> {
> "metrics": [
> {
> "appid": "nodemanager",
> "metadata": {},
> "metricname": "cpu_idle._sum",
> "metrics": {
> "152145480": 198.990001,
> "152145510": 192.56
> },
> "starttime": 152145480,
> "timestamp": 152145480
> }
> ]
> }
> {code}
> But via Ambari, cpu_idle._sum becomes *{color:#d04437}100 times{color}* 
> smaller
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_idle._sum[1521454950,152140,15]'
> ...(snip)...
>   "metrics" : {
> "cpu" : {
>   "cpu_idle._sum" : [
> [
>   1.8687,
>   1521454950
> ],
> [
>   1.9843,
>   1521454980
> ],
> [
>   1.9,
>   1521455010
> ],
> [
>   1.9844,
>   1521455040
> ],
> [
>   1.8925,
>   1521455070
> ],
> ...(snip)...
> {code}
> Somehow 'cpu_idle._sum' is always wrong for this Widget:
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_nice._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._avg[1521196167,1521199767,15],metrics/cpu/cpu_wio._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._sum[1521196167,1521199767,15],metrics/cpu/cpu_user._sum[1521196167,1521199767,15],metrics/cpu/cpu_system._sum[1521196167,1521199767,15]'
>  -o ./ambari_NODEMANAGER_metrics.json
> [root@sandbox-hdp ~]# grep -E -B1 '"cpu_|152145' 
> ambari_NODEMANAGER_metrics.json | grep -vE -- '(--|\],)'
> "cpu" : {
>   "cpu_idle._avg" : [
>   85.549998,
>   1521199500
>   "cpu_idle._sum" : [
>   1.7106, <<< need to multiply 100
>   1521199500
>   "cpu_nice._sum" : [
>   0.0,
>   1521199500
>   "cpu_system._sum" : [
>   21.902,
>   1521199500
>   "cpu_user._sum" : [
>   6.666,
>   1521199500
>   "cpu_wio._sum" : [
>   0.2,
>   1521199500
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (AMBARI-23478) YARN Cluster CPU Usage Graph Always Shows High CPU Usage

2019-06-13 Thread Krisztian Kasa (JIRA) 


 [ 
https://issues.apache.org/jira/browse/AMBARI-23478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Kasa updated AMBARI-23478:

Fix Version/s: 2.7.4

> YARN Cluster CPU Usage Graph Always Shows High CPU Usage
> 
>
> Key: AMBARI-23478
> URL: https://issues.apache.org/jira/browse/AMBARI-23478
> Project: Ambari
>  Issue Type: Bug
>Affects Versions: 2.5.0
>Reporter: Jonathan Hurley
>Assignee: Aravindan Vijayan
>Priority: Major
>  Labels: pull-request-available
> Fix For: 2.8.0, 2.7.4
>
> Attachments: image-2018-03-19-20-26-44-325.png, 
> image-2018-03-19-20-27-19-160.png
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> h3. ISSUE
> In Ambari, YARN's Cluster CPU widget always shows relatively high CPU usage, 
> when NodeManager in a cluster is more than one.
>  !image-2018-03-19-20-26-44-325.png|thumbnail! 
>  !image-2018-03-19-20-27-19-160.png|thumbnail! 
> (started another node at around 19:00)
> h3. REPRODUCE STEPS
> # Install a cluster with one NodeManager and AMS.
> # Confirm "Cluster CPU" widget looks OK
> # Add one more node with NodeManager, and wait for a while
> h3. INVESTIGATION
> AMS side looks OK
> {code}
> curl -s -k http://sandbox-hdp.hortonworks.com:6188/ws/v1/timeline/metrics -G 
> --data-urlencode metricNames=cpu_idle._sum --data-urlencode appId=NODEMANAGER 
> --data-urlencode startTime=1521454794 --data-urlencode endTime=1521455394 
> --data-urlencode precision=MINUTES 
> ...
> {
> "metrics": [
> {
> "appid": "nodemanager",
> "metadata": {},
> "metricname": "cpu_idle._sum",
> "metrics": {
> "152145480": 198.990001,
> "152145510": 192.56
> },
> "starttime": 152145480,
> "timestamp": 152145480
> }
> ]
> }
> {code}
> But via Ambari, cpu_idle._sum becomes *{color:#d04437}100 times{color}* 
> smaller
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_idle._sum[1521454950,152140,15]'
> ...(snip)...
>   "metrics" : {
> "cpu" : {
>   "cpu_idle._sum" : [
> [
>   1.8687,
>   1521454950
> ],
> [
>   1.9843,
>   1521454980
> ],
> [
>   1.9,
>   1521455010
> ],
> [
>   1.9844,
>   1521455040
> ],
> [
>   1.8925,
>   1521455070
> ],
> ...(snip)...
> {code}
> Somehow 'cpu_idle._sum' is always wrong for this Widget:
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_nice._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._avg[1521196167,1521199767,15],metrics/cpu/cpu_wio._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._sum[1521196167,1521199767,15],metrics/cpu/cpu_user._sum[1521196167,1521199767,15],metrics/cpu/cpu_system._sum[1521196167,1521199767,15]'
>  -o ./ambari_NODEMANAGER_metrics.json
> [root@sandbox-hdp ~]# grep -E -B1 '"cpu_|152145' 
> ambari_NODEMANAGER_metrics.json | grep -vE -- '(--|\],)'
> "cpu" : {
>   "cpu_idle._avg" : [
>   85.549998,
>   1521199500
>   "cpu_idle._sum" : [
>   1.7106, <<< need to multiply 100
>   1521199500
>   "cpu_nice._sum" : [
>   0.0,
>   1521199500
>   "cpu_system._sum" : [
>   21.902,
>   1521199500
>   "cpu_user._sum" : [
>   6.666,
>   1521199500
>   "cpu_wio._sum" : [
>   0.2,
>   1521199500
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (AMBARI-23478) YARN Cluster CPU Usage Graph Always Shows High CPU Usage

2018-11-14 Thread ASF GitHub Bot (JIRA) 


 [ 
https://issues.apache.org/jira/browse/AMBARI-23478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated AMBARI-23478:

Labels: pull-request-available  (was: )

> YARN Cluster CPU Usage Graph Always Shows High CPU Usage
> 
>
> Key: AMBARI-23478
> URL: https://issues.apache.org/jira/browse/AMBARI-23478
> Project: Ambari
>  Issue Type: Bug
>Affects Versions: 2.5.0
>Reporter: Jonathan Hurley
>Assignee: Aravindan Vijayan
>Priority: Major
>  Labels: pull-request-available
> Fix For: 2.8.0
>
> Attachments: image-2018-03-19-20-26-44-325.png, 
> image-2018-03-19-20-27-19-160.png
>
>
> h3. ISSUE
> In Ambari, YARN's Cluster CPU widget always shows relatively high CPU usage, 
> when NodeManager in a cluster is more than one.
>  !image-2018-03-19-20-26-44-325.png|thumbnail! 
>  !image-2018-03-19-20-27-19-160.png|thumbnail! 
> (started another node at around 19:00)
> h3. REPRODUCE STEPS
> # Install a cluster with one NodeManager and AMS.
> # Confirm "Cluster CPU" widget looks OK
> # Add one more node with NodeManager, and wait for a while
> h3. INVESTIGATION
> AMS side looks OK
> {code}
> curl -s -k http://sandbox-hdp.hortonworks.com:6188/ws/v1/timeline/metrics -G 
> --data-urlencode metricNames=cpu_idle._sum --data-urlencode appId=NODEMANAGER 
> --data-urlencode startTime=1521454794 --data-urlencode endTime=1521455394 
> --data-urlencode precision=MINUTES 
> ...
> {
> "metrics": [
> {
> "appid": "nodemanager",
> "metadata": {},
> "metricname": "cpu_idle._sum",
> "metrics": {
> "152145480": 198.990001,
> "152145510": 192.56
> },
> "starttime": 152145480,
> "timestamp": 152145480
> }
> ]
> }
> {code}
> But via Ambari, cpu_idle._sum becomes *{color:#d04437}100 times{color}* 
> smaller
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_idle._sum[1521454950,152140,15]'
> ...(snip)...
>   "metrics" : {
> "cpu" : {
>   "cpu_idle._sum" : [
> [
>   1.8687,
>   1521454950
> ],
> [
>   1.9843,
>   1521454980
> ],
> [
>   1.9,
>   1521455010
> ],
> [
>   1.9844,
>   1521455040
> ],
> [
>   1.8925,
>   1521455070
> ],
> ...(snip)...
> {code}
> Somehow 'cpu_idle._sum' is always wrong for this Widget:
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_nice._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._avg[1521196167,1521199767,15],metrics/cpu/cpu_wio._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._sum[1521196167,1521199767,15],metrics/cpu/cpu_user._sum[1521196167,1521199767,15],metrics/cpu/cpu_system._sum[1521196167,1521199767,15]'
>  -o ./ambari_NODEMANAGER_metrics.json
> [root@sandbox-hdp ~]# grep -E -B1 '"cpu_|152145' 
> ambari_NODEMANAGER_metrics.json | grep -vE -- '(--|\],)'
> "cpu" : {
>   "cpu_idle._avg" : [
>   85.549998,
>   1521199500
>   "cpu_idle._sum" : [
>   1.7106, <<< need to multiply 100
>   1521199500
>   "cpu_nice._sum" : [
>   0.0,
>   1521199500
>   "cpu_system._sum" : [
>   21.902,
>   1521199500
>   "cpu_user._sum" : [
>   6.666,
>   1521199500
>   "cpu_wio._sum" : [
>   0.2,
>   1521199500
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (AMBARI-23478) YARN Cluster CPU Usage Graph Always Shows High CPU Usage

2018-11-02 Thread Aravindan Vijayan (JIRA) 


 [ 
https://issues.apache.org/jira/browse/AMBARI-23478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aravindan Vijayan updated AMBARI-23478:
---
Fix Version/s: (was: 3.0.0)
   2.8.0

> YARN Cluster CPU Usage Graph Always Shows High CPU Usage
> 
>
> Key: AMBARI-23478
> URL: https://issues.apache.org/jira/browse/AMBARI-23478
> Project: Ambari
>  Issue Type: Bug
>Affects Versions: 2.5.0
>Reporter: Jonathan Hurley
>Assignee: Aravindan Vijayan
>Priority: Major
> Fix For: 2.8.0
>
> Attachments: image-2018-03-19-20-26-44-325.png, 
> image-2018-03-19-20-27-19-160.png
>
>
> h3. ISSUE
> In Ambari, YARN's Cluster CPU widget always shows relatively high CPU usage, 
> when NodeManager in a cluster is more than one.
>  !image-2018-03-19-20-26-44-325.png|thumbnail! 
>  !image-2018-03-19-20-27-19-160.png|thumbnail! 
> (started another node at around 19:00)
> h3. REPRODUCE STEPS
> # Install a cluster with one NodeManager and AMS.
> # Confirm "Cluster CPU" widget looks OK
> # Add one more node with NodeManager, and wait for a while
> h3. INVESTIGATION
> AMS side looks OK
> {code}
> curl -s -k http://sandbox-hdp.hortonworks.com:6188/ws/v1/timeline/metrics -G 
> --data-urlencode metricNames=cpu_idle._sum --data-urlencode appId=NODEMANAGER 
> --data-urlencode startTime=1521454794 --data-urlencode endTime=1521455394 
> --data-urlencode precision=MINUTES 
> ...
> {
> "metrics": [
> {
> "appid": "nodemanager",
> "metadata": {},
> "metricname": "cpu_idle._sum",
> "metrics": {
> "152145480": 198.990001,
> "152145510": 192.56
> },
> "starttime": 152145480,
> "timestamp": 152145480
> }
> ]
> }
> {code}
> But via Ambari, cpu_idle._sum becomes *{color:#d04437}100 times{color}* 
> smaller
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_idle._sum[1521454950,152140,15]'
> ...(snip)...
>   "metrics" : {
> "cpu" : {
>   "cpu_idle._sum" : [
> [
>   1.8687,
>   1521454950
> ],
> [
>   1.9843,
>   1521454980
> ],
> [
>   1.9,
>   1521455010
> ],
> [
>   1.9844,
>   1521455040
> ],
> [
>   1.8925,
>   1521455070
> ],
> ...(snip)...
> {code}
> Somehow 'cpu_idle._sum' is always wrong for this Widget:
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_nice._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._avg[1521196167,1521199767,15],metrics/cpu/cpu_wio._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._sum[1521196167,1521199767,15],metrics/cpu/cpu_user._sum[1521196167,1521199767,15],metrics/cpu/cpu_system._sum[1521196167,1521199767,15]'
>  -o ./ambari_NODEMANAGER_metrics.json
> [root@sandbox-hdp ~]# grep -E -B1 '"cpu_|152145' 
> ambari_NODEMANAGER_metrics.json | grep -vE -- '(--|\],)'
> "cpu" : {
>   "cpu_idle._avg" : [
>   85.549998,
>   1521199500
>   "cpu_idle._sum" : [
>   1.7106, <<< need to multiply 100
>   1521199500
>   "cpu_nice._sum" : [
>   0.0,
>   1521199500
>   "cpu_system._sum" : [
>   21.902,
>   1521199500
>   "cpu_user._sum" : [
>   6.666,
>   1521199500
>   "cpu_wio._sum" : [
>   0.2,
>   1521199500
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (AMBARI-23478) YARN Cluster CPU Usage Graph Always Shows High CPU Usage

2018-08-20 Thread Jayush Luniya (JIRA) 


 [ 
https://issues.apache.org/jira/browse/AMBARI-23478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jayush Luniya updated AMBARI-23478:
---
Fix Version/s: (was: 2.7.1)
   3.0.0

> YARN Cluster CPU Usage Graph Always Shows High CPU Usage
> 
>
> Key: AMBARI-23478
> URL: https://issues.apache.org/jira/browse/AMBARI-23478
> Project: Ambari
>  Issue Type: Bug
>Affects Versions: 2.5.0
>Reporter: Jonathan Hurley
>Assignee: Aravindan Vijayan
>Priority: Major
> Fix For: 3.0.0
>
> Attachments: image-2018-03-19-20-26-44-325.png, 
> image-2018-03-19-20-27-19-160.png
>
>
> h3. ISSUE
> In Ambari, YARN's Cluster CPU widget always shows relatively high CPU usage, 
> when NodeManager in a cluster is more than one.
>  !image-2018-03-19-20-26-44-325.png|thumbnail! 
>  !image-2018-03-19-20-27-19-160.png|thumbnail! 
> (started another node at around 19:00)
> h3. REPRODUCE STEPS
> # Install a cluster with one NodeManager and AMS.
> # Confirm "Cluster CPU" widget looks OK
> # Add one more node with NodeManager, and wait for a while
> h3. INVESTIGATION
> AMS side looks OK
> {code}
> curl -s -k http://sandbox-hdp.hortonworks.com:6188/ws/v1/timeline/metrics -G 
> --data-urlencode metricNames=cpu_idle._sum --data-urlencode appId=NODEMANAGER 
> --data-urlencode startTime=1521454794 --data-urlencode endTime=1521455394 
> --data-urlencode precision=MINUTES 
> ...
> {
> "metrics": [
> {
> "appid": "nodemanager",
> "metadata": {},
> "metricname": "cpu_idle._sum",
> "metrics": {
> "152145480": 198.990001,
> "152145510": 192.56
> },
> "starttime": 152145480,
> "timestamp": 152145480
> }
> ]
> }
> {code}
> But via Ambari, cpu_idle._sum becomes *{color:#d04437}100 times{color}* 
> smaller
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_idle._sum[1521454950,152140,15]'
> ...(snip)...
>   "metrics" : {
> "cpu" : {
>   "cpu_idle._sum" : [
> [
>   1.8687,
>   1521454950
> ],
> [
>   1.9843,
>   1521454980
> ],
> [
>   1.9,
>   1521455010
> ],
> [
>   1.9844,
>   1521455040
> ],
> [
>   1.8925,
>   1521455070
> ],
> ...(snip)...
> {code}
> Somehow 'cpu_idle._sum' is always wrong for this Widget:
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_nice._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._avg[1521196167,1521199767,15],metrics/cpu/cpu_wio._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._sum[1521196167,1521199767,15],metrics/cpu/cpu_user._sum[1521196167,1521199767,15],metrics/cpu/cpu_system._sum[1521196167,1521199767,15]'
>  -o ./ambari_NODEMANAGER_metrics.json
> [root@sandbox-hdp ~]# grep -E -B1 '"cpu_|152145' 
> ambari_NODEMANAGER_metrics.json | grep -vE -- '(--|\],)'
> "cpu" : {
>   "cpu_idle._avg" : [
>   85.549998,
>   1521199500
>   "cpu_idle._sum" : [
>   1.7106, <<< need to multiply 100
>   1521199500
>   "cpu_nice._sum" : [
>   0.0,
>   1521199500
>   "cpu_system._sum" : [
>   21.902,
>   1521199500
>   "cpu_user._sum" : [
>   6.666,
>   1521199500
>   "cpu_wio._sum" : [
>   0.2,
>   1521199500
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (AMBARI-23478) YARN Cluster CPU Usage Graph Always Shows High CPU Usage

2018-07-09 Thread Ishan Bhatt (JIRA) 


 [ 
https://issues.apache.org/jira/browse/AMBARI-23478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ishan Bhatt updated AMBARI-23478:
-
Fix Version/s: (was: 2.7.0)
   2.7.1

> YARN Cluster CPU Usage Graph Always Shows High CPU Usage
> 
>
> Key: AMBARI-23478
> URL: https://issues.apache.org/jira/browse/AMBARI-23478
> Project: Ambari
>  Issue Type: Bug
>Affects Versions: 2.5.0
>Reporter: Jonathan Hurley
>Priority: Major
> Fix For: 2.7.1
>
> Attachments: image-2018-03-19-20-26-44-325.png, 
> image-2018-03-19-20-27-19-160.png
>
>
> h3. ISSUE
> In Ambari, YARN's Cluster CPU widget always shows relatively high CPU usage, 
> when NodeManager in a cluster is more than one.
>  !image-2018-03-19-20-26-44-325.png|thumbnail! 
>  !image-2018-03-19-20-27-19-160.png|thumbnail! 
> (started another node at around 19:00)
> h3. REPRODUCE STEPS
> # Install a cluster with one NodeManager and AMS.
> # Confirm "Cluster CPU" widget looks OK
> # Add one more node with NodeManager, and wait for a while
> h3. INVESTIGATION
> AMS side looks OK
> {code}
> curl -s -k http://sandbox-hdp.hortonworks.com:6188/ws/v1/timeline/metrics -G 
> --data-urlencode metricNames=cpu_idle._sum --data-urlencode appId=NODEMANAGER 
> --data-urlencode startTime=1521454794 --data-urlencode endTime=1521455394 
> --data-urlencode precision=MINUTES 
> ...
> {
> "metrics": [
> {
> "appid": "nodemanager",
> "metadata": {},
> "metricname": "cpu_idle._sum",
> "metrics": {
> "152145480": 198.990001,
> "152145510": 192.56
> },
> "starttime": 152145480,
> "timestamp": 152145480
> }
> ]
> }
> {code}
> But via Ambari, cpu_idle._sum becomes *{color:#d04437}100 times{color}* 
> smaller
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_idle._sum[1521454950,152140,15]'
> ...(snip)...
>   "metrics" : {
> "cpu" : {
>   "cpu_idle._sum" : [
> [
>   1.8687,
>   1521454950
> ],
> [
>   1.9843,
>   1521454980
> ],
> [
>   1.9,
>   1521455010
> ],
> [
>   1.9844,
>   1521455040
> ],
> [
>   1.8925,
>   1521455070
> ],
> ...(snip)...
> {code}
> Somehow 'cpu_idle._sum' is always wrong for this Widget:
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_nice._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._avg[1521196167,1521199767,15],metrics/cpu/cpu_wio._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._sum[1521196167,1521199767,15],metrics/cpu/cpu_user._sum[1521196167,1521199767,15],metrics/cpu/cpu_system._sum[1521196167,1521199767,15]'
>  -o ./ambari_NODEMANAGER_metrics.json
> [root@sandbox-hdp ~]# grep -E -B1 '"cpu_|152145' 
> ambari_NODEMANAGER_metrics.json | grep -vE -- '(--|\],)'
> "cpu" : {
>   "cpu_idle._avg" : [
>   85.549998,
>   1521199500
>   "cpu_idle._sum" : [
>   1.7106, <<< need to multiply 100
>   1521199500
>   "cpu_nice._sum" : [
>   0.0,
>   1521199500
>   "cpu_system._sum" : [
>   21.902,
>   1521199500
>   "cpu_user._sum" : [
>   6.666,
>   1521199500
>   "cpu_wio._sum" : [
>   0.2,
>   1521199500
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (AMBARI-23478) YARN Cluster CPU Usage Graph Always Shows High CPU Usage

2018-04-05 Thread Jonathan Hurley (JIRA) 

 [ 
https://issues.apache.org/jira/browse/AMBARI-23478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jonathan Hurley updated AMBARI-23478:
-
Attachment: image-2018-03-19-20-27-19-160.png
image-2018-03-19-20-26-44-325.png

> YARN Cluster CPU Usage Graph Always Shows High CPU Usage
> 
>
> Key: AMBARI-23478
> URL: https://issues.apache.org/jira/browse/AMBARI-23478
> Project: Ambari
>  Issue Type: Bug
>Affects Versions: 2.5.0
>Reporter: Jonathan Hurley
>Priority: Major
> Fix For: 2.7.0
>
> Attachments: image-2018-03-19-20-26-44-325.png, 
> image-2018-03-19-20-27-19-160.png
>
>
> h3. ISSUE
> In Ambari, YARN's Cluster CPU widget always shows relatively high CPU usage, 
> when NodeManager in a cluster is more than one.
>  !image-2018-03-19-20-26-44-325.png|thumbnail! 
>  !image-2018-03-19-20-27-19-160.png|thumbnail! 
> (started another node at around 19:00)
> h3. REPRODUCE STEPS
> # Install a cluster with one NodeManager and AMS.
> # Confirm "Cluster CPU" widget looks OK
> # Add one more node with NodeManager, and wait for a while
> h3. INVESTIGATION
> AMS side looks OK
> {code}
> curl -s -k http://sandbox-hdp.hortonworks.com:6188/ws/v1/timeline/metrics -G 
> --data-urlencode metricNames=cpu_idle._sum --data-urlencode appId=NODEMANAGER 
> --data-urlencode startTime=1521454794 --data-urlencode endTime=1521455394 
> --data-urlencode precision=MINUTES 
> ...
> {
> "metrics": [
> {
> "appid": "nodemanager",
> "metadata": {},
> "metricname": "cpu_idle._sum",
> "metrics": {
> "152145480": 198.990001,
> "152145510": 192.56
> },
> "starttime": 152145480,
> "timestamp": 152145480
> }
> ]
> }
> {code}
> But via Ambari, cpu_idle._sum becomes *{color:#d04437}100 times{color}* 
> smaller
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_idle._sum[1521454950,152140,15]'
> ...(snip)...
>   "metrics" : {
> "cpu" : {
>   "cpu_idle._sum" : [
> [
>   1.8687,
>   1521454950
> ],
> [
>   1.9843,
>   1521454980
> ],
> [
>   1.9,
>   1521455010
> ],
> [
>   1.9844,
>   1521455040
> ],
> [
>   1.8925,
>   1521455070
> ],
> ...(snip)...
> {code}
> Somehow 'cpu_idle._sum' is always wrong for this Widget:
> {code}
> curl -s -k -u admin:admin 
> http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/services/YARN/components/NODEMANAGER
>  -G --data-urlencode 
> 'fields=metrics/cpu/cpu_nice._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._avg[1521196167,1521199767,15],metrics/cpu/cpu_wio._sum[1521196167,1521199767,15],metrics/cpu/cpu_idle._sum[1521196167,1521199767,15],metrics/cpu/cpu_user._sum[1521196167,1521199767,15],metrics/cpu/cpu_system._sum[1521196167,1521199767,15]'
>  -o ./ambari_NODEMANAGER_metrics.json
> [root@sandbox-hdp ~]# grep -E -B1 '"cpu_|152145' 
> ambari_NODEMANAGER_metrics.json | grep -vE -- '(--|\],)'
> "cpu" : {
>   "cpu_idle._avg" : [
>   85.549998,
>   1521199500
>   "cpu_idle._sum" : [
>   1.7106, <<< need to multiply 100
>   1521199500
>   "cpu_nice._sum" : [
>   0.0,
>   1521199500
>   "cpu_system._sum" : [
>   21.902,
>   1521199500
>   "cpu_user._sum" : [
>   6.666,
>   1521199500
>   "cpu_wio._sum" : [
>   0.2,
>   1521199500
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)