Re: metrics can not work as expected

2018-05-08 Thread Siddharth Wagle 
Yes the default that Ambari sets in most cases should just work, not sure about 
the move part, usually configs are cluster specific so cannot know for sure 
unless diving deeper.


The wiki has some useful info that you could take a look at:


https://cwiki.apache.org/confluence/display/AMBARI/Troubleshooting+Guide


https://cwiki.apache.org/confluence/display/AMBARI/Known+Issues


https://cwiki.apache.org/confluence/display/AMBARI/Configuration​


- Sid



From: David Quiroga <quirogadf4w...@gmail.com>
Sent: Tuesday, May 8, 2018 9:46 PM
To: user@ambari.apache.org
Subject: Re: metrics can not work as expected

In most cases Ambari Metrics runs separate HBase and Zookeeper instances.
The default ports of Ambari Metrics Zookeeper are typically in the 60,000 range.
Would expect the Ambari defaults to do the trick, which I suspect relates to 
Sid's question.


On Sun, May 6, 2018 at 5:07 AM, 
<xiang@sky-data.cn<mailto:xiang@sky-data.cn>> wrote:
I just download them and make my own repo including them.
Then, i install them with ambari UI.




From: "Siddharth Wagle" <swa...@hortonworks.com<mailto:swa...@hortonworks.com>>
To: "user" <user@ambari.apache.org<mailto:user@ambari.apache.org>>
Sent: Saturday, May 5, 2018 11:07:12 PM
Subject: Re: metrics can not work as expected


​Collector is not able to reach Zookeeper. Are you not installing AMS using 
Ambari?


- Sid



From: xiang@sky-data.cn<mailto:xiang@sky-data.cn> 
<xiang@sky-data.cn<mailto:xiang@sky-data.cn>>
Sent: Saturday, May 5, 2018 1:27 AM
To: user
Subject: metrics can not work as expected

Hi!

I tested installation on my vbox, it works well, then i move it to a server 
which run many services.

When install, it failed at check service status.

I checked ambari-metrics-collector.log and found below error:

2018-05-05 08:16:03,536 INFO org.apache.phoenix.metrics.Metrics: Initializing 
metrics system: phoenix
2018-05-05 08:16:03,559 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: 
Cannot locate configuration: tried 
hadoop-metrics2-phoenix.properties,hadoop-metrics2.properties


2018-05-05 08:18:50,342 INFO org.apache.zookeeper.ClientCnxn: Socket connection 
established to dx-1.novalocal/192.168.80.34:2188<http://192.168.80.34:2188>, 
initiating session
2018-05-05 08:18:50,343 INFO org.apache.zookeeper.ClientCnxn: Unable to read 
additional data from server sessionid 0x0, likely server has closed socket, 
closing socket connection and attempting reconnect
2018-05-05 08:18:50,811 INFO org.apache.zookeeper.ClientCnxn: Opening socket 
connection to server 
dx-2.novalocal/192.168.80.27:2188<http://192.168.80.27:2188>. Will not attempt 
to authenticate using SASL (unknown error)
2018-05-05 08:18:50,812 INFO org.apache.zookeeper.ClientCnxn: Socket connection 
established to dx-2.novalocal/192.168.80.27:2188<http://192.168.80.27:2188>, 
initiating session
2018-05-05 08:18:50,813 INFO org.apache.zookeeper.ClientCnxn: Unable to read 
additional data from server sessionid 0x0, likely server has closed socket, 
closing socket connection and attempting reconnect


2018-05-05 08:18:50,947 INFO org.apache.helix.manager.zk.ZkClient: Closing 
zkclient: State:CONNECTING sessionid:0x0 local:null remoteserver:null 
lastZxid:0 xid:1 sent:35 recv:0 queuedpkts:0 pendingresp:0 queuedevents:0
2018-05-05 08:18:50,947 INFO org.I0Itec.zkclient.ZkEventThread: Terminate 
ZkClient event thread.
2018-05-05 08:18:51,352 INFO org.apache.zookeeper.ZooKeeper: Session: 0x0 closed
2018-05-05 08:18:51,352 INFO org.apache.helix.manager.zk.ZkClient: Closed 
zkclient
2018-05-05 08:18:51,352 ERROR 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore:
 org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to 
zookeeper server within timeout: 3
2018-05-05 08:18:51,354 INFO org.apache.hadoop.service.AbstractService: Service 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore
 failed in state INITED; cause: 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException:
 Unable to initialize HA controller
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException:
 Unable to initialize HA controller
at 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.initializeSubsystem(HBaseTimelineMetricStore.java:118)
at 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.serviceInit(HBaseTimelineMetricStore.java:96)
.

The 2188 port is my setting about zookeeper, and from web UI, its status is OK.
Also i check zookeeper process, it runs as usual.

By the way, me

Re: metrics can not work as expected

2018-05-08 Thread David Quiroga 
In most cases Ambari Metrics runs separate HBase and Zookeeper instances.
The default ports of Ambari Metrics Zookeeper are typically in the 60,000
range.
Would expect the Ambari defaults to do the trick, which I suspect relates
to Sid's question.


On Sun, May 6, 2018 at 5:07 AM, <xiang@sky-data.cn> wrote:

> I just download them and make my own repo including them.
> Then, i install them with ambari UI.
>
>
>
> --
> *From: *"Siddharth Wagle" <swa...@hortonworks.com>
> *To: *"user" <user@ambari.apache.org>
> *Sent: *Saturday, May 5, 2018 11:07:12 PM
> *Subject: *Re: metrics can not work as expected
>
> ​Collector is not able to reach Zookeeper. Are you not installing AMS
> using Ambari?
>
>
> - Sid
>
>
> --
> *From:* xiang@sky-data.cn <xiang@sky-data.cn>
> *Sent:* Saturday, May 5, 2018 1:27 AM
> *To:* user
> *Subject:* metrics can not work as expected
>
> Hi!
>
> I tested installation on my vbox, it works well, then i move it to a
> server which run many services.
>
> When install, it failed at check service status.
>
> I checked ambari-metrics-collector.log and found below error:
>
> 2018-05-05 08:16:03,536 INFO org.apache.phoenix.metrics.Metrics:
> Initializing metrics system: phoenix
> 2018-05-05 08:16:03,559 WARN org.apache.hadoop.metrics2.impl.MetricsConfig:
> Cannot locate configuration: tried hadoop-metrics2-phoenix.
> properties,hadoop-metrics2.properties
> 
>
> 2018-05-05 08:18:50,342 INFO org.apache.zookeeper.ClientCnxn: Socket
> connection established to dx-1.novalocal/192.168.80.34:2188, initiating
> session
> 2018-05-05 08:18:50,343 INFO org.apache.zookeeper.ClientCnxn: Unable to
> read additional data from server sessionid 0x0, likely server has closed
> socket, closing socket connection and attempting reconnect
> 2018-05-05 08:18:50,811 INFO org.apache.zookeeper.ClientCnxn: Opening
> socket connection to server dx-2.novalocal/192.168.80.27:2188. Will not
> attempt to authenticate using SASL (unknown error)
> 2018-05-05 08:18:50,812 INFO org.apache.zookeeper.ClientCnxn: Socket
> connection established to dx-2.novalocal/192.168.80.27:2188, initiating
> session
> 2018-05-05 08:18:50,813 INFO org.apache.zookeeper.ClientCnxn: Unable to
> read additional data from server sessionid 0x0, likely server has closed
> socket, closing socket connection and attempting reconnect
> 
>
> 2018-05-05 08:18:50,947 INFO org.apache.helix.manager.zk.ZkClient:
> Closing zkclient: State:CONNECTING sessionid:0x0 local:null
> remoteserver:null lastZxid:0 xid:1 sent:35 recv:0 queuedpkts:0
> pendingresp:0 queuedevents:0
> 2018-05-05 08:18:50,947 INFO org.I0Itec.zkclient.ZkEventThread: Terminate
> ZkClient event thread.
> 2018-05-05 08:18:51,352 INFO org.apache.zookeeper.ZooKeeper: Session: 0x0
> closed
> 2018-05-05 08:18:51,352 INFO org.apache.helix.manager.zk.ZkClient: Closed
> zkclient
> 2018-05-05 08:18:51,352 ERROR org.apache.hadoop.yarn.server.
> applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore:
> org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to
> zookeeper server within timeout: 3
> 2018-05-05 08:18:51,354 INFO org.apache.hadoop.service.AbstractService:
> Service org.apache.hadoop.yarn.server.applicationhistoryservice.
> metrics.timeline.HBaseTimelineMetricStore failed in state INITED; cause:
> org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.
> MetricsSystemInitializationException: Unable to initialize HA controller
> org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.
> MetricsSystemInitializationException: Unable to initialize HA controller
> at org.apache.hadoop.yarn.server.applicationhistoryservice.
> metrics.timeline.HBaseTimelineMetricStore.initializeSubsystem(
> HBaseTimelineMetricStore.java:118)
> at org.apache.hadoop.yarn.server.applicationhistoryservice.
> metrics.timeline.HBaseTimelineMetricStore.serviceInit(
> HBaseTimelineMetricStore.java:96)
> .
>
> The 2188 port is my setting about zookeeper, and from web UI, its status
> is OK.
> Also i check zookeeper process, it runs as usual.
>
> By the way, metrics needs listen 6188 port, but i use `netstat` to check,
> related processes do not start.
>
> I do not know how to fix it, could someone help me?
>
> Thanks
>

Re: metrics can not work as expected

2018-05-06 Thread xiang . dai 
I just download them and make my own repo including them. 
Then, i install them with ambari UI. 




From: "Siddharth Wagle" <swa...@hortonworks.com> 
To: "user" <user@ambari.apache.org> 
Sent: Saturday, May 5, 2018 11:07:12 PM 
Subject: Re: metrics can not work as expected 



​Collector is not able to reach Zookeeper. Are you not installing AMS using 
Ambari? 





- Sid 




From: xiang@sky-data.cn <xiang@sky-data.cn> 
Sent: Saturday, May 5, 2018 1:27 AM 
To: user 
Subject: metrics can not work as expected 
Hi! 

I tested installation on my vbox, it works well, then i move it to a server 
which run many services. 

When install, it failed at check service status. 

I checked ambari-metrics-collector.log and found below error: 

2018-05-05 08:16:03,536 INFO org.apache.phoenix.metrics.Metrics: Initializing 
metrics system: phoenix 
2018-05-05 08:16:03,559 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: 
Cannot locate configuration: tried 
hadoop-metrics2-phoenix.properties,hadoop-metrics2.properties 
 

2018-05-05 08:18:50,342 INFO org.apache.zookeeper.ClientCnxn: Socket connection 
established to dx-1.novalocal/192.168.80.34:2188, initiating session 
2018-05-05 08:18:50,343 INFO org.apache.zookeeper.ClientCnxn: Unable to read 
additional data from server sessionid 0x0, likely server has closed socket, 
closing socket connection and attempting reconnect 
2018-05-05 08:18:50,811 INFO org.apache.zookeeper.ClientCnxn: Opening socket 
connection to server dx-2.novalocal/192.168.80.27:2188. Will not attempt to 
authenticate using SASL (unknown error) 
2018-05-05 08:18:50,812 INFO org.apache.zookeeper.ClientCnxn: Socket connection 
established to dx-2.novalocal/192.168.80.27:2188, initiating session 
2018-05-05 08:18:50,813 INFO org.apache.zookeeper.ClientCnxn: Unable to read 
additional data from server sessionid 0x0, likely server has closed socket, 
closing socket connection and attempting reconnect 
 

2018-05-05 08:18:50,947 INFO org.apache.helix.manager.zk.ZkClient: Closing 
zkclient: State:CONNECTING sessionid:0x0 local:null remoteserver:null 
lastZxid:0 xid:1 sent:35 recv:0 queuedpkts:0 pendingresp:0 queuedevents:0 
2018-05-05 08:18:50,947 INFO org.I0Itec.zkclient.ZkEventThread: Terminate 
ZkClient event thread. 
2018-05-05 08:18:51,352 INFO org.apache.zookeeper.ZooKeeper: Session: 0x0 
closed 
2018-05-05 08:18:51,352 INFO org.apache.helix.manager.zk.ZkClient: Closed 
zkclient 
2018-05-05 08:18:51,352 ERROR 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore:
 org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to 
zookeeper server within timeout: 3 
2018-05-05 08:18:51,354 INFO org.apache.hadoop.service.AbstractService: Service 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore
 failed in state INITED; cause: 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException:
 Unable to initialize HA controller 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException:
 Unable to initialize HA controller 
at 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.initializeSubsystem(HBaseTimelineMetricStore.java:118)
 
at 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.serviceInit(HBaseTimelineMetricStore.java:96)
 
. 

The 2188 port is my setting about zookeeper, and from web UI, its status is OK. 
Also i check zookeeper process, it runs as usual. 

By the way, metrics needs listen 6188 port, but i use `netstat` to check, 
related processes do not start. 

I do not know how to fix it, could someone help me? 

Thanks

Re: metrics can not work as expected

2018-05-05 Thread Siddharth Wagle 
?Collector is not able to reach Zookeeper. Are you not installing AMS using 
Ambari?


- Sid



From: xiang@sky-data.cn 
Sent: Saturday, May 5, 2018 1:27 AM
To: user
Subject: metrics can not work as expected

Hi!

I tested installation on my vbox, it works well, then i move it to a server 
which run many services.

When install, it failed at check service status.

I checked ambari-metrics-collector.log and found below error:

2018-05-05 08:16:03,536 INFO org.apache.phoenix.metrics.Metrics: Initializing 
metrics system: phoenix
2018-05-05 08:16:03,559 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: 
Cannot locate configuration: tried 
hadoop-metrics2-phoenix.properties,hadoop-metrics2.properties


2018-05-05 08:18:50,342 INFO org.apache.zookeeper.ClientCnxn: Socket connection 
established to dx-1.novalocal/192.168.80.34:2188, initiating session
2018-05-05 08:18:50,343 INFO org.apache.zookeeper.ClientCnxn: Unable to read 
additional data from server sessionid 0x0, likely server has closed socket, 
closing socket connection and attempting reconnect
2018-05-05 08:18:50,811 INFO org.apache.zookeeper.ClientCnxn: Opening socket 
connection to server dx-2.novalocal/192.168.80.27:2188. Will not attempt to 
authenticate using SASL (unknown error)
2018-05-05 08:18:50,812 INFO org.apache.zookeeper.ClientCnxn: Socket connection 
established to dx-2.novalocal/192.168.80.27:2188, initiating session
2018-05-05 08:18:50,813 INFO org.apache.zookeeper.ClientCnxn: Unable to read 
additional data from server sessionid 0x0, likely server has closed socket, 
closing socket connection and attempting reconnect


2018-05-05 08:18:50,947 INFO org.apache.helix.manager.zk.ZkClient: Closing 
zkclient: State:CONNECTING sessionid:0x0 local:null remoteserver:null 
lastZxid:0 xid:1 sent:35 recv:0 queuedpkts:0 pendingresp:0 queuedevents:0
2018-05-05 08:18:50,947 INFO org.I0Itec.zkclient.ZkEventThread: Terminate 
ZkClient event thread.
2018-05-05 08:18:51,352 INFO org.apache.zookeeper.ZooKeeper: Session: 0x0 closed
2018-05-05 08:18:51,352 INFO org.apache.helix.manager.zk.ZkClient: Closed 
zkclient
2018-05-05 08:18:51,352 ERROR 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore:
 org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to 
zookeeper server within timeout: 3
2018-05-05 08:18:51,354 INFO org.apache.hadoop.service.AbstractService: Service 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore
 failed in state INITED; cause: 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException:
 Unable to initialize HA controller
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException:
 Unable to initialize HA controller
at 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.initializeSubsystem(HBaseTimelineMetricStore.java:118)
at 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.serviceInit(HBaseTimelineMetricStore.java:96)
.

The 2188 port is my setting about zookeeper, and from web UI, its status is OK.
Also i check zookeeper process, it runs as usual.

By the way, metrics needs listen 6188 port, but i use `netstat` to check, 
related processes do not start.

I do not know how to fix it, could someone help me?

Thanks