?Collector is not able to reach Zookeeper. Are you not installing AMS using
Ambari?
- Sid
________________________________
From: xiang....@sky-data.cn <xiang....@sky-data.cn>
Sent: Saturday, May 5, 2018 1:27 AM
To: user
Subject: metrics can not work as expected
Hi!
I tested installation on my vbox, it works well, then i move it to a server
which run many services.
When install, it failed at check service status.
I checked ambari-metrics-collector.log and found below error:
2018-05-05 08:16:03,536 INFO org.apache.phoenix.metrics.Metrics: Initializing
metrics system: phoenix
2018-05-05 08:16:03,559 WARN org.apache.hadoop.metrics2.impl.MetricsConfig:
Cannot locate configuration: tried
hadoop-metrics2-phoenix.properties,hadoop-metrics2.properties
....
2018-05-05 08:18:50,342 INFO org.apache.zookeeper.ClientCnxn: Socket connection
established to dx-1.novalocal/192.168.80.34:2188, initiating session
2018-05-05 08:18:50,343 INFO org.apache.zookeeper.ClientCnxn: Unable to read
additional data from server sessionid 0x0, likely server has closed socket,
closing socket connection and attempting reconnect
2018-05-05 08:18:50,811 INFO org.apache.zookeeper.ClientCnxn: Opening socket
connection to server dx-2.novalocal/192.168.80.27:2188. Will not attempt to
authenticate using SASL (unknown error)
2018-05-05 08:18:50,812 INFO org.apache.zookeeper.ClientCnxn: Socket connection
established to dx-2.novalocal/192.168.80.27:2188, initiating session
2018-05-05 08:18:50,813 INFO org.apache.zookeeper.ClientCnxn: Unable to read
additional data from server sessionid 0x0, likely server has closed socket,
closing socket connection and attempting reconnect
....
2018-05-05 08:18:50,947 INFO org.apache.helix.manager.zk.ZkClient: Closing
zkclient: State:CONNECTING sessionid:0x0 local:null remoteserver:null
lastZxid:0 xid:1 sent:35 recv:0 queuedpkts:0 pendingresp:0 queuedevents:0
2018-05-05 08:18:50,947 INFO org.I0Itec.zkclient.ZkEventThread: Terminate
ZkClient event thread.
2018-05-05 08:18:51,352 INFO org.apache.zookeeper.ZooKeeper: Session: 0x0 closed
2018-05-05 08:18:51,352 INFO org.apache.helix.manager.zk.ZkClient: Closed
zkclient
2018-05-05 08:18:51,352 ERROR
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore:
org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to
zookeeper server within timeout: 30000
2018-05-05 08:18:51,354 INFO org.apache.hadoop.service.AbstractService: Service
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore
failed in state INITED; cause:
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException:
Unable to initialize HA controller
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException:
Unable to initialize HA controller
at
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.initializeSubsystem(HBaseTimelineMetricStore.java:118)
at
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.serviceInit(HBaseTimelineMetricStore.java:96)
.....
The 2188 port is my setting about zookeeper, and from web UI, its status is OK.
Also i check zookeeper process, it runs as usual.
By the way, metrics needs listen 6188 port, but i use `netstat` to check,
related processes do not start.
I do not know how to fix it, could someone help me?
Thanks
