[
https://issues.apache.org/jira/browse/AMBARI-26595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Himanshu Maurya updated AMBARI-26595:
-------------------------------------
Description:
*Summary*
Add support for collecting and visualizing ZooKeeper metrics in Ambari through
Timeline Metrics Provider integration with Ambari Metrics Collector.
*Motivation*
ZooKeeper is a critical coordination service in Hadoop clusters but currently
lacks metrics visibility in Ambari. Operators have no insight into ZooKeeper
cluster health, performance, connection states, or operational metrics through
Ambari's monitoring infrastructure. This enhancement would enable comprehensive
ZooKeeper observability integrated with existing Ambari metrics systems.
*Proposed Solution*
Implement ZooKeeper metrics collection by:
# Creating a Timeline Metrics Sink in \{{ambari-metrics}} that receives
metrics from ZooKeeper's Timeline Metrics Provider and forwards them to Ambari
Metrics Collector
# Updating ZooKeeper service stack definitions to auto-configure Timeline
Metrics Provider when Ambari Metrics Collector is present
# Providing Grafana dashboards for visualizing ZooKeeper metrics (connections,
latency, throughput, JVM, quorum health)
# Ensuring upgrade compatibility for existing deployments
*Key Metrics to Expose*
* Connection metrics (active connections, sessions)
* Performance metrics (latency, throughput, request queue depth)
* Data metrics (znode count, watches, data size)
* Transaction metrics (commit time with percentiles)
* JVM metrics (heap, GC)
* Quorum/ensemble health metrics
*Benefits*
* Native ZooKeeper monitoring in Ambari
* Out-of-the-box Grafana dashboards
* Historical metrics and trending
* Performance troubleshooting with percentile metrics
* Capacity planning visibility
*Dependencies*
* Requires ZooKeeper with Timeline Metrics Provider support
* Ambari Metrics Collector must be installed
Corresponding Zookeeper Jira :- ZOOKEEPER-5036
> Add ZooKeeper Timeline Metrics integration support
> --------------------------------------------------
>
> Key: AMBARI-26595
> URL: https://issues.apache.org/jira/browse/AMBARI-26595
> Project: Ambari
> Issue Type: New Feature
> Components: metrics
> Reporter: Himanshu Maurya
> Assignee: Himanshu Maurya
> Priority: Major
>
> *Summary*
> Add support for collecting and visualizing ZooKeeper metrics in Ambari
> through Timeline Metrics Provider integration with Ambari Metrics Collector.
> *Motivation*
> ZooKeeper is a critical coordination service in Hadoop clusters but currently
> lacks metrics visibility in Ambari. Operators have no insight into ZooKeeper
> cluster health, performance, connection states, or operational metrics
> through Ambari's monitoring infrastructure. This enhancement would enable
> comprehensive ZooKeeper observability integrated with existing Ambari metrics
> systems.
> *Proposed Solution*
> Implement ZooKeeper metrics collection by:
> # Creating a Timeline Metrics Sink in \{{ambari-metrics}} that receives
> metrics from ZooKeeper's Timeline Metrics Provider and forwards them to
> Ambari Metrics Collector
> # Updating ZooKeeper service stack definitions to auto-configure Timeline
> Metrics Provider when Ambari Metrics Collector is present
> # Providing Grafana dashboards for visualizing ZooKeeper metrics
> (connections, latency, throughput, JVM, quorum health)
> # Ensuring upgrade compatibility for existing deployments
> *Key Metrics to Expose*
> * Connection metrics (active connections, sessions)
> * Performance metrics (latency, throughput, request queue depth)
> * Data metrics (znode count, watches, data size)
> * Transaction metrics (commit time with percentiles)
> * JVM metrics (heap, GC)
> * Quorum/ensemble health metrics
> *Benefits*
> * Native ZooKeeper monitoring in Ambari
> * Out-of-the-box Grafana dashboards
> * Historical metrics and trending
> * Performance troubleshooting with percentile metrics
> * Capacity planning visibility
> *Dependencies*
> * Requires ZooKeeper with Timeline Metrics Provider support
> * Ambari Metrics Collector must be installed
>
> Corresponding Zookeeper Jira :- ZOOKEEPER-5036
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
