[ https://issues.apache.org/jira/browse/KAFKA-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109790#comment-17109790 ]
Li Wei commented on KAFKA-9660: ------------------------------- [~cricket007] and promethes jmx exporter collect all mertric a time, some metrics need collect instantly would delay so much for alert > KAFKA-1 build a kafka-exporter by java > --------------------------------------- > > Key: KAFKA-9660 > URL: https://issues.apache.org/jira/browse/KAFKA-9660 > Project: Kafka > Issue Type: Improvement > Components: admin, metrics > Affects Versions: 0.10.2.0, 1.1.0, 2.0.0 > Environment: java8+ > Reporter: francis lee > Assignee: Sujay Hegde > Priority: Major > Labels: newbie > > [KIP-575|https://cwiki.apache.org/confluence/display/KAFKA/KIP-575%3A+build+a+Kafka-Exporter+by+Java] > kafka is an excellent MQ running on JVM, but no exporters JVMly. for a > better future of Kafka-Ecosystems > the Apache needs a formal exporter like > [https://github.com/apache/kafka-exporter]. > i wrote one for working, and hope to give to Apache. there are a lot of > metric in JMX, it can be configed in the exporter-config. > > if you are interested in it , join me! > if you are interested in it , join me! > if you are interested in it , join me! > > for some metric list here: > kafka_AddPartitionsToTxn_50thPercentile > kafka_AddPartitionsToTxn_95thPercentile > kafka_AddPartitionsToTxn_999thPercentile > kafka_AddPartitionsToTxn_99thPercentile > kafka_AddPartitionsToTxn_Count > kafka_AddPartitionsToTxn_Max > kafka_AddPartitionsToTxn_Mean > kafka_AddPartitionsToTxn_MeanRate > kafka_AddPartitionsToTxn_Min > kafka_AddPartitionsToTxn_OneMinuteRate > kafka_AddPartitionsToTxn_StdDev > kafka_BrokerTopicMetrics_BytesInPerSec_Count > kafka_BrokerTopicMetrics_BytesInPerSec_MeanRate > kafka_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate > kafka_BrokerTopicMetrics_BytesOutPerSec_Count > kafka_BrokerTopicMetrics_BytesOutPerSec_MeanRate > kafka_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate > kafka_BrokerTopicMetrics_BytesRejectedPerSec_Count > kafka_BrokerTopicMetrics_BytesRejectedPerSec_MeanRate > kafka_BrokerTopicMetrics_BytesRejectedPerSec_OneMinuteRate > kafka_BrokerTopicMetrics_FailedFetchRequestsPerSec_Count > kafka_BrokerTopicMetrics_FailedFetchRequestsPerSec_MeanRate > kafka_BrokerTopicMetrics_FailedFetchRequestsPerSec_OneMinuteRate > kafka_BrokerTopicMetrics_FailedProduceRequestsPerSec_Count > kafka_BrokerTopicMetrics_FailedProduceRequestsPerSec_MeanRate > kafka_BrokerTopicMetrics_FailedProduceRequestsPerSec_OneMinuteRate > kafka_BrokerTopicMetrics_MessagesInPerSec_Count > kafka_BrokerTopicMetrics_MessagesInPerSec_MeanRate > kafka_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate > kafka_BrokerTopicMetrics_ProduceMessageConversionsPerSec_Count > kafka_BrokerTopicMetrics_ProduceMessageConversionsPerSec_MeanRate > kafka_BrokerTopicMetrics_ProduceMessageConversionsPerSec_OneMinuteRate > kafka_BrokerTopicMetrics_ReplicationBytesInPerSec_Count > kafka_BrokerTopicMetrics_ReplicationBytesInPerSec_MeanRate > kafka_BrokerTopicMetrics_ReplicationBytesInPerSec_OneMinuteRate > kafka_BrokerTopicMetrics_ReplicationBytesOutPerSec_Count > kafka_BrokerTopicMetrics_ReplicationBytesOutPerSec_MeanRate > kafka_BrokerTopicMetrics_ReplicationBytesOutPerSec_OneMinuteRate > kafka_BrokerTopicMetrics_TotalFetchRequestsPerSec_Count > kafka_BrokerTopicMetrics_TotalFetchRequestsPerSec_MeanRate > kafka_BrokerTopicMetrics_TotalFetchRequestsPerSec_OneMinuteRate > kafka_BrokerTopicMetrics_TotalProduceRequestsPerSec_Count > kafka_BrokerTopicMetrics_TotalProduceRequestsPerSec_MeanRate > kafka_BrokerTopicMetrics_TotalProduceRequestsPerSec_OneMinuteRate > kafka_BytesInPerSec_Count > kafka_BytesInPerSec_FifteenMinuteRate > kafka_BytesInPerSec_FiveMinuteRate > kafka_BytesInPerSec_MeanRate > kafka_BytesInPerSec_OneMinuteRate > kafka_BytesOutPerSec_Count > kafka_BytesOutPerSec_FifteenMinuteRate > kafka_BytesOutPerSec_FiveMinuteRate > kafka_BytesOutPerSec_MeanRate > kafka_BytesOutPerSec_OneMinuteRate > kafka_BytesRejectedPerSec_Count > kafka_BytesRejectedPerSec_FifteenMinuteRate > kafka_BytesRejectedPerSec_FiveMinuteRate > kafka_BytesRejectedPerSec_MeanRate > kafka_BytesRejectedPerSec_OneMinuteRate > kafka_CreatePartitions_50thPercentile > kafka_CreatePartitions_95thPercentile > kafka_CreatePartitions_999thPercentile > kafka_CreatePartitions_99thPercentile > kafka_CreatePartitions_Count > kafka_CreatePartitions_Max > kafka_CreatePartitions_Mean > kafka_CreatePartitions_MeanRate > kafka_CreatePartitions_Min > kafka_CreatePartitions_OneMinuteRate > kafka_CreatePartitions_StdDev > kafka_CreateTopics_50thPercentile > kafka_CreateTopics_95thPercentile > kafka_CreateTopics_999thPercentile > kafka_CreateTopics_99thPercentile > kafka_CreateTopics_Count > kafka_CreateTopics_Max > kafka_CreateTopics_Mean > kafka_CreateTopics_MeanRate > kafka_CreateTopics_Min > kafka_CreateTopics_OneMinuteRate > kafka_CreateTopics_StdDev > kafka_DeleteGroups_50thPercentile > kafka_DeleteGroups_95thPercentile > kafka_DeleteGroups_999thPercentile > kafka_DeleteGroups_99thPercentile > kafka_DeleteGroups_Count > kafka_DeleteGroups_Max > kafka_DeleteGroups_Mean > kafka_DeleteGroups_Min > kafka_DeleteGroups_StdDev > kafka_DeleteTopics_50thPercentile > kafka_DeleteTopics_95thPercentile > kafka_DeleteTopics_999thPercentile > kafka_DeleteTopics_99thPercentile > kafka_DeleteTopics_Count > kafka_DeleteTopics_Max > kafka_DeleteTopics_Mean > kafka_DeleteTopics_MeanRate > kafka_DeleteTopics_Min > kafka_DeleteTopics_OneMinuteRate > kafka_DeleteTopics_StdDev > kafka_DescribeGroups_50thPercentile > kafka_DescribeGroups_95thPercentile > kafka_DescribeGroups_999thPercentile > kafka_DescribeGroups_99thPercentile > kafka_DescribeGroups_Count > kafka_DescribeGroups_Max > kafka_DescribeGroups_Mean > kafka_DescribeGroups_MeanRate > kafka_DescribeGroups_Min > kafka_DescribeGroups_OneMinuteRate > kafka_DescribeGroups_StdDev > kafka_FailedFetchRequestsPerSec_Count > kafka_FailedFetchRequestsPerSec_FifteenMinuteRate > kafka_FailedFetchRequestsPerSec_FiveMinuteRate > kafka_FailedFetchRequestsPerSec_MeanRate > kafka_FailedFetchRequestsPerSec_OneMinuteRate > kafka_FailedProduceRequestsPerSec_Count > kafka_FailedProduceRequestsPerSec_FifteenMinuteRate > kafka_FailedProduceRequestsPerSec_FiveMinuteRate > kafka_FailedProduceRequestsPerSec_MeanRate > kafka_FailedProduceRequestsPerSec_OneMinuteRate > kafka_FetchConsumer_50thPercentile > kafka_FetchConsumer_95thPercentile > kafka_FetchConsumer_999thPercentile > kafka_FetchConsumer_99thPercentile > kafka_FetchConsumer_Count > kafka_FetchConsumer_Max > kafka_FetchConsumer_Mean > kafka_FetchConsumer_MeanRate > kafka_FetchConsumer_Min > kafka_FetchConsumer_OneMinuteRate > kafka_FetchConsumer_StdDev > kafka_FetchFollower_50thPercentile > kafka_FetchFollower_95thPercentile > kafka_FetchFollower_999thPercentile > kafka_FetchFollower_99thPercentile > kafka_FetchFollower_Count > kafka_FetchFollower_Max > kafka_FetchFollower_Mean > kafka_FetchFollower_MeanRate > kafka_FetchFollower_Min > kafka_FetchFollower_OneMinuteRate > kafka_FetchFollower_StdDev > kafka_FetchMessageConversionsPerSec_Count > kafka_FetchMessageConversionsPerSec_FifteenMinuteRate > kafka_FetchMessageConversionsPerSec_FiveMinuteRate > kafka_FetchMessageConversionsPerSec_MeanRate > kafka_FetchMessageConversionsPerSec_OneMinuteRate > kafka_Fetch_50thPercentile > kafka_Fetch_95thPercentile > kafka_Fetch_999thPercentile > kafka_Fetch_99thPercentile > kafka_Fetch_Count > kafka_Fetch_Max > kafka_Fetch_Mean > kafka_Fetch_MeanRate > kafka_Fetch_Min > kafka_Fetch_OneMinuteRate > kafka_Fetch_StdDev > kafka_FindCoordinator_50thPercentile > kafka_FindCoordinator_95thPercentile > kafka_FindCoordinator_999thPercentile > kafka_FindCoordinator_99thPercentile > kafka_FindCoordinator_Count > kafka_FindCoordinator_Max > kafka_FindCoordinator_Mean > kafka_FindCoordinator_MeanRate > kafka_FindCoordinator_Min > kafka_FindCoordinator_OneMinuteRate > kafka_FindCoordinator_StdDev > kafka_G1_Old_Generation_CollectionCount > kafka_G1_Old_Generation_CollectionTime > kafka_G1_Young_Generation_CollectionCount > kafka_G1_Young_Generation_CollectionTime > kafka_GarbageCollector_G1_Old_Generation_CollectionCount > kafka_GarbageCollector_G1_Old_Generation_CollectionTime > kafka_GarbageCollector_G1_Young_Generation_CollectionCount > kafka_GarbageCollector_G1_Young_Generation_CollectionTime > kafka_Heartbeat_50thPercentile > kafka_Heartbeat_95thPercentile > kafka_Heartbeat_999thPercentile > kafka_Heartbeat_99thPercentile > kafka_Heartbeat_Count > kafka_Heartbeat_Max > kafka_Heartbeat_Mean > kafka_Heartbeat_MeanRate > kafka_Heartbeat_Min > kafka_Heartbeat_OneMinuteRate > kafka_Heartbeat_StdDev > kafka_JoinGroup_50thPercentile > kafka_JoinGroup_95thPercentile > kafka_JoinGroup_999thPercentile > kafka_JoinGroup_99thPercentile > kafka_JoinGroup_Count > kafka_JoinGroup_Max > kafka_JoinGroup_Mean > kafka_JoinGroup_MeanRate > kafka_JoinGroup_Min > kafka_JoinGroup_OneMinuteRate > kafka_JoinGroup_StdDev > kafka_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_Count > kafka_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_MeanRate > kafka_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_OneMinuteRate > kafka_LeaderAndIsr_50thPercentile > kafka_LeaderAndIsr_95thPercentile > kafka_LeaderAndIsr_999thPercentile > kafka_LeaderAndIsr_99thPercentile > kafka_LeaderAndIsr_Count > kafka_LeaderAndIsr_Max > kafka_LeaderAndIsr_Mean > kafka_LeaderAndIsr_MeanRate > kafka_LeaderAndIsr_Min > kafka_LeaderAndIsr_OneMinuteRate > kafka_LeaderAndIsr_StdDev > kafka_LeaveGroup_50thPercentile > kafka_LeaveGroup_95thPercentile > kafka_LeaveGroup_999thPercentile > kafka_LeaveGroup_99thPercentile > kafka_LeaveGroup_Count > kafka_LeaveGroup_Max > kafka_LeaveGroup_Mean > kafka_LeaveGroup_MeanRate > kafka_LeaveGroup_Min > kafka_LeaveGroup_OneMinuteRate > kafka_LeaveGroup_StdDev > kafka_ListGroups_50thPercentile > kafka_ListGroups_95thPercentile > kafka_ListGroups_999thPercentile > kafka_ListGroups_99thPercentile > kafka_ListGroups_Count > kafka_ListGroups_Max > kafka_ListGroups_Mean > kafka_ListGroups_MeanRate > kafka_ListGroups_Min > kafka_ListGroups_OneMinuteRate > kafka_ListGroups_StdDev > kafka_ListOffsets_50thPercentile > kafka_ListOffsets_95thPercentile > kafka_ListOffsets_999thPercentile > kafka_ListOffsets_99thPercentile > kafka_ListOffsets_Count > kafka_ListOffsets_Max > kafka_ListOffsets_Mean > kafka_ListOffsets_MeanRate > kafka_ListOffsets_Min > kafka_ListOffsets_OneMinuteRate > kafka_ListOffsets_StdDev > kafka_MessagesInPerSec_Count > kafka_MessagesInPerSec_FifteenMinuteRate > kafka_MessagesInPerSec_FiveMinuteRate > kafka_MessagesInPerSec_MeanRate > kafka_MessagesInPerSec_OneMinuteRate > kafka_Metadata_50thPercentile > kafka_Metadata_95thPercentile > kafka_Metadata_999thPercentile > kafka_Metadata_99thPercentile > kafka_Metadata_Count > kafka_Metadata_Max > kafka_Metadata_Mean > kafka_Metadata_MeanRate > kafka_Metadata_Min > kafka_Metadata_OneMinuteRate > kafka_Metadata_StdDev > kafka_OffsetCommit_50thPercentile > kafka_OffsetCommit_95thPercentile > kafka_OffsetCommit_999thPercentile > kafka_OffsetCommit_99thPercentile > kafka_OffsetCommit_Count > kafka_OffsetCommit_Max > kafka_OffsetCommit_Mean > kafka_OffsetCommit_MeanRate > kafka_OffsetCommit_Min > kafka_OffsetCommit_OneMinuteRate > kafka_OffsetCommit_StdDev > kafka_OffsetFetch_50thPercentile > kafka_OffsetFetch_95thPercentile > kafka_OffsetFetch_999thPercentile > kafka_OffsetFetch_99thPercentile > kafka_OffsetFetch_Count > kafka_OffsetFetch_Max > kafka_OffsetFetch_Mean > kafka_OffsetFetch_MeanRate > kafka_OffsetFetch_Min > kafka_OffsetFetch_OneMinuteRate > kafka_OffsetFetch_StdDev > kafka_ProduceMessageConversionsPerSec_Count > kafka_ProduceMessageConversionsPerSec_FifteenMinuteRate > kafka_ProduceMessageConversionsPerSec_FiveMinuteRate > kafka_ProduceMessageConversionsPerSec_MeanRate > kafka_ProduceMessageConversionsPerSec_OneMinuteRate > kafka_Produce_50thPercentile > kafka_Produce_95thPercentile > kafka_Produce_999thPercentile > kafka_Produce_99thPercentile > kafka_Produce_Count > kafka_Produce_Max > kafka_Produce_Mean > kafka_Produce_MeanRate > kafka_Produce_Min > kafka_Produce_OneMinuteRate > kafka_Produce_StdDev > kafka_ReplicationBytesInPerSec_Count > kafka_ReplicationBytesInPerSec_FifteenMinuteRate > kafka_ReplicationBytesInPerSec_FiveMinuteRate > kafka_ReplicationBytesInPerSec_MeanRate > kafka_ReplicationBytesInPerSec_OneMinuteRate > kafka_ReplicationBytesOutPerSec_Count > kafka_ReplicationBytesOutPerSec_FifteenMinuteRate > kafka_ReplicationBytesOutPerSec_FiveMinuteRate > kafka_ReplicationBytesOutPerSec_MeanRate > kafka_ReplicationBytesOutPerSec_OneMinuteRate > kafka_RequestChannel_RequestQueueSize_Value > kafka_RequestChannel_ResponseQueueSize_Value > kafka_RequestMetrics_RequestsPerSec_Count > kafka_RequestMetrics_RequestsPerSec_MeanRate > kafka_RequestMetrics_RequestsPerSec_OneMinuteRate > kafka_SocketServer_MemoryPoolAvailable_Value > kafka_SocketServer_MemoryPoolUsed_Value > kafka_SocketServer_NetworkProcessorAvgIdlePercent_Value > kafka_SyncGroup_50thPercentile > kafka_SyncGroup_95thPercentile > kafka_SyncGroup_999thPercentile > kafka_SyncGroup_99thPercentile > kafka_SyncGroup_Count > kafka_SyncGroup_Max > kafka_SyncGroup_Mean > kafka_SyncGroup_MeanRate > kafka_SyncGroup_Min > kafka_SyncGroup_OneMinuteRate > kafka_SyncGroup_StdDev > kafka_ThreadCount > kafka_Threading_CurrentThreadCpuTime > kafka_Threading_CurrentThreadUserTime > kafka_Threading_DaemonThreadCount > kafka_Threading_PeakThreadCount > kafka_Threading_ThreadCount > kafka_Threading_TotalStartedThreadCount > kafka_TotalFetchRequestsPerSec_Count > kafka_TotalFetchRequestsPerSec_FifteenMinuteRate > kafka_TotalFetchRequestsPerSec_FiveMinuteRate > kafka_TotalFetchRequestsPerSec_MeanRate > kafka_TotalFetchRequestsPerSec_OneMinuteRate > kafka_TotalProduceRequestsPerSec_Count > kafka_TotalProduceRequestsPerSec_FifteenMinuteRate > kafka_TotalProduceRequestsPerSec_FiveMinuteRate > kafka_TotalProduceRequestsPerSec_MeanRate > kafka_TotalProduceRequestsPerSec_OneMinuteRate > kafka_UpdateMetadata_50thPercentile > kafka_UpdateMetadata_95thPercentile > kafka_UpdateMetadata_999thPercentile > kafka_UpdateMetadata_99thPercentile > kafka_UpdateMetadata_Count > kafka_UpdateMetadata_Max > kafka_UpdateMetadata_Mean > kafka_UpdateMetadata_MeanRate > kafka_UpdateMetadata_Min > kafka_UpdateMetadata_OneMinuteRate > kafka_UpdateMetadata_StdDev > kafka_consumer_lag -- This message was sent by Atlassian Jira (v8.3.4#803005)