[ https://issues.apache.org/jira/browse/KAFKA-9813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17077837#comment-17077837 ]
Jordan Moore commented on KAFKA-9813: ------------------------------------- How large is each segment file on disk? How large is each partition? > __consumer_offsets loaded cost very long time > --------------------------------------------- > > Key: KAFKA-9813 > URL: https://issues.apache.org/jira/browse/KAFKA-9813 > Project: Kafka > Issue Type: Bug > Components: core > Affects Versions: 2.1.1 > Reporter: leibo > Priority: Major > Attachments: 2020-04-03_163556.png > > > __consumer_offsets loaded with a long time. > > After I restart kafka(3 HA), one of __consumer_offsets loaded with 41256909 > ms (about 11 hours), the others __consumer_offsets partition that load after > __consumer_offsets-14 can not be loaded , that lead many consumer can not > commit offsets and consume. > restart time: 2020-04-02 19:06 > __consumer_offsets-14 loaded time: 2020-04-03 06:32, 41256909 ms > other info: > 1. there are 72408 consumer groups in kafka cluster, and most of it > (70498) are empty. > 2. there was no exception can be found in server.log > 3. the disk i/o and cpu ,memory load are very low. > -- This message was sent by Atlassian Jira (v8.3.4#803005)