I have a 9-node Kafka cluster, and all of the brokers just started spouting the following error:
ERROR [Replica Manager on Broker 1]: Error when processing fetch request for partition [mytopic,57] offset 0 from follower with correlation id 58166. Possible cause: Request for offset 0 but we only have log segments in the range 39 to 39. (kafka.server.ReplicaManager) The "mytopic" topic has a replication factor of 3, and metrics are showing a large number of under replicated partitions. My assumption is that a log aged out but that the replicas weren't aware of it. In any case, this problem isn't fixing itself, and the volume of log messages of this type is enormous. What might have caused this? How does one resolve it?