Hello Team, I wanted to check on the status of KIP-1266 <https://cwiki.apache.org/confluence/spaces/KAFKA/pages/406618613/KIP-1266+Bounding+The+Number+Of+RemoteLogMetadata+Messages+via+Compacted+Topic>, which proposes making the __remote_log_metadata topic compacted.
Recently, during a rolling restart of brokers, we observed that Tiered Storage consumers were unable to read from the __remote_log_metadata topic for over two minutes. The topic currently has unlimited retention, with approximately 14 days of metadata in our case. After restarting, the broker took more than two minutes to build its cache, during which consumers encountered ReplicaNotAvailableException errors. Making the topic compacted could help reduce the amount of metadata that needs to be replayed during broker startup and potentially reduce cache rebuild time, minimizing the impact on Tiered Storage consumers during rolling restarts. Could you please share the current status of KIP-1266 and any updates on its implementation timeline? Thanks!
