Hi, Thanks for the KIP! Overall the KIP looks good and covered most of the items.
1. Could you explain how the brokers will handle the DisableRemoteTopic API request? 2. Who will initiate the controller interaction sequence? Does the controller listens for topic config updates and initiate the disablement? -- Kamal On Tue, Mar 26, 2024 at 4:40 PM Satish Duggana <satish.dugg...@gmail.com> wrote: > Thanks Mehari, Divij, Christo etal for the KIP. > > I had an initial review of the KIP and left the below comments. > > 101. For remote.log.disable.policy=delete: > Does it delete the remote log data immediately and the data in remote > storage will not be taken into account by any replica? That means > log-start-offset is moved to the earlier local-log-start-offset. > > 102. Can we update the remote.log.disable.policy after tiered storage > is disabled on a topic? > > 103. Do we plan to add any metrics related to this feature? > > 104. Please add configuration details about copier thread pool, > expiration thread pool and the migration of the existing > RemoteLogManagerScheduledThreadPool. > > 105. How is the behaviour with topic or partition deletion request > handled when tiered storage disablement request is still being > processed on a topic? > > ~Satish. > > On Mon, 25 Mar 2024 at 13:34, Doğuşcan Namal <namal.dogus...@gmail.com> > wrote: > > > > Hi Christo and Luke, > > > > I think the KRaft section of the KIP requires slight improvement. The > metadata propagation in KRaft is handled by the RAFT layer instead of > sending Controller -> Broker RPCs. In fact, KIP-631 deprecated these RPCs. > > > > I will come up with some recommendations on how we could improve that > one but until then, @Luke please feel free to review the KIP. > > > > @Satish, if we want this to make it to Kafka 3.8 I believe we need to > aim to get the KIP approved in the following weeks otherwise it will slip > and we can not support it in Zookeeper mode. > > > > I also would like to better understand what is the community's stand for > adding a new feature for Zookeeper since it is marked as deprecated already. > > > > Thanks. > > > > > > > > On Mon, 18 Mar 2024 at 13:42, Christo Lolov <christolo...@gmail.com> > wrote: > >> > >> Heya, > >> > >> I do have some time to put into this, but to be honest I am still after > >> reviews of the KIP itself :) > >> > >> After the latest changes it ought to be detailing both a Zookeeper > approach > >> and a KRaft approach. > >> > >> Do you have any thoughts on how it could be improved or should I start a > >> voting thread? > >> > >> Best, > >> Christo > >> > >> On Thu, 14 Mar 2024 at 06:12, Luke Chen <show...@gmail.com> wrote: > >> > >> > Hi Christo, > >> > > >> > Any update with this KIP? > >> > If you don't have time to complete it, I can collaborate with you to > work > >> > on it. > >> > > >> > Thanks. > >> > Luke > >> > > >> > On Wed, Jan 17, 2024 at 11:38 PM Satish Duggana < > satish.dugg...@gmail.com> > >> > wrote: > >> > > >> > > Hi Christo, > >> > > Thanks for volunteering to contribute to the KIP discussion. I > suggest > >> > > considering this KIP for both ZK and KRaft as it will be helpful for > >> > > this feature to be available in 3.8.0 running with ZK clusters. > >> > > > >> > > Thanks, > >> > > Satish. > >> > > > >> > > On Wed, 17 Jan 2024 at 19:04, Christo Lolov <christolo...@gmail.com > > > >> > > wrote: > >> > > > > >> > > > Hello! > >> > > > > >> > > > I volunteer to get this KIP moving forward and implemented in > Apache > >> > > Kafka > >> > > > 3.8. > >> > > > > >> > > > I have caught up with Mehari offline and we have agreed that given > >> > Apache > >> > > > Kafka 4.0 being around the corner we would like to propose this > feature > >> > > > only for KRaft clusters. > >> > > > > >> > > > Any and all reviews and comments are welcome! > >> > > > > >> > > > Best, > >> > > > Christo > >> > > > > >> > > > On Tue, 9 Jan 2024 at 09:44, Doğuşcan Namal < > namal.dogus...@gmail.com> > >> > > > wrote: > >> > > > > >> > > > > Hi everyone, any progress on the status of this KIP? Overall > looks > >> > > good to > >> > > > > me but I wonder whether we still need to support it for > Zookeeper > >> > mode > >> > > > > given that it will be deprecated in the next 3 months. > >> > > > > > >> > > > > On 2023/07/21 20:16:46 "Beyene, Mehari" wrote: > >> > > > > > Hi everyone, > >> > > > > > I would like to start a discussion on KIP-950: Tiered Storage > >> > > Disablement > >> > > > > ( > >> > > > > > >> > > > > > >> > > > >> > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-950%3A++Tiered+Storage+Disablement > >> > > > > ). > >> > > > > > > >> > > > > > This KIP proposes adding the ability to disable and re-enable > >> > tiered > >> > > > > storage on a topic. > >> > > > > > > >> > > > > > Thanks, > >> > > > > > Mehari > >> > > > > > > >> > > > > > >> > > > >> > >
