Thanks for the answer, Joseph. Aiven's implementation was already in my TODO list 😅. I also saw in the README that you plan to add an Azure implementation. Do you know when you plan to have it (I'm working for a company that uses both AWS & Azure)? For the tests & benchmarks, I guess we'll use Aiven's S3 implementation and LinkedIn's Azure implementation, but the latter is not maintained. So, if the tests are successful (and we have a better idea about the release date of the production ready version of tiered storage), we'll either rely on a more reliable azure implementation or manage our own implementation.
Le mar. 17 oct. 2023 à 17:07, Josep Prat <josep.p...@aiven.io.invalid> a écrit : > Hi Christophe, > > We highly encourage the community to try Tiered Storage in their staging > environments and report any deficiencies they might encounter. > > That being said, at Aiven to develop our S3 and GCS plugin [1] we did some > extensive testing and we will be enabling it to our service offering on the > upcoming days. > > At the moment I'm not aware of a creation of a repository of plugins. But > it might be worth having. > > [1]: https://github.com/Aiven-Open/tiered-storage-for-apache-kafka/ > > > Thanks for your interest in Kafka and Tiered Storage. > > Disclaimer, I'm employed at Aiven. > > Best, > ——— > Josep Prat > > Aiven Deutschland GmbH > > Alexanderufer 3-7, 10117 Berlin > > Amtsgericht Charlottenburg, HRB 209739 B > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen > > m: +491715557497 > > w: aiven.io > > e: josep.p...@aiven.io > > On Tue, Oct 17, 2023, 16:39 Christophe Kalenzaga < > christophe.kalenz...@gmail.com> wrote: > > > Hi, > > > > Congratulation for the release of kafka 3.6 that contains a feature I was > > waiting for many years! > > > > Speaking of the devil, the tiered storage is currently in early access. > > When do you expect it to be production ready? I know it's not an easy > > question since the early access was just released, but it's just to get > an > > order of magnitude (Is it a couple of months? A year? Multiple years?). > > > > Another question regarding this feature: the current version doesn't > > provide a RemoteStorageManager implementation. According to the KIP-405 > > "HDFS and S3 implementation are planned to be hosted in external repos > and > > these will not be part of Apache Kafka repo". Do you plan to list > somewhere > > the implementations vetted by the Kafka community so that users can > select > > a safe implementation? > > > > Best regards, > > Christophe > > >
