Re: FlinkFileIO implementation

2024-04-24 Thread Péter Váry
Hi Ryan, In my experience the different engines often have different ways to distribute the authentication information. Some engines use IAM roles to access S3, some engines uses security tokens to authenticate, which means, we already have a different Catalog/FileIO configurations on engine

Re: Query regarding UPSERT Mode in Flink

2024-04-24 Thread Aditya Narayan Gupta
Hi Péter, Thanks a lot for explaining and sharing the reference thread, I will follow it. Regards, Aditya On Mon, Apr 22, 2024 at 8:39 PM Péter Váry wrote: > Very high change rate means that it is most probably worth it to rewrite > the data files from time to time. > The high change rate