Re: [Discussion] Versioned SQL UDFs (Catalog routines) in Iceberg

Thanks, Ajantha. I'm skeptical about whether it's a good idea to add UDFs tracked by Iceberg catalogs. I think that Iceberg primarily deals with things that are centralized, like tables of data. While it would be great to have a common set of functions across engines, I don't see how that is pract

[Discussion] Versioned SQL UDFs (Catalog routines) in Iceberg

Hi Everyone, This is a discussion to gauge the community interest in storing the Versioned SQL UDFs in Iceberg. We want to propose the spec addition for storing the versioned UDFs in Iceberg (inspired by view spec). These UDFs can operate similarly to views in that they are associated with tables

View Support for Hive Catalog

Hi Everyone, As part of the issue-8698 , I was working on this PR . Since Hive has a different complexity compared to other catalogs. It would be really helpful if one of the Hive related people looked into

Re: [Discuss] Heap pressure with RewriteFiles APIs

Hi Amogh, Thanks for your feedback. It really sounds like a good idea to me. For all the heavy operations like compaction, gc it can reduce heap pressure. However, can't we do something where we don't need to save all the dataFiles? Especially for Rewrite cases, what will be harm if we flush to

Re: Iceberg Summit Video not accessible from non-registered users

Hi, The sessions will be available on youtube channel soon. Regards JB On Fri, May 24, 2024 at 2:45 AM Pucheng Yang wrote: > > Hi, > > My co-workers who did not register for the iceberg summit would like to check > the videos. However, it seems the registration is closed hence they are not >