Hi Szheon,
Thanks for the follow-up. It is possible some of the concerns were
referring to the backend catalogs, but it is all connected. My main
personal concern is from the engine connector APIs point of view, but I
share the concern about the catalogs.
I think everyone's concern is not about t
Hi,
This sounds very interesting!
IIUC, the current variant type in the Apache Spark stores data in the
BINARY type. When it comes to subcolumnarization, does it require the file
format (e.g. Apache Parquet/ORC/Avro) to support variant type natively?
Best,
Gang
On Sat, May 11, 2024 at 1:07 PM T
Hello,
We (Tyler, Nileema, Selcuk, Aihua) are working on a proposal for which we’d
like to get early feedback from the community. As you may know, Snowflake
has embraced Iceberg as its open Data Lake format. Having made good
progress on our own adoption of the Iceberg standard, we’re now in a
posi
Hi Walaa
OK thanks for confirming. I am still not 100% in agreement, my
understanding of the rationale for separate Table/View objects in the
comment that you linked:
I think the biggest problem with this is that we would need to modify every
> catalog to support this combination and that would
