Kafka did this with librdkafka and was wildly successful. The underlying bindings being in rust are great with a layer for access in Python +1
~ Joe Stein On Wed, Jul 31, 2024 at 10:29 PM Xuanwo <xua...@apache.org> wrote: > Hello everyone > > I start this thread to discuss the idea about using iceberg-rust as > pyiceberg file io. > > The idea is living at https://hackmd.io/@xuanwo/iceberg_rust_as_file_io > > In summary, we can leverage the work from iceberg-rust to help pyiceberg > in developing a fast and compact file IO system that benefits users with > specific constraints. > > Welcome to join in the discussion. > > Xuanwo > > https://xuanwo.io/ >