This is great work! Very excited to see this. Cell : 425-233-8271
On Tue, Feb 13, 2024 at 4:38 PM huaxin gao <huaxin.ga...@gmail.com> wrote: > Hello Iceberg community, > > As you may already know, Project Comet > <https://github.com/apache/arrow-datafusion-comet>, a plugin to > accelerate Spark query execution via leveraging DataFusion and Arrow, has > been open sourced under the Apache Arrow umbrella. To capitalize on the > capabilities of Project Comet, I propose the implementation of a dynamic > plugin mechanism. This mechanism will enable seamless integration with not > only Project Comet but also other native execution engines. > > I have prepared a spec > <https://docs.google.com/document/d/1WTagYUQsykfBiAHYDwi_ogUxbHROJdStTp9EZ63POhk/edit> > and also submitted a corresponding PR > <https://github.com/apache/iceberg/pull/9721/>. Your feedback on this > proposal would be greatly appreciated. > > Thanks, > Huaxin > > > >
