While Apache Arrow and OneTable both broadly aim for interoperability, they have different goals. Arrow focuses on creating an in-memory columnar data representation for use across multiple engines and applications. On the other hand, OneTable serves as a converter for table formats that (1) does not expose a new table format abstraction / API, and (2) does not aim to standardize / provide cross-compatibility for data representation; instead it relies on the data representation used by the specific table format.
-Jesús On Mon, Dec 4, 2023 at 11:58 PM Yuanbo Liu <liuyuanb...@gmail.com> wrote: > What are the differences between OneTable and Apache Arrow > > On Tue, Dec 5, 2023 at 11:11 AM Jeff Zhang <zjf...@gmail.com> wrote: > > > Seems an interesting project, looking forward to seeing it get into the > > apache incubator. > > > > On Tue, Dec 5, 2023 at 7:14 AM Felix Cheung <felixche...@apache.org> > > wrote: > > > > > Interesting. Let me know if I can be of help as mentor > > > > > > > > > On Mon, Dec 4, 2023 at 1:35 PM Austin Bennett <aus...@apache.org> > wrote: > > > > > > > Awesome -- OneTable has a great purpose/mission, and can be really > > > > useful! I look forward to helping where I am able. > > > > > > > > > > > > On 2023/12/04 21:23:17 Jesus Camacho Rodriguez wrote: > > > > > Hi All, > > > > > > > > > > I would like to propose a new project to the ASF incubator - > > OneTable. > > > > > > > > > > OneTable[1] is an omni-directional converter for table formats that > > > > > facilitates interoperability across data processing systems and > query > > > > > engines. Currently, OneTable supports widely adopted open-source > > table > > > > > formats such as Apache Hudi, Apache Iceberg, and Delta Lake. > > > > > > > > > > Here is the proposal - > > > > > > > > > https://cwiki.apache.org/confluence/display/INCUBATOR/OneTable+Proposal > > > > > > > > > > I would be the Champion of the project. I will mentor and help the > > > > project > > > > > through the incubator with Hitesh Shah [hit...@apache.org], > Stamatis > > > > > Zampetakis [zabe...@apache.org], and Jean-Baptiste Onofré [ > > > > > jbono...@apache.org]. > > > > > > > > > > We are looking forward to your feedback! > > > > > > > > > > Thanks, > > > > > Jesús > > > > > > > > > > [1] https://github.com/onetable-io/onetable > > > > > > > > > > > > > --------------------------------------------------------------------- > > > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > > > For additional commands, e-mail: general-h...@incubator.apache.org > > > > > > > > > > > > > > > > > -- > > Best Regards > > > > Jeff Zhang > > >
