Sharing notes from the Iceberg Rust community sync on Thursday (2026-10-22). The sync is every 3 weeks and we record agenda and some notes in the Iceberg Rust community sync Google doc: https://docs.google.com/document/d/1_1yhzaWOr28aURogoe7a8LONdLRDXfo88jYPHbLHIg4/
Notes from this sync as follows: - 0.11 release o Aligned to stick with current 0.11 branch and release ASAP. Not worth recutting as we no longer have the DataFusion integration in the repo. - Discussed the need for a community roadmap (~3mo) to help guide contributor and maintainer effort and set expectations. This has worked well in DataFusion and we’d like to try it out in iceberg-rust. • Quarterly roadmap in DataFusion: https://github.com/apache/datafusion/issues/22882 • This stems from increased burden with AI-generated PRs. • Blog from A Lamb My plan for reviewing PRs in Open Source Projects in the age of AI | Andrew A Lamb • “Overwhelming number of PRs” discussion from arrow-rs https://github.com/apache/arrow-rs/issues/11808 • Encourage or discourage v4 work? • Add a tracking issue with the caveat that it might not merge now • Prototypes in user forks to map to spec development • Russell’s recent talk on contributors/maintainers co-existing with LLMs https://www.youtube.com/watch?v=FLhqp9_IWGU • Shawn will post roadmap issue • Matt has opened V4 tracking issue https://github.com/apache/iceberg-rust/issues/3513 - DataFusion Iceberg integration first release under DF governance o Matt has opened a new issue in that repo to foster initial discussion - FileFormat / DataFusion data source discussion o There was discussion around changing the shape of Iceberg Rust’s scanning to better fit DataFusion’s data source APIs. Ultimately, this led us back towards the proposal for a File Format API alike Iceberg Java’s. o Other references • Blog of Java’s FileFormat API: https://iceberg.apache.org/blog/apache-iceberg-file-format-api/#2-column-families • row function shared library: https://github.com/spiraldb/rowfn • Vortex proposal for Iceberg: https://docs.google.com/document/d/1g0EJDr3DkSmfAce8C94zA2JyWRj2SeNeAeiYOotnSww/edit?usp=sharing Kudos to Matt for taking notes during the sync. I also have a recording of the sync available on Slack now (retention unclear): https://apache-iceberg.slack.com/archives/C05HTENMJG4/p1792747638711669?thread_ts=1792671921.955779&cid=C05HTENMJG4. (I’d be happy to get that across to someone if we want to get that up on the YT channel.) Thanks, Danny
