Hi Iceberg community 👋, I'd like to open a discussion about telemetry in Iceberg clients. As of now, we have the Metrics Reporting API <https://iceberg.apache.org/docs/latest/metrics-reporting/> spec. This is only implemented in Iceberg Java, and while working on an implementation in Rust <https://github.com/apache/iceberg-rust/pull/1496>, we've realized that there are other (likely better) approaches to submit telemetry these days. I've created this doc <https://docs.google.com/document/d/1fTvk0IT-lncOQpYM2c_B8xkYznI5N0DSxFNZ1U8Cgpk/edit?usp=drive_link> to facilitate a discussion about potentially adopting OpenTelemetry (or similar frameworks) to 1) simplify implementing metrics reporting in more clients 2) allow for easier integration with observability tooling and 3) bring us into a better position to extend on the telemetry we emit from clients (be it traces, additional metric dimensions, or additional metrics altogether). Since this is an effort that would benefit from the input of all language communities, I'm bringing this to the dev list. Cross-client metric aggregations for example would heavily benefit from a shared agreement on metric names.
Looking forward to all of your input 🙏
