rustyconover commented on PR #9445: URL: https://github.com/apache/arrow-rs/pull/9445#issuecomment-6450105672
@alamb, the concrete cost is an additional 8 bytes per batch on 64-bit targets (40 → 48 bytes), regardless of row count. Empty metadata adds no allocation or reference-count update; populated metadata shares its map when cloned. I haven’t measured downstream performance, so I can’t claim the impact is negligible. I think preserving per-batch metadata is useful enough to justify this trade-off, but I understand the concern given how widely `RecordBatch` is used. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
