pitrou commented on PR #49312: URL: https://github.com/apache/arrow/pull/49312#issuecomment-3917018279
The IPC file format is just the IPC stream format + a fixed-size header + a footer with additional metadata for random access (like a ZIP catalog, basically). However, since the IPC file format allows for random access, the IPC file reader has specifics shortcuts and heuristics to make better use of IO, meaning different code paths than the IPC stream format. (it's not a problem to exercise the IPC stream reader code, either, even though we have a separate fuzz harness for it) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
