sfackler commented on pull request #9536: URL: https://github.com/apache/arrow/pull/9536#issuecomment-782928758
There are two potential sources of error when writing a stream. It could come from the underlying writer (e.g. the TCP socket is closed or the disk is full), in which case the automatic footer write will probably also fail. However, it could come from the code *producing* the data (e.g. it's reading from a database and that connection dies). If that is the case, the Arrow stream is logically incomplete but if a footer is automatically applied on drop, it can appear to a downstream consumer like everything is fine. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
