Reranko05 commented on PR #51038: URL: https://github.com/apache/arrow/pull/51038#issuecomment-5874753832
Before i create an issue just to verify I am wording it correctly:- Title : `truncated_bytes() returns arbitrary values for empty streams` Desc : ``` ### Description We are using `simdjson::ondemand::document_stream` in Apache Arrow's JSON parser. When the input is empty and the stream contains no documents, `truncated_bytes()` can return a large arbitrary value such as `4294967295`, causing empty input to be reported as truncated. The behavior only occurs in the Arrow environment after repeated parser operations. ### Question Is `truncated_bytes()` supported when the stream contains no complete documents? If not, could this limitation be made more explicit in the documentation? Context: https://github.com/apache/arrow/pull/51038 ``` @pitrou is this fine? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
