Reranko05 commented on PR #50945: URL: https://github.com/apache/arrow/pull/50945#issuecomment-5410575244
@pitrou I tried using` simdjson::ondemand::parser::iterate_many()`. Most tests pass, but `PropagateErrorsNonLinewiseChunker` behaves differently: malformed input is split into a separate document and the error is then reported by the JSON parser, whereas the current implementation reports a chunker error. Manual structural parsing approach preserved the existing test behavior. @rok, since your earlier implementation was helpful here, do you have any suggestions on how to preserve the current error behavior with `iterate_many()`? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
