Reranko05 commented on PR #50945: URL: https://github.com/apache/arrow/pull/50945#issuecomment-5424653086
@pitrou I tried using `simdjson::ondemand::parser::iterate_many()` for this, but after several attempts I’m running into semantic differences from RapidJSON’s `kParseStopWhenDoneFlag`, particularly when a complete JSON value is followed by a partial or malformed one. I think a manual boundary scan may be a better fit here: scan for the end of the first complete object/array while handling strings and escapes, then validate only that slice with simdjson. This seems closer to the existing RapidJSON behavior and avoids relying on `iterate_many()` stream semantics. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
