Reranko05 commented on PR #50945:
URL: https://github.com/apache/arrow/pull/50945#issuecomment-5393687334

   > I don't understand why this is parsing JSON by hand?
   It seems that we might be able to use 
simdjson::ondemand::parser::iterate_many.
   
   I initially tried using `simdjson::ondemand::parser::iterate_many`, but 
after a few attempts I ran into boundary-handling issues with the chunker 
semantics. I then referred to an earlier implementation by @rok as a reference 
and followed that approach.
   
   That said, I agree that parsing JSON manually here is not ideal. I'll 
revisit this using `iterate_many` and address the other review comments as well.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to