Reranko05 commented on PR #51038:
URL: https://github.com/apache/arrow/pull/51038#issuecomment-5869506183
@pitrou I was going to open an issue on simdjson, but their issue template
asks for the problem to be reproducible with a standalone program using the
vendored simdjson source. I tried that, but couldn't reproduce the behavior
outside of Arrow, so I don't think I have enough to file an issue yet.
Within Arrow, I narrowed it down to
`InferringChunkedArrayBuilder.MultipleChunkIntegerParallel`. I tried different
iteration counts: 16 iterations passes, while 32 and higher trigger the failure
in the subsequent empty parse. I also changed the test to use
`TaskGroup::MakeSerial()` instead of the threaded task group, and the failure
still occurs, so it doesn't appear to depend on the task group threading. I am
confused on how to proceed now?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
