Thanks Antione for the pointers. I switched to using io::BufferReader and
that fixed the issue. Newline options also work fine. It is an extra copy
for me, but for now I am good.
On Wed, Mar 9, 2022 at 7:46 AM Antoine Pitrou wrote:
> On Mon, 7 Mar 2022 11:52:02 -0800
> HK Verma
inputstream that feeds data into arrow streaming reader. I
checked the Read bytes in this stream and they are in order and serialized
by mutexes as well.
Thanks
HK
On Mon, Mar 7, 2022 at 11:31 AM Antoine Pitrou wrote:
>
> Hi HK,
>
> On Mon, 7 Mar 2022 10:16:07 -0800
> HK Verma
I am integrating Arrow with another C++ library. For this, I wrote an input
stream which feeds CSV data into the streaming reader. It fails for very
large files with the error messages like - "CSV parser got out of sync with
chunker".
I have tried various things like -
* Look at the stream to see
