bdklahn opened a new pull request, #615:
URL: https://github.com/apache/arrow-julia/pull/615
RecordBatch.variadicBufferCounts is defined as [long] (Int64) in the Apache
Arrow Message.fbs spec, but was deserialized as FlatBuffers.Array{Int32}. When
reading tables with multiple Utf8View/BinaryView columns (e.g. from Polars),
reading 32-bit elements split each 64-bit buffer count into two 32-bit words,
shifting buffer offsets for subsequent columns and causing out-of-bounds reads
or segmentation faults in Arrow.View getindex:
signal 11 (2): Segmentation fault: 11
getindex at ./essentials.jl:975 [inlined]
getindex at Arrow/src/arraytypes/views.jl:61 [inlined]
Also handle 4-byte-aligned Int64 vectors in FlatBuffers.Array{T} when the
vector payload following the 4-byte UOffsetT length prefix is not 8-byte
aligned.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
