jun wang created ARROW-18309: -------------------------------- Summary: [Go] delta_bit_packing Decode may panic Key: ARROW-18309 URL: https://issues.apache.org/jira/browse/ARROW-18309 Project: Apache Arrow Issue Type: Bug Components: Go Affects Versions: 9.0.0 Environment: all release version Reporter: jun wang Fix For: 9.0.1 Attachments: @timestamp.data
[https://github.com/apache/arrow/blob/master/go/parquet/internal/encoding/delta_bit_packing.go] The DeltaBitPackInt32 and DeltaBitPackInt64 Decode method did not use d.nvals subtract decoded number at end, which lead streaming decode panic. Also, when copy the decoded value to out, the end value should be shared_utils.MinInt(int(d.valsPerMini), start + len(out)) When encode 68610 timestamp data, and decode 1024 value a batch, we encounter the panic -- This message was sent by Atlassian Jira (v8.20.10#820010)