rmorgans commented on issue #584:
URL: https://github.com/apache/arrow-go/issues/584#issuecomment-3592019542
Hi @zeroshade
I know very little about go and parquet (and what a nullable level is!) -
was porting some pyarrow code to go, and am heistant to introduce AI slop.. BUT
I think it's still there:
go version go1.25.4 darwin/arm64
v18.4.1 output:
```
In-memory record before write:
col[0][embedding]: [[1 2 3 4 5 6 7 8]]
Table read back:
embedding: [[[(null) (null) (null) (null)
(null) (null) (null) (null)]]]
```
It looks like the LIST and MAP cases calls this:
https://github.com/apache/arrow-go/blob/4b04248429bc94e25b87fe285a41467d06cdf4e9/parquet/pqarrow/path_builder.go#L398
before visiting child values.
but the FIXED_SIZE_LIST does not...
https://github.com/apache/arrow-go/blob/4b04248429bc94e25b87fe285a41467d06cdf4e9/parquet/pqarrow/path_builder.go#L400-L415.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
