paleolimbot commented on PR #433:
URL: https://github.com/apache/arrow-nanoarrow/pull/433#issuecomment-2066704683
This has been updated significantly from the earlier version!
> Why would a user need this?
The motivation is a straightforward path to column-wise conversion (e.g.,
numpy, pandas). For small numbers of chunks this seems to be faster than
pyarrow (although I'm sure we could fix that). With some knowledge of the
internals you could also do:
```python
for item in na.c_array_view(something):
view = item.view()
```
...but that creates a new `CArrayView` each time and we technically don't
need to (my quick check suggested this was about a 10% overhead, which might
not matter since the Python per-chunk overhead is really the issue here). We
could also just have `iter_array_view()` be what I pasted above.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
