I've been trying out IO with Arrow's extension types and I was able write a
parquet file but reading it back causes an error:
"pyarrow.lib.ArrowInvalid: Unsupported nested type: ...". Looking at the
code for the parquet reader, it checks nested types and only allows a few
specific ones. Is this a known limitation? I couldn't find a JIRA but I'll
make one if it is. Alternatively, I was able to convert my extension array
to/from a Pandas DataFrame and read/write to a Feather file, which is
awesome - nice work!

Thanks,
Bryan

Reply via email to