Small correction, I of course meant to use "write_table" and not
"write_to_dataset" in the code snippet (as the latter won't work that way).
Corrected example below:
But, if you already want to use the new filesystems for writing as well,
> there is one workaround to create an output stream
Hi Weston,
You are not missing something obvious, but this is a bit an unfortunate
"transitional phase" where we have new filesystems, but they are not yet
fully supported (on the reading side they are supported in pyarrow 1.0, but
for the writing side we are actively working on that, which will
Forgive me if I am missing something obvious but I am unable to write
parquet files using the new filesystem API.
Here is what I am trying:
https://gist.github.com/westonpace/0c5ef01e21a40de5d16608b7f12de80d
I receive an error:
OSError: Unrecognized filesystem:
