Small correction, I of course meant to use "write_table" and not "write_to_dataset" in the code snippet (as the latter won't work that way). Corrected example below:
But, if you already want to use the new filesystems for writing as well, > there is one workaround to create an output stream manually and pass that > instead of the path. > So in your example, you could replace > > pq.write_table(table, out_path, filesystem=subtree_filesystem) > > with > > with subtree_filesystem.open_output_stream(out_path) as f: > pq.write_table(table, f) > > However, this only works with single files (and not yet with > write_to_dataset for partitioned datasets). > >
