thisisnic commented on issue #30575:
URL: https://github.com/apache/arrow/issues/30575#issuecomment-6711004994
This has been resolved. `open_dataset()` on compressed CSVs worked at the
time of filing (see the reproductions above), and the `read_csv_arrow()` case
was addressed by ARROW-16612: compression is now detected when you pass a path
from the bucket, e.g. `read_csv_arrow(bucket$path("file.csv.gz"))`. Passing an
already opened file handle from `OpenInputFile()` still requires wrapping it in
`CompressedInputStream$create()`, since the handle does not carry the file
name, but `bucket$path()` is the recommended way to do this. Closing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
