[ https://issues.apache.org/jira/browse/ARROW-8942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dyfan Jones updated ARROW-8942: ------------------------------- Description: Hi all, Apologises if this has already been covered by another ticket. Is it possible for arrow to read in compress delimited files (for example gzip)? Currently I get an error when trying to read in a compressed delimited file: {code:java} vroom::vroom_write(iris, "iris.csv.gz", delim = ",") arrow::read_csv_arrow("iris.csv.gz") # Error in csv__TableReader_Read(self) : # Invalid: CSV parse error: Expected 1 columns, got 4{code} however it can be read in by vroom and readr: {code:java} vroom::vroom("iris.csv.gz") readr::read_csv("iris.csv.gz") {code} was: Hi all, Apologises if this has already been covered by another ticket. Is it possible for arrow to read in compress delimited files (for example gzip)? Currently I get an error when trying to read in a compressed delimited file: ``` vroom::vroom_write(iris, "iris.csv.gz", delim = ",") arrow::read_csv_arrow("iris.csv.gz") # Error in csv___TableReader__Read(self) : # Invalid: CSV parse error: Expected 1 columns, got 4 # however it can be read in by vroom and readr: vroom::vroom("iris.csv.gz") readr::read_csv("iris.csv.gz") ``` > [R] support read gzip csv files > ------------------------------- > > Key: ARROW-8942 > URL: https://issues.apache.org/jira/browse/ARROW-8942 > Project: Apache Arrow > Issue Type: New Feature > Reporter: Dyfan Jones > Priority: Major > > Hi all, > Apologises if this has already been covered by another ticket. Is it possible > for arrow to read in compress delimited files (for example gzip)? > Currently I get an error when trying to read in a compressed delimited file: > > {code:java} > vroom::vroom_write(iris, "iris.csv.gz", delim = ",") > arrow::read_csv_arrow("iris.csv.gz") > # Error in csv__TableReader_Read(self) : > # Invalid: CSV parse error: Expected 1 columns, got 4{code} > however it can be read in by vroom and readr: > {code:java} > vroom::vroom("iris.csv.gz") > readr::read_csv("iris.csv.gz") > {code} > > > > -- This message was sent by Atlassian Jira (v8.3.4#803005)