Carl Boettiger created ARROW-17120: -------------------------------------- Summary: copy_files() does not take paths to specific files Key: ARROW-17120 URL: https://issues.apache.org/jira/browse/ARROW-17120 Project: Apache Arrow Issue Type: Improvement Components: R Reporter: Carl Boettiger
`copy_files()` is a pretty handy function for working between local and remote interfaces, particularly for any file type arrow doesn't handle (arvo, ncdf, h5, etc etc). Unfortunately, it seems to work only from directory-to-directory, at least in the direction of copying S3 -> local file system. e.g. this reprex: {code:java} library(arrow) local_dir <- tempfile() fs::dir_delete(local_dir) fs::dir_create(local_dir) # create dir if it doesn't exist l3 <- SubTreeFileSystem$create(local_dir) l3$ls() #empty s3 <- s3_bucket("neon4cast-targets/aquatics", endpoint_override = "data.ecoforecast.org", anonymous=TRUE) s3$ls() #not empty, good copy_files(s3$path("aquatics-targets.csv.gz"), l3$path("aquatics-targets.csv.gz")) l3$ls() # darn, nothing! copy_files(s3$path("aquatics-targets.csv.gz"), l3) l3$ls() # darn, nothing! copy_files(s3, l3) l3$ls() # Finally! only this works {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)