[ https://issues.apache.org/jira/browse/ARROW-18313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17633833#comment-17633833 ]
Dewey Dunnington commented on ARROW-18313: ------------------------------------------ Yes, this one shows up frequently! ARROW-17208, ARROW-17002, ARROW-16421, ARROW-16452 are all basically this...and from reading those tickets it sounds like there may be an R-specific thing happening that is keeping those file handles from being closed as soon as possible. > [R] Issues with open_dataset() > ------------------------------ > > Key: ARROW-18313 > URL: https://issues.apache.org/jira/browse/ARROW-18313 > Project: Apache Arrow > Issue Type: Bug > Components: R > Reporter: N Gautam Animesh > Priority: Major > Attachments: image-2022-11-11-09-19-16-065.png, > image-2022-11-14-10-51-09-893.png > > > On using open_dataset, it creates a connection due to which the files in the > directory get blocked and we cannot perform other operations on the file like > replace! > Actual issue: > # We are running an atomic operation on a bunch of files, which replaces the > temp file names to the target file names. > # But while this is happening, if we try to run open_dataset() on that > particular directory, the atomic operation is failing and there are both > target files and temp files in the directory. > # It is blocking the files that have been read through open_dataset(). > # Please, provide me with more about how we can handle such problems. > # Snapshot: !image-2022-11-11-09-19-16-065.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)