[ https://issues.apache.org/jira/browse/BEAM-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15754636#comment-15754636 ]
Pei He commented on BEAM-1041: ------------------------------ Yes I think this jira could be obsolete given the IOChannelFactory re-design will use URI, and an utility can delete directories recursively based on the URI hierarchy. https://docs.google.com/document/d/11TdPyZ9_zmjokhNWM3Id-XJsVG3qel2lhdKTknmZ_7M/edit > IOChannelFactory: supports for recursively remove(). > ---------------------------------------------------- > > Key: BEAM-1041 > URL: https://issues.apache.org/jira/browse/BEAM-1041 > Project: Beam > Issue Type: Sub-task > Components: sdk-java-core > Reporter: Pei He > Assignee: Tenghuan He > > 1. FileIOChannelFactory: > Maybe using deleteDirectory() as suggested in here: > http://stackoverflow.com/questions/779519/delete-directories-recursively-in-java > 2. GcsIOChannelFactory: > Since gcs doesn't have directories, remove recursively means remove all files > whose prefixes match. > However, there are two issues to consider: > First. remove("gs://mybucket/directory-to-remove") > a. it should remove "gs://mybucket/directory-to-remove/my-file". > b. it should not remove "gs://mybucket/directory-to-remove-my-file". > Second, there should be a way to skip the prefix match for > remove(collection-of-a-thousand-files), perhaps by adding a recursive boolean > parameter to remove(). -- This message was sent by Atlassian JIRA (v6.3.4#6332)