[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775059#comment-16775059 ] Steve Loughran commented on HADOOP-16090: - In HADOOP-16134 I've done a first PoC of what a

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763114#comment-16763114 ] Steve Loughran commented on HADOOP-16090: - Assigned the JIRA to you patch-wise, i'd rather

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-06 Thread Dmitri Chmelev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762281#comment-16762281 ] Dmitri Chmelev commented on HADOOP-16090: - Ok, sounds good. I'll send the patch that performs

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761739#comment-16761739 ] Steve Loughran commented on HADOOP-16090: - I've been thinking for a while about having an

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-05 Thread Dmitri Chmelev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761089#comment-16761089 ] Dmitri Chmelev commented on HADOOP-16090: - {quote}So do it when createFile() is kicked off?

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761068#comment-16761068 ] Steve Loughran commented on HADOOP-16090: - {{copyFromLocalFile}} has its own issues

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-05 Thread Dmitri Chmelev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760577#comment-16760577 ] Dmitri Chmelev commented on HADOOP-16090: - Another idea is to amortize the cost of the

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-04 Thread Dmitri Chmelev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760157#comment-16760157 ] Dmitri Chmelev commented on HADOOP-16090: - A slight optimization of #1 is to avoid calling

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760077#comment-16760077 ] Steve Loughran commented on HADOOP-16090: - Some possible options here # we go back to check &

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760065#comment-16760065 ] Steve Loughran commented on HADOOP-16090: - bq. Note that issuing a DELETE request without