[jira] [Commented] (HADOOP-16090) S3A Client to add explicit support for versioned stores

2020-03-26 Thread Dmitri Chmelev (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068087#comment-17068087 ] Dmitri Chmelev commented on HADOOP-16090: - Depending on your use case, you can mitigate this

[jira] [Commented] (HADOOP-16090) S3A Client to add explicit support for versioned stores

2020-03-26 Thread Dmitri Chmelev (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068083#comment-17068083 ] Dmitri Chmelev commented on HADOOP-16090: - This issue is a function of the number of writes,

[jira] [Commented] (HADOOP-16090) S3A Client to add explicit support for versioned stores

2019-04-03 Thread Dmitri Chmelev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808989#comment-16808989 ] Dmitri Chmelev commented on HADOOP-16090: - I have some bad news with regards to performance

[jira] [Commented] (HADOOP-16090) S3A Client to add explicit support for versioned stores

2019-03-18 Thread Dmitri Chmelev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795510#comment-16795510 ] Dmitri Chmelev commented on HADOOP-16090: - Steve, I have a slightly different patch that

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-06 Thread Dmitri Chmelev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762281#comment-16762281 ] Dmitri Chmelev commented on HADOOP-16090: - Ok, sounds good. I'll send the patch that performs

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-05 Thread Dmitri Chmelev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761089#comment-16761089 ] Dmitri Chmelev commented on HADOOP-16090: - {quote}So do it when createFile() is kicked off?

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-05 Thread Dmitri Chmelev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760577#comment-16760577 ] Dmitri Chmelev commented on HADOOP-16090: - Another idea is to amortize the cost of the

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-04 Thread Dmitri Chmelev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760157#comment-16760157 ] Dmitri Chmelev commented on HADOOP-16090: - A slight optimization of #1 is to avoid calling

[jira] [Updated] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-01 Thread Dmitri Chmelev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitri Chmelev updated HADOOP-16090: Description: The fix to avoid calls to getFileStatus() for each path component in

[jira] [Created] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-01-31 Thread Dmitri Chmelev (JIRA)
Dmitri Chmelev created HADOOP-16090: --- Summary: deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket Key: HADOOP-16090 URL: