steveloughran commented on a change in pull request #1721: HADOOP-16709.
Consider having the ability to turn off TTL in S3Guard …
URL: https://github.com/apache/hadoop/pull/1721#discussion_r347957325
##########
File path:
hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java
##########
@@ -2669,9 +2671,7 @@ S3AFileStatus innerGetFileStatus(final Path f,
// modification - compare the modTime to check if metadata is up to date
// Skip going to s3 if the file checked is a directory. Because if the
// dest is also a directory, there's no difference.
- // TODO After HADOOP-16085 the modification detection can be done with
Review comment:
see https://issues.apache.org/jira/browse/HADOOP-16644 ; if there's any
clock skew then the first open/head triggers a s3guard update, which makes Sidd
sad. For a simple S3 PUT we know the modtime; for a multipart we can just do
one more HEAD request at create time
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
