Aaron Fabbri created HADOOP-14468:
-------------------------------------
Summary: S3Guard: make short-circuit getFileStatus() configurable
Key: HADOOP-14468
URL: https://issues.apache.org/jira/browse/HADOOP-14468
Project: Hadoop Common
Issue Type: Sub-task
Reporter: Aaron Fabbri
Assignee: Aaron Fabbri
Currently, when S3Guard is enabled, getFileStatus() will skip S3 if it gets a
result from the MetadataStore (e.g. dynamodb) first.
I would like to add a new parameter
{{fs.s3a.metadatastore.getfilestatus.authoritative}} which, when true, keeps
the current behavior. When false, S3AFileSystem will check both S3 and the
MetadataStore.
I'm not sure yet if we want to have this behavior the same for all callers of
getFileStatus(), or if we only want to check both S3 and MetadataStore for some
internal callers such as open().
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
