[
https://issues.apache.org/jira/browse/HADOOP-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875670#comment-17875670
]
Viraj Jasani edited comment on HADOOP-19256 at 8/21/24 10:15 PM:
-----------------------------------------------------------------
Does this mean we need S3A configs for each of the getObject, headObject and
copyObject headers? Probably we can introduce something similar to
"fs.s3a.aws.credentials.provider.mapping"?
e.g.
{code:java}
<property>
<name>fs.s3a.getobject.headers</name>
<vale>
If-Match=<E-tag>,
If-Modified-Since=2024-02-03T10:15:30.00Z,
If-None-Match=<E-tag>,
If-Unmodified-Since=2024-02-03T10:15:30.00Z
</vale>
</property>{code}
Both "If-Modified-Since" and "If-Unmodified-Since" can be made relative values
too, from s3a viewpoint.
was (Author: vjasani):
Does this mean we need S3A configs for each of the getObject, headObject and
copyObject headers? Probably we can introduce something similar to
"fs.s3a.aws.credentials.provider.mapping"?
e.g.
{code:java}
<property>
<name>fs.s3a.getobject.headers</name>
<vale>
If-Match=<E-tag>,
If-Modified-Since=2024-02-03T10:15:30.00Z,
If-None-Match=<E-tag>,
If-Unmodified-Since=2024-02-03T10:15:30.00Z
</vale>
</property>{code}
> Support S3 Conditional Writes
> -----------------------------
>
> Key: HADOOP-19256
> URL: https://issues.apache.org/jira/browse/HADOOP-19256
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Ahmar Suhail
> Priority: Major
>
> S3 Conditional Write (Put-if-absent) capability is now generally available -
> [https://aws.amazon.com/about-aws/whats-new/2024/08/amazon-s3-conditional-writes/]
>
> S3A should allow passing in this put-if-absent header to prevent over writing
> of files.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
