[
https://issues.apache.org/jira/browse/HADOOP-17199?focusedWorklogId=477987&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477987
]
ASF GitHub Bot logged work on HADOOP-17199:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 02/Sep/20 17:22
Start Date: 02/Sep/20 17:22
Worklog Time Spent: 10m
Work Description: steveloughran opened a new pull request #2269:
URL: https://github.com/apache/hadoop/pull/2269
This backports the listing-side changes of HADOOP-13230.
With this patch in, this branch of Hadoop is compatible with S3A clients
which do not delete directory markers when files are created underneath.
It does not allow this version to disable marker deletion; if the
fs.s3a.marker.retention option is changed to request this, a message
is printed at INFO and the policy remains at "delete"
The s3guard bucket-info command has been extended to support
probing for marker retention, as has the hasPathCapability method on
S3AFileSystem.
Read the documentation!
------
This is java 7 language and (hopefully) classes; testing with/without
s3guard in progress.
note: listing is v1 API only, with all logic in S3AFS itself. Left as is.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 477987)
Time Spent: 1h (was: 50m)
> Backport HADOOP-13230 list/getFileStatus changes for preserved directory
> markers to 3.2.x
> -----------------------------------------------------------------------------------------
>
> Key: HADOOP-17199
> URL: https://issues.apache.org/jira/browse/HADOOP-17199
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.2.1, 3.1.3
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.2.2
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> Our supported Hadoop releases all need to handle s3a stores where the s3a
> client does not delete directory markers.
> This is only the minimal set of list changes; no intent of changing marker
> retention policy. It should be transparent to all clients
> * list/getFileStatus changes
> * backwards compatible test of new algorithm
> * new tests to verify marker handling
> * marker rename bug (HADOOP-17200) surfacing in testing
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
