Implement S3 retry mechanism for failed block transfers
-------------------------------------------------------
Key: HADOOP-997
URL: https://issues.apache.org/jira/browse/HADOOP-997
Project: Hadoop
Issue Type: Improvement
Components: fs
Affects Versions: 0.11.0
Reporter: Tom White
HADOOP-882 improves S3FileSystem so that when certain communications problems
with S3 occur the operation is retried. However, the retry mechanism cannot
handle a block transfer failure, since blocks may be very large and we don't
want to buffer them in memory. This improvement is to write a wrapper (using
java.lang.reflect.Proxy if possible - see discussion in HADOOP-882) that can
retry block transfers.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
