[
https://issues.apache.org/jira/browse/HADOOP-13871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HADOOP-13871:
---
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.0.0-alpha2
2.8.0
Status: Resolved (was: Patch Available)
Ran integration tests against US standard.
Thanks [~ste...@apache.org] for great analysis and patch contribution. I have
committed to {{trunk}} through {{branch-2.8}} branches. For the commit, I fixed
the whitespace warnings; and also addressed javadoc of {{getS3AInputStream()}}
method, per [~mackrorysd]'s comment. Thanks for reviewing this.
> ITestS3AInputStreamPerformance.testTimeToOpenAndReadWholeFileBlocks
> performance awful
> -
>
> Key: HADOOP-13871
> URL: https://issues.apache.org/jira/browse/HADOOP-13871
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: 2.8.0, 2.9.0, 3.0.0-alpha2
> Environment: landsat bucket from the UK
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: 2.8.0, 3.0.0-alpha2
>
> Attachments: HADOOP-13871-001.patch, HADOOP-13871-002.patch,
> HADOOP-13871-003.patch,
> org.apache.hadoop.fs.s3a.scale.ITestS3AInputStreamPerformance-output.txt
>
>
> The ITestS3AInputStreamPerformance.testTimeToOpenAndReadWholeFileBlocks takes
> 15s on branch-2, but is now taking minutes.
> This is a regression, and it's surfacing on some internal branches too. Even
> where the code hasn't changed. -It does not happen on branch-2, which has a
> later SDK.-
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
