[ https://issues.apache.org/jira/browse/HADOOP-16058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16746742#comment-16746742 ]
Steve Loughran edited comment on HADOOP-16058 at 1/18/19 10:40 PM: ------------------------------------------------------------------- patch 001. Tested S3 ireland. Those pasted in numbers were not from parallel test runs. They work with 100K of data BTW, so its a kilosort really. if you want real terasort numbers, because Terasort is patched to work with any object store, you can do it from any yarn cluster. was (Author: ste...@apache.org): patch 001. Tested S3 ireland. Those pasted in numbers were not from parallel test runs > S3A tests to include Terasort > ----------------------------- > > Key: HADOOP-16058 > URL: https://issues.apache.org/jira/browse/HADOOP-16058 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/s3, test > Affects Versions: 3.3.0 > Reporter: Steve Loughran > Assignee: Steve Loughran > Priority: Major > Attachments: HADOOP-16058-001.patch > > > Add S3A tests to run terasort for the magic and directory committers. > MAPREDUCE-7091 is a requirement for this > Bonus feature: print the results to see which committers are faster in the > specific test setup. As that's a function of latency to the store, bandwidth > and size of jobs, it's not at all meaningful, just interesting. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org