[ https://issues.apache.org/jira/browse/HBASE-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Phabricator updated HBASE-4916: ------------------------------- Attachment: HBASE-4916.D741.1.patch cgist requested code review of "HBASE-4916 [jira] LoadTest MR Job". Reviewers: JIRA MR-based load tester with pluggable workloads This is a new load tester for HBase which supports pluggable workloads and more flexibility in configuring how the load is exercised. This load tester runs as a native map reduce job. Interfaces which define the workloads can be extended for specific testing. The intensity of a load can be controlled by the number of clients, number of threads and desired operations per second. Add a script to start a streaming map-reduce job where each map tasks runs an instance of the load tester for a partition of the key-space. Ensure that the load tester takes a parameter indicating the start key for write operations. TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D741 AFFECTED FILES src/main/java/org/apache/hadoop/hbase/loadtest/CompositeOperationGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/DataGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/GetGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/GetOperation.java src/main/java/org/apache/hadoop/hbase/loadtest/KeyCounter.java src/main/java/org/apache/hadoop/hbase/loadtest/MixedWorkloadGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/Operation.java src/main/java/org/apache/hadoop/hbase/loadtest/OperationGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/PutGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/PutOperation.java src/main/java/org/apache/hadoop/hbase/loadtest/PutReGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/RandomDataGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/SeparateWorkloadGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/StatsCollector.java src/main/java/org/apache/hadoop/hbase/loadtest/VersionWorkloadGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/Workload.java src/main/java/org/apache/hadoop/hbase/mapreduce/Driver.java src/main/java/org/apache/hadoop/hbase/mapreduce/LoadTest.java MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/1587/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. > LoadTest MR Job > --------------- > > Key: HBASE-4916 > URL: https://issues.apache.org/jira/browse/HBASE-4916 > Project: HBase > Issue Type: Sub-task > Components: client, regionserver > Reporter: Nicolas Spiegelberg > Assignee: Christopher Gist > Fix For: 0.94.0 > > Attachments: HBASE-4916.D741.1.patch > > > Add a script to start a streaming map-reduce job where each map tasks runs an > instance of the load tester for a partition of the key-space. Ensure that the > load tester takes a parameter indicating the start key for write operations. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira