[ https://issues.apache.org/jira/browse/HBASE-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mikhail Bautin resolved HBASE-4516. ----------------------------------- Resolution: Fixed Resolved as part of HBASE-4218. > HFile-level load tester with compaction and random-read workloads > ----------------------------------------------------------------- > > Key: HBASE-4516 > URL: https://issues.apache.org/jira/browse/HBASE-4516 > Project: HBase > Issue Type: Test > Reporter: Mikhail Bautin > Assignee: Mikhail Bautin > Priority: Minor > Fix For: 0.94.0 > > > This is a load testing tool for HFile implementations, which supports two > workloads: > - Compactions (merge the input HFiles). A special case of this is only one > input, which allows to do HFile format conversions. > - Random reads. Launches the specified number of threads that do seeks and > short scans on randomly generated keys. > The original purpose of this tool was to ensure that HFile format v2 did not > introduce performance regressions. > Keys for the read workload are generated randomly between the first and the > last key of the HFile. At each position, instead of precisely calculating the > correct probability for every byte value b, we select a uniformly random byte > between in the allowed [low, high] range. In addition, there is a heuristic > that determines the positions at which the key has hex characters, and the > random key contains hex characters at those positions as well. > Example output for the random read workload: > Time: 120 sec, seek/sec: 8290, kv/sec: 30351, kv bytes/sec: 91868121, > blk/sec: 10147, unique keys: 232779 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira