[jira] [Updated] (HBASE-10788) Add 99th percentile of latency in PE
[ https://issues.apache.org/jira/browse/HBASE-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-10788: -- Resolution: Fixed Fix Version/s: 0.99.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Add 99th percentile of latency in PE Key: HBASE-10788 URL: https://issues.apache.org/jira/browse/HBASE-10788 Project: HBase Issue Type: Improvement Affects Versions: 0.99.0 Reporter: Liu Shaohui Assignee: Liu Shaohui Priority: Minor Fix For: 0.99.0 Attachments: HBASE-10788-trunk-v1.diff, HBASE-10788-trunk-v2.diff, HBASE-10788-trunk-v3.diff In production env, 99th percentile of latency is more important than the avg. The 99th percentile is helpful to measure the influence of GC, slow read/write of HDFS. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10788) Add 99th percentile of latency in PE
[ https://issues.apache.org/jira/browse/HBASE-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shaohui updated HBASE-10788: Attachment: HBASE-10788-trunk-v3.diff Update for [~ndimiduk]'s review. Changes: a, clean some extra ws. b, remove redundant thread name in log c, make latency metric with sample rate and support the sample rate for all tests. Add 99th percentile of latency in PE Key: HBASE-10788 URL: https://issues.apache.org/jira/browse/HBASE-10788 Project: HBase Issue Type: Improvement Affects Versions: 0.99.0 Reporter: Liu Shaohui Assignee: Liu Shaohui Priority: Minor Attachments: HBASE-10788-trunk-v1.diff, HBASE-10788-trunk-v2.diff, HBASE-10788-trunk-v3.diff In production env, 99th percentile of latency is more important than the avg. The 99th percentile is helpful to measure the influence of GC, slow read/write of HDFS. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10788) Add 99th percentile of latency in PE
[ https://issues.apache.org/jira/browse/HBASE-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-10788: -- Affects Version/s: 0.99.0 Status: Patch Available (was: Open) Add 99th percentile of latency in PE Key: HBASE-10788 URL: https://issues.apache.org/jira/browse/HBASE-10788 Project: HBase Issue Type: Improvement Affects Versions: 0.99.0 Reporter: Liu Shaohui Assignee: Liu Shaohui Priority: Minor Attachments: HBASE-10788-trunk-v1.diff, HBASE-10788-trunk-v2.diff In production env, 99th percentile of latency is more important than the avg. The 99th percentile is helpful to measure the influence of GC, slow read/write of HDFS. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10788) Add 99th percentile of latency in PE
[
https://issues.apache.org/jira/browse/HBASE-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liu Shaohui updated HBASE-10788:
Attachment: HBASE-10788-trunk-v2.diff
Add an report of min, avg, 95th, 99th, and 99.9th, max atency for each test.
Sample output
{code}
2014-03-20 13:59:27,924 INFO [TestClient-2] hbase.PerformanceEvaluation:
client-TestClient-2 RandomWriteTest latency log (ms), on 10240 measures
2014-03-20 13:59:27,924 INFO [TestClient-2] hbase.PerformanceEvaluation:
client-TestClient-2 RandomWriteTest Min= 0.0
2014-03-20 13:59:27,924 INFO [TestClient-2] hbase.PerformanceEvaluation:
client-TestClient-2 RandomWriteTest Avg= 0.11376953125
2014-03-20 13:59:27,924 INFO [TestClient-2] hbase.PerformanceEvaluation:
client-TestClient-2 RandomWriteTest StdDev = 4.195329193206241
2014-03-20 13:59:27,924 INFO [TestClient-2] hbase.PerformanceEvaluation:
client-TestClient-2 RandomWriteTest 50th = 0.0
2014-03-20 13:59:27,925 INFO [TestClient-2] hbase.PerformanceEvaluation:
client-TestClient-2 RandomWriteTest 95th = 0.0
2014-03-20 13:59:27,925 INFO [TestClient-2] hbase.PerformanceEvaluation:
client-TestClient-2 RandomWriteTest 99th = 0.71000364
2014-03-20 13:59:27,925 INFO [TestClient-2] hbase.PerformanceEvaluation:
client-TestClient-2 RandomWriteTest 99.9th = 45.782015
2014-03-20 13:59:27,925 INFO [TestClient-2] hbase.PerformanceEvaluation:
client-TestClient-2 RandomWriteTest Max= 289.0
{code}
[~ndimiduk][~lhofhansl] [~apurtell]
Please help to review this patch. Thx
Add 99th percentile of latency in PE
Key: HBASE-10788
URL: https://issues.apache.org/jira/browse/HBASE-10788
Project: HBase
Issue Type: Improvement
Reporter: Liu Shaohui
Assignee: Liu Shaohui
Priority: Minor
Attachments: HBASE-10788-trunk-v1.diff, HBASE-10788-trunk-v2.diff
In production env, 99th percentile of latency is more important than the avg.
The 99th percentile is helpful to measure the influence of GC, slow
read/write of HDFS.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (HBASE-10788) Add 99th percentile of latency in PE
[ https://issues.apache.org/jira/browse/HBASE-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shaohui updated HBASE-10788: Attachment: HBASE-10788-trunk-v1.diff Patch for trunk Add 99th percentile of latency in PE Key: HBASE-10788 URL: https://issues.apache.org/jira/browse/HBASE-10788 Project: HBase Issue Type: Improvement Reporter: Liu Shaohui Assignee: Liu Shaohui Priority: Minor Attachments: HBASE-10788-trunk-v1.diff In production env, 99th percentile of latency is more important than the avg. The 99th percentile is helpful to measure the influence of GC, slow read/write of HDFS. -- This message was sent by Atlassian JIRA (v6.2#6252)
