[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[
https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980724#comment-13980724
]
stack commented on HBASE-11074:
---
[~ndimiduk] Good by you sir?
> Have PE emit histogram stats as it runs rather than dump once at end of test
>
>
> Key: HBASE-11074
> URL: https://issues.apache.org/jira/browse/HBASE-11074
> Project: HBase
> Issue Type: Improvement
> Components: Performance
>Reporter: stack
>Priority: Minor
> Attachments: 11074.txt
>
>
> PE emits progress reading and writing. Add to the progress emission current
> histogram snapshot readings. Means don' t have to wait till test completes
> to get idea of latencies. Here is sample:
> {code}
> 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79,
> 95th=1590.00, 99th=2950.68
> 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56,
> 95th=1543.00, 99th=2911.00
> 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96,
> 95th=1480.00, 99th=2863.00
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[
https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980766#comment-13980766
]
Hadoop QA commented on HBASE-11074:
---
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12641873/11074.txt
against trunk revision .
ATTACHMENT ID: 12641873
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified tests.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/9397//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/9397//console
This message is automatically generated.
> Have PE emit histogram stats as it runs rather than dump once at end of test
>
>
> Key: HBASE-11074
> URL: https://issues.apache.org/jira/browse/HBASE-11074
> Project: HBase
> Issue Type: Improvement
> Components: Performance
>Reporter: stack
>Assignee: stack
>Priority: Minor
> Attachments: 11074.txt
>
>
> PE emits progress reading and writing. Add to the progress emission current
> histogram snapshot readings. Means don' t have to wait till test completes
> to get idea of latencies. Here is sample:
> {code}
> 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79,
> 95th=1590.00, 99th=2950.68
> 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56,
> 95th=1543.00, 99th=2911.00
> 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96,
> 95th=1480.00, 99th=2863.00
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[
https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980996#comment-13980996
]
Nicolas Liochon commented on HBASE-11074:
-
+1
> Have PE emit histogram stats as it runs rather than dump once at end of test
>
>
> Key: HBASE-11074
> URL: https://issues.apache.org/jira/browse/HBASE-11074
> Project: HBase
> Issue Type: Improvement
> Components: Performance
>Reporter: stack
>Assignee: stack
>Priority: Minor
> Attachments: 11074.txt
>
>
> PE emits progress reading and writing. Add to the progress emission current
> histogram snapshot readings. Means don' t have to wait till test completes
> to get idea of latencies. Here is sample:
> {code}
> 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79,
> 95th=1590.00, 99th=2950.68
> 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56,
> 95th=1543.00, 99th=2911.00
> 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96,
> 95th=1480.00, 99th=2863.00
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[
https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981172#comment-13981172
]
Nick Dimiduk commented on HBASE-11074:
--
Good by me.
> Have PE emit histogram stats as it runs rather than dump once at end of test
>
>
> Key: HBASE-11074
> URL: https://issues.apache.org/jira/browse/HBASE-11074
> Project: HBase
> Issue Type: Improvement
> Components: Performance
>Reporter: stack
>Assignee: stack
>Priority: Minor
> Attachments: 11074.txt
>
>
> PE emits progress reading and writing. Add to the progress emission current
> histogram snapshot readings. Means don' t have to wait till test completes
> to get idea of latencies. Here is sample:
> {code}
> 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79,
> 95th=1590.00, 99th=2950.68
> 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56,
> 95th=1543.00, 99th=2911.00
> 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96,
> 95th=1480.00, 99th=2863.00
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[
https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981243#comment-13981243
]
Andrew Purtell commented on HBASE-11074:
+1 nice, please commit to all branches !
> Have PE emit histogram stats as it runs rather than dump once at end of test
>
>
> Key: HBASE-11074
> URL: https://issues.apache.org/jira/browse/HBASE-11074
> Project: HBase
> Issue Type: Improvement
> Components: Performance
>Reporter: stack
>Assignee: stack
>Priority: Minor
> Attachments: 11074.txt
>
>
> PE emits progress reading and writing. Add to the progress emission current
> histogram snapshot readings. Means don' t have to wait till test completes
> to get idea of latencies. Here is sample:
> {code}
> 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79,
> 95th=1590.00, 99th=2950.68
> 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56,
> 95th=1543.00, 99th=2911.00
> 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96,
> 95th=1480.00, 99th=2863.00
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[
https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981448#comment-13981448
]
Andrew Purtell commented on HBASE-11074:
Why not backport the histogram support? Should tools like this have the same
functionality cross branches so we can compare them?
> Have PE emit histogram stats as it runs rather than dump once at end of test
>
>
> Key: HBASE-11074
> URL: https://issues.apache.org/jira/browse/HBASE-11074
> Project: HBase
> Issue Type: Improvement
> Components: Performance
>Reporter: stack
>Assignee: stack
>Priority: Minor
> Fix For: 0.99.0
>
> Attachments: 11074.txt
>
>
> PE emits progress reading and writing. Add to the progress emission current
> histogram snapshot readings. Means don' t have to wait till test completes
> to get idea of latencies. Here is sample:
> {code}
> 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79,
> 95th=1590.00, 99th=2950.68
> 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56,
> 95th=1543.00, 99th=2911.00
> 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96,
> 95th=1480.00, 99th=2863.00
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[
https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981453#comment-13981453
]
stack commented on HBASE-11074:
---
bq. Why not backport the histogram support?
Sorry. Working on trunk. PE seems to be under a bit of churn at the moment
(folks are using it). Lets backport the whole thing when it settles.
> Have PE emit histogram stats as it runs rather than dump once at end of test
>
>
> Key: HBASE-11074
> URL: https://issues.apache.org/jira/browse/HBASE-11074
> Project: HBase
> Issue Type: Improvement
> Components: Performance
>Reporter: stack
>Assignee: stack
>Priority: Minor
> Fix For: 0.99.0
>
> Attachments: 11074.txt
>
>
> PE emits progress reading and writing. Add to the progress emission current
> histogram snapshot readings. Means don' t have to wait till test completes
> to get idea of latencies. Here is sample:
> {code}
> 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79,
> 95th=1590.00, 99th=2950.68
> 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56,
> 95th=1543.00, 99th=2911.00
> 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96,
> 95th=1480.00, 99th=2863.00
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[
https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981462#comment-13981462
]
Nick Dimiduk commented on HBASE-11074:
--
According to git, 0.96 and 0.98 have equivalent patches applied. Trunk is ahead
by at least: HBASE-11055, HBASE-11026, HBASE-11000, HBASE-11000, HBASE-10997,
HBASE-10788.
> Have PE emit histogram stats as it runs rather than dump once at end of test
>
>
> Key: HBASE-11074
> URL: https://issues.apache.org/jira/browse/HBASE-11074
> Project: HBase
> Issue Type: Improvement
> Components: Performance
>Reporter: stack
>Assignee: stack
>Priority: Minor
> Fix For: 0.99.0
>
> Attachments: 11074.txt
>
>
> PE emits progress reading and writing. Add to the progress emission current
> histogram snapshot readings. Means don' t have to wait till test completes
> to get idea of latencies. Here is sample:
> {code}
> 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79,
> 95th=1590.00, 99th=2950.68
> 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56,
> 95th=1543.00, 99th=2911.00
> 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96,
> 95th=1480.00, 99th=2863.00
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[
https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981487#comment-13981487
]
Hudson commented on HBASE-11074:
FAILURE: Integrated in HBase-TRUNK #5117 (See
[https://builds.apache.org/job/HBase-TRUNK/5117/])
HBASE-11074 Have PE emit histogram stats as it runs rather than dump once at
end of test (stack: rev 1590085)
*
/hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
> Have PE emit histogram stats as it runs rather than dump once at end of test
>
>
> Key: HBASE-11074
> URL: https://issues.apache.org/jira/browse/HBASE-11074
> Project: HBase
> Issue Type: Improvement
> Components: Performance
>Reporter: stack
>Assignee: stack
>Priority: Minor
> Fix For: 0.99.0
>
> Attachments: 11074.txt
>
>
> PE emits progress reading and writing. Add to the progress emission current
> histogram snapshot readings. Means don' t have to wait till test completes
> to get idea of latencies. Here is sample:
> {code}
> 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79,
> 95th=1590.00, 99th=2950.68
> 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56,
> 95th=1543.00, 99th=2911.00
> 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96,
> 95th=1480.00, 99th=2863.00
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[
https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981496#comment-13981496
]
Andrew Purtell commented on HBASE-11074:
Thanks [~stack] and [~ndimiduk]. I filed HBASE-11079 and will look for more
related.
> Have PE emit histogram stats as it runs rather than dump once at end of test
>
>
> Key: HBASE-11074
> URL: https://issues.apache.org/jira/browse/HBASE-11074
> Project: HBase
> Issue Type: Improvement
> Components: Performance
>Reporter: stack
>Assignee: stack
>Priority: Minor
> Fix For: 0.99.0
>
> Attachments: 11074.txt
>
>
> PE emits progress reading and writing. Add to the progress emission current
> histogram snapshot readings. Means don' t have to wait till test completes
> to get idea of latencies. Here is sample:
> {code}
> 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79,
> 95th=1590.00, 99th=2950.68
> 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56,
> 95th=1543.00, 99th=2911.00
> 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation:
> 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96,
> 95th=1480.00, 99th=2863.00
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
