[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[ https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980724#comment-13980724 ] stack commented on HBASE-11074: --- [~ndimiduk] Good by you sir? > Have PE emit histogram stats as it runs rather than dump once at end of test > > > Key: HBASE-11074 > URL: https://issues.apache.org/jira/browse/HBASE-11074 > Project: HBase > Issue Type: Improvement > Components: Performance >Reporter: stack >Priority: Minor > Attachments: 11074.txt > > > PE emits progress reading and writing. Add to the progress emission current > histogram snapshot readings. Means don' t have to wait till test completes > to get idea of latencies. Here is sample: > {code} > 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79, > 95th=1590.00, 99th=2950.68 > 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56, > 95th=1543.00, 99th=2911.00 > 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96, > 95th=1480.00, 99th=2863.00 > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[ https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980766#comment-13980766 ] Hadoop QA commented on HBASE-11074: --- {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12641873/11074.txt against trunk revision . ATTACHMENT ID: 12641873 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 3 new or modified tests. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:green}+1 site{color}. The mvn site goal succeeds with this patch. {color:green}+1 core tests{color}. The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/9397//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9397//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/9397//console This message is automatically generated. > Have PE emit histogram stats as it runs rather than dump once at end of test > > > Key: HBASE-11074 > URL: https://issues.apache.org/jira/browse/HBASE-11074 > Project: HBase > Issue Type: Improvement > Components: Performance >Reporter: stack >Assignee: stack >Priority: Minor > Attachments: 11074.txt > > > PE emits progress reading and writing. Add to the progress emission current > histogram snapshot readings. Means don' t have to wait till test completes > to get idea of latencies. Here is sample: > {code} > 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79, > 95th=1590.00, 99th=2950.68 > 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56, > 95th=1543.00, 99th=2911.00 > 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96, > 95th=1480.00, 99th=2863.00 > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[ https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980996#comment-13980996 ] Nicolas Liochon commented on HBASE-11074: - +1 > Have PE emit histogram stats as it runs rather than dump once at end of test > > > Key: HBASE-11074 > URL: https://issues.apache.org/jira/browse/HBASE-11074 > Project: HBase > Issue Type: Improvement > Components: Performance >Reporter: stack >Assignee: stack >Priority: Minor > Attachments: 11074.txt > > > PE emits progress reading and writing. Add to the progress emission current > histogram snapshot readings. Means don' t have to wait till test completes > to get idea of latencies. Here is sample: > {code} > 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79, > 95th=1590.00, 99th=2950.68 > 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56, > 95th=1543.00, 99th=2911.00 > 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96, > 95th=1480.00, 99th=2863.00 > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[ https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981172#comment-13981172 ] Nick Dimiduk commented on HBASE-11074: -- Good by me. > Have PE emit histogram stats as it runs rather than dump once at end of test > > > Key: HBASE-11074 > URL: https://issues.apache.org/jira/browse/HBASE-11074 > Project: HBase > Issue Type: Improvement > Components: Performance >Reporter: stack >Assignee: stack >Priority: Minor > Attachments: 11074.txt > > > PE emits progress reading and writing. Add to the progress emission current > histogram snapshot readings. Means don' t have to wait till test completes > to get idea of latencies. Here is sample: > {code} > 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79, > 95th=1590.00, 99th=2950.68 > 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56, > 95th=1543.00, 99th=2911.00 > 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96, > 95th=1480.00, 99th=2863.00 > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[ https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981243#comment-13981243 ] Andrew Purtell commented on HBASE-11074: +1 nice, please commit to all branches ! > Have PE emit histogram stats as it runs rather than dump once at end of test > > > Key: HBASE-11074 > URL: https://issues.apache.org/jira/browse/HBASE-11074 > Project: HBase > Issue Type: Improvement > Components: Performance >Reporter: stack >Assignee: stack >Priority: Minor > Attachments: 11074.txt > > > PE emits progress reading and writing. Add to the progress emission current > histogram snapshot readings. Means don' t have to wait till test completes > to get idea of latencies. Here is sample: > {code} > 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79, > 95th=1590.00, 99th=2950.68 > 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56, > 95th=1543.00, 99th=2911.00 > 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96, > 95th=1480.00, 99th=2863.00 > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[ https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981448#comment-13981448 ] Andrew Purtell commented on HBASE-11074: Why not backport the histogram support? Should tools like this have the same functionality cross branches so we can compare them? > Have PE emit histogram stats as it runs rather than dump once at end of test > > > Key: HBASE-11074 > URL: https://issues.apache.org/jira/browse/HBASE-11074 > Project: HBase > Issue Type: Improvement > Components: Performance >Reporter: stack >Assignee: stack >Priority: Minor > Fix For: 0.99.0 > > Attachments: 11074.txt > > > PE emits progress reading and writing. Add to the progress emission current > histogram snapshot readings. Means don' t have to wait till test completes > to get idea of latencies. Here is sample: > {code} > 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79, > 95th=1590.00, 99th=2950.68 > 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56, > 95th=1543.00, 99th=2911.00 > 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96, > 95th=1480.00, 99th=2863.00 > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[ https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981453#comment-13981453 ] stack commented on HBASE-11074: --- bq. Why not backport the histogram support? Sorry. Working on trunk. PE seems to be under a bit of churn at the moment (folks are using it). Lets backport the whole thing when it settles. > Have PE emit histogram stats as it runs rather than dump once at end of test > > > Key: HBASE-11074 > URL: https://issues.apache.org/jira/browse/HBASE-11074 > Project: HBase > Issue Type: Improvement > Components: Performance >Reporter: stack >Assignee: stack >Priority: Minor > Fix For: 0.99.0 > > Attachments: 11074.txt > > > PE emits progress reading and writing. Add to the progress emission current > histogram snapshot readings. Means don' t have to wait till test completes > to get idea of latencies. Here is sample: > {code} > 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79, > 95th=1590.00, 99th=2950.68 > 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56, > 95th=1543.00, 99th=2911.00 > 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96, > 95th=1480.00, 99th=2863.00 > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[ https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981462#comment-13981462 ] Nick Dimiduk commented on HBASE-11074: -- According to git, 0.96 and 0.98 have equivalent patches applied. Trunk is ahead by at least: HBASE-11055, HBASE-11026, HBASE-11000, HBASE-11000, HBASE-10997, HBASE-10788. > Have PE emit histogram stats as it runs rather than dump once at end of test > > > Key: HBASE-11074 > URL: https://issues.apache.org/jira/browse/HBASE-11074 > Project: HBase > Issue Type: Improvement > Components: Performance >Reporter: stack >Assignee: stack >Priority: Minor > Fix For: 0.99.0 > > Attachments: 11074.txt > > > PE emits progress reading and writing. Add to the progress emission current > histogram snapshot readings. Means don' t have to wait till test completes > to get idea of latencies. Here is sample: > {code} > 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79, > 95th=1590.00, 99th=2950.68 > 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56, > 95th=1543.00, 99th=2911.00 > 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96, > 95th=1480.00, 99th=2863.00 > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[ https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981487#comment-13981487 ] Hudson commented on HBASE-11074: FAILURE: Integrated in HBase-TRUNK #5117 (See [https://builds.apache.org/job/HBase-TRUNK/5117/]) HBASE-11074 Have PE emit histogram stats as it runs rather than dump once at end of test (stack: rev 1590085) * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java > Have PE emit histogram stats as it runs rather than dump once at end of test > > > Key: HBASE-11074 > URL: https://issues.apache.org/jira/browse/HBASE-11074 > Project: HBase > Issue Type: Improvement > Components: Performance >Reporter: stack >Assignee: stack >Priority: Minor > Fix For: 0.99.0 > > Attachments: 11074.txt > > > PE emits progress reading and writing. Add to the progress emission current > histogram snapshot readings. Means don' t have to wait till test completes > to get idea of latencies. Here is sample: > {code} > 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79, > 95th=1590.00, 99th=2950.68 > 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56, > 95th=1543.00, 99th=2911.00 > 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96, > 95th=1480.00, 99th=2863.00 > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11074) Have PE emit histogram stats as it runs rather than dump once at end of test
[ https://issues.apache.org/jira/browse/HBASE-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981496#comment-13981496 ] Andrew Purtell commented on HBASE-11074: Thanks [~stack] and [~ndimiduk]. I filed HBASE-11079 and will look for more related. > Have PE emit histogram stats as it runs rather than dump once at end of test > > > Key: HBASE-11074 > URL: https://issues.apache.org/jira/browse/HBASE-11074 > Project: HBase > Issue Type: Improvement > Components: Performance >Reporter: stack >Assignee: stack >Priority: Minor > Fix For: 0.99.0 > > Attachments: 11074.txt > > > PE emits progress reading and writing. Add to the progress emission current > histogram snapshot readings. Means don' t have to wait till test completes > to get idea of latencies. Here is sample: > {code} > 2014-04-24 22:47:28,085 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/188730/1048576, Min=137.00, Mean=578.74, Max=5152756.00, StdDev=11884.79, > 95th=1590.00, 99th=2950.68 > 2014-04-24 22:47:32,465 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/199215/1048576, Min=137.00, Mean=570.19, Max=5152756.00, StdDev=11591.56, > 95th=1543.00, 99th=2911.00 > 2014-04-24 22:47:37,334 INFO [TestClient-0] hbase.PerformanceEvaluation: > 0/209700/1048576, Min=137.00, Mean=564.80, Max=5152756.00, StdDev=11317.96, > 95th=1480.00, 99th=2863.00 > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)