[
https://issues.apache.org/jira/browse/HBASE-8228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13618148#comment-13618148
]
Amitanand Aiyer commented on HBASE-8228:
----------------------------------------
Yeah, I start the timer once we grab the write lock for the update lock; until
it is released.
Most of the times the value is 0 ms. But sometimes it is as high as 225 sec.
Here are some log lines, across various clusters. (removed the machine names
part).
: 2013-03-29 16:17:29,420 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 4679 ms.
: 2013-03-29 16:17:31,231 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 6481 ms.
: 2013-03-29 16:17:32,421 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 7667 ms.
: 2013-03-29 16:17:34,640 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 9882 ms.
: 2013-03-29 16:17:37,864 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 13101 ms.
: 2013-03-29 16:17:45,824 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 14414 ms.
: 2013-03-29 16:17:44,076 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 14479 ms.
: 2013-03-29 16:17:47,361 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 14814 ms.
: 2013-03-29 16:17:42,829 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 14982 ms.
: 2013-03-29 16:17:39,923 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 15160 ms.
: 2013-03-26 01:32:22,441 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 7819 ms.
: 2013-03-26 01:32:24,770 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 7873 ms.
: 2013-03-26 13:42:08,474 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 8470 ms.
: 2013-03-25 13:30:30,404 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 8565 ms.
: 2013-03-26 01:32:24,056 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 9422 ms.
: 2013-03-29 23:39:23,840 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 9824 ms.
: 2013-03-25 13:30:32,207 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 10368 ms.
: 2013-03-25 13:30:33,620 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 11781 ms.
: 2013-03-25 13:30:36,327 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 14488 ms.
: 2013-03-25 13:30:38,915 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 14719 ms.
: 2013-03-20 15:16:24,890 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 7543 ms.
: 2013-03-20 15:16:22,730 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 7641 ms.
: 2013-03-27 00:20:06,791 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 7748 ms.
: 2013-03-25 05:06:32,657 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 7773 ms.
: 2013-03-20 15:16:25,790 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 7843 ms.
: 2013-03-27 00:20:05,957 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 7972 ms.
: 2013-03-20 15:16:29,719 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 8518 ms.
: 2013-03-20 15:16:28,645 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 8707 ms.
: 2013-03-20 15:16:27,764 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 8965 ms.
: 2013-03-27 00:20:04,811 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 11526 ms.
: 2013-03-17 10:32:29,415 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 5043 ms.
: 2013-03-17 10:32:28,687 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 5487 ms.
: 2013-03-17 10:32:31,868 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 5497 ms.
: 2013-03-17 10:32:31,445 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 5598 ms.
: 2013-03-17 10:32:30,617 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 5635 ms.
: 2013-03-17 10:32:28,159 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 6355 ms.
: 2013-03-17 10:32:27,035 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 6391 ms.
: 2013-03-17 10:32:26,273 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 7039 ms.
: 2013-03-17 10:32:25,747 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 7097 ms.
: 2013-03-17 10:32:24,851 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
Finished snapshotting. Held region-wide updates lock for 8349 ms.
,60020,1364409296334.cacheFlusher.1] DEBUG
org.apache.hadoop.hbase.regionserver.HRegion: Finished snapshotting. Held
region-wide updates lock for 94859 ms.
,60020,1364409296754.cacheFlusher.0] DEBUG
org.apache.hadoop.hbase.regionserver.HRegion: Finished snapshotting. Held
region-wide updates lock for 97814 ms.
,60020,1364409297006.cacheFlusher.1] DEBUG
org.apache.hadoop.hbase.regionserver.HRegion: Finished snapshotting. Held
region-wide updates lock for 104621 ms.
,60020,1364409292493.cacheFlusher.0] DEBUG
org.apache.hadoop.hbase.regionserver.HRegion: Finished snapshotting. Held
region-wide updates lock for 105046 ms.
,60020,1364409295677.cacheFlusher.0] DEBUG
org.apache.hadoop.hbase.regionserver.HRegion: Finished snapshotting. Held
region-wide updates lock for 116958 ms.
,60020,1364409297314.cacheFlusher.1] DEBUG
org.apache.hadoop.hbase.regionserver.HRegion: Finished snapshotting. Held
region-wide updates lock for 131425 ms.
,60020,1364409297449.cacheFlusher.0] DEBUG
org.apache.hadoop.hbase.regionserver.HRegion: Finished snapshotting. Held
region-wide updates lock for 134293 ms.
,60020,1364409294933.cacheFlusher.0] DEBUG
org.apache.hadoop.hbase.regionserver.HRegion: Finished snapshotting. Held
region-wide updates lock for 165076 ms.
,60020,1364409291262.cacheFlusher.1] DEBUG
org.apache.hadoop.hbase.regionserver.HRegion: Finished snapshotting. Held
region-wide updates lock for 216242 ms.
,60020,1364409296374.cacheFlusher.0] DEBUG
org.apache.hadoop.hbase.regionserver.HRegion: Finished snapshotting. Held
region-wide updates lock for 223500 ms.
> Investigate time taken to snapshot memstore
> -------------------------------------------
>
> Key: HBASE-8228
> URL: https://issues.apache.org/jira/browse/HBASE-8228
> Project: HBase
> Issue Type: Sub-task
> Reporter: Amitanand Aiyer
> Assignee: Amitanand Aiyer
> Priority: Minor
> Fix For: 0.89-fb
>
>
> Snapshotting memstores is normally quick. But, sometimes it seems to take
> long. This JIRA is to track the investigation and fix to improve the outliers.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
