[
https://issues.apache.org/jira/browse/HBASE-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13576244#comment-13576244
]
Jeffrey Zhong commented on HBASE-7006:
--------------------------------------
The big table approach is kind of middle ground approach between the existing
implementation and the proposal in the JIRA. The file block implementation
seems need more work though. Each region server has to read all those newly
created block files to replay edits but cut writes significantly so it should
have improvements over existing approach(not the new proposal as it still read
recovery data twice: one is in log splitting and the other is in replay phase
and incur some extra writes).
Thanks,
-Jeffrey
> [MTTR] Study distributed log splitting to see how we can make it faster
> -----------------------------------------------------------------------
>
> Key: HBASE-7006
> URL: https://issues.apache.org/jira/browse/HBASE-7006
> Project: HBase
> Issue Type: Bug
> Reporter: stack
> Assignee: Jeffrey Zhong
> Fix For: 0.96.0
>
> Attachments: LogSplitting Comparison.pdf,
> ProposaltoimprovelogsplittingprocessregardingtoHBASE-7006.pdf
>
>
> Just saw interesting issue where a cluster went down hard and 30 nodes had
> 1700 WALs to replay. Replay took almost an hour. It looks like it could run
> faster that much of the time is spent zk'ing and nn'ing.
> Putting in 0.96 so it gets a look at least. Can always punt.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
