[ https://issues.apache.org/jira/browse/HBASE-6980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13476595#comment-13476595 ]
Kannan Muthukkaruppan commented on HBASE-6980: ---------------------------------------------- Thanks for the pointer-- wasn't aware of the JIRA. I am ok with closing this as a dup, or keep this for the 89-fb patch as the code base is slightly different in some of the parts. (I think HBASE-6466 description doesn't adequately capture the motivation/wins we can get from this, especially for WAL-less ingest type use case. But we can update the description for that JIRA to reflect those aspects). I will check the patch to see how Chunhui is getting around the locks. > Parallel Flushing Of Memstores > ------------------------------ > > Key: HBASE-6980 > URL: https://issues.apache.org/jira/browse/HBASE-6980 > Project: HBase > Issue Type: New Feature > Reporter: Kannan Muthukkaruppan > Assignee: Kannan Muthukkaruppan > > For write dominated workloads, single threaded memstore flushing is an > unnecessary bottleneck. With a single flusher thread, we are basically not > setup to take advantage of the aggregate throughput that multi-disk nodes > provide. > * For puts with WAL enabled, the bottleneck is more likely the "single" WAL > per region server. So this particular fix may not buy as much unless we > unlock that bottleneck with multiple commit logs per region server. (Topic > for a separate JIRA-- HBASE-6981). > * But for puts with WAL disabled (e.g., when using HBASE-5783 style fast bulk > imports), we should be able to support much better ingest rates with parallel > flushing of memstores. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira