[ https://issues.apache.org/jira/browse/HBASE-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12908119#action_12908119 ]
Todd Lipcon commented on HBASE-2981: ------------------------------------ Another idea that has been bandied about is changing the current "blocking store files" behavior to something that's more like a squishy pillow instead of a brick wall. That is to say, as we start to approach the "blocking" limit number of store files, we add some "friction" to writes going into that region. This way writes will slow down and give the compaction queue some time to catch up. Basically we want to smoothly throttle the overall request rate to something we can consistently handle, rather than letting everyone write like crazy and then throw up a wall while we catch up. > Improve consistency of performance during heavy load > ---------------------------------------------------- > > Key: HBASE-2981 > URL: https://issues.apache.org/jira/browse/HBASE-2981 > Project: HBase > Issue Type: Task > Components: regionserver > Reporter: Todd Lipcon > > Currently when running load tests like YCSB, we experience periods of > complete cluster inactivity while all clients are blocked on a single region > which is unavailable. > As discussed recently on the list, we should brainstorm some ideas for how to > improve the situation: the goal here is to (a) minimize the amount of time > when a region is inaccessible, and (b) minimize the impact that one > inaccessible region has on other operations in the cluster. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.