Re: sporadic hbase "outages"

2016-03-29 Thread feedly team
The stack traces of the region servers during the mapper executions didn't really show much activity. Thus we are focusing on getting a region server stack trace during the slow downs during regular application activity. It's still in progress, but we have captured a few traces where all the ipc

Re: sporadic hbase "outages"

2016-03-22 Thread Ted Yu
bq. a small number will take 20 minutes or more Were these mappers performing selective scan on big regions ? Can you pastebin the stack trace of region server(s) which served such regions during slow mapper operation ? Pastebin of region server log would also give us more clue. On Tue, Mar

sporadic hbase "outages"

2016-03-22 Thread feedly team
Recently we have been experiencing short downtimes (~2-5 minutes) in our hbase cluster and are trying to understand why. Many times we have HLog write spikes around the down times, but not always. Not sure if this is a red herring. We have looked a bit farther back in time and have noticed many