[ https://issues.apache.org/jira/browse/HBASE-6018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277237#comment-13277237 ]
Lars Hofhansl commented on HBASE-6018: -------------------------------------- ThreadPoolExecutor is pretty stupid (if you ask me). Unless the Queue fills up it will never allocate more than threads than indicated by the number of core threads. The LinkedBlockingQueue has no limit, so it'll only ever use conf.getInt("hbasefsck.numthreads") number of threads. > hbck fails with a RejectedExecutionException > -------------------------------------------- > > Key: HBASE-6018 > URL: https://issues.apache.org/jira/browse/HBASE-6018 > Project: HBase > Issue Type: Bug > Affects Versions: 0.92.1, 0.94.0 > Reporter: Jonathan Hsieh > Assignee: Jonathan Hsieh > Attachments: hbase-6018.patch > > > On a long running job 0.94.0rc3 cluster, we get to a point where hbck > consistently encounters this error and fails: > {code} > Exception in thread "main" java.util.concurrent.RejectedExecutionException > at > java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:1768) > at > java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:767) > at > java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:658) > at > org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:633) > at > org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:354) > at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:382) > at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:3120) > {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira