hbase version HBase 1.2.0-cdh5.7.2
java version "1.7.0_75" Java(TM) SE Runtime Environment (build 1.7.0_75-b13) Java HotSpot(TM) 64-Bit Server VM (build 24.75-b04, mixed mode) From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Thursday, March 02, 2017 10:07 AM To: Motty Cruz; user@hbase.apache.org Subject: Re: last exception: java.io.IOException: Call to e26-node.fqdn.com/10.12.1.209:60020 failed on local exception Dropping hadoop ML. This should be directed to user@hbase. Which hbase release are you using ? On Thu, Mar 2, 2017 at 10:02 AM, Motty Cruz <motty.c...@gmail.com> wrote: Hello, in the past two weeks, I see the following error on HBase Thrift servers, we have total of about 10 Thrift servers and randomly get the following errors: 2017-02-28 10:45:56,541 INFO org.apache.hadoop.hbase.client.AsyncProcess: #4087940, table=MBData, attempt=11/35 failed=2ops, last exception: ja va.io.IOException: Call to e26-node.fqdn.com/10.12.1.209:60020 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutExcepti on: Call id=36009061, waitTime=180001, operationTimeout=180000 expired. on e26-node.fqdn.com,60020,1487800633128, tracking started null, retrying after=10060ms, replay=2ops 2017-02-28 10:45:57,207 INFO org.apache.hadoop.hbase.client.AsyncProcess: #4084675, waiting for some tasks to finish. Expected max=0, tasksInPro gress=22 Restarting the Thrift server resolves the issue. Any ideas where should I be looking for? Thanks, Motty