Have you tried increasing the value of hbase.client.scanner.timeout.period (default 60000) ?
On Fri, Sep 9, 2016 at 11:06 AM, marjana <mivko...@us.ibm.com> wrote: > Hi, > I am trying to copy a table from one cluster to another. This worked fine > for smaller tables, but trying to copy a few of the larger ones, I keep > getting ScannerTimeoutException. It fails at the very end, when it is 98% > complete. Sample from the log: > 2016-09-09 17:50:19,065 WARN [Thread-25] mapred.LocalJobRunner: > job_local2143790046_0001 > java.lang.Exception: org.apache.hadoop.hbase.client. > ScannerTimeoutException: > 170435ms passed since the last invocation, timeout is currently set to > 60000 > at > org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks( > LocalJobRunner.java:462) > at > org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522) > This is Hbase version 1.2.0. > I did presplit table on the destination cluster. > I tried setting hbase.client.scanner.caching to 1000, but still I get the > timeout exception. > This is not very large table, 400g raw data, some 354068412 rows, only 1 > column family. > Anything else I could try? > Thanks > Marjana > > > > > -- > View this message in context: http://apache-hbase.679495.n3. > nabble.com/copyTable-mapreduce-job-failing-with-ScannerTimeoutException- > tp4082544.html > Sent from the HBase User mailing list archive at Nabble.com. >
