Hi,
I am trying to copy a table from one cluster to another. This worked fine
for smaller tables, but trying to copy a few of the larger ones, I keep
getting ScannerTimeoutException. It fails at the very end, when it is 98%
complete. Sample from the log:
2016-09-09 17:50:19,065 WARN [Thread-25] mapred.LocalJobRunner:
job_local2143790046_0001
java.lang.Exception: org.apache.hadoop.hbase.client.ScannerTimeoutException:
170435ms passed since the last invocation, timeout is currently set to 60000
at
org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
This is Hbase version 1.2.0.
I did presplit table on the destination cluster.
I tried setting hbase.client.scanner.caching to 1000, but still I get the
timeout exception.
This is not very large table, 400g raw data, some 354068412 rows, only 1
column family.
Anything else I could try?
Thanks
Marjana
--
View this message in context:
http://apache-hbase.679495.n3.nabble.com/copyTable-mapreduce-job-failing-with-ScannerTimeoutException-tp4082544.html
Sent from the HBase User mailing list archive at Nabble.com.
