Hi,
I am pasting the region server logs:
2009-04-08 00:06:26,378 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
5427021309867584920 lease expired
2009-04-08 00:16:23,641 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
-3894991203345155244 lease expired
2009-04-08 00:29:08,402 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
651295424715622118 lease expired
2009-04-08 00:39:05,430 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
-2734117247134548430 lease expired
2009-04-08 00:46:35,515 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
2810685965461882801 lease expired
2009-04-08 00:56:38,289 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
9085655909080042643 lease expired
2009-04-08 01:06:36,035 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
5701864683466148562 lease expired
2009-04-08 03:13:02,545 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
-2157771707879192919 lease expired
2009-04-08 03:29:24,603 ERROR
org.apache.hadoop.hbase.regionserver.HRegionServer:
org.apache.hadoop.hbase.UnknownScannerException: Name: -2157771707879192919
2009-04-08 03:29:24,606 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server
handler 0 on 60020, call next(-2157771707879192919, 30) from
10.250.6.4:37602: error: org.apache.hadoop.hbase.UnknownScannerException:
Name: -2157771707879192919
org.apache.hadoop.hbase.UnknownScannerException: Name: -2157771707879192919
at
org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1568)
at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:632)
at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:895)
2009-04-08 03:29:24,655 ERROR
org.apache.hadoop.hbase.regionserver.HRegionServer: org.apache.hadoop.h Sent
at 15:17 on Wednesday
What i believe is at the region server... scanner lease expires for scanner
id SCANNER_ID [which happens @ 3:13]
and then my map reduce program is calling a next() which takes this
SCANNER_ID and hence we get this scanner timeout exception/unknown scanner
exception. [this happens at 3:24]
How do i avoid succha situation?
Thanks,
Raakhi
On Wed, Apr 8, 2009 at 2:03 PM, Rakhi Khatwani <rakhi.khatw...@gmail.com>wrote:
> Hi,
> I am using hbase-0.19 on 20 node ec2 cluster.
> I have a map-reduce program which performs some analysis on each row.
> when i process about 17k rows in ec2 cluster, after performing 65%, my job
> fails
> after going through the logs, in the UI we found out that the job failed
> because of a Scanner Timeout Exception.
>
> My map function reads data from one table 'table1' performs analysis, if
> analysis is completed, i mark the status of the row to 'analyzed' (table1
> has a column-family called status). and i write the result of the analyzed
> data into table2. (All this happens in my map function. i have no reduce for
> this).
>
> i did go through the archives.. where someone mentioned to increase the
> reagion lease period. so i increased the lease period to 360000 ms (1 hour).
> despite that i came across Scanner Timeout Exception.
>
> Your help will be greatly appreciated as this scanner timeout exception is
> a blocker to my application.
>
> Thanks,
> Raakhi
>
>
>
>
