Dru, It may be also caused by a compaction going on (or a flush). Best way to be sure is to up the regionserver lease timeout. Default is 30 seconds but I recommend 60 seconds for MR jobs. See if this works for you.
J-D On Mon, Aug 11, 2008 at 6:34 PM, Dru Jensen <[EMAIL PROTECTED]> wrote: > Hi J-D, > > I watched as one of the map tasks completed successfully. Another one was > launched as a child of the second MR task. then I get the Unknown Scanner > Exception: > org.apache.hadoop.hbase.UnknownScannerException: > org.apache.hadoop.hbase.UnknownScannerException: Name: -463563612898654250 > at > org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1115) > at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:473) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896) > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at > org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82) > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:885) > at > org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1321) > at > org.apache.hadoop.hbase.mapred.TableInputFormatBase$TableRecordReader.next(TableInputFormatBase.java:202) > at > org.apache.hadoop.hbase.mapred.TableInputFormatBase$TableRecordReader.next(TableInputFormatBase.java:84) > at > org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:158) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:45) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219) > at > org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124) > I checked the table in the UI but it still only shows 4 regions. Up to > this point, I have not been able to get this process to complete so I think > there is more to this than just a failing task. After re-running the task, > I continued to get the same error. > > By creating an intermediary table, The map/reduce process completed > successfully. > > Thanks again for your help. > Dru > > > On Aug 11, 2008, at 1:09 PM, Jean-Daniel Cryans wrote: > > Dru, >> >> Using another table, but we're still not so sure that it does something >> bad >> apart from restarting the Map task (see the discussion between sebastien >> and >> stack in 810). >> >> J-D >> >> On Mon, Aug 11, 2008 at 3:58 PM, Dru Jensen <[EMAIL PROTECTED]> wrote: >> >> J-D, >>> >>> I have 4 regions for this table all on the same server. >>> >>> It looks like it may be related. I have started another test and will >>> verify. >>> >>> Is there a fix for this issue or should I create a intermediary table for >>> now? >>> >>> thanks, >>> Dru >>> >>> >>> On Aug 11, 2008, at 11:54 AM, Jean-Daniel Cryans wrote: >>> >>> Dru, >>> >>>> >>>> Apart from doing a 'tail' on all your region server logs, watching your >>>> number of regions in the web UI. How many regions do you have currently >>>> in >>>> your table? >>>> >>>> J-D >>>> >>>> On Mon, Aug 11, 2008 at 2:52 PM, Dru Jensen <[EMAIL PROTECTED]> >>>> wrote: >>>> >>>> Hi J-D, >>>> >>>>> >>>>> I am writing to the same table that I'm scanning, however I get this >>>>> often >>>>> and would be surprised if its caused by a split. >>>>> >>>>> How can I determine if a split is occurring? >>>>> >>>>> thanks, >>>>> Dru >>>>> >>>>> >>>>> On Aug 11, 2008, at 11:35 AM, Jean-Daniel Cryans wrote: >>>>> >>>>> Dru, >>>>> >>>>> >>>>>> Can you tell me if your situation is the same on as in >>>>>> https://issues.apache.org/jira/browse/HBASE-810 >>>>>> >>>>>> Thx, >>>>>> >>>>>> J-D >>>>>> >>>>>> On Mon, Aug 11, 2008 at 2:35 PM, Dru Jensen <[EMAIL PROTECTED]> >>>>>> wrote: >>>>>> >>>>>> What causes the following error? It's coming from the >>>>>> >>>>>> TableInputFormatBase >>>>>>> class. It seems to be fairly random for me. >>>>>>> >>>>>>> From what I've read so far, its related to a timeout error? I >>>>>>> verified >>>>>>> my >>>>>>> map task doesn't take long to process. Anything else that may cause >>>>>>> this? >>>>>>> >>>>>>> org.apache.hadoop.hbase.UnknownScannerException: >>>>>>> org.apache.hadoop.hbase.UnknownScannerException: Name: >>>>>>> 4797186499140551292 >>>>>>> at >>>>>>> >>>>>>> >>>>>>> >>>>>>> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1115) >>>>>>> at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source) >>>>>>> at >>>>>>> >>>>>>> >>>>>>> >>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >>>>>>> at java.lang.reflect.Method.invoke(Method.java:597) >>>>>>> at >>>>>>> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:473) >>>>>>> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896) >>>>>>> >>>>>>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native >>>>>>> Method) >>>>>>> at >>>>>>> >>>>>>> >>>>>>> >>>>>>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) >>>>>>> at >>>>>>> >>>>>>> >>>>>>> >>>>>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) >>>>>>> at java.lang.reflect.Constructor.newInstance(Constructor.java:513) >>>>>>> at >>>>>>> >>>>>>> >>>>>>> >>>>>>> org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82) >>>>>>> at >>>>>>> >>>>>>> >>>>>>> >>>>>>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:885) >>>>>>> at >>>>>>> >>>>>>> >>>>>>> >>>>>>> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1321) >>>>>>> at >>>>>>> >>>>>>> >>>>>>> >>>>>>> org.apache.hadoop.hbase.mapred.TableInputFormatBase$TableRecordReader.next(TableInputFormatBase.java:202) >>>>>>> at >>>>>>> >>>>>>> >>>>>>> >>>>>>> org.apache.hadoop.hbase.mapred.TableInputFormatBase$TableRecordReader.next(TableInputFormatBase.java:84) >>>>>>> at >>>>>>> >>>>>>> >>>>>>> >>>>>>> org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:158) >>>>>>> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:45) >>>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219) >>>>>>> at >>>>>>> >>>>>>> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124) >>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>> >>> >
