edward yoon wrote:
Hmm. I see.
Now i see the 165 line at TableInputFormat.
Can map number be operated with a setNumMapTasks() method?
What is the current split policy?
See how the method at line 165 makes a split per region found.
See JobClient #575 inside submitJobs. Looks like it sets number of maps
to be splits.length.
St.Ack
On 2/18/08, stack <[EMAIL PROTECTED]> wrote:
Probably that the lease expired on the scanner your map or reduce task
was using. Any other exceptions in the log or does the processing of
the data to put into hbase take a long time to do?
St.Ack
edward yoon wrote:
I tried scan a 1 thousand * 1 thousand table twice on mapreduce.
BTW, What is this exception mean?
----
08/02/18 11:34:53 INFO mapred.JobClient: Task Id :
task_200802181109_0002_m_000000_1, Status : FAILED
org.apache.hadoop.hbase.UnknownScannerException:
org.apache.hadoop.hbase.UnknownScannerException: -4925937627020823950
at org.apache.hadoop.hbase.HRegionServer.close(HRegionServer.java:1543)
at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:910)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method) at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82)
at org.apache.hadoop.hbase.HTable$ClientScanner.close(HTable.java:1169)
at
org.apache.hadoop.hama.mapred.TableInputFormat$TableRecordReader.close(Unknown
Source)
at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.close(MapTask.java:155)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:212)
at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2065)
