Re: TableInputFormat and number of mappers == number of regions

2011-04-11 Thread Avery Ching
houldn't be hard. Study the current splitter and >> see how it juggles locations. >> >> Can you put us in contact w/ the person running the cluster (offline >> if you prefer)? 150k sounds like regions need to be bigger. >> >> Thanks, >> St.Ack

Re: TableInputFormat and number of mappers == number of regions

2011-04-09 Thread Avery Ching
how it juggles locations. > > Can you put us in contact w/ the person running the cluster (offline > if you prefer)? 150k sounds like regions need to be bigger. > > Thanks, > St.Ack > > On Sat, Apr 9, 2011 at 9:33 AM, Avery Ching wrote: >> The number of regions is pr

Re: TableInputFormat and number of mappers == number of regions

2011-04-09 Thread Avery Ching
ons, but you can have > less. Try going that way. > > Also 149,624 regions is insane, is that really the case? I don't think > i've ever seen such a large deploy and it's probably bound to hit some > issues... > > J-D > > On Sat, Apr 9, 2011 at 9:15 AM

TableInputFormat and number of mappers == number of regions

2011-04-09 Thread Avery Ching
Hi, First off, I'd like to say thanks to the developers for HBase, it's been fun to work with. I've been using TableInputFormat to run a Map-Reduce job and ran into an issue. Exception in thread "main" org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.io.IOException: The number