Re: How to split a specified number of rows per Map

2011-06-06 Thread edward choi
I guess there are no other options. Thanks for the info Ted. Ed. 2011/6/5 Ted Yu > You need to modify getSplits(). > > On Sun, Jun 5, 2011 at 4:04 AM, edward choi wrote: > > > Hi, > > > > I am using HBase as a source of my MapReduce jobs. > > > > I recently found out that TableInputFormat aut

Re: How to split a specified number of rows per Map

2011-06-05 Thread Ted Yu
You need to modify getSplits(). On Sun, Jun 5, 2011 at 4:04 AM, edward choi wrote: > Hi, > > I am using HBase as a source of my MapReduce jobs. > > I recently found out that TableInputFormat automatically splits the input > table so that each region of the table will be assigned to a single Map

How to split a specified number of rows per Map

2011-06-05 Thread edward choi
Hi, I am using HBase as a source of my MapReduce jobs. I recently found out that TableInputFormat automatically splits the input table so that each region of the table will be assigned to a single Map job. But what I want to do is to split the input table so that user-specified lines of row will