Re: Basic question on how reducer works

2012-07-16 Thread Subir S
Just for reference of others who might see this thread. Jira corresponding to parameter on reduce input limit is MAPREDUCE-2324 On 7/14/12, Harsh J wrote: > Subir, > > On Sat, Jul 14, 2012 at 5:30 PM, Subir S wrote: >> Harsh, Thanks I think this is what I was looking for. I have 3 related >> que

Re: CombineFileInputFormat ran out of memory while making splits

2012-07-16 Thread Felix . 徐
My hadoop version is 1.0.1 and I didn't specify any parameter. 2012/7/16 Felix.徐 > HI all, > I have written a MyCombineFileInputFormat extends from > CombineFileInputFormat , it can put multi files together into the same > inputsplit, it works fine for just a small amount of files. But if I try