Possible to get counters such as Spill file numbers from mapreduce log?

Hi all, I'm wondering if it is possible to get information such as Spill file numbers, Spill start/ end time for each Mapper from mapreduce's log? Thanks!

Collect, Spill and Merge phases insight

Hi all, I am trying to understand the process of Collect, Spill and Merge in Map, I've referred to a few documentations but still have a few questions. Here is my understanding about the spill phase in map: 1.Collect function add a record into the buffer. 2.If the buffer exceeds a threshold

Re: CombineFileInputFormat ran out of memory while making splits

My hadoop version is 1.0.1 and I didn't specify any parameter. 2012/7/16 Felix.徐 ygnhz...@gmail.com HI all, I have written a MyCombineFileInputFormat extends from CombineFileInputFormat , it can put multi files together into the same inputsplit, it works fine for just a small amount of files

How to run or submit MapReduce Job to Hadoop in my own program?

Hi,all..How can I run a MR job though my own program instead of using console to submit a job to a real Hadoop env? I write code like this, this program works fine but i don't think it ran in my Hadoop env,since nothing was produced in hadoop logs folder. public int run(String[] args) throws