Re: Using chainmapper and chain reducer in hadoop

2009-07-18 Thread jason hadoop
The examples in ch8 and ch9 use chain mapping, I will pick this conversation in the www.prohadoop.com forum On Fri, Jul 17, 2009 at 9:34 AM, Rakhi Khatwani wrote: > Hi Jason, > I have the book with me and reading that book i got a fair > idea about chaining maps/reduce. but i wanted

Re: Using chainmapper and chain reducer in hadoop

2009-07-17 Thread Rakhi Khatwani
Hi Jason, I have the book with me and reading that book i got a fair idea about chaining maps/reduce. but i wanted to try out a simple example to get my concepts clear. i coudn't find any example which depicts the use of chainMapper/chainReducer. so i downloaded prohadoop.jar. but tha

Re: Using chainmapper and chain reducer in hadoop

2009-07-17 Thread jason hadoop
There are some examples for chain mapping in the example bundle for chapter 8 of Pro Hadoop. One think that may not be clear is that the chain of mappers execute within the single task jvm assigned for each map task, and the mappers chained to the reduce execute in the jvm assigned to the reduce. S

Using chainmapper and chain reducer in hadoop

2009-07-17 Thread Rakhi Khatwani
Hi I am trying out a simple example in which you have two maps and one reduce, Map1 and Map2 and Reduce1 now i wanna execute my job in the following fashion Map1 -> Map2 -> Reduce1 (o/p of map1 goes into map2 and o/p of map2 goes into reduce1) i have declared my conf as follows: JobCo