Re: Structuring MapReduce Jobs

2012-04-09 Thread Deepak Nettem
What a well structured question! On Sun, Apr 8, 2012 at 6:37 AM, Tom Ferguson wrote: > Hello, > > I'm very new to Hadoop and I am trying to carry out of proof of concept for > processing some trading data. I am from a .net background, so I am trying > to prove whether it can be done primarily us

Re: Structuring MapReduce Jobs

2012-04-09 Thread Jay Vyas
Hi : Well phrased question I think you will need to read up on reducers, and then you will see the light. 1) in your mapper, emit (date,tradeValue) objects. 2) Then hadoop will send the following to the reducers. date1,tradeValues[] date2,tradeValues[] ... 3) Then, in your reducer, you wi

Structuring MapReduce Jobs

2012-04-09 Thread Tom Ferguson
Resending my query below... it didn't seem to post first time. Thanks, Tom On Apr 8, 2012 11:37 AM, "Tom Ferguson" wrote: > Hello, > > I'm very new to Hadoop and I am trying to carry out of proof of concept > for processing some trading data. I am from a .net background, so I am > trying to pro

Structuring MapReduce Jobs

2012-04-09 Thread Tom Ferguson
Hello, I'm very new to Hadoop and I am trying to carry out of proof of concept for processing some trading data. I am from a .net background, so I am trying to prove whether it can be done primarily using C#, therefore I am looking at the Hadoop Streaming job (from the Hadoop examples) to call in