Re: How to pull data in the Map/Reduce functions?

2011-09-24 Thread Praveen Sripati
Matt, Neither of the books have much information about the new MR API. I was reading the 'Hadoop - The Definitive Guide' and came across a single pager on new API. I wanted to try the new MR, but could not find much information neither in the book nor on the internet. Thanks, Praveen On Sat, Sep

Re: Re: Re: Re: How do I set the intermediate output path when I use 2 mapreduce jobs?

2011-09-24 Thread Swathi V
Hi Jun Tun, Yeah ! surely... Well the code i gave is the new API. 2011/9/24 谭军 > Hi Swathi.V., > Thank you very much. > It's very kind of you to do that. > I think the code you gave is implemented in old APIs. > I made it several days ago. What I can't is by new APIs. > I just get started to ma

RE: How to pull data in the Map/Reduce functions?

2011-09-24 Thread GOEKE, MATTHEW (AG/1000)
Praveen, Functionality wise you don't gain much from using the new API and most would actually recommend that you stay with the old API as it will not be "officially" deprecated until 0.22 / 0.23 (I can't remember which one). If you want to take a look at the classes dig into the packages for

How to pull data in the Map/Reduce functions?

2011-09-24 Thread Praveen Sripati
Hi, Normally the Hadoop framework calls the map()/reduce() for each record in the input split. I read in the 'Hadoop : The Definitive Guide' that that data can be pulled using the new MR API. What is the new API for pulling the data in the map()/reduce() or is there a sample code? Thanks, Pravee

Re: Re: Re: Re: The method addCacheFIle(URI) is undefined for the type Job

2011-09-24 Thread Joey Echeverria
Doesn't look like it to me: http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapreduce/Job.html 2011/9/23 谭军 : > Joey Echeverria, > Yes, that works. > I thought job.addCacheFile(new URI(args[0])); could run on hadoop-0.20.2. > Because hadoop-0.20.2 could run context object. > Th