Re: PiEstimator error - Type mismatch in key from map

2011-01-26 Thread Srihari Anantha Padmanabhan
are in different versions. >> >> Nicholas >> >> >> >> From: Srihari Anantha Padmanabhan >> To: "mapreduce-user@hadoop.apache.org" >> Sent: Wed, January 26, 2011 10:15:08 AM >> Subject: Re: PiEstimator error - Type mismatch

Re: PiEstimator error - Type mismatch in key from map

2011-01-26 Thread Srihari Anantha Padmanabhan
I got a similar error before in one of my projects. I had to set the values for "mapred.output.key.class" and "mapred.output.value.class". That resolved the issue for me. Srihari On Jan 26, 2011, at 10:09 AM, Pedro Costa wrote: Yes, I can reproduce it deterministically. But, I also did some ch

Write to different files based on key from mapper

2010-11-22 Thread Srihari Anantha Padmanabhan
Hi, I want to write the records to different hdfs files (instead of the default part-m..) into different output dirs based on the key generated by the mapper. I would like to implement this using the hadoop mapreduce API. Has anyone faced this problem? Is there any sample program that I can

Re: Migrating from mapred to mapreduce API

2010-11-18 Thread Srihari Anantha Padmanabhan
Thank you. I will check it out. On Nov 18, 2010, at 4:29 PM, Ted Yu wrote: You can get the source code here: http://archive.cloudera.com/cdh/3/hadoop-0.20.2+320.tar.gz On Thu, Nov 18, 2010 at 4:21 PM, Srihari Anantha Padmanabhan mailto:sriha...@yahoo-inc.com>> wrote: I am using Hadoop

Re: Migrating from mapred to mapreduce API

2010-11-18 Thread Srihari Anantha Padmanabhan
I am using Hadoop 0.20.2. On Nov 18, 2010, at 4:14 PM, Ted Yu wrote: > hadoop

Re: Migrating from mapred to mapreduce API

2010-11-18 Thread Srihari Anantha Padmanabhan
I think MultipleOutputs.java is a part of mapred and not mapreduce. Please correct me if I am wrong. I can find only the following classes under mapreduce/lib/output FileOutputCommitter.java FileOutputFormat.java NullOutputFormat.java SequenceFileOutputFormat.java TextOutputFormat.java On

Migrating from mapred to mapreduce API

2010-11-18 Thread Srihari Anantha Padmanabhan
Hi, I am working on migrating a mapreduce program from using org.apache.hadoop.mapred to org.apache.hadoop.mapreduce APIs. The program currently uses orf.apache.hadoop.mapred.lib.MultipleOutputFormat. I could not find any equivalent class in mapreduce. Can anyone suggest an equivalent class or