Re: multiple outputs

2010-06-08 Thread Amareshwari Sri Ramadasu
Yes. They can be used inside a mapper also. See org.apache.hadoop.mapred.lib.TestMultipleOutputs.java or org.apache.hadoop.mapreduce.lib.output.TestMRMultiplteOutputs for some sample code. Thanks Amareshwari On 6/9/10 5:57 AM, "Torsten Curdt" wrote: Can the MultipleOutputs also be used insid

Re: multiple outputs

2010-06-08 Thread Torsten Curdt
Can the MultipleOutputs also be used inside a mapper? So basically I pipe data into different reducers from the mapper. Of course I could do two separate jobs but that would very inefficient as I would have to go/read through all the data twice. cheers -- Torsten On Tue, Jun 8, 2010 at 06:22, A

Re: Problem with DBOutputFormat

2010-06-08 Thread Nick Jones
Hi Giridhar, Can you share your code somewhere? Nick Jones Sent by radiation. On Jun 8, 2010, at 7:21 AM, "Giridhar Addepalli" > wrote: Hi Sonal, I am using Hadoop 0.20.2. Is this okay ? Thanks for the suggestion , will look at the hiho framework. Thanks, Giridhar. -Original Message--

RE: Problem with DBOutputFormat

2010-06-08 Thread Giridhar Addepalli
Hi Sonal, I am using Hadoop 0.20.2. Is this okay ? Thanks for the suggestion , will look at the hiho framework. Thanks, Giridhar. -Original Message- From: Sonal Goyal [mailto:sonalgoy...@gmail.com] Sent: Tuesday, June 08, 2010 5:48 PM To: mapreduce-user@hadoop.apache.org Subject: Re: P

Re: Problem with DBOutputFormat

2010-06-08 Thread Sonal Goyal
Hi Giridhar, Which version of Hadoop are you using? If you want, you can also load data to MySQL using the hiho framework at http://code.google.com/p/hiho/ Thanks and Regards, Sonal www.meghsoft.com http://in.linkedin.com/in/sonalgoyal On Tue, Jun 8, 2010 at 3:02 PM, Giridhar Addepalli wrote

Problem with DBOutputFormat

2010-06-08 Thread Giridhar Addepalli
Hi, I am trying to write output to MYSQL DB, I am getting following error java.io.IOException at org.apache.hadoop.mapreduce.lib.db.DBOutputFormat.getRecordWriter(DBOutp utFormat.java:180) at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.j