RE: Writing output in multiple files in Hadoop

2011-12-27 Thread Devaraj K 
Can you check the MultipleOutputs class.

http://hadoop.apache.org/common/docs/r0.20.205.0/api/org/apache/hadoop/mapre
d/lib/MultipleOutputs.html


Devaraj K 

-Original Message-
From: Bhavesh Shah [mailto:bhavesh25s...@gmail.com] 
Sent: Tuesday, December 27, 2011 3:29 PM
To: hadoop-...@lucene.apache.org
Subject: Writing output in multiple files in Hadoop

Hello all,
I want to write the files according to months using map-reduce in
hadoop. If data is from January month then the data should be wriiten
in jan-file and likewise for each month there should be seperate file.

How Can I create such file in hadoop mapredude. I am trying for
recursive map-reduce but not getting how to implement it?

Pls suggest me some solution.

Thanks.


-- 
Regards,
Bhavesh Shah

Re: Writing output in multiple files in Hadoop

2011-12-27 Thread Harsh J 
Use the class 'MultipleOutputs':
hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapred/lib/MultipleOutputs.html

On Tue, Dec 27, 2011 at 3:29 PM, Bhavesh Shah  wrote:
> Hello all,
> I want to write the files according to months using map-reduce in
> hadoop. If data is from January month then the data should be wriiten
> in jan-file and likewise for each month there should be seperate file.
>
> How Can I create such file in hadoop mapredude. I am trying for
> recursive map-reduce but not getting how to implement it?
>
> Pls suggest me some solution.
>
> Thanks.
>
>
> --
> Regards,
> Bhavesh Shah



-- 
Harsh J

Writing output in multiple files in Hadoop

2011-12-27 Thread Bhavesh Shah 
Hello all,
I want to write the files according to months using map-reduce in
hadoop. If data is from January month then the data should be wriiten
in jan-file and likewise for each month there should be seperate file.

How Can I create such file in hadoop mapredude. I am trying for
recursive map-reduce but not getting how to implement it?

Pls suggest me some solution.

Thanks.


-- 
Regards,
Bhavesh Shah