mapreduce problem

2009-04-02 Thread Vishal Ghawate
Hi,

I am new to map-reduce programming model ,

 I am writing a MR that will process the log file and results are written to
different files on hdfs  based on some values in the log file

The program is working fine even if I haven't done any
processing in reducer ,I am not getting how to use reducer for solving my
problem efficiently

Can anybody please help me on this.

 


DISCLAIMER
==
This e-mail may contain privileged and confidential information which is the 
property of Persistent Systems Ltd. It is intended only for the use of the 
individual or entity to which it is addressed. If you are not the intended 
recipient, you are not authorized to read, retain, copy, print, distribute or 
use this message. If you have received this communication in error, please 
notify the sender and delete all copies of this message. Persistent Systems 
Ltd. does not accept any liability for virus infected mails.


Re: mapreduce problem

2009-04-02 Thread Rasit OZDAS
MultipleOutputFormat would be what you want. It supplies multiple files as
output.
I can paste some code here if you want..

2009/4/2 Vishal Ghawate vishal_ghaw...@persistent.co.in

 Hi,

 I am new to map-reduce programming model ,

  I am writing a MR that will process the log file and results are written
 to
 different files on hdfs  based on some values in the log file

The program is working fine even if I haven't done any
 processing in reducer ,I am not getting how to use reducer for solving my
 problem efficiently

 Can anybody please help me on this.




 DISCLAIMER
 ==
 This e-mail may contain privileged and confidential information which is
 the property of Persistent Systems Ltd. It is intended only for the use of
 the individual or entity to which it is addressed. If you are not the
 intended recipient, you are not authorized to read, retain, copy, print,
 distribute or use this message. If you have received this communication in
 error, please notify the sender and delete all copies of this message.
 Persistent Systems Ltd. does not accept any liability for virus infected
 mails.




-- 
M. Raşit ÖZDAŞ