Re: How to read whole files and output processed texts to another file through MapReduce

2010-11-19 Thread Bhaskar Ghosh
utPath(job, new Path(otherArgs[0])); FileOutputFormat.setOutputPath(job, new Path(otherArgs[1])); System.exit(job.waitForCompletion(true) ? 0 : 1); I am really disturbed at this. Any idea if I am missing something? Any help would be very useful. Thanks Bhaskar Ghosh Hy

How to read whole files and output processed texts to another file through MapReduce

2010-11-17 Thread Bhaskar Ghosh
(or point me to resources) so that I can: a) My map function gets one file at a time (instead of one line at a time) b) Should implementing a custom RecordReader and/or FileInputFormat allow me to read files in subdirectories as well (one file at a time) ? Appreciate any help. Thanks Bhaskar Ghosh

Re: How to create a composite value object for output from Map method

2010-09-22 Thread Bhaskar Ghosh
Chris / All, Any idea why this is error-ing out? From: Bhaskar Ghosh To: mapreduce-user@hadoop.apache.org Sent: Tue, 21 September, 2010 12:08:21 AM Subject: Re: How to create a composite value object for output from Map method Hello All, Thanks Chris for

Re: How to create a composite value object for output from Map method

2010-09-20 Thread Bhaskar Ghosh
OException { >ObjectWritable list = new ObjectWritable(String[].class, >listOfString.toArray(new String[]{""})); >list.write(out); >out.write(value); >} Has anybody faced similar issue? Appreciate any help. Thanks Bhaskar Ghosh Hyderabad, India http://www.google.com/profiles/b

How to create a composite value object for output from Map method

2010-09-19 Thread Bhaskar Ghosh
? * Currently, I am doing it as a work-around: * The first set of Mapper-Reducer write to HDFS. Then the second set of Mapper-Reducer pick up that output file from HDFS and writes further processed output to another HDFS directory. * An example would be really really he