RE: Map reduce technique

2013-03-05 Thread Samir Kumar Das Mohapatra
P/Reduce based on the logic what you need From: AMARNATH, Balachandar [mailto:balachandar.amarn...@airbus.com] Sent: 06 March 2013 11:24 To: user@hadoop.apache.org Subject: RE: Map reduce technique Thanks for the mail, Can u please share few links to start with? Regards Bala From: Samir Kumar Das

RE: Map reduce technique

2013-03-05 Thread AMARNATH, Balachandar
Thanks for the mail, Can u please share few links to start with? Regards Bala From: Samir Kumar Das Mohapatra [mailto:dasmo...@adobe.com] Sent: 06 March 2013 11:21 To: user@hadoop.apache.org Subject: RE: Map reduce technique I think you have to look the sequence file as input format

RE: Map reduce technique

2013-03-05 Thread Samir Kumar Das Mohapatra
I think you have to look the sequence file as input format . Basically, the way this works is, you will have a separate Java process that takes several image files, reads the ray bytes into memory, then stores the data into a key-value pair in a SequenceFile. Keep going and keep writing into

Re: Map reduce technique

2013-03-05 Thread Sandy Ryza
Hi Balachandar, In MapReduce, interpreting input files as key value pairs is accomplished through InputFormats. Some common InputFormats are TextInputFormat, which uses lines in a text file as values and their byte offset into the file as keys, KeyValueTextInputFormat, which interprets the first