Re: How hadoop parse input files into (Key,Value) pairs ??

2011-07-12 Thread praveenesh kumar
Hi, So I have a file in which the records are comma separated ( Record1,Record2). I want to make first record (Record1 as key) and Record2 as value. I am using hadoop 0.20-append version. I am looking forward to use KeyValueTextInputFormat and then setting key.value.separator.in.input.line with

Re: How hadoop parse input files into (Key,Value) pairs ??

2011-05-22 Thread Mark question
The case your talking about is when you use FileInputFormat ... So usually the InputFormat Interface is the one responsible for that. For FileInputFormat, it uses a LineRecordReader which will take your text file and assigns key to be the offset within your text file and value to be the line

How hadoop parse input files into (Key,Value) pairs ??

2011-05-05 Thread praveenesh kumar
Hi, As we know hadoop mapper takes input as (Key,Value) pairs and generate intermediate (Key,Value) pairs and usually we give input to our Mapper as a text file. How hadoop understand this and parse our input text file into (Key,Value) Pairs Usually our mapper looks like -- *public* *void*