Yeah I found the TextInputFormat and TextKeyValueInputFormat and I know how to
parse text--I'm just too lazy. I was hoping there was a Text equivalent of a
SequenceFile that was hidden somewhere. As I said there is no mapper, this is
running outside of hadoop M/R. So I at least need a line
: Hadoop 101
Yeah I found the TextInputFormat and TextKeyValueInputFormat and I know how
to parse text--I'm just too lazy. I was hoping there was a Text equivalent
of a SequenceFile that was hidden somewhere. As I said there is no mapper,
this is running outside of hadoop M/R. So I at least need a line
You use TextInputFormat, you'll get the following keyLongWritable,
valueText pairs in your mapper:
file_position, your_input
Example:
0,
0\t[356:0.3481597,359:0.3481597,358:0.3481597,361:0.3481597,360:0.3481597]
100,
8\t[356:0.34786037,359:0.34786037,358:0.34786037,361:0.34786037,360:0.34786
I suggest reading up around map reduce first:
http://labs.google.com/papers/mapreduce-osdi04.pdf
Cheers
On Mon, Sep 1, 2008 at 11:27 AM, HHB [EMAIL PROTECTED] wrote:
Hey,
I'm reading about Hadoop lately but I'm unable to understand it.
Would you please explain it to me in easy words?
How
