Hi Jackob,
A combiner acts a lot like a reduce step but it's executed on the mapper
with in-memory data. I've seen a reduction in job execution time by
adding one. The one caveat to keep in mind is that it may or may not
run on a particular map attempt.
Nick
On 8/2/2010 10:39 AM, Jackob
On 3/15/2010 9:51 AM, Raymond Jennings III wrote:
I need to pass a counter value to my reducer from the main program. Can this
be done through the context parameter somehow?
Have you tried serializing both the mapper output value and this counter
as value in the key/value pair?
Nick
or
is this normal?
Thanks
Nick Jones
the package information. (i.e.
com.mycompany.mytool.election)
Nick Jones
Sent by radiation.
On Mar 5, 2010, at 7:27 AM, Varun Thacker
varunthacker1...@gmail.com wrote:
This is how my jar looks like.
Its name is Election.jar
Directory:had...@varun:~/hadoop-0.20.1
Inside the jar
);
DistributedCache.addCacheFile(new URI(/path/to/file2.txt), conf);
DistributedCache.addCacheFile(new URI(/path/to/file3.txt), conf);
...
}
}
Nick Jones
Udaya Lakshmi wrote:
Hi,
As a newbie to hadoop, I am not able to figure out how to use
DistributedCache class. Can someone give me a small code which
-by-one. How can I take advantage of MySQL's support
of generating fewer insert statements with more values within each one?
Thanks.
--
Nick Jones
