How much RAM do you have?
A good rule of thumb is to use 1-1.5G for maps and 2G per reduce
(vmem). Ensure your OS has at least 2G of memory.
Thus, with 24G and dual quad cores you should be at 8-10m/2r. Scale up
if you have more memory.
Also, ensure you turn on memory monitoring so that a rouge
Not sure what you are trying, or if MR is the right tool...
Anyway, the basic idea is to write a map-only job with a custom RecordReader
to stop emitting inputs to your map when the mapper/recordreader finds the
needle in the haystack.
Arun
Sent from my iPhone
On Sep 30, 2011, at 8:39 PM, Prave
That means you don't have the autotool chain necessary for build the
native code.
For now pass -P-cbuild to skip them.
Arun
Sent from my iPhone
On Aug 18, 2011, at 11:26 PM, rajesh putta wrote:
> Hi,
> I am using apache-maven-3.0.3 and i have set LD_LIBRARY_PATH=/usr/local/lib
> which has goo
