Ok, understood this part, even though the architecture of hadoop is designed
for thread safety, the actual implementation level details make it thread
unsafe.
Thank you for the comments, did a good background check and figured out that
staying within the hadoop framework, best way to manage
This will likely break most programs you try to run. Many mapper
implementations are not thread safe.
That having been said, if you want to force all programs using the old API
(org.apache.hadoop.mapred.*) to run on the multithreaded maprunner, you can
do this by setting mapred.map.runner.class
