For setup(), do you mean configure(JobConf)? We need to deserialize a big object and do some other preparing work on it within the configure() for setting up. It takes a few seconds and it is the same for all task. We just declare the object as static and do not recreate it if it is not null. By that way, we make sure only create it once and save the setup time for the rest of the tasks.
Zhu, Guojun Modeling Sr Graduate 571-3824370 [email protected] Financial Engineering Freddie Mac Arpit Wanchoo <[email protected]> 06/04/2012 08:12 AM Please respond to [email protected] To "[email protected]" <[email protected]> cc Subject JVM reuse in Map Tasks Hi I wanted to check what exactly we gain when JVM reusability is enabled in mapped job. My doubt was regarding the setup() method of mapper. Is it called for a mapper even if it is using the JVM for previously run mapper ? If yes then is there any way I can control it or stop from being called more than once. Regards, Arpit Wanchoo | Sr. Software Engineer Guavus Network Systems. 6th Floor, Enkay Towers, Tower B & B1,Vanijya Nikunj, Udyog Vihar Phase - V, Gurgaon,Haryana. Mobile Number +91-9899949788
