Re: Task JVM Reuse for MapReduce Jobs in 0.20.2

2011-07-29 Thread Harsh J
Brandon, New JVMs for each slot will be spawned across different jobs. For tasks of the same job, this shouldn't happen. Are you seeing this happen for tasks of the same job itself? Also, since your question may be specific to CDH use, I've moved the discussion to cdh-u...@cloudera.org (mapreduce

Task JVM Reuse for MapReduce Jobs in 0.20.2

2011-07-29 Thread Brandon Vargo
Hello, I am trying to setup a MapReduce job so that the task JVMs are reused on each cluster node. Libraries used by my MapReduce job have a significant initialization time, mainly creating singletons, and it would be nice if I could make it so that these singletons are only created once per slot,