Hi, When I ran a job (containing some hundreds of thousands tasks) over our hadoop-0.19.2 cluster, I got OutOfMemoryError at JobTracker. Monitoring memory usage at the JobTracker with Ganglia, it looks like that memory space of the JobTracker is released every 24 hours, which is the default value of mapred.jobtracker.retirejob.interval. What happens if I set mapred.jobtracker.retirejob.interval to any less values like 12 hours or even 0? Does it only control job retirement interval from JobTrackers memory? Any ohter side effects can you suppose?
Thanks. Manhee