Re: Memory intensive jobs and JVM reuse

2010-04-29 Thread Danny Leshem
Rosenstrauch wrote: > On 04/29/2010 08:58 AM, Danny Leshem wrote: > >> Hello, >> >> I'm using Hadoop to run a memory intensive job on different input datum. >> The job requires the availability (in memory) of some read-only HashMap, >> about 4Gb in size. >> The

Memory intensive jobs and JVM reuse

2010-04-29 Thread Danny Leshem
Hello, I'm using Hadoop to run a memory intensive job on different input datum. The job requires the availability (in memory) of some read-only HashMap, about 4Gb in size. The same fixed HashMap is used for all input datum. I'm using a cluster of EC2 machines with more than enough memory (around