You are better of trying hadoop-0.23.1 or even hadoop-0.23.2-rc0 since CDH4's version of YARN is very incomplete and you might get nasty surprises there.
Settings: # Run 1 NodeManager with yarn.nodemanager.resource.memory-mb -> 1024 # Use CapacityScheduler (significantly better tested) by setting yarn.resourcemanager.scheduler.class to org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler # Set min container size to 128M or 256M (upto you) by setting yarn.scheduler.capacity.minimum-allocation-mb # Set max container size to 1024M (max given to NM) by setting yarn.scheduler.capacity.maximum-allocation-mb Arun On Apr 18, 2012, at 8:00 PM, praveenesh kumar wrote: > Hi, > > Sweet.. Can you please elaborate how can I tweak my configs to make > CDH4/hadoop-0.23 run in 1.5GB RAM VM. > > Regards, > Praveenesh > > On Wed, Apr 18, 2012 at 8:42 AM, Harsh J <ha...@cloudera.com> wrote: > >> Praveenesh, >> >> Speaking minimally (and thereby requiring less tweaks on your end), >> 1.5 GB would be a good value to use for RAM if available (1.0 will do >> too, if you make sure to tweak your configs to not use too much heap >> memory). Single processor should do fine for testing purposes. >> >> On Tue, Apr 17, 2012 at 8:51 PM, praveenesh kumar <praveen...@gmail.com> >> wrote: >>> I am looking to test hadoop 0.23 or CDH4 beta on my local VM. I am >> looking >>> to execute the sample example codes in new architecture, play around with >>> the containers/resource managers. >>> Is there any pre-requisite on default memory/CPU/core settings I need to >>> keep in mind before setting up the VM. >>> >>> Regards, >>> Praveenesh >> >> >> >> -- >> Harsh J >> -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/
