Hi Jorge, I have two questions:
1) Has anyone optimized nova to work in a HPC environment like you describe? Such as an intelligent scheduler that will generate VMs that consume x percent of a physical machines resources (so you don't end up with one machine with two separate Hadoop instances competing for resources)? 2) Why not use something like http://en.wikipedia.org/wiki/TORQUE_Resource_Manager or http://hadoop.apache.org/common/docs/r0.16.4/hod.html? best, Joe Gordon On Thu, Jan 19, 2012 at 10:49 AM, Jorge Luiz Correa <corre...@gmail.com>wrote: > Hum, I'm just studying and understanding the ccgroups to try this with > libvirt and kvm (all nodes are linux here). > > My case is a test that can be very useful for us. We have about 150 > computers spread over the LAN. These computers are desktops and notebook > underutilized. So, our test scenario is not an isolated datacenter, what I > think is the ideal scenario for private clouds. > > We need to run some simulations that requires, most of the time, a lot of > processor nodes with not so much memory (for example, to run Hadoop). Once > the computers have 8 GB or 16 GB and are used to run office applications, > they are idle. We think to attach them to the cloud (a controller of a > private cloud) and use these idle resources. But, we want to ensure > nova-compute not interfere in computers' usability (in this case we can > define what is considered usability, like 2 cores and 4 GB of memory). > These idle resources over the LAN can be VERY useful, and are cheap (they > have already been purchased)! > > And, we have a laboratory with 20 good hosts that is used along some > periods of time. At the lab we can use all the hosts resources when it > isn't being used. > > This is our test scenario. > > Regards. > > :) > > > On Thu, Jan 19, 2012 at 4:00 PM, Christian Berendt > <bere...@b1-systems.de>wrote: > >> Hi Jorge. >> >> > I would like to know if it's possible to configure quota in each >> > nova-compute node. For example, I set up a new hardware with 8 GB of >> memory >> > and install the nova-compute, but I wish only 4 GB of memory are used >> > (dedicated to nova-compute). Is it possible? If so, how can I configure >> > that? >> >> I can't remember such a function at the moment, but it's relative simple >> to implement such a feature (at least for Linux systems) using cgroups. >> >> Can you please describe your use case. At the moment I can't follow >> where I should use the feature. Why should I install nova-compute on a >> bare metal system with 32 GByte memory and only use 16 GByte memory? >> >> Bye, Christian. >> >> -- >> Christian Berendt >> Linux / Unix Consultant & Developer >> Mail: bere...@b1-systems.de >> >> B1 Systems GmbH >> Osterfeldstraße 7 / 85088 Vohburg / http://www.b1-systems.de >> GF: Ralph Dehner / Unternehmenssitz: Vohburg / AG: Ingolstadt,HRB 3537 >> >> >> _______________________________________________ >> Mailing list: https://launchpad.net/~openstack >> Post to : openstack@lists.launchpad.net >> Unsubscribe : https://launchpad.net/~openstack >> More help : https://help.launchpad.net/ListHelp >> >> > > > -- > - MSc. Correa, J.L. > > > _______________________________________________ > Mailing list: https://launchpad.net/~openstack > Post to : openstack@lists.launchpad.net > Unsubscribe : https://launchpad.net/~openstack > More help : https://help.launchpad.net/ListHelp > >
_______________________________________________ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp