Re: [Openstack] HPC with Openstack?

2011-12-06 Thread Daniel P. Berrange
On Mon, Dec 05, 2011 at 09:07:06PM -0500, Lorin Hochstein wrote: On Dec 4, 2011, at 7:46 AM, Soren Hansen wrote: 2011/12/4 Lorin Hochstein lo...@isi.edu: Some of the LXC-related issues we've run into: - The CPU affinity issue on LXC you mention. Running LXC with OpenStack, you

Re: [Openstack] HPC with Openstack?

2011-12-05 Thread Lorin Hochstein
On Dec 4, 2011, at 7:46 AM, Soren Hansen wrote: 2011/12/4 Lorin Hochstein lo...@isi.edu: Some of the LXC-related issues we've run into: - The CPU affinity issue on LXC you mention. Running LXC with OpenStack, you don't get proper space sharing out of the box, each instance actually sees

Re: [Openstack] HPC with Openstack?

2011-12-04 Thread Soren Hansen
2011/12/4 Lorin Hochstein lo...@isi.edu: Some of the LXC-related issues we've run into: - The CPU affinity issue on LXC you mention. Running LXC with OpenStack, you don't get proper space sharing out of the box, each instance actually sees all of the available CPUs. It's possible to restrict

Re: [Openstack] HPC with Openstack?

2011-12-03 Thread Muriel
On Fri, Dec 2, 2011 at 1:17 PM, Sandy Walsh sandy.wa...@rackspace.com wrote: I've recently had inquiries about High Performance Computing (HPC) on Openstack. As opposed to the Service Provider (SP) model, HPC is interested in fast provisioning, potentially short lifetime instances with

Re: [Openstack] HPC with Openstack?

2011-12-03 Thread Cole
First and foremost: http://wiki.openstack.org/HeterogeneousSgiUltraVioletSupport With Numa and lightweight container technology (LXC / OpenVZ) you can achieve very close to real hardware performance for certain HPC applications. The problem with technologies like LXC is there isn't a ton of

Re: [Openstack] HPC with Openstack?

2011-12-03 Thread Lorin Hochstein
Hi Cole: That link you posted refers to our work at ISI. We're currently running LXC as the hypervisor on our SGI UV. Other than performance, one of the issues with KVM is that it currently has a hard-coded limit on how many vCPUs you can run in a single instance, so we can't run, say, a 256

Re: [Openstack] HPC with Openstack?

2011-12-02 Thread David Busby
May be worth looking at rightscale: http://www.rightscale.com/products/plans-pricing/grid-edition.php The article there is only and only cites EC2 usage, but their API's support Rackspace cloud which is Nova http://support.rightscale.com/12-Guides/RightScale_API Cheers David On 2 Dec 2011,

Re: [Openstack] HPC with Openstack?

2011-12-02 Thread Lorin Hochstein
As a side note, HPC means very different things to different people. In the circles I move in, HPC is interested in running compute jobs that are CPU-intensive, require large amounts of memory, and need low-latency/high-bandwidth interconnects to allow the user to break up a tightly coupled

Re: [Openstack] HPC with Openstack?

2011-12-02 Thread Oleg Gelbukh
Hello, Here at Mirantis we are working on deployment of Openstack that intended to manage HPC cluster eventually. There are few features that we are going to incorporate, and we are still researching. The general idea is to use LXC as a lightweight virtualization engine, and make use of faster

Re: [Openstack] HPC with Openstack?

2011-12-02 Thread Sandy Walsh
Good point ... thanks for the clarification. -S From: Lorin Hochstein [lo...@isi.edu] Sent: Friday, December 02, 2011 9:47 AM To: Sandy Walsh Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] HPC with Openstack? As a side note, HPC means very different

Re: [Openstack] HPC with Openstack?

2011-12-02 Thread Brian Schott
You did see that Amazon hit #42 on the Top 500 supercomputing list? It is somewhat of a stunt, but the point is that access to a supercomputer is a credit-card swipe away and rentable by the hour. There was a lot of buzz at SC11 a few weeks ago. There are several HPC groups in the OpenStack

Re: [Openstack] HPC with Openstack?

2011-12-02 Thread Oliver Baltzer
As a side note, HPC means very different things to different people. In the circles I move in, HPC is interested in running compute jobs that are CPU-intensive, require large amounts of memory, and need low-latency/high-bandwidth interconnects to allow the user to break up a tightly coupled

Re: [Openstack] HPC with Openstack?

2011-12-02 Thread Leandro Reox
An HPC way of usage for.openstack at.mercadolibre is for example to run integration and regresions test on productios pre and post deploy too. So Jenkins servers are shooted in a minute to support the tests load and then they destroy themselves. On Dec 2, 2011 3:55 PM, Oliver Baltzer