Hi Chris, Starcluster looks pretty good, however as you pointed out Univa with UniCloud + UGE can do very similar things and in fact does some additional functionality that is not present in StarCluster. Please have a look at: http://www.univa.com/resources/video/hpc_cloud_video.php Takes about 10 minutes (most of the time is spent waiting for Amazon to start things)....The actual time waiting for UniCloud to do suff - about 3 minutes.
And since we are talking about cool things that can be done with Grid Engine on EC2. Our solution supports.... EBS back instances, dynamically grow and shrink the cluster using rules (so easy to create rules for Grid Engine) Create a hybrid cluster (Hey if you are crazy enough you can bridge EC2 and Rackspace) Dynamically add additional software kits to the system (basically anything that can be packaged as a RPM can be added) Works on Cluster Compute Instances Works on multiple instance types. Add remove nodes (add as many as you need) Add different types of nodes - you can customize the software profile of the nodes to meet your needs. NFS is automatically added to the cluster but of course you can customize it. User accounts are automatically managed across the cluster DNS is automatically managed across the cluster. Routing is automatically managed across the cluster Firewall iptables is automatically managed across the cluster. Kits for (MPI, Cacti, Ganglia, Nagios, Univa Grid Engine, and others...) paswordless ssh between nodes ( well I would expect all solutions to do this). And more cause the *same* software can be configured to work on just about *any* cloud infrastructure and if the cloud infrastructure has a Amazon API (quite a lot do) then it is easy to add to the UniCloud + UGE environment. I think our solution has changed quite a bit since you last tried it out. Bill. On 2011-04-29, at 1:34 PM, Chris Dagdigian wrote: > > I'm buried in work and biz travel so apologies if this quick reply is > not on topic ... > > By FAR the best way to run standalone Grid Engine clusters on the Amazon > Cloud today is to simply use MIT Starcluster : > > http://web.mit.edu/stardev/cluster/index.html > > The people behind starcluster basically did everything I did many years > ago as part of my cheesy demos showing SGE on the "cloud" at various > meetings and talks. The main difference is they did it correctly with > smart people who can write good code, heh. And they also extended and > added all the usual features that you would want and request. It really > is a nice solution. Much of the code is python. > > My company is a big user and we are helping push it into more enterprise > environments by (for instance) making sure that it plays nicely with VPC > VPNs and HTTP proxies and other odd network/use-cases that you don't > often see in academic environments. > > Bridging cloud SGE nodes to local SGE clusters ("hybrid clusters", > "cloud bursting") is a different story, this is something that I pretty > much refuse to do mainly because in my field I'm bound by data movement > and moving job data into and out of the cloud is slow enough to be a > deal breaker. The networking is also a hassle. > > SDM can do this, you can do this yourself on Amazon via linking your > local and cloud subnets via Amazon VPC. > > Univa can also do this with their own products that contain grid engine > + other cool stuff. > > -Chris > > > > > Dave Love wrote: >> LaoTsao<[email protected]> writes: >> >>> Could SDM help in this case? >> >> Maybe (e.g. >> http://wiki.gridengine.info/wiki/index.php/SGE-Hedeby-And-Amazon-EC2), >> and there are other options like OpenNebula (e.g. the links at >> http://wiki.gridengine.info/wiki/index.php/Virtualization_and_Grid_Engine). >> >> If anyone wants it, the SDM source is available under >> http://arc.liv.ac.uk/downloads/SGE/ as hedeby-*.tar.gz, roughly in the >> state it was left at sunsource.net. I haven't tried to build it against >> post-6.2u5 SGE, and I don't remember how the build works to know whether >> to expect any problems. > _______________________________________________ > users mailing list > [email protected] > https://gridengine.org/mailman/listinfo/users William Bryce | VP of Products Univa Corporation - 1001 Warrenville Road, Suite 100 Lisle, Il, 65032 USA Email [email protected] | Mobile: 512.751.8014 | Office: 905.237.4462 --------------------------------------------------------------------- Notice from Univa Postmaster: This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. This message has been content scanned by the Univa Mail system. --------------------------------------------------------------------- _______________________________________________ users mailing list [email protected] https://gridengine.org/mailman/listinfo/users
