Nice work Bruno!
On Thu, Dec 15, 2011 at 10:07 PM, Konstantin Boudnik <[email protected]> wrote: > Great stuff Bruno! Thanks for making this available! > > Cos > > On Thu, Dec 15, 2011 at 01:42AM, Bruno MahИ wrote: >> Hi, >> >> I am glad to announce the availability of a new deployment method for >> Apache Hadoop and related projects in Apache Bigtop (incubating). >> Anyone can now download an image for their favourite virtualization >> technology with Apache Hadoop pre-installed and configured. >> >> This may be useful in a lot of cases such as: >> * You want to get familiar with Apache Hadoop or related projects >> without worries regarding the setup >> * You want to run some tests in a reproducible environment without being >> afraid of breaking your system >> * You want to develop and test your project against some specific >> environments >> * You quickly want to see what is coming up in Apache Hadoop 0.23 branch >> * You want to maintain some specific images at your cloud provider (ex: >> AWS, ElasticHosts) >> * You use an operating system which is not compatible with Apache Hadoop >> but would like to write/test some jobs against Apache Hadoop or related >> projects >> * You quickly want to get familiar with Apache Hadoop or related project >> in a real distributed mode across multiple VMs >> >> >> Currently Apache Bigtop only provides a base appliance with Apache >> Hadoop running in pseudo-distributed mode on CentOS 6. >> Several jobs have been created on our jenkins instance to generate >> images based on the released version of Apache Hadoop 0.20.205 as well >> as the in development branches of Apache Hadoop 0.22 (needs to update to >> the released bits) and Apache Hadoop 0.23. Each of these jobs create >> images for the following virtualization technology: >> * KVM (libvirtd) >> * Virtualbox >> * VMware >> >> >> Under the hood we use BoxGrinder (http://boxgrinder.org/), a fantastic >> tool for generating all these VMs. >> Currently it can creates VM for RHEL/CentOS/Fedora/ScientificLinux, but >> could handle more OSes through plugins. >> The list of supported virtualization technology (KVM, VirtualBox, >> VMware, EC2) and delivery methods (local, sftp, s3, ebs, elastichosts, >> and soon local/remote libvirtd) is also pretty large. >> The BoxGrinder appliance definition format is also pretty simple to >> understand and the current appliance should be easy to modify and >> extend. There is also a convenient method to make an appliance inherits >> from one or several other appliances. >> This explains why the current appliance in Apache Bigtop is quite small, >> so one could easily create an appliance with all the packages provided >> by Apache Bigtop by just providing the additional packages. >> >> >> If you wish to download the VMs built from Apache Bigtop (incubating) >> jenkins instance, here are the links: >> * Apache Bigtop 0.2.0 (incubating), includes Apache Hadoop 0.20.205: >> - KVM: http://bit.ly/tlPZCz >> - VMware: http://bit.ly/s1V42p >> - VirtualBox: http://bit.ly/s5vuj8 >> >> * Branch hadoop-0.22 in Apache Bigtop (incubating): >> - KVM: http://bit.ly/sMSupy >> - VMware: http://bit.ly/tSfN6E >> - VirtualBox: http://bit.ly/sc0wvL >> >> * Branch hadoop-0.23 in Apache Bigtop (incubating): >> - KVM: http://bit.ly/sBdEVX >> - VMware: http://bit.ly/vj22mo >> - VirtualBox: http://bit.ly/ttwm5k >> >> * The jenkins job creating these images is located there: >> http://bit.ly/vM3tLP >> >> Once the chosen artefact is downloaded and expanded, you just need to >> tell your virtualization tool to import an existing disk. >> Be also careful regarding the RAM allocated to your VM. Apache Hadoop >> 0.23 has become quite memory hungry and will not be able to run the pi >> example on a VM with 1024MB of RAM. >> >> >> Please, don't hesitate to share your feedback, ideas or issues on Apache >> Bigtop (incubating) mailing list or the ticket tracker. >> >> Thanks, >> Bruno MahИ >> >> PS: I CCed the Apache Hadoop general since this email may interest a few >> folks focused on that mailing list > > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.10 (GNU/Linux) > > iF4EAREIAAYFAk7q4DQACgkQenyFlstYjhJ2uAD/U/DGGLtf+r50AsdB6rgn+nha > qF9tLhctuj9tsFCCcKwA/33zrb1wE+t4HGAQX+54quvKVgWNZ8oTIPL8eGGCBnvo > =ITQZ > -----END PGP SIGNATURE----- >
