Re: FreeBSD/EC2 lives!
On 06/21/11 22:34, Chris Fordham wrote: > On Wed, 22 Jun 2011 15:12:55 +1000, Colin Percival wrote: >> The current status of FreeBSD/EC2 is at >> http://www.daemonology.net/freebsd-on-ec2/ >> >>> I am an engineer at RightScale and a couple of us that are FreeBSD users >>> are looking at creating RightImages for the 5 regions. >>> We'd like to offer our help and support if needed. >> >> I've released 8.2-RELEASE AMIs for t1.micro instances for all 5 regions. >> There's also an 8.2ish AMI for cc1.4xlarge in us-east-1. > > Thank you kindly Colin. We are wondering about the limited instance > types, the issues on why this is so and if there any plans to support more? I"m doing my best. ;-) > In addition, is it possible to get the build source or otherwise to > build the AMIs from scratch? The t1.micro instances were built from 8.2-RELEASE. The source tree used for cc1.4xlarge was slightly modified and is included in the AMI. -- Colin Percival Security Officer, FreeBSD | freebsd.org | The power to serve Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: FreeBSD/EC2 lives!
On 06/21/11 18:15, Chris Fordham wrote: > On Tue, 14 Dec 2010 06:00:34 +1100, Colin Percival wrote: >> Thanks to a month of bug fixing and a lot of help from Amazon, FreeBSD >> is now >> available on EC2: >> http://www.daemonology.net/blog/2010-12-13-FreeBSD-on-EC2.html >> >> Only for 9.0-CURRENT and only t1.micro instances so far, though -- but >> we're >> moving in the right direction. :-) >> > A belated big thanks again for this Colin! > > Just wondering if there are any updates or developments post December > 2010's initial release? Yes. The current status of FreeBSD/EC2 is at http://www.daemonology.net/freebsd-on-ec2/ > I am an engineer at RightScale and a couple of us that are FreeBSD users > are looking at creating RightImages for the 5 regions. > We'd like to offer our help and support if needed. I've released 8.2-RELEASE AMIs for t1.micro instances for all 5 regions. There's also an 8.2ish AMI for cc1.4xlarge in us-east-1. -- Colin Percival Security Officer, FreeBSD | freebsd.org | The power to serve Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: FreeBSD/EC2 lives!
On Tue, Dec 14, 2010 at 09:11:06AM -0800, Colin Percival wrote: > > Probably the biggest thing you can do to help right now is to spin up a bunch > of instances, throw some load at them, and see if you can get them to panic. > :-) I signed up for Amazon EC2 last night and managed to panic my FreeBSD instance a couple times today while compiling security/libgcrypt out of /usr/ports. The panics happen during the configure phase, and the last line I see before the panic is: checking whether mlock is broken... I'm a debugging n00b however. What do you need in terms of a debugging report? I have files in /var/crash as a result of the two panics at exactly the same place. -rw-r--r-- 1 root wheel 2 Dec 20 21:16 bounds -rw--- 1 root wheel 149546 Dec 20 20:45 core.txt.0 -rw--- 1 root wheel 140384 Dec 20 21:16 core.txt.1 -rw--- 1 root wheel519 Dec 20 20:45 info.0 -rw--- 1 root wheel518 Dec 20 21:16 info.1 -rw-r--r-- 1 root wheel 5 Dec 11 21:52 minfree -rw--- 1 root wheel 118460416 Dec 20 20:45 vmcore.0 -rw--- 1 root wheel 102764544 Dec 20 21:16 vmcore.1 And finally my "uname -a" is: FreeBSD ip-10-196-90-178 9.0-CURRENT FreeBSD 9.0-CURRENT #68: Sun Dec 12 03:52:29 UTC 2010 r...@chch.daemonology.net:/usr/obj/i386.i386/usr/src/sys/XEN i386 (Sent to the freebsd-xen mailing list as well) -- Collin Forbescollin.for...@gmail.com ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: FreeBSD/EC2 lives!
On 12/20/10 13:21, Collin Forbes wrote: > the last line I see before the panic is: > > checking whether mlock is broken... Yep, known issue -- this is PR kern/140313. > I'm a debugging n00b however. What do you need in terms of a debugging > report? I have files in /var/crash as a result of the two panics at > exactly the same place. > > -rw-r--r-- 1 root wheel 2 Dec 20 21:16 bounds > -rw--- 1 root wheel 149546 Dec 20 20:45 core.txt.0 > -rw--- 1 root wheel 140384 Dec 20 21:16 core.txt.1 > -rw--- 1 root wheel519 Dec 20 20:45 info.0 > -rw--- 1 root wheel518 Dec 20 21:16 info.1 > -rw-r--r-- 1 root wheel 5 Dec 11 21:52 minfree > -rw--- 1 root wheel 118460416 Dec 20 20:45 vmcore.0 > -rw--- 1 root wheel 102764544 Dec 20 21:16 vmcore.1 Can you look in the core.txt.[01] files and make sure that the backtraces match the backtrace at http://www.freebsd.org/cgi/query-pr.cgi?pr=kern/140313 Assuming they're the same, I don't think I need any more data... of course, if you want to dig through the FreeBSD kernel source code and figure out why the vm page queue mutex is not owned, that would be great. :-) (My guess is that the VM code was adjusted to push that lock down (i.e., hold it for less time) and the xen code wasn't modified at the same time, but I haven't had time to investigate this fully yet.) -- Colin Percival Security Officer, FreeBSD | freebsd.org | The power to serve Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: FreeBSD/EC2 lives!
On 12/17/10 01:29, Robert Watson wrote: > On Mon, 13 Dec 2010, Aleksey Ovcharenko wrote: >> Any plans of using ZFS there? > > I don't know about Amazon's live disk resizing policy, but at least in > our local Xen deployment of FreeBSD at Cambridge, ZFS seems like the > sensible thing so that we can do live disk resizing during provision of > VMs through cloning. Amazon EBS doesn't allow disks to be resized -- this is something I asked for a long time ago, but I'm guessing it isn't something a very large number of people are demanding. Of course, with EBS you can always create a new volume, sync everything across, then destroy the old volume[*]; so it's not as large a problem as on a local Xen deployment where the amount of disk space you have available might limit your ability to temporarily duplicate everything. [*] In theory, at least. Last time I tried I got a FreeBSD kernel panic when I detached an EBS volume from a running instance. -- Colin Percival Security Officer, FreeBSD | freebsd.org | The power to serve Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: FreeBSD/EC2 lives!
On Mon, 13 Dec 2010, Aleksey Ovcharenko wrote: Any plans of using ZFS there? I don't know about Amazon's live disk resizing policy, but at least in our local Xen deployment of FreeBSD at Cambridge, ZFS seems like the sensible thing so that we can do live disk resizing during provision of VMs through cloning. There are some missing features in GEOM to notify up the stack that a non-destructive resize has taken place, unfortunately. Pawel CC'd on the principle that he might take an interest in helping :-). (I've also given Kirk a ping about live resize for UFS -- it's an increasingly obvious missing feature that will force us, despite concerns about memory overhead, to use ZFS in virtual configurations here). Robert On 13.12.2010, at 21:00, Colin Percival wrote: Hi freebsd-xen people and wannabe FreeBSD/EC2 users, Thanks to a month of bug fixing and a lot of help from Amazon, FreeBSD is now available on EC2: http://www.daemonology.net/blog/2010-12-13-FreeBSD-on-EC2.html Only for 9.0-CURRENT and only t1.micro instances so far, though -- but we're moving in the right direction. :-) -- Colin Percival Security Officer, FreeBSD | freebsd.org | The power to serve Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org" ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: FreeBSD/EC2 lives!
Hi, If it's full PV is it 32 bit only? Last time I've checked amd64 was only hvm with PV drivers. Are there any 32bit images (tar.gz) to start with? We run Xen 3.4.3 on our servers and I'd give it a try also. We have Opteron and Xeon processors as well on the hosts. Regards, Andras Colin Percival wrote: On 12/14/10 04:04, Luke Marsden wrote: This is clearly an enormous milestone on the road to a stable FreeBSD 8 AMI which I hope will eventually work in amd64 mode on the large EC2 instances :-) I hope so too. :-) Is this working with PV net and disk drivers? Presumably to run on EC2 at all (notwithstanding their expensive cluster compute nodes which are meant for HPC and which do run HVM) it must be in fully PV mode. This is fully PV, yes. We at Hybrid Logic are very happy to provide testing, assistance and any resources we can muster to help you in this effort. Probably the biggest thing you can do to help right now is to spin up a bunch of instances, throw some load at them, and see if you can get them to panic. :-) ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: FreeBSD/EC2 lives!
On 12/14/10 04:04, Luke Marsden wrote: > This is clearly an enormous milestone on the road to a stable FreeBSD 8 > AMI which I hope will eventually work in amd64 mode on the large EC2 > instances :-) I hope so too. :-) > Is this working with PV net and disk drivers? Presumably to run on EC2 > at all (notwithstanding their expensive cluster compute nodes which are > meant for HPC and which do run HVM) it must be in fully PV mode. This is fully PV, yes. > We at Hybrid Logic are very happy to provide testing, assistance and any > resources we can muster to help you in this effort. Probably the biggest thing you can do to help right now is to spin up a bunch of instances, throw some load at them, and see if you can get them to panic. :-) -- Colin Percival Security Officer, FreeBSD | freebsd.org | The power to serve Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: FreeBSD/EC2 lives!
On Mon, 2010-12-13 at 11:00 -0800, Colin Percival wrote: > Thanks to a month of bug fixing and a lot of help from Amazon, FreeBSD > is now available on EC2 Congratulations Colin, this is absolutely fantastic news! Thank you!! This is clearly an enormous milestone on the road to a stable FreeBSD 8 AMI which I hope will eventually work in amd64 mode on the large EC2 instances :-) Is this working with PV net and disk drivers? Presumably to run on EC2 at all (notwithstanding their expensive cluster compute nodes which are meant for HPC and which do run HVM) it must be in fully PV mode. We at Hybrid Logic are very happy to provide testing, assistance and any resources we can muster to help you in this effort. We are building a cross-cloud PaaS web cluster on top of FreeBSD/ZFS. Having EC2 support is a big win for us and our clients, so this is really excellent news. Thank you again. With stable KVM, Xen HVM and soon Xen PV support, it looks like FreeBSD in the cloud is truly coming to fruition in 2011. Awesome! -- Best Regards, Luke Marsden CTO, Hybrid Logic Ltd. Web: http://www.hybrid-cluster.com/ Hybrid Web Cluster - cloud web hosting Mobile: +447791750420 ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: FreeBSD/EC2 lives!
On 12/13/10 11:58, Vasiliy G Tolstov wrote: > Great! Can You say, does freebsd support live migration and memory > hotplug? I don't think so. -- Colin Percival Security Officer, FreeBSD | freebsd.org | The power to serve Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: FreeBSD/EC2 lives!
Any plans of using ZFS there? On 13.12.2010, at 21:00, Colin Percival wrote: > Hi freebsd-xen people and wannabe FreeBSD/EC2 users, > > Thanks to a month of bug fixing and a lot of help from Amazon, FreeBSD is now > available on EC2: > http://www.daemonology.net/blog/2010-12-13-FreeBSD-on-EC2.html > > Only for 9.0-CURRENT and only t1.micro instances so far, though -- but we're > moving in the right direction. :-) > > -- > Colin Percival > Security Officer, FreeBSD | freebsd.org | The power to serve > Founder / author, Tarsnap | tarsnap.com | Online backups for the truly > paranoid ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
FreeBSD/EC2 lives!
Hi freebsd-xen people and wannabe FreeBSD/EC2 users, Thanks to a month of bug fixing and a lot of help from Amazon, FreeBSD is now available on EC2: http://www.daemonology.net/blog/2010-12-13-FreeBSD-on-EC2.html Only for 9.0-CURRENT and only t1.micro instances so far, though -- but we're moving in the right direction. :-) -- Colin Percival Security Officer, FreeBSD | freebsd.org | The power to serve Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"