Re: FreeBSD/EC2 lives!

2011-06-22 Thread Colin Percival
On 06/21/11 22:34, Chris Fordham wrote:
> On Wed, 22 Jun 2011 15:12:55 +1000, Colin Percival wrote:
>> The current status of FreeBSD/EC2 is at
>>   http://www.daemonology.net/freebsd-on-ec2/
>>
>>> I am an engineer at RightScale and a couple of us that are FreeBSD users
>>> are looking at creating RightImages for the 5 regions.
>>> We'd like to offer our help and support if needed.
>>
>> I've released 8.2-RELEASE AMIs for t1.micro instances for all 5 regions.
>> There's also an 8.2ish AMI for cc1.4xlarge in us-east-1.
> 
> Thank you kindly Colin. We are wondering about the limited instance
> types, the issues on why this is so and if there any plans to support more?

I"m doing my best. ;-)

> In addition, is it possible to get the build source or otherwise to
> build the AMIs from scratch?

The t1.micro instances were built from 8.2-RELEASE.  The source tree used for
cc1.4xlarge was slightly modified and is included in the AMI.

-- 
Colin Percival
Security Officer, FreeBSD | freebsd.org | The power to serve
Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid
___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


Re: FreeBSD/EC2 lives!

2011-06-21 Thread Colin Percival
On 06/21/11 18:15, Chris Fordham wrote:
> On Tue, 14 Dec 2010 06:00:34 +1100, Colin Percival wrote:
>> Thanks to a month of bug fixing and a lot of help from Amazon, FreeBSD
>> is now
>> available on EC2:
>>   http://www.daemonology.net/blog/2010-12-13-FreeBSD-on-EC2.html
>>
>> Only for 9.0-CURRENT and only t1.micro instances so far, though -- but
>> we're
>> moving in the right direction. :-)
>>
> A belated big thanks again for this Colin!
> 
> Just wondering if there are any updates or developments post December
> 2010's initial release?

Yes.  The current status of FreeBSD/EC2 is at
  http://www.daemonology.net/freebsd-on-ec2/

> I am an engineer at RightScale and a couple of us that are FreeBSD users
> are looking at creating RightImages for the 5 regions.
> We'd like to offer our help and support if needed.

I've released 8.2-RELEASE AMIs for t1.micro instances for all 5 regions.
There's also an 8.2ish AMI for cc1.4xlarge in us-east-1.

-- 
Colin Percival
Security Officer, FreeBSD | freebsd.org | The power to serve
Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid
___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


Re: FreeBSD/EC2 lives!

2010-12-20 Thread Collin Forbes
On Tue, Dec 14, 2010 at 09:11:06AM -0800, Colin Percival wrote:
> 
> Probably the biggest thing you can do to help right now is to spin up a bunch
> of instances, throw some load at them, and see if you can get them to panic. 
> :-)

I signed up for Amazon EC2 last night and managed to panic my FreeBSD
instance a couple times today while compiling security/libgcrypt out of 
/usr/ports.

The panics happen during the configure phase, and the last line I see 
before the panic is:

checking whether mlock is broken... 

I'm a debugging n00b however.  What do you need in terms of a debugging 
report?  I have files in /var/crash as a result of the two panics at 
exactly the same place.

-rw-r--r--  1 root  wheel  2 Dec 20 21:16 bounds
-rw---  1 root  wheel 149546 Dec 20 20:45 core.txt.0
-rw---  1 root  wheel 140384 Dec 20 21:16 core.txt.1
-rw---  1 root  wheel519 Dec 20 20:45 info.0
-rw---  1 root  wheel518 Dec 20 21:16 info.1
-rw-r--r--  1 root  wheel  5 Dec 11 21:52 minfree
-rw---  1 root  wheel  118460416 Dec 20 20:45 vmcore.0
-rw---  1 root  wheel  102764544 Dec 20 21:16 vmcore.1

And finally my "uname -a" is:

FreeBSD ip-10-196-90-178 9.0-CURRENT FreeBSD 9.0-CURRENT #68: Sun Dec 12 
03:52:29 UTC 2010 
r...@chch.daemonology.net:/usr/obj/i386.i386/usr/src/sys/XEN  i386

(Sent to the freebsd-xen mailing list as well)

-- 
Collin Forbescollin.for...@gmail.com
___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


Re: FreeBSD/EC2 lives!

2010-12-20 Thread Colin Percival
On 12/20/10 13:21, Collin Forbes wrote:
> the last line I see before the panic is:
> 
> checking whether mlock is broken... 

Yep, known issue -- this is PR kern/140313.

> I'm a debugging n00b however.  What do you need in terms of a debugging 
> report?  I have files in /var/crash as a result of the two panics at 
> exactly the same place.
> 
> -rw-r--r--  1 root  wheel  2 Dec 20 21:16 bounds
> -rw---  1 root  wheel 149546 Dec 20 20:45 core.txt.0
> -rw---  1 root  wheel 140384 Dec 20 21:16 core.txt.1
> -rw---  1 root  wheel519 Dec 20 20:45 info.0
> -rw---  1 root  wheel518 Dec 20 21:16 info.1
> -rw-r--r--  1 root  wheel  5 Dec 11 21:52 minfree
> -rw---  1 root  wheel  118460416 Dec 20 20:45 vmcore.0
> -rw---  1 root  wheel  102764544 Dec 20 21:16 vmcore.1

Can you look in the core.txt.[01] files and make sure that the backtraces
match the backtrace at
  http://www.freebsd.org/cgi/query-pr.cgi?pr=kern/140313

Assuming they're the same, I don't think I need any more data... of course,
if you want to dig through the FreeBSD kernel source code and figure out
why the vm page queue mutex is not owned, that would be great. :-)

(My guess is that the VM code was adjusted to push that lock down (i.e.,
hold it for less time) and the xen code wasn't modified at the same time,
but I haven't had time to investigate this fully yet.)

-- 
Colin Percival
Security Officer, FreeBSD | freebsd.org | The power to serve
Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid
___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


Re: FreeBSD/EC2 lives!

2010-12-17 Thread Colin Percival
On 12/17/10 01:29, Robert Watson wrote:
> On Mon, 13 Dec 2010, Aleksey Ovcharenko wrote:
>> Any plans of using ZFS there?
> 
> I don't know about Amazon's live disk resizing policy, but at least in
> our local Xen deployment of FreeBSD at Cambridge, ZFS seems like the
> sensible thing so that we can do live disk resizing during provision of
> VMs through cloning.

Amazon EBS doesn't allow disks to be resized -- this is something I asked for
a long time ago, but I'm guessing it isn't something a very large number of
people are demanding.  Of course, with EBS you can always create a new volume,
sync everything across, then destroy the old volume[*]; so it's not as large
a problem as on a local Xen deployment where the amount of disk space you have
available might limit your ability to temporarily duplicate everything.

[*] In theory, at least.  Last time I tried I got a FreeBSD kernel panic when
I detached an EBS volume from a running instance.

-- 
Colin Percival
Security Officer, FreeBSD | freebsd.org | The power to serve
Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid
___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


Re: FreeBSD/EC2 lives!

2010-12-17 Thread Robert Watson


On Mon, 13 Dec 2010, Aleksey Ovcharenko wrote:


Any plans of using ZFS there?


I don't know about Amazon's live disk resizing policy, but at least in our 
local Xen deployment of FreeBSD at Cambridge, ZFS seems like the sensible 
thing so that we can do live disk resizing during provision of VMs through 
cloning.  There are some missing features in GEOM to notify up the stack that 
a non-destructive resize has taken place, unfortunately.  Pawel CC'd on the 
principle that he might take an interest in helping :-).


(I've also given Kirk a ping about live resize for UFS -- it's an increasingly 
obvious missing feature that will force us, despite concerns about memory 
overhead, to use ZFS in virtual configurations here).


Robert



On 13.12.2010, at 21:00, Colin Percival wrote:


Hi freebsd-xen people and wannabe FreeBSD/EC2 users,

Thanks to a month of bug fixing and a lot of help from Amazon, FreeBSD is now
available on EC2:
 http://www.daemonology.net/blog/2010-12-13-FreeBSD-on-EC2.html

Only for 9.0-CURRENT and only t1.micro instances so far, though -- but we're
moving in the right direction. :-)

--
Colin Percival
Security Officer, FreeBSD | freebsd.org | The power to serve
Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid


___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


Re: FreeBSD/EC2 lives!

2010-12-14 Thread Gót András

Hi,

If it's full PV is it 32 bit only? Last time I've checked amd64 was only hvm 
with PV drivers.


Are there any 32bit images (tar.gz) to start with? We run Xen 3.4.3 on our 
servers and I'd give it a try also. We have Opteron and Xeon processors as well 
on the hosts.


Regards,
Andras

Colin Percival wrote:

On 12/14/10 04:04, Luke Marsden wrote:

This is clearly an enormous milestone on the road to a stable FreeBSD 8
AMI which I hope will eventually work in amd64 mode on the large EC2
instances :-)


I hope so too. :-)


Is this working with PV net and disk drivers? Presumably to run on EC2
at all (notwithstanding their expensive cluster compute nodes which are
meant for HPC and which do run HVM) it must be in fully PV mode.


This is fully PV, yes.


We at Hybrid Logic are very happy to provide testing, assistance and any
resources we can muster to help you in this effort.


Probably the biggest thing you can do to help right now is to spin up a bunch
of instances, throw some load at them, and see if you can get them to panic. :-)


___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


Re: FreeBSD/EC2 lives!

2010-12-14 Thread Colin Percival
On 12/14/10 04:04, Luke Marsden wrote:
> This is clearly an enormous milestone on the road to a stable FreeBSD 8
> AMI which I hope will eventually work in amd64 mode on the large EC2
> instances :-)

I hope so too. :-)

> Is this working with PV net and disk drivers? Presumably to run on EC2
> at all (notwithstanding their expensive cluster compute nodes which are
> meant for HPC and which do run HVM) it must be in fully PV mode.

This is fully PV, yes.

> We at Hybrid Logic are very happy to provide testing, assistance and any
> resources we can muster to help you in this effort.

Probably the biggest thing you can do to help right now is to spin up a bunch
of instances, throw some load at them, and see if you can get them to panic. :-)

-- 
Colin Percival
Security Officer, FreeBSD | freebsd.org | The power to serve
Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid
___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


Re: FreeBSD/EC2 lives!

2010-12-14 Thread Luke Marsden
On Mon, 2010-12-13 at 11:00 -0800, Colin Percival wrote:
> Thanks to a month of bug fixing and a lot of help from Amazon, FreeBSD
> is now available on EC2

Congratulations Colin, this is absolutely fantastic news! Thank you!!

This is clearly an enormous milestone on the road to a stable FreeBSD 8
AMI which I hope will eventually work in amd64 mode on the large EC2
instances :-)

Is this working with PV net and disk drivers? Presumably to run on EC2
at all (notwithstanding their expensive cluster compute nodes which are
meant for HPC and which do run HVM) it must be in fully PV mode.

We at Hybrid Logic are very happy to provide testing, assistance and any
resources we can muster to help you in this effort. We are building a
cross-cloud PaaS web cluster on top of FreeBSD/ZFS. Having EC2 support
is a big win for us and our clients, so this is really excellent news.
Thank you again.

With stable KVM, Xen HVM and soon Xen PV support, it looks like FreeBSD
in the cloud is truly coming to fruition in 2011. Awesome!

-- 
Best Regards,
Luke Marsden
CTO, Hybrid Logic Ltd.

Web: http://www.hybrid-cluster.com/
Hybrid Web Cluster - cloud web hosting

Mobile: +447791750420




___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


Re: FreeBSD/EC2 lives!

2010-12-13 Thread Colin Percival
On 12/13/10 11:58, Vasiliy G Tolstov wrote:
> Great! Can You say, does freebsd support live migration and memory
> hotplug?

I don't think so.

-- 
Colin Percival
Security Officer, FreeBSD | freebsd.org | The power to serve
Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid
___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


Re: FreeBSD/EC2 lives!

2010-12-13 Thread Aleksey Ovcharenko
Any plans of using ZFS there?

On 13.12.2010, at 21:00, Colin Percival wrote:

> Hi freebsd-xen people and wannabe FreeBSD/EC2 users,
> 
> Thanks to a month of bug fixing and a lot of help from Amazon, FreeBSD is now
> available on EC2:
>  http://www.daemonology.net/blog/2010-12-13-FreeBSD-on-EC2.html
> 
> Only for 9.0-CURRENT and only t1.micro instances so far, though -- but we're
> moving in the right direction. :-)
> 
> -- 
> Colin Percival
> Security Officer, FreeBSD | freebsd.org | The power to serve
> Founder / author, Tarsnap | tarsnap.com | Online backups for the truly 
> paranoid

___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


FreeBSD/EC2 lives!

2010-12-13 Thread Colin Percival
Hi freebsd-xen people and wannabe FreeBSD/EC2 users,

Thanks to a month of bug fixing and a lot of help from Amazon, FreeBSD is now
available on EC2:
  http://www.daemonology.net/blog/2010-12-13-FreeBSD-on-EC2.html

Only for 9.0-CURRENT and only t1.micro instances so far, though -- but we're
moving in the right direction. :-)

-- 
Colin Percival
Security Officer, FreeBSD | freebsd.org | The power to serve
Founder / author, Tarsnap | tarsnap.com | Online backups for the truly paranoid
___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"