Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-12-11 Thread Greg Miller
Ivan Voras wrote: Ivan Voras wrote: Another data point - the OS in the VM in question hanged today sometime after 5 AM in the following way: * console nonresponsive (also to ctrl-alt-del) * ssh login nonresponsive (timeout) * ping works (!) Judging by the last seen timestamp, th

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-19 Thread Ivan Voras
Ivan Voras wrote: Another data point - the OS in the VM in question hanged today sometime after 5 AM in the following way: * console nonresponsive (also to ctrl-alt-del) * ssh login nonresponsive (timeout) * ping works (!) Judging by the last seen timestamp, the machine should hav

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-15 Thread Janet Sullivan
Steven Hartland wrote: We're not running 8 yet but we do have a 7.x box which its under fairly high IO load doing mrtg graphs which has similar behaviour. When typing a command on ssh it will freeze for may seconds. We have a FreeBSD 7.2 cacti box running on a dell 1950 that has the same prob

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-15 Thread Ivan Voras
Ivan Voras wrote: 2009/10/13 Larry Rosenman : note huge packet loss. It looks like it's VM fault or something like it. It sounds like the VM is failing to execute the guest during certain types of I/O. A bit of scheduler tracing in the host OS probably wouldn't go amiss to confirm that the VM

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-15 Thread Giovanni Trematerra
On Oct 12, 2009, at 10:45 AM, Thomas Backman wrote: >Here's the original thread (not from the beginning, though): >http://lists.freebsd.org/pipermail/freebsd-performance/2009-October/003843.html >Long story short, my version: when the disk is stressed hard enough, >console IO becomes COMPLETELY un

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-14 Thread Luigi Rizzo
On Tue, Oct 13, 2009 at 09:58:09AM +0200, Thomas Backman wrote: > > On Oct 13, 2009, at 12:35 AM, Luigi Rizzo wrote: ... > >hi, > >this issue (not specific to FreeBSD, and not new -- it has been > >like this forever) is discussed in some detail here > > > > http://www.bsdcan.org/2009/schedule/

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-14 Thread Ivan Voras
Kris Kennaway wrote: Ivan Voras wrote: I recall others having various weird problems in 3.5 that went away when they upgraded to 4.0. It would be a good idea except that apparently my installation is unupgradeable because of "unsupported boot disk" (a SCSI RAID volume).

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-14 Thread Kris Kennaway
Ivan Voras wrote: 2009/10/13 Larry Rosenman : note huge packet loss. It looks like it's VM fault or something like it. It sounds like the VM is failing to execute the guest during certain types of I/O. A bit of scheduler tracing in the host OS probably wouldn't go amiss to confirm that the VM

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-14 Thread Ivan Voras
Larry Rosenman wrote: On Tue, 13 Oct 2009, Ivan Voras wrote: As for what data is needed, it depends on what you can get - from this discussion thread it looks like it would be enough to verify that disk IO doesn't leave VM processes waiting (i.e. that disk IO doesn't interfere with CPU-bound o

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-13 Thread Larry Rosenman
On Tue, 13 Oct 2009, Ivan Voras wrote: 2009/10/13 Larry Rosenman : note huge packet loss. It looks like it's VM fault or something like it. It sounds like the VM is failing to execute the guest during certain types of I/O. A bit of scheduler tracing in the host OS probably wouldn't go amiss

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-13 Thread Ivan Voras
2009/10/13 Larry Rosenman : note huge packet loss. It looks like it's VM fault or something like it. >>> >>> It sounds like the VM is failing to execute the guest during certain >>> types of I/O. A bit of scheduler tracing in the host OS probably wouldn't go >>> amiss to confirm that the VM r

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-13 Thread Larry Rosenman
On Tue, 13 Oct 2009, Ivan Voras wrote: Robert N. M. Watson wrote: On 13 Oct 2009, at 14:33, Ivan Voras wrote: If (1) is highly variable during I/O, it's almost certainly a property of the VM technology you're using, and there's nought to be done about it in the guest OS. Here's an example

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-13 Thread Ivan Voras
Robert N. M. Watson wrote: On 13 Oct 2009, at 14:33, Ivan Voras wrote: If (1) is highly variable during I/O, it's almost certainly a property of the VM technology you're using, and there's nought to be done about it in the guest OS. Here's an example of a ping session with 0.1s resolution

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-13 Thread Ivan Voras
Robert N. M. Watson wrote: On 13 Oct 2009, at 14:33, Ivan Voras wrote: If (1) is highly variable during I/O, it's almost certainly a property of the VM technology you're using, and there's nought to be done about it in the guest OS. Here's an example of a ping session with 0.1s resolution

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-13 Thread Robert N. M. Watson
On 13 Oct 2009, at 14:33, Ivan Voras wrote: If (1) is highly variable during I/O, it's almost certainly a property of the VM technology you're using, and there's nought to be done about it in the guest OS. Here's an example of a ping session with 0.1s resolution during a few seconds-stall

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-13 Thread Ivan Voras
2009/10/13 Robert Watson : > > On Tue, 13 Oct 2009, Ivan Voras wrote: > >> Thomas Backman wrote: >>> >>> I'm copying this over from the freebsd-performance list, as I'm looking >>> for a few more opinions - not on the problems *I* am having, but rather to >>> check whether the problem is universal

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-13 Thread Robert Watson
On Tue, 13 Oct 2009, Ivan Voras wrote: Thomas Backman wrote: I'm copying this over from the freebsd-performance list, as I'm looking for a few more opinions - not on the problems *I* am having, but rather to check whether the problem is universal or not, and if not, find a possible common fa

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-13 Thread Svein Skogen (listmail account)
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Ivan Voras wrote: > Thomas Backman wrote: >> I'm copying this over from the freebsd-performance list, as I'm >> looking for a few more opinions - not on the problems *I* am having, >> but rather to check whether the problem is universal or not, and if

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-13 Thread Ivan Voras
Thomas Backman wrote: I'm copying this over from the freebsd-performance list, as I'm looking for a few more opinions - not on the problems *I* am having, but rather to check whether the problem is universal or not, and if not, find a possible common factor. In other words: I want to hear abou

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-13 Thread Luigi Rizzo
On Tue, Oct 13, 2009 at 11:13:31AM +0100, Kris Kennaway wrote: > Luigi Rizzo wrote: > >On Mon, Oct 12, 2009 at 09:48:42PM +0200, Thomas Backman wrote: > >>I'm copying this over from the freebsd-performance list, as I'm > >>looking for a few more opinions - not on the problems *I* am having, > >

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-13 Thread Kris Kennaway
Luigi Rizzo wrote: On Mon, Oct 12, 2009 at 09:48:42PM +0200, Thomas Backman wrote: I'm copying this over from the freebsd-performance list, as I'm looking for a few more opinions - not on the problems *I* am having, but rather to check whether the problem is universal or not, and if not, fi

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-13 Thread Thomas Backman
On Oct 13, 2009, at 12:35 AM, Luigi Rizzo wrote: On Mon, Oct 12, 2009 at 09:48:42PM +0200, Thomas Backman wrote: I'm copying this over from the freebsd-performance list, as I'm looking for a few more opinions - not on the problems *I* am having, but rather to check whether the problem is unive

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-12 Thread Luigi Rizzo
On Mon, Oct 12, 2009 at 09:48:42PM +0200, Thomas Backman wrote: > I'm copying this over from the freebsd-performance list, as I'm > looking for a few more opinions - not on the problems *I* am having, > but rather to check whether the problem is universal or not, and if > not, find a possible

Re: Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-12 Thread Steven Hartland
o: "freebsd-stable" Sent: Monday, October 12, 2009 8:48 PM Subject: Extreme console latency during disk IO (8.0-RC1,previous releases also affected according to others) I'm copying this over from the freebsd-performance list, as I'm looking for a few more opinions - not on the

Extreme console latency during disk IO (8.0-RC1, previous releases also affected according to others)

2009-10-12 Thread Thomas Backman
I'm copying this over from the freebsd-performance list, as I'm looking for a few more opinions - not on the problems *I* am having, but rather to check whether the problem is universal or not, and if not, find a possible common factor. In other words: I want to hear about your experiences,