Re: Best way to measure disk bandwidth usage

2007-11-07 Thread Doug Clements
On 11/7/07, Andrea Venturoli <[EMAIL PROTECTED]> wrote:
>
> Hello.
> I've got a couple of servers which I'd like to keep an eye on in order
> to check wether their storage subsection is providing enough throughput
> or wether disk i/o is their bottleneck.
>
> I know how to check this wrt cpu usage, memory size, network throughput,
> but I'm totally lost when it comes to disk i/o.
> I can run top and press 'm': this will allow me to know which processes
> are using disk the most, but not wether I'm exploiting the hardware to
> the limit or just to a small fraction of what it can do.



gstat, iostat, and systat -vm are the tools I use for this.

--Doug
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: Migrating a file system with minimal downtime

2007-10-30 Thread Doug Clements
On 10/30/07, Daniel Eriksson <[EMAIL PROTECTED]> wrote:
>
>
> I want to migrate a file system containing multiple jails from a small
> drive to a large (RAID-1) array. I want to do this with minimal
> downtime.
>

I did a migration like this, but instead of dump, I used rdist. Take an
initial snapshot (live) with rdist, then when you're ready to do the final
copy, the offline rdist will run much more quickly, resulting in less
downtime. Replace rdist with rsync if you like.

--Doug
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: Windows SSH client?

2007-10-24 Thread Doug Clements
On 10/24/07, Eric F Crist <[EMAIL PROTECTED]> wrote:
>
> Hey folks,
>
> I'm looking for a good, free, SSH client that has line/column numbers
> at the bottom, similar to SecureCRT.  Any advice is appreciated!
>

Free for non-commercial use:

http://ssh.com/

--Doug
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Interrupt problems with 6.2 NFS Server

2007-10-12 Thread Doug Clements
Hi,
   I have an new NFS server that is processing roughly 15mbit of NFS traffic
that we recently upgraded from an older 4.10 box. It has a 3-ware raid card,
and is serving NFS out a single em nic to LAN clients. The machine works
great just serving NFS, but when I try to copy data from one raid volume to
another for backups, the machine's NFS performance goes way down, and NFS
ops start taking multiple seconds to perform. The file copy goes quite
quickly, as would be expected. The console of the machine also starts to lag
pretty badly, and I get the 'typing through mud' effect. I use rdist6 to do
the backup.

My first impression was that I was having interrupt issues, since during the
backup, the em interfaces were pushing over 200k interrupts/sec (roughly 60%
CPU processing interrupts). So I recompiled the kernel with polling enabled
and enabled it on the NICs. The strange thing is that polling shows enabled
in ifconfig, but systat -vm still shows the same amount of interrupts. I get
the same performance with polling enabled.

I'm looking for some guidance on why the machine bogs so much during what
seems to me to be something that should barely impact machine performance at
all. The old machine was 6 years old running an old intel raid5, and it
handled NFS and the concurrent file copies without a sweat.

My 3ware is setup as follows:
a 2 disk mirror, for the system
a 4 disk raid10, for /mnt/data1
a 4 disk raid10, for /mnt/data2

Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 6.2-RELEASE-p8 #0: Thu Oct 11 10:43:22 PDT 2007
[EMAIL PROTECTED]:/usr/obj/usr/src/sys/MADONNA
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Genuine Intel(R) CPU  @ 2.66GHz (2670.65-MHz K8-class
CPU)
  Origin = "GenuineIntel"  Id = 0x6f4  Stepping = 4

Features=0xbfebfbff

Features2=0x4e3bd,CX16,,,>
  AMD Features=0x20100800
  AMD Features2=0x1
  Cores per package: 2
real memory  = 4831838208 (4608 MB)
avail memory = 4125257728 (3934 MB)
ACPI APIC Table: 
ioapic0  irqs 0-23 on motherboard
ioapic1  irqs 24-47 on motherboard
lapic0: Forcing LINT1 to edge trigger
kbd1 at kbdmux0
ath_hal: 0.9.17.2 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
acpi0:  on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
cpu0:  on acpi0
acpi_throttle0:  on cpu0
acpi_button0:  on acpi0
acpi_button1:  on acpi0
pcib0:  port 0xca2,0xca3,0xcf8-0xcff on acpi0
pci0:  on pcib0
pcib1:  at device 2.0 on pci0
pci1:  on pcib1
pcib2:  irq 16 at device 0.0 on pci1
pci2:  on pcib2
pcib3:  irq 16 at device 0.0 on pci2
pci3:  on pcib3
pcib4:  irq 17 at device 1.0 on pci2
pci4:  on pcib4
pcib5:  irq 18 at device 2.0 on pci2
pci5:  on pcib5
em0:  port
0x3020-0x303f mem 0xf882-0xf883,0xf840-0xf87f irq 18 at
device 0.0 on pci5
em0: Ethernet address: 00:15:17:21:bf:30
em1:  port
0x3000-0x301f mem 0xf880-0xf881,0xf800-0xf83f irq 19 at
device 0.1 on pci5
em1: Ethernet address: 00:15:17:21:bf:31
pcib6:  at device 0.3 on pci1
pci6:  on pcib6
3ware device driver for 9000 series storage controllers, version:
3.60.02.012
twa0: <3ware 9000 series Storage Controller> port 0x2000-0x203f mem
0xfa00-0xfbff,0xf890-0xf8900fff irq 26 at device 2.0 on pci6
twa0: [GIANT-LOCKED]
twa0: INFO: (0x15: 0x1300): Controller details:: Model 9550SX-12, 12 ports,
Firmware FE9X 3.08.00.004, BIOS BE9X 3.08.00.002
pcib7:  at device 3.0 on pci0
pci7:  on pcib7
pcib8:  at device 4.0 on pci0
pci8:  on pcib8
pcib9:  at device 5.0 on pci0
pci9:  on pcib9
pcib10:  at device 6.0 on pci0
pci10:  on pcib10
pcib11:  at device 7.0 on pci0
pci11:  on pcib11
pci0:  at device 8.0 (no driver attached)
pcib12:  irq 16 at device 28.0 on pci0
pci12:  on pcib12
uhci0:  port 0x4080-0x409f irq 23 at device
29.0 on pci0
uhci0: [GIANT-LOCKED]
usb0:  on uhci0
usb0: USB revision 1.0
uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1:  port 0x4060-0x407f irq 22 at device
29.1 on pci0
uhci1: [GIANT-LOCKED]
usb1:  on uhci1
usb1: USB revision 1.0
uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhci2:  port 0x4040-0x405f irq 23 at device
29.2 on pci0
uhci2: [GIANT-LOCKED]
usb2:  on uhci2
usb2: USB revision 1.0
uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
uhci3:  port 0x4020-0x403f irq 22 at device
29.3 on pci0
uhci3: [GIANT-LOCKED]
usb3:  on uhci3
usb3: USB revision 1.0
uhub3: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub3: 2 ports with 2 removable, self powered
ehci0:  mem 0xf8c00400-0xf8c007ff irq 23
at device 29.7 on pci0
ehci0: [GIA

Interrupt/speed problems with 6.2 NFS server

2007-10-12 Thread Doug Clements
Hi,
   I have an new NFS server that is processing roughly 15mbit of NFS traffic
that we recently upgraded from an older 4.10 box. It has a 3-ware raid card,
and is serving NFS out a single em nic to LAN clients. The machine works
great just serving NFS, but when I try to copy data from one raid volume to
another for backups, the machine's NFS performance goes way down, and NFS
ops start taking multiple seconds to perform. The file copy goes quite
quickly, as would be expected. The console of the machine also starts to lag
pretty badly, and I get the 'typing through mud' effect. I use rdist6 to do
the backup.

My first impression was that I was having interrupt issues, since during the
backup, the em interfaces were pushing over 200k interrupts/sec (roughly 60%
CPU processing interrupts). So I recompiled the kernel with polling enabled
and enabled it on the NICs. The strange thing is that polling shows enabled
in ifconfig, but systat -vm still shows the same amount of interrupts. I get
the same performance with polling enabled.

I'm looking for some guidance on why the machine bogs so much during what
seems to me to be something that should barely impact machine performance at
all. The old machine was 6 years old running an old intel raid5, and it
handled NFS and the concurrent file copies without a sweat.

My 3ware is setup as follows:
a 2 disk mirror, for the system
a 4 disk raid10, for /mnt/data1
a 4 disk raid10, for /mnt/data2

Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 6.2-RELEASE-p8 #0: Thu Oct 11 10:43:22 PDT 2007
[EMAIL PROTECTED] :/usr/obj/usr/src/sys/MADONNA
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Genuine Intel(R) CPU  @ 2.66GHz (2670.65-MHz K8-class
CPU)
  Origin = "GenuineIntel"  Id = 0x6f4  Stepping = 4

Features=0xbfebfbff

Features2=0x4e3bd,CX16,,,>
  AMD Features=0x20100800
  AMD Features2=0x1
  Cores per package: 2
real memory  = 4831838208 (4608 MB)
avail memory = 4125257728 (3934 MB)
ACPI APIC Table: 
ioapic0  irqs 0-23 on motherboard
ioapic1  irqs 24-47 on motherboard
lapic0: Forcing LINT1 to edge trigger
kbd1 at kbdmux0
ath_hal: 0.9.17.2 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
acpi0:  on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
cpu0:  on acpi0
acpi_throttle0:  on cpu0
acpi_button0:  on acpi0
acpi_button1:  on acpi0
pcib0:  port 0xca2,0xca3,0xcf8-0xcff on acpi0
pci0:  on pcib0
pcib1:  at device 2.0 on pci0
pci1:  on pcib1
pcib2:  irq 16 at device 0.0 on pci1
pci2:  on pcib2
pcib3:  irq 16 at device 0.0 on pci2
pci3:  on pcib3
pcib4:  irq 17 at device 1.0 on pci2
pci4:  on pcib4
pcib5:  irq 18 at device 2.0 on pci2
pci5:  on pcib5
em0:  port
0x3020-0x303f mem 0xf882-0xf883,0xf840-0xf87f irq 18 at
device 0.0 on pci5
em0: Ethernet address: 00:15:17:21:bf:30
em1:  port
0x3000-0x301f mem 0xf880-0xf881,0xf800-0xf83f irq 19 at
device 0.1 on pci5
em1: Ethernet address: 00:15:17:21:bf:31
pcib6:  at device 0.3 on pci1
pci6:  on pcib6
3ware device driver for 9000 series storage controllers, version:
3.60.02.012
twa0: <3ware 9000 series Storage Controller> port 0x2000-0x203f mem
0xfa00-0xfbff,0xf890-0xf8900fff irq 26 at device 2.0 on pci6
twa0: [GIANT-LOCKED]
twa0: INFO: (0x15: 0x1300): Controller details:: Model 9550SX-12, 12 ports,
Firmware FE9X 3.08.00.004, BIOS BE9X 3.08.00.002
pcib7:  at device 3.0 on pci0
pci7:  on pcib7
pcib8:  at device 4.0 on pci0
pci8:  on pcib8
pcib9:  at device 5.0 on pci0
pci9:  on pcib9
pcib10:  at device 6.0 on pci0
pci10:  on pcib10
pcib11:  at device 7.0 on pci0
pci11:  on pcib11
pci0:  at device 8.0 (no driver attached)
pcib12:  irq 16 at device 28.0 on pci0
pci12:  on pcib12
uhci0:  port 0x4080-0x409f irq 23 at device
29.0 on pci0
uhci0: [GIANT-LOCKED]
usb0:  on uhci0
usb0: USB revision 1.0
uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1:  port 0x4060-0x407f irq 22 at device
29.1 on pci0
uhci1: [GIANT-LOCKED]
usb1:  on uhci1
usb1: USB revision 1.0
uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhci2:  port 0x4040-0x405f irq 23 at device
29.2 on pci0
uhci2: [GIANT-LOCKED]
usb2:  on uhci2
usb2: USB revision 1.0
uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
uhci3:  port 0x4020-0x403f irq 22 at device
29.3 on pci0
uhci3: [GIANT-LOCKED]
usb3:  on uhci3
usb3: USB revision 1.0
uhub3: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub3: 2 ports with 2 removable, self powered
ehci0:  mem 0xf8c00400-0xf8c007ff irq 23
at device 29.7 on pci0
ehci0: [GI