Re: CFT: msk(4) 64bit DMA support

[David Schultz]

85;95;0cOn Thu, May 26, 2011, YongHyeon PYUN wrote:
> Here is a patch that implements 64bit DMA on msk(4). If you use
> msk(4) on a system that has more than 4GB memory, please try the
> patch at the following URL and let me know whether it works or not.
> You need latest msk(4) in HEAD to apply the patch.
> http://people.freebsd.org/~yongari/msk/msk.64bit.dma.diff
> 
> Previously msk(4) may have used bounce buffers on systems that have
> more than 4GB memory. You can verify whether msk(4) is using bounce
> buffers by checking the output of "sysctl hw.busdma". For instance,
> hw.busdma.zone0.total_bounced counter would increase while network
> operation is in progress.  If patch above works you wouldn't see
> the counter change anymore and it would also enhance network
> performance since it wouldn't have to copy from or to bounce
> buffers.

After applying this patch, I still see total_bounced increasing:
hw.busdma.zone0.total_bounced: 441

Note that I have MSI disabled to work around some issues with the
card becoming wedged:
hw.pci.enable_msix=0
hw.pci.enable_msi=0

Possibly relevant bits of dmesg:

FreeBSD 9.0-CURRENT #4 r222717M: Sun Jun  5 12:27:07 EDT 2011
CPU: Intel(R) Core(TM)2 Duo CPU E8400  @ 3.00GHz (3000.06-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x10676  Family = 6  Model = 17  Stepping = 6
  
Features=0xbfebfbff
  
Features2=0x8e3fd
  AMD Features=0x20100800
  AMD Features2=0x1
  TSC: P-state invariant, performance statistics
real memory  = 8589934592 (8192 MB)
avail memory = 8246677504 (7864 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table: 
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s)
ioapic0: Changing APIC ID to 4
ioapic0  irqs 0-23 on motherboard
mskc0:  port 0xae00-0xaeff mem 
0xfdefc000-0xfdef irq 17 at device 0.0 on pci4
msk0:  on mskc0
msk0: Ethernet address: 00:01:29:a3:3c:a3
miibus0:  on msk0
e1000phy0:  PHY 0 on miibus0
e1000phy0:  none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 
1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
msk0: link state changed to UP
___
freebsd-current@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

NEW_PCIB? pcib1: failed to allocate initial I/O port window: 0x4000-0x4fff

[John]

Hi Folks,

   I just attempted to update an HP385G0 system from current as of
4-15-2011 to 6-2-2011. The new system will not boot, and shows the
following message when it hangs:

pcib1: at device 3.0 on pci0
pcib1: failed to allocate initial I/O port window: 0x4000-0x4fff

   From a booting system, device 3.0 shows the following in dmesg:

pcib1:  at device 3.0 on pci0
vgapci0:  port 0x4400-0x44ff mem 
0xf600-0xf6ff,0xf5ff-0xf5ff0fff at device 3.0 on pci1

   From reading other msgs that seem related to this problem, I've
attached the dmesg, devinfo -ur, and devinfo -rv below.

   Thanks for any help solving this.

-John



DMESG:

Copyright (c) 1992-2011 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 9.0-CURRENT #0: Fri Apr 15 06:55:07 UTC 2011
nih...@zfscarp1.unx.sas.com:/usr/obj/usr/src/sys/GENERIC amd64
WARNING: WITNESS option enabled, expect reduced performance.
CPU: AMD Opteron(tm) Processor 252 (2605.97-MHz K8-class CPU)
  Origin = "AuthenticAMD"  Id = 0x20f51  Family = f  Model = 25  Stepping = 1
  
Features=0x78bfbff
  Features2=0x1
  AMD Features=0xe2500800
real memory  = 17179869184 (16384 MB)
avail memory = 16372264960 (15613 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table: 
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 2 package(s) x 1 core(s)
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
ACPI Warning: Invalid length for Pm1aControlBlock: 32, using default 16 
(20110316/tbfadt-638)
ACPI Warning: Invalid length for Pm1bControlBlock: 32, using default 16 
(20110316/tbfadt-638)
MADT: Forcing active-low polarity and level trigger for SCI
ioapic0  irqs 0-23 on motherboard
ioapic1  irqs 24-27 on motherboard
ioapic2  irqs 28-31 on motherboard
ioapic3  irqs 32-35 on motherboard
ioapic4  irqs 36-39 on motherboard
ispfw: registered firmware 
ispfw: registered firmware 
ispfw: registered firmware 
ispfw: registered firmware 
ispfw: registered firmware 
ispfw: registered firmware 
ispfw: registered firmware 
ispfw: registered firmware 
ispfw: registered firmware 
ispfw: registered firmware 
ispfw: registered firmware 
ispfw: registered firmware 
ispfw: registered firmware 
ispfw: registered firmware 
kbd1 at kbdmux0
acpi0:  on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0
cpu0:  on acpi0
cpu1:  on acpi0
pcib0:  on acpi0
pci0:  on pcib0
pcib1:  at device 3.0 on pci0
pci1:  on pcib1
ohci0:  mem 0xf7bf-0xf7bf0fff irq 19 at 
device 0.0 on pci1
usbus0:  on ohci0
ohci1:  mem 0xf7be-0xf7be0fff irq 19 at 
device 0.1 on pci1
usbus1:  on ohci1
pci1:  at device 2.0 (no driver attached)
pci1:  at device 2.2 (no driver attached)
vgapci0:  port 0x4400-0x44ff mem 
0xf600-0xf6ff,0xf5ff-0xf5ff0fff at device 3.0 on pci1
isab0:  at device 4.0 on pci0
isa0:  on isab0
atapci0:  port 
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x2000-0x200f at device 4.1 on pci0
ata0:  on atapci0
ata1:  on atapci0
pci0:  at device 4.3 (no driver attached)
pcib2:  at device 7.0 on pci0
pci2:  on pcib2
ciss0:  port 0x5000-0x50ff mem 
0xf7cf-0xf7cf1fff,0xf7c8-0xf7cb irq 24 at device 4.0 on pci2
ciss0: PERFORMANT Transport
ciss0: got 0 MSI messages]
pcib3:  at device 8.0 on pci0
pci3:  on pcib3
bge0:  mem 
0xf7df-0xf7df irq 28 at device 6.0 on pci3
bge0: CHIP ID 0x2100; ASIC REV 0x02; CHIP REV 0x21; PCI-X
miibus0:  on bge0
brgphy0:  PHY 1 on miibus0
brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 
1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge0: Ethernet address: 00:16:35:3b:7b:52
bge1:  mem 
0xf7de-0xf7de irq 29 at device 6.1 on pci3
bge1: CHIP ID 0x2100; ASIC REV 0x02; CHIP REV 0x21; PCI-X
miibus1:  on bge1
brgphy1:  PHY 1 on miibus1
brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 
1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge1: Ethernet address: 00:16:35:3b:7b:51
pcib4:  on acpi0
pci4:  on pcib4
pcib5:  at device 9.0 on pci4
pci5:  on pcib5
isp0:  port 0x6000-0x60ff mem 
0xf7ef-0xf7ef0fff irq 34 at device 7.0 on pci5
isp1:  port 0x6400-0x64ff mem 
0xf7ee-0xf7ee0fff irq 35 at device 7.1 on pci5
isp2:  port 0x6800-0x68ff mem 
0xf7ed-0xf7ed0fff irq 32 at device 8.0 on pci5
isp3:  port 0x6c00-0x6cff mem 
0xf7ec-0xf7ec0fff irq 33 at device 8.1 on pci5
pcib6:  at device 10.0 on pci4
pci6:  on pcib6
mpt0:  port 0x7000-0x70ff mem 
0xf7ff-0xf7ff,0xf7fe-0xf7fe irq 36 at device 9.0 on pci6
mpt0: MPI Version=1.3.2.0
mpt1:  port 0x7400-0x74ff mem 
0xf7fd-0xf7fd,0xf7fc-0xf7fc irq 37 at device 9.1 on pci6
mpt1: MPI Version=1.3.2.0
attimer0:  port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0