Hello, I have been following the mailing list for some time and seen 1 reference to big memory related slowdowns in the 2.4.x series of kernels which seem related. Waiting for the latest version of the kernel to see if it would clear up the issues which I believe are related to mtrr mis-assigning regions has not fixed the issue. I have been experiencing severe performance slowdowns when using the 4GB or 64GB memory options in the stock 2.4.4 kernel. When using the 1GB option performace is ok, but unfortuntly does not allow access to the 8GB which are installed in the machine. The severe memory problems seem to be out of line with the overhead for the three layer memory addressing in the 64GB memory scheme. Simple commands such as 'ls' take half a second instead of the customary .009 seconds in the lower memory configuration. The system is: 4 x 700Mhz Xeon PIII w/2MB cache 8GB ECC RAM Supermicro S2QR6 ServerWorks ServerSet III HE Chipset MB AMI Bios 3-Ware raid controller running raid5 in hardware mtrr is enabled in all situations and /proc/mtrr has always (in "off", "4GB" and "64GB" memory modes) said: borg.corp[root]~# cat /proc/mtrr reg00: base=0x00000000 ( 0MB), size=8192MB: write-back, count=1 reg01: base=0xfc000000 (4032MB), size= 64MB: uncachable, count=1 There is no problem with the system registering the whole amount of RAM, and we haven't had any problem with crashes in the limited tests we have done. The interesting part is that certain system calls take long periods to complete, this was most evident when stracing the command. The system physical RAM information is as follows: BIOS-provided physical RAM map: BIOS-e820: 0000000000000000 - 000000000009fc00 (usable) BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved) BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved) BIOS-e820: 0000000000100000 - 00000000fcdf0000 (usable) BIOS-e820: 00000000fcdf0000 - 00000000fcdff000 (ACPI data) BIOS-e820: 00000000fcdff000 - 00000000fce00000 (ACPI NVS) BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved) BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved) BIOS-e820: 00000000fff80000 - 0000000100000000 (reserved) BIOS-e820: 0000000100000000 - 0000000200000000 (usable) In the message to the list on Jan 15, 2001 by Mr. Ingo he recommended another person with slowdown problems to force a memory map on the system. We looked throught the kernel source and found that the mem= commands can only parse and return long words, not long long words. We therefore only looked to use the following memory areas: BIOS-e820: 0000000000000000 - 000000000009fc00 (usable) BIOS-e820: 0000000000100000 - 00000000fcdf0000 (usable) for a total of approximently 4GB. This yielded a lilo line that looks like: append="mem=exactmap mem=0x0009fc00@0x00000000 mem=0xfccf0000@0x00100000" We had hoped that this would yield faster performance and would allow us to manually add using echo "..." >| /proc/mtrr the final 4GB block: BIOS-e820: 0000000100000000 - 0000000200000000 (usable) Unfortunently when we ran this configuration the /proc/mtrr looked the same as before. The kernel looked like it knew it was passed the correct lines and I am still at a loss to make my MTRR look like the MTRR settings that was talked of. I have included 2 system boot logs as attachments to this letter. One is with the exactmap lines, the other is the kernel booting normally. I hope that this will cover anything I have not been able to cover. Any help is greatly appreciated. Shay
boot: linux-serial Loading linux-serial Linux version 2.4.3TV ([EMAIL PROTECTED]) (gcc version egcs-2.91.66 19990314/Linux (egcs-1.1.2 release)) #2 SMP Thu Apr 5 01:13:24 PDT 2001 BIOS-provided physical RAM map: BIOS-e820: 0000000000000000 - 000000000009fc00 (usable) BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved) BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved) BIOS-e820: 0000000000100000 - 00000000fcdf0000 (usable) BIOS-e820: 00000000fcdf0000 - 00000000fcdff000 (ACPI data) BIOS-e820: 00000000fcdff000 - 00000000fce00000 (ACPI NVS) BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved) BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved) BIOS-e820: 00000000fff80000 - 0000000100000000 (reserved) BIOS-e820: 0000000100000000 - 0000000200000000 (usable) Warning only 4GB will be used. Use a PAE enabled kernel. 3200MB HIGHMEM available. Scan SMP from c0000000 for 1024 bytes. Scan SMP from c009fc00 for 1024 bytes. Scan SMP from c00f0000 for 65536 bytes. found SMP MP-table at 000fb4d0 hm, page 000fb000 reserved twice. hm, page 000fc000 reserved twice. hm, page 000f5000 reserved twice. hm, page 000f6000 reserved twice. On node 0 totalpages: 1048576 zone(0): 4096 pages. zone(1): 225280 pages. zone(2): 819200 pages. Intel MultiProcessor Specification v1.1 Virtual Wire compatibility mode. OEM ID: AMI Product ID: CNB20HE APIC at: 0xFEE00000 Processor #0 Pentium(tm) Pro APIC version 17 Floating point unit present. Machine Exception supported. 64 bit compare & exchange supported. Internal APIC present. SEP present. MTRR present. PGE present. MCA present. CMOV present. PAT present. PSE present. PSN present. MMX present. FXSR present. XMM present. Bootup CPU Processor #1 Pentium(tm) Pro APIC version 17 Floating point unit present. Machine Exception supported. 64 bit compare & exchange supported. Internal APIC present. SEP present. MTRR present. PGE present. MCA present. CMOV present. PAT present. PSE present. PSN present. MMX present. FXSR present. XMM present. Processor #2 Pentium(tm) Pro APIC version 17 Floating point unit present. Machine Exception supported. 64 bit compare & exchange supported. Internal APIC present. SEP present. MTRR present. PGE present. MCA present. CMOV present. PAT present. PSE present. PSN present. MMX present. FXSR present. XMM present. Processor #3 Pentium(tm) Pro APIC version 17 Floating point unit present. Machine Exception supported. 64 bit compare & exchange supported. Internal APIC present. SEP present. MTRR present. PGE present. MCA present. CMOV present. PAT present. PSE present. PSN present. MMX present. FXSR present. XMM present. Bus #0 is PCI Bus #1 is PCI Bus #2 is PCI Bus #3 is ISA I/O APIC #4 Version 17 at 0xFEC00000. I/O APIC #5 Version 17 at 0xFEC01000. Int: type 0, pol 3, trig 3, bus 0, IRQ 0c, APIC ID 5, APIC INT 0f Int: type 0, pol 3, trig 3, bus 0, IRQ 3c, APIC ID 4, APIC INT 0a Int: type 0, pol 3, trig 3, bus 1, IRQ 0c, APIC ID 5, APIC INT 04 Int: type 0, pol 3, trig 3, bus 1, IRQ 10, APIC ID 5, APIC INT 0c Int: type 0, pol 3, trig 3, bus 1, IRQ 15, APIC ID 5, APIC INT 01 Int: type 0, pol 3, trig 3, bus 1, IRQ 14, APIC ID 5, APIC INT 00 Int: type 3, pol 1, trig 1, bus 3, IRQ 00, APIC ID 4, APIC INT 00 Int: type 0, pol 1, trig 1, bus 3, IRQ 01, APIC ID 4, APIC INT 01 Int: type 0, pol 1, trig 1, bus 3, IRQ 00, APIC ID 4, APIC INT 02 Int: type 0, pol 1, trig 1, bus 3, IRQ 03, APIC ID 4, APIC INT 03 Int: type 0, pol 1, trig 1, bus 3, IRQ 04, APIC ID 4, APIC INT 04 Int: type 0, pol 1, trig 1, bus 3, IRQ 06, APIC ID 4, APIC INT 06 Int: type 0, pol 1, trig 1, bus 3, IRQ 08, APIC ID 4, APIC INT 08 Int: type 0, pol 1, trig 1, bus 3, IRQ 0c, APIC ID 4, APIC INT 0c Int: type 0, pol 1, trig 1, bus 3, IRQ 0d, APIC ID 4, APIC INT 0d Int: type 0, pol 1, trig 1, bus 3, IRQ 0e, APIC ID 4, APIC INT 0e Int: type 0, pol 1, trig 1, bus 3, IRQ 0f, APIC ID 4, APIC INT 0f Lint: type 3, pol 1, trig 1, bus 3, IRQ 00, APIC ID ff, APIC LINT 00 Lint: type 1, pol 1, trig 1, bus 0, IRQ 00, APIC ID ff, APIC LINT 01 Processors: 4 mapped APIC to ffffe000 (fee00000) mapped IOAPIC to ffffd000 (fec00000) mapped IOAPIC to ffffc000 (fec01000) Kernel command line: BOOT_IMAGE=linux-serial ro root=803 console=tty0 console=ttyS0,38400n8 Initializing CPU#0 Detected 701.621 MHz processor. Console: colour VGA+ 80x25 Calibrating delay loop... 1399.19 BogoMIPS Memory: 4070940k/4194304k available (986k kernel code, 71712k reserved, 334k data, 188k init, 3225536k highmem) Dentry-cache hash table entries: 262144 (order: 9, 2097152 bytes) Buffer-cache hash table entries: 262144 (order: 8, 1048576 bytes) Page-cache hash table entries: 524288 (order: 9, 2097152 bytes) Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) VFS: Diskquotas version dquot_6.4.0 initialized CPU: L1 I cache: 16K, L1 D cache: 16K CPU: L2 cache: 2048K Intel machine check architecture supported. Intel machine check reporting enabled on CPU#0. Enabling fast FPU save and restore... done. Enabling unmasked SIMD FPU exception support... done. Checking 'hlt' instruction... OK. POSIX conformance testing by UNIFIX mtrr: v1.37 (20001109) Richard Gooch ([EMAIL PROTECTED]) mtrr: detected mtrr type: Intel CPU: L1 I cache: 16K, L1 D cache: 16K CPU: L2 cache: 2048K Intel machine check reporting enabled on CPU#0. CPU0: Intel Pentium III (Cascades) stepping 01 per-CPU timeslice cutoff: 5855.10 usecs. Getting VERSION: 40011 Getting VERSION: 40011 Getting ID: 0 Getting ID: f000000 Getting LVT0: 700 Getting LVT1: 400 enabled ExtINT on CPU#0 ESR value before enabling vector: 00000004 ESR value after enabling vector: 00000000 CPU present map: f Booting processor 1/1 eip 2000 Setting warm reset code and vector. 1. 2. 3. Asserting INIT. Waiting for send to finish... +Deasserting INIT. Waiting for send to finish... +#startup loops: 2. Sending STARTUP #1. After apic_write. Initializing CPU#1 Startup point 1. CPU#1 (phys ID: 1) waiting for CALLOUT Waiting for send to finish... +Sending STARTUP #2. After apic_write. Startup point 1. Waiting for send to finish... +After Startup. Before Callout 1. After Callout 1. CALLIN, before setup_local_APIC(). masked ExtINT on CPU#1 ESR value before enabling vector: 00000000 ESR value after enabling vector: 00000000 Calibrating delay loop... 1402.47 BogoMIPS Stack at about c544bfbc CPU: L1 I cache: 16K, L1 D cache: 16K CPU: L2 cache: 2048K Intel machine check reporting enabled on CPU#1. OK. CPU1: Intel Pentium III (Cascades) stepping 01 CPU has booted. Booting processor 2/2 eip 2000 Setting warm reset code and vector. 1. 2. 3. Asserting INIT. Waiting for send to finish... +Deasserting INIT. Waiting for send to finish... +#startup loops: 2. Sending STARTUP #1. After apic_write. Initializing CPU#2 Startup point 1. CPU#2 (phys ID: 2) waiting for CALLOUT Waiting for send to finish... +Sending STARTUP #2. After apic_write. Startup point 1. Waiting for send to finish... +After Startup. Before Callout 2. After Callout 2. CALLIN, before setup_local_APIC(). masked ExtINT on CPU#2 ESR value before enabling vector: 00000000 ESR value after enabling vector: 00000000 Calibrating delay loop... 1402.47 BogoMIPS Stack at about c545ffbc CPU: L1 I cache: 16K, L1 D cache: 16K CPU: L2 cache: 2048K Intel machine check reporting enabled on CPU#2. OK. CPU2: Intel Pentium III (Cascades) stepping 01 CPU has booted. Booting processor 3/3 eip 2000 Setting warm reset code and vector. 1. 2. 3. Asserting INIT. Waiting for send to finish... +Deasserting INIT. Waiting for send to finish... +#startup loops: 2. Sending STARTUP #1. After apic_write. Initializing CPU#3 Startup point 1. CPU#3 (phys ID: 3) waiting for CALLOUT Waiting for send to finish... +Sending STARTUP #2. After apic_write. Startup point 1. Waiting for send to finish... +After Startup. Before Callout 3. After Callout 3. CALLIN, before setup_local_APIC(). masked ExtINT on CPU#3 ESR value before enabling vector: 00000000 ESR value after enabling vector: 00000000 Calibrating delay loop... 1402.47 BogoMIPS Stack at about c545dfbc CPU: L1 I cache: 16K, L1 D cache: 16K CPU: L2 cache: 2048K Intel machine check reporting enabled on CPU#3. OK. CPU3: Intel Pentium III (Cascades) stepping 01 CPU has booted. Before bogomips. Total of 4 processors activated (5606.60 BogoMIPS). Before bogocount - setting activated=1. Boot done. ENABLING IO-APIC IRQs ...changing IO-APIC physical APIC ID to 4 ... ok. ...changing IO-APIC physical APIC ID to 5 ... ok. Synchronizing Arb IDs. ..TIMER: vector=49 pin1=2 pin2=0 ..MP-BIOS bug: 8254 timer not connected to IO-APIC ...trying to set up timer (IRQ0) through the 8259A ... ..... (found pin 0) ...works. testing the IO APIC....................... .................................... done. calibrating APIC timer ... ..... CPU clock speed is 701.6090 MHz. ..... host bus clock speed is 100.2297 MHz. cpu: 0, clocks: 1002297, slice: 200459 CPU0<T0:1002288,T1:801824,D:5,S:200459,C:1002297> cpu: 1, clocks: 1002297, slice: 200459 cpu: 2, clocks: 1002297, slice: 200459 cpu: 3, clocks: 1002297, slice: 200459 CPU1<T0:1002288,T1:601360,D:10,S:200459,C:1002297> CPU2<T0:1002288,T1:400896,D:15,S:200459,C:1002297> CPU3<T0:1002288,T1:200448,D:4,S:200459,C:1002297> checking TSC synchronization across CPUs: passed. Setting commenced=1, go go go PCI: PCI BIOS revision 2.10 entry at 0xfdbb1, last bus=2 PCI: Using configuration type 1 PCI: Probing PCI hardware PCI: Discovered peer bus 01 PCI->APIC IRQ transform: (B0,I3,P0) -> 31 PCI->APIC IRQ transform: (B0,I15,P0) -> 10 PCI->APIC IRQ transform: (B1,I3,P0) -> 20 PCI->APIC IRQ transform: (B1,I4,P0) -> 28 PCI->APIC IRQ transform: (B1,I5,P0) -> 16 PCI->APIC IRQ transform: (B1,I5,P1) -> 17 Linux NET4.0 for Linux 2.4 Based upon Swansea University Computer Society NET3.039 Starting kswapd v1.8 pty: 256 Unix98 ptys configured block: queued sectors max/low 2708968kB/2577896kB, 8000 slots per queue RAMDISK driver initialized: 16 RAM disks of 4096K size 1024 blocksize loop: loaded (max 8 devices) Serial driver version 5.05 (2000-12-13) with MANY_PORTS SHARE_IRQ SERIAL_PCI enabled ttyS00 at 0x03f8 (irq = 4) is a 16550A ttyS01 at 0x02f8 (irq = 3) is a 16550A Real Time Clock Driver v1.10d Linux agpgart interface v0.99 (c) Jeff Hartmann agpgart: Maximum main memory to use for agp memory: 816M SCSI subsystem driver Revision: 1.00 scsi0 : 3ware Storage Controller Vendor: 3ware Model: 3w-xxxx Rev: 1.0 Type: Direct-Access ANSI SCSI revision: 00 Detected scsi disk sda at scsi0, channel 0, id 0, lun 0 SCSI device sda: 900806401 512-byte hdwr sectors (461213 MB) Partition check: sda: sda1 sda2 sda3 sda4 < sda5 sda6 sda7 sda8 sda9 sda10 > NET4: Linux TCP/IP 1.0 for NET4.0 IP Protocols: ICMP, UDP, TCP, IGMP IP: routing cache hash table of 32768 buckets, 256Kbytes TCP: Hash tables configured (established 262144 bind 65536) NET4: Unix domain sockets 1.0/SMP for Linux NET4.0. VFS: Mounted root (ext2 filesystem) readonly. Freeing unused kernel memory: 188k freed
boot: linux-memserial Loading linux-memserial Linux version 2.4.3TV ([EMAIL PROTECTED]) (gcc version egcs-2.91.66 19990314/Linux (egcs-1.1.2 release)) #2 SMP Thu Apr 5 01:13:24 PDT 2001 BIOS-provided physical RAM map: BIOS-e820: 0000000000000000 - 000000000009fc00 (usable) BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved) BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved) BIOS-e820: 0000000000100000 - 00000000fcdf0000 (usable) BIOS-e820: 00000000fcdf0000 - 00000000fcdff000 (ACPI data) BIOS-e820: 00000000fcdff000 - 00000000fce00000 (ACPI NVS) BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved) BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved) BIOS-e820: 00000000fff80000 - 0000000100000000 (reserved) BIOS-e820: 0000000100000000 - 0000000200000000 (usable) user-defined physical RAM map: user: 0000000000000000 - 000000000009fc00 (usable) user: 0000000000100000 - 00000000fcdf0000 (usable) 3149MB HIGHMEM available. Scan SMP from c0000000 for 1024 bytes. Scan SMP from c009fc00 for 1024 bytes. Scan SMP from c00f0000 for 65536 bytes. found SMP MP-table at 000fb4d0 hm, page 000fb000 reserved twice. hm, page 000fc000 reserved twice. hm, page 000f5000 reserved twice. hm, page 000f6000 reserved twice. On node 0 totalpages: 1035760 zone(0): 4096 pages. zone(1): 225280 pages. zone(2): 806384 pages. Intel MultiProcessor Specification v1.1 Virtual Wire compatibility mode. OEM ID: AMI Product ID: CNB20HE APIC at: 0xFEE00000 Processor #0 Pentium(tm) Pro APIC version 17 Floating point unit present. Machine Exception supported. 64 bit compare & exchange supported. Internal APIC present. SEP present. MTRR present. PGE present. MCA present. CMOV present. PAT present. PSE present. PSN present. MMX present. FXSR present. XMM present. Bootup CPU Processor #1 Pentium(tm) Pro APIC version 17 Floating point unit present. Machine Exception supported. 64 bit compare & exchange supported. Internal APIC present. SEP present. MTRR present. PGE present. MCA present. CMOV present. PAT present. PSE present. PSN present. MMX present. FXSR present. XMM present. Processor #2 Pentium(tm) Pro APIC version 17 Floating point unit present. Machine Exception supported. 64 bit compare & exchange supported. Internal APIC present. SEP present. MTRR present. PGE present. MCA present. CMOV present. PAT present. PSE present. PSN present. MMX present. FXSR present. XMM present. Processor #3 Pentium(tm) Pro APIC version 17 Floating point unit present. Machine Exception supported. 64 bit compare & exchange supported. Internal APIC present. SEP present. MTRR present. PGE present. MCA present. CMOV present. PAT present. PSE present. PSN present. MMX present. FXSR present. XMM present. Bus #0 is PCI Bus #1 is PCI Bus #2 is PCI Bus #3 is ISA I/O APIC #4 Version 17 at 0xFEC00000. I/O APIC #5 Version 17 at 0xFEC01000. Int: type 0, pol 3, trig 3, bus 0, IRQ 0c, APIC ID 5, APIC INT 0f Int: type 0, pol 3, trig 3, bus 0, IRQ 3c, APIC ID 4, APIC INT 0a Int: type 0, pol 3, trig 3, bus 1, IRQ 0c, APIC ID 5, APIC INT 04 Int: type 0, pol 3, trig 3, bus 1, IRQ 10, APIC ID 5, APIC INT 0c Int: type 0, pol 3, trig 3, bus 1, IRQ 15, APIC ID 5, APIC INT 01 Int: type 0, pol 3, trig 3, bus 1, IRQ 14, APIC ID 5, APIC INT 00 Int: type 3, pol 1, trig 1, bus 3, IRQ 00, APIC ID 4, APIC INT 00 Int: type 0, pol 1, trig 1, bus 3, IRQ 01, APIC ID 4, APIC INT 01 Int: type 0, pol 1, trig 1, bus 3, IRQ 00, APIC ID 4, APIC INT 02 Int: type 0, pol 1, trig 1, bus 3, IRQ 03, APIC ID 4, APIC INT 03 Int: type 0, pol 1, trig 1, bus 3, IRQ 04, APIC ID 4, APIC INT 04 Int: type 0, pol 1, trig 1, bus 3, IRQ 06, APIC ID 4, APIC INT 06 Int: type 0, pol 1, trig 1, bus 3, IRQ 08, APIC ID 4, APIC INT 08 Int: type 0, pol 1, trig 1, bus 3, IRQ 0c, APIC ID 4, APIC INT 0c Int: type 0, pol 1, trig 1, bus 3, IRQ 0d, APIC ID 4, APIC INT 0d Int: type 0, pol 1, trig 1, bus 3, IRQ 0e, APIC ID 4, APIC INT 0e Int: type 0, pol 1, trig 1, bus 3, IRQ 0f, APIC ID 4, APIC INT 0f Lint: type 3, pol 1, trig 1, bus 3, IRQ 00, APIC ID ff, APIC LINT 00 Lint: type 1, pol 1, trig 1, bus 0, IRQ 00, APIC ID ff, APIC LINT 01 Processors: 4 mapped APIC to ffffe000 (fee00000) mapped IOAPIC to ffffd000 (fec00000) mapped IOAPIC to ffffc000 (fec01000) Kernel command line: BOOT_IMAGE=linux-memserial ro root=803 console=tty0 console=ttyS0,38400n8 mem=exactmap mem=0x0009fc00@0x00000000 mem=0xfccf0000@0x00100000 Initializing CPU#0 Detected 701.614 MHz processor. Console: colour VGA+ 80x25 Calibrating delay loop... 1399.19 BogoMIPS Memory: 4071796k/4143040k available (986k kernel code, 70856k reserved, 334k data, 188k init, 3225536k highmem) Dentry-cache hash table entries: 262144 (order: 9, 2097152 bytes) Buffer-cache hash table entries: 262144 (order: 8, 1048576 bytes) Page-cache hash table entries: 524288 (order: 9, 2097152 bytes) Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) VFS: Diskquotas version dquot_6.4.0 initialized CPU: L1 I cache: 16K, L1 D cache: 16K CPU: L2 cache: 2048K Intel machine check architecture supported. Intel machine check reporting enabled on CPU#0. Enabling fast FPU save and restore... done. Enabling unmasked SIMD FPU exception support... done. Checking 'hlt' instruction... OK. POSIX conformance testing by UNIFIX mtrr: v1.37 (20001109) Richard Gooch ([EMAIL PROTECTED]) mtrr: detected mtrr type: Intel CPU: L1 I cache: 16K, L1 D cache: 16K CPU: L2 cache: 2048K Intel machine check reporting enabled on CPU#0. CPU0: Intel Pentium III (Cascades) stepping 01 per-CPU timeslice cutoff: 5855.10 usecs. Getting VERSION: 40011 Getting VERSION: 40011 Getting ID: 0 Getting ID: f000000 Getting LVT0: 700 Getting LVT1: 400 enabled ExtINT on CPU#0 ESR value before enabling vector: 00000004 ESR value after enabling vector: 00000000 CPU present map: f Booting processor 1/1 eip 2000 Setting warm reset code and vector. 1. 2. 3. Asserting INIT. Waiting for send to finish... +Deasserting INIT. Waiting for send to finish... +#startup loops: 2. Sending STARTUP #1. After apic_write. Initializing CPU#1 Startup point 1. CPU#1 (phys ID: 1) waiting for CALLOUT Waiting for send to finish... +Sending STARTUP #2. After apic_write. Startup point 1. Waiting for send to finish... +After Startup. Before Callout 1. After Callout 1. CALLIN, before setup_local_APIC(). masked ExtINT on CPU#1 ESR value before enabling vector: 00000000 ESR value after enabling vector: 00000000 Calibrating delay loop... 1402.47 BogoMIPS Stack at about c5379fbc CPU: L1 I cache: 16K, L1 D cache: 16K CPU: L2 cache: 2048K Intel machine check reporting enabled on CPU#1. OK. CPU1: Intel Pentium III (Cascades) stepping 01 CPU has booted. Booting processor 2/2 eip 2000 Setting warm reset code and vector. 1. 2. 3. Asserting INIT. Waiting for send to finish... +Deasserting INIT. Waiting for send to finish... +#startup loops: 2. Sending STARTUP #1. After apic_write. Initializing CPU#2 Startup point 1. CPU#2 (phys ID: 2) waiting for CALLOUT Waiting for send to finish... +Sending STARTUP #2. After apic_write. Startup point 1. Waiting for send to finish... +After Startup. Before Callout 2. After Callout 2. CALLIN, before setup_local_APIC(). masked ExtINT on CPU#2 ESR value before enabling vector: 00000000 ESR value after enabling vector: 00000000 Calibrating delay loop... 1402.47 BogoMIPS Stack at about c5375fbc CPU: L1 I cache: 16K, L1 D cache: 16K CPU: L2 cache: 2048K Intel machine check reporting enabled on CPU#2. OK. CPU2: Intel Pentium III (Cascades) stepping 01 CPU has booted. Booting processor 3/3 eip 2000 Setting warm reset code and vector. 1. 2. 3. Asserting INIT. Waiting for send to finish... +Deasserting INIT. Waiting for send to finish... +#startup loops: 2. Sending STARTUP #1. After apic_write. Initializing CPU#3 Startup point 1. CPU#3 (phys ID: 3) waiting for CALLOUT Waiting for send to finish... +Sending STARTUP #2. After apic_write. Startup point 1. Waiting for send to finish... +After Startup. Before Callout 3. After Callout 3. CALLIN, before setup_local_APIC(). masked ExtINT on CPU#3 ESR value before enabling vector: 00000000 ESR value after enabling vector: 00000000 Calibrating delay loop... 1402.47 BogoMIPS Stack at about c5373fbc CPU: L1 I cache: 16K, L1 D cache: 16K CPU: L2 cache: 2048K Intel machine check reporting enabled on CPU#3. OK. CPU3: Intel Pentium III (Cascades) stepping 01 CPU has booted. Before bogomips. Total of 4 processors activated (5606.60 BogoMIPS). Before bogocount - setting activated=1. Boot done. ENABLING IO-APIC IRQs ...changing IO-APIC physical APIC ID to 4 ... ok. ...changing IO-APIC physical APIC ID to 5 ... ok. Synchronizing Arb IDs. ..TIMER: vector=49 pin1=2 pin2=0 ..MP-BIOS bug: 8254 timer not connected to IO-APIC ...trying to set up timer (IRQ0) through the 8259A ... ..... (found pin 0) ...works. testing the IO APIC....................... .................................... done. calibrating APIC timer ... ..... CPU clock speed is 701.5854 MHz. ..... host bus clock speed is 100.2262 MHz. cpu: 0, clocks: 1002262, slice: 200452 CPU0<T0:1002256,T1:801792,D:12,S:200452,C:1002262> cpu: 1, clocks: 1002262, slice: 200452 cpu: 3, clocks: 1002262, slice: 200452 cpu: 2, clocks: 1002262, slice: 200452 CPU1<T0:1002256,T1:601344,D:8,S:200452,C:1002262> CPU3<T0:1002256,T1:200448,D:0,S:200452,C:1002262> CPU2<T0:1002256,T1:400896,D:4,S:200452,C:1002262> checking TSC synchronization across CPUs: passed. Setting commenced=1, go go go PCI: PCI BIOS revision 2.10 entry at 0xfdbb1, last bus=2 PCI: Using configuration type 1 PCI: Probing PCI hardware PCI: Discovered peer bus 01 PCI->APIC IRQ transform: (B0,I3,P0) -> 31 PCI->APIC IRQ transform: (B0,I15,P0) -> 10 PCI->APIC IRQ transform: (B1,I3,P0) -> 20 PCI->APIC IRQ transform: (B1,I4,P0) -> 28 PCI->APIC IRQ transform: (B1,I5,P0) -> 16 PCI->APIC IRQ transform: (B1,I5,P1) -> 17 Linux NET4.0 for Linux 2.4 Based upon Swansea University Computer Society NET3.039 Starting kswapd v1.8 pty: 256 Unix98 ptys configured block: queued sectors max/low 2709538kB/2578466kB, 8000 slots per queue RAMDISK driver initialized: 16 RAM disks of 4096K size 1024 blocksize loop: loaded (max 8 devices) Serial driver version 5.05 (2000-12-13) with MANY_PORTS SHARE_IRQ SERIAL_PCI enabled ttyS00 at 0x03f8 (irq = 4) is a 16550A ttyS01 at 0x02f8 (irq = 3) is a 16550A Real Time Clock Driver v1.10d Linux agpgart interface v0.99 (c) Jeff Hartmann agpgart: Maximum main memory to use for agp memory: 816M SCSI subsystem driver Revision: 1.00 scsi0 : 3ware Storage Controller Vendor: 3ware Model: 3w-xxxx Rev: 1.0 Type: Direct-Access ANSI SCSI revision: 00 Detected scsi disk sda at scsi0, channel 0, id 0, lun 0 SCSI device sda: 900806401 512-byte hdwr sectors (461213 MB) Partition check: sda: sda1 sda2 sda3 sda4 < sda5 sda6 sda7 sda8 sda9 sda10 > NET4: Linux TCP/IP 1.0 for NET4.0 IP Protocols: ICMP, UDP, TCP, IGMP IP: routing cache hash table of 32768 buckets, 256Kbytes TCP: Hash tables configured (established 262144 bind 65536) NET4: Unix domain sockets 1.0/SMP for Linux NET4.0. VFS: Mounted root (ext2 filesystem) readonly. Freeing unused kernel memory: 188k freed cat /proc/mtrr reg00: base=0x00000000 ( 0MB), size=8192MB: write-back, count=1 reg01: base=0xfc000000 (4032MB), size= 64MB: uncachable, count=1 borg.corp[root]~#