Re: [Samba] Performance Issues with GBit LAN
Now I have built the RAID into the other machine with 700 MHz Celeron and the same GBit card. This Machine has also 384 MB of RAM, so this is upgraded too. The output of Bonnie tested on the Raid looks like: [EMAIL PROTECTED] bonnie]# ./Bonnie File './Bonnie.2324', size: 104857600 Writing with putc()...done Rewriting...done Writing intelligently...done Reading with getc()...done Reading intelligently...done Seeker 1...Seeker 2...Seeker 3...start 'em...done...done...done... ---Sequential Output ---Sequential Input-- --Random-- -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- MachineMB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU 100 5084 99.0 47481 96.9 15686 15.0 5079 94.9 48069 23.0 558.3 5.6 [EMAIL PROTECTED] bonnie]# I think, the CPU-Rates are better as before in the old machine. Now the test on the (Now Onboard-IDE) 10 GB Seagate Harddisk /dev/hda/: [EMAIL PROTECTED] bonnie]# ./Bonnie File './Bonnie.2331', size: 104857600 Writing with putc()...done Rewriting...done Writing intelligently...done Reading with getc()...done Reading intelligently...done Seeker 1...Seeker 2...Seeker 3...start 'em...done...done...done... ---Sequential Output ---Sequential Input-- --Random-- -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- MachineMB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU 100 4952 98.8 36262 47.8 9078 9.6 4356 87.7 48891 23.4 338.5 3.4 [EMAIL PROTECTED] bonnie]# Here the CPU-Rates are better, too. So this should have been the first bottleneck. The dmesg now looks like: [EMAIL PROTECTED] bonnie]# dmesg Linux version 2.4.20-8 ([EMAIL PROTECTED]) (gcc version 3.2.2 20030222 (Red Hat Linux 3.2.2-5)) #1 Thu Mar 13 17:54:28 EST 2003 BIOS-provided physical RAM map: BIOS-e820: - 0009f800 (usable) BIOS-e820: 0009f800 - 000a (reserved) BIOS-e820: 000f - 0010 (reserved) BIOS-e820: 0010 - 17feb000 (usable) BIOS-e820: 17feb000 - 17fef000 (ACPI data) BIOS-e820: 17fef000 - 17fff000 (reserved) BIOS-e820: 17fff000 - 1800 (ACPI NVS) BIOS-e820: - 0001 (reserved) 0MB HIGHMEM available. 383MB LOWMEM available. On node 0 totalpages: 98283 zone(0): 4096 pages. zone(1): 94187 pages. zone(2): 0 pages. Kernel command line: auto BOOT_IMAGE=linux ro BOOT_FILE=/boot/vmlinuz-2.4.20-8 root=LABEL=/ Initializing CPU#0 Detected 701.604 MHz processor. Console: colour VGA+ 80x25 Calibrating delay loop... 1399.19 BogoMIPS Memory: 381976k/393132k available (1347k kernel code, 8592k reserved, 999k data, 132k init, 0k highmem) Dentry cache hash table entries: 65536 (order: 7, 524288 bytes) Inode cache hash table entries: 32768 (order: 6, 262144 bytes) Mount cache hash table entries: 512 (order: 0, 4096 bytes) Buffer-cache hash table entries: 32768 (order: 5, 131072 bytes) Page-cache hash table entries: 131072 (order: 7, 524288 bytes) CPU: L1 I cache: 16K, L1 D cache: 16K CPU: L2 cache: 128K Intel machine check architecture supported. Intel machine check reporting enabled on CPU#0. CPU: After generic, caps: 0383f9ff CPU: Common caps: 0383f9ff CPU: Intel Celeron (Coppermine) stepping 06 Enabling fast FPU save and restore... done. Enabling unmasked SIMD FPU exception support... done. Checking 'hlt' instruction... OK. POSIX conformance testing by UNIFIX mtrr: v1.40 (20010327) Richard Gooch ([EMAIL PROTECTED]) mtrr: detected mtrr type: Intel PCI: PCI BIOS revision 2.10 entry at 0xf0d90, last bus=2 PCI: Using configuration type 1 PCI: Probing PCI hardware Transparent bridge - Intel Corp. 82801BA/CA/DB PCI Bridge PCI: Using IRQ router PIIX [8086/2440] at 00:1f.0 isapnp: Scanning for PnP cards... isapnp: No Plug & Play device found Linux NET4.0 for Linux 2.4 Based upon Swansea University Computer Society NET3.039 Initializing RT netlink socket apm: BIOS version 1.2 Flags 0x03 (Driver version 1.16) Starting kswapd VFS: Disk quotas vdquot_6.5.1 pty: 2048 Unix98 ptys configured Serial driver version 5.05c (2001-07-08) with MANY_PORTS MULTIPORT SHARE_IRQ SERIAL_PCI ISAPNP enabled ttyS0 at 0x03f8 (irq = 4) is a 16550A ttyS1 at 0x02f8 (irq = 3) is a 16550A Real Time Clock Driver v1.10e Floppy drive(s): fd0 is 1.44M FDC 0 is a post-1991 82077 NET4: Frame Diverter 0.46 RAMDISK driver initialized: 16 RAM disks of 4096K size 1024 blocksize Uniform Multi-Platform E-IDE driver Revision: 7.00beta-2.4 ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx ICH2: IDE controller at PCI slot 00:1f.1 ICH2: chipset revision 2 ICH2: not 100% native mode: will probe irqs later ide0: BM-DMA at 0xa800-0xa807, BIOS settings: hda:DMA, hdb:pio ide1: BM-DMA at 0xa808-0xa80f, BIOS settings: hdc:pio, hdd:pio hda:
Re: [Samba] Performance Issues with GBit LAN
Dimitar Vassilev wrote: >Read the links and adjust your values accordingly. I haven't been able to >implement all options, but I have a similar problem on 10/100mbit net with a >slack 10/2.6.8 kernel. The tips on netbios over tcp and computer browser were >given me by my net admin. The rest I googled and wrote down. Hope it helps. >Please tell how it works. >Regards, >Dimitar Vassilev I adjusted the settings, and i got a plus in performance of 1 MB so i get a download of 9-10 MB now. But not what i expected. Anyway: thanks for your help, it gave me a great insight in the configuration of the samba Server. If i should Cc: you in the following mails, please let me know. Regards, Steffen Timmermann Tom Hibbert wrote: >Hi Steffen > >Looking at the configuration of the server PC, you have a Realtek >network card and an unspecified RAID card on a P2 300. I'm guessing that >the machine is based on an LX or BX chipset with PC66 or PC100 ram. I looked it up and it's an ASUS P2B-LS Motherboard with the 440BX Chipset. >You have 66mhz bandwidth to play with in the PCI bus. You also have >66mhz FSB thanks to the PII 300 CPU. All the benchmarking you have done >(both Iperf and hdparm) both test the two subsystems individually, not >together. My initial guess is that your PCI bus and/or CPU cannot drive >this system at its full potential. Look at the load average on the >server during transfer. The average loads are 0.23, 0.22, 0.12 I don't know what it means exactly, but i get them out of "top" during transfer > >Secondly you are running Redhat 9 with a Realtek 8169. There were a >number of issues with the stock Redhat 9 kernel versus a Realtek 8169, >see here >http://www.linuxquestions.org/questions/showthread.php?s=&threadid=14975 >1&highlight=8169. In fact these users are reporting only 8-10mb >throughput which is exactly what you are describing. I have tested the machine with Suse 8.2 before, but there's the same problem. Maybe because the Kernel version is almost the same? (2.4.20) >My advice to you is to roll a custom kernel for your system I have once compiled a new kernel on another machine, but i'm not familiar with it. Please tell me the commands i have to run for this. >(optimized >for Pentium 2, raid and network drivers built into kernel instead of >modules). At the Moment they're both modules [r8169.o (version 2.2 from realtek site) and the raidcontroller (which is an ITE 8212)] >Then perform a proper hard disk benchmark using Bonnie++ so >you know what the disks are truly capable of (hdparm -t doesn't cut it >in this respect). I've done it. Here are the results: On /dev/sda: [EMAIL PROTECTED] bonnie]# ./Bonnie File './Bonnie.1938', size: 104857600 Writing with putc()...done Rewriting...done Writing intelligently...done Reading with getc()...done Reading intelligently...done Seeker 1...Seeker 2...Seeker 3...start 'em...done...done...done... ---Sequential Output ---Sequential Input-- --Random-- -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- MachineMB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU 100 2419 99.2 42898 85.5 58114 98.2 2378 99.5 154956 99.9 7765.2 99.0 [EMAIL PROTECTED] bonnie]# On /dev/sdb: [EMAIL PROTECTED] bonnie]# ./Bonnie File './Bonnie.1926', size: 104857600 Writing with putc()...done Rewriting...done Writing intelligently...done Reading with getc()...done Reading intelligently...done Seeker 1...Seeker 2...Seeker 3...start 'em...done...done...done... ---Sequential Output ---Sequential Input-- --Random-- -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- MachineMB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU 100 2259 99.6 27232 99.5 60478 93.3 2382 99.6 154711 101.2 7958.0 99.5 [EMAIL PROTECTED] bonnie]# As I see, there is almost 100% CPU Used when the Program reads/writes from/to the Harddisks. In this case, do you think upgrading the System to an 700 Mhz Celeron will bring more Performance? When I want to do so, i must ensure that the data on the RAID isn't lost while transferring the harddisks and the controller to the other PC, because it's too much to transfer on the 2nd PC. (By the Way: Do you know if the Data on the disks is lost when i transfer the raid out of the one machine into another?) >Then I would compare the difference between throughput serving from both >your SCSI disk (sda) and RAID array with the benchmark data given by >bonnie++. This may reveal a CPU or FSB bottleneck. > > >Good luck and thanks > >Tom Additional information about the System: This is the dmesg output: [EMAIL PROTECTED] root]# dmesg Linux version 2.4.20-8 ([EMAIL PROTECTED]) (gcc version 3.2.2 20030222 (Red Hat Linux 3.2.2-5)) #1 Thu Mar 13 17:54:28 EST 2003 BIOS-provided physical RAM map: BIOS-e820: - 0009f800 (usable) BIOS-e820: 0009f800 - 000a
RE: [Samba] Performance Issues with GBit LAN
Hi Steffen >At first: Thanks for the response. >Here are the performance Measures of my Harddisks in the Server. As the >Harddisks are not connected to the Onboard IDE, they're not limited to 9 >MB/sec >/dev/sdb is the RAID 0, Connected to the PCI Raid Controller Card. The only >Share Samba provides is on the RAID, so performance should be enough. >/dev/sdb: >Timing buffered disk reads: 64 MB in 1.55 seconds = 41.29 MB/sec >(Redhat9.0, 256 SD-RAM, 300MHz PII, RTL8169 NIC, 2x Western Digital WD200JB >RAID 0) to my Windows-PC(AMD Athlon XP 1800+, 1024 MB DDR-RAM, WINXP PRO, >RTL8169 NIC, 2x Western Digital WD080JB RAID 0) Looking at the configuration of the server PC, you have a Realtek network card and an unspecified RAID card on a P2 300. I'm guessing that the machine is based on an LX or BX chipset with PC66 or PC100 ram. You have 66mhz bandwidth to play with in the PCI bus. You also have 66mhz FSB thanks to the PII 300 CPU. All the benchmarking you have done (both Iperf and hdparm) both test the two subsystems individually, not together. My initial guess is that your PCI bus and/or CPU cannot drive this system at its full potential. Look at the load average on the server during transfer. Secondly you are running Redhat 9 with a Realtek 8169. There were a number of issues with the stock Redhat 9 kernel versus a Realtek 8169, see here http://www.linuxquestions.org/questions/showthread.php?s=&threadid=14975 1&highlight=8169. In fact these users are reporting only 8-10mb throughput which is exactly what you are describing. My advice to you is to roll a custom kernel for your system (optimized for Pentium 2, raid and network drivers built into kernel instead of modules). Then perform a proper hard disk benchmark using Bonnie++ so you know what the disks are truly capable of (hdparm -t doesn't cut it in this respect). Then I would compare the difference between throughput serving from both your SCSI disk (sda) and RAID array with the benchmark data given by bonnie++. This may reveal a CPU or FSB bottleneck. Good luck and thanks Tom -- To unsubscribe from this list go to the following URL and read the instructions: http://lists.samba.org/mailman/listinfo/samba
Re: [Samba] Performance Issues with GBit LAN
At first: Thanks for the response. Here are the performance Measures of my Harddisks in the Server. As the Harddisks are not connected to the Onboard IDE, they're not limited to 9 MB/sec /dev/sda is the SCSI HDD where Redhat 9.0 is installed on. /dev/sdb is the RAID 0, Connected to the PCI Raid Controller Card. The only Share Samba provides is on the RAID, so performance should be enough. [EMAIL PROTECTED] /]# hdparm -t /dev/sda /dev/sda: Timing buffered disk reads: 64 MB in 5.42 seconds = 11.81 MB/sec [EMAIL PROTECTED] /]# hdparm -t /dev/sdb /dev/sdb: Timing buffered disk reads: 64 MB in 1.55 seconds = 41.29 MB/sec - Original Message - From: "Dimitar Vassilev" <[EMAIL PROTECTED]> To: "Holger Krull" <[EMAIL PROTECTED]> Cc: "Steffen Timmermann" <[EMAIL PROTECTED]>; "Sambaliste" <[EMAIL PROTECTED]> Sent: Tuesday, October 12, 2004 7:40 PM Subject: Re: [Samba] Performance Issues with GBit LAN > В отговор на Holger Krull <[EMAIL PROTECTED]>: > Please post your socket options. Where do i find them? > Disable computer browser from Control panel -> Administrative Tools->Services Wasn't disabled...done > Enable Netbios over TCP Wasn't enableddone > set SO_RCVBUF and SO_SNDBUF to a value higher than 16386 How do I set the Buffersizes and on which machine? > set dir caching. Where do i set this? > Get clients gigabit NICs The Server and the Client both have the same GBit NIC with 8169 chipset. > Best regards, > Dimitar Vassilev -- To unsubscribe from this list go to the following URL and read the instructions: http://lists.samba.org/mailman/listinfo/samba
Re: [Samba] Performance Issues with GBit LAN
Steffen Timmermann schrieb: I have 2 PC's connected with 1GBit NIC's. When I transfer a file from my File-Server (Redhat9.0, 256 SD-RAM, 300MHz PII, RTL8169 NIC, What Chipset? Maybe Intel BX? The at this time common Harddisk Interface can't read faster than about 9MB per second. If you use a separate PCI Card as Harddisk Interface enable PCI Buffers in Bios. 2x Western Digital WD200JB RAID 0) to my Windows-PC(AMD Athlon XP 1800+, 1024 MB DDR-RAM, WINXP PRO, RTL8169 NIC, 2x Western Digital WD080JB RAID 0) with Samba, i get Speeds around 8-9MB/sec. to be expected -- To unsubscribe from this list go to the following URL and read the instructions: http://lists.samba.org/mailman/listinfo/samba
