Re: [Samba] samba 3 performance issues
On Monday 01 May 2006 13:25, you wrote:
malcolm wrote:
What dows this mean in /var/log/samba/machine
(apart from everything to do with printing from Windoze to a Linux
printer taking such a long time)?
error packet at smbd/ipc.c(97) cmd=37 (SMBtrans) STATUS_BUFFER_OVERFLOW
You don't give a lot of background so I'll just respond in
the general case. The STATUS_BUFFER_OVERFLOW error is used
to indicate to a client that the RPC reply PDU will be fragmented
across multiple read requests.
When I print from Windows, I get 8 messages with STATUS_BUFFER_OVERFLOW, and
when I put the cursor over my printer icon, I see the balloon message access
denyed, no connection possible. All of this takes up to 30 seconds.
If I ignore the the warning that the printer is not accessible, I get another
3 warnings of STATUS_BUFFER_OVERFLOW, but then after about a minute, the
output appears at the printer.
My smb.conf is as follows:
[global]
workgroup = MALCOLM.NET
kernel oplocks = no
os level = 2
time server = Yes
unix extensions = Yes
encrypt passwords = yes
map to guest = Bad User
printing = CUPS
printcap name = CUPS
socket options = SO_KEEPALIVE IPTOS_LOWDELAY TCP_NODELAY
wins support = No
veto files = /*.eml/*.nws/riched20.dll/*.{*}/
# character set = ISO8859-15
log level = 3
log file = /var/log/samba/%m
interfaces = eth1 192.168.15.1/255.255.255.0
server string = Samba Server
add user script =
domain logons = no
local master = no
preferred master = auto
[printers]
comment = All Printers
path = /var/tmp
printable = yes
create mask = 0600
browseable = no
guest ok = no
[print$]
comment = Printer Drivers
path = /var/lib/samba/drivers
write list = @ntadmin root
force group = ntadmin
create mask = 0664
directory mask = 0775
browseable = yes
guest ok = no
printable = no
cheers, jerry
=
I live in a Reply-to-All world. ---
Samba--- http://www.samba.org
Centeris --- http://www.centeris.com
--
To unsubscribe from this list go to the following URL and read the
instructions: https://lists.samba.org/mailman/listinfo/samba
Re: [Samba] samba 3 performance issues
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 malcolm wrote: What dows this mean in /var/log/samba/machine (apart from everything to do with printing from Windoze to a Linux printer taking such a long time)? error packet at smbd/ipc.c(97) cmd=37 (SMBtrans) STATUS_BUFFER_OVERFLOW You don't give a lot of background so I'll just respond in the general case. The STATUS_BUFFER_OVERFLOW error is used to indicate to a client that the RPC reply PDU will be fragmented across multiple read requests. cheers, jerry = I live in a Reply-to-All world. --- Samba--- http://www.samba.org Centeris --- http://www.centeris.com -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.2 (GNU/Linux) Comment: Using GnuPG with SUSE - http://enigmail.mozdev.org iD8DBQFEVfAdIR7qMdg1EfYRAi0dAKDK5qSrRvWIqMmBZvyCW/8j77QZCwCfWenZ nGPjHQGDRQAD5GIr+Y2h2go= =6hTu -END PGP SIGNATURE- -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/listinfo/samba
Re: [Samba] samba 3 performance issues
What dows this mean in /var/log/samba/machine (apart from everything to do with printing from Windoze to a Linux printer taking such a long time)? error packet at smbd/ipc.c(97) cmd=37 (SMBtrans) STATUS_BUFFER_OVERFLOW Malcolm -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/listinfo/samba
Re: [Samba] samba 3 performance issues
hi, these questions especially go out to greg and collen: 1) (after some windows tweaking, coz windows isn't gb lan ready by default) - how did you tweak windows in detail? 2) I can tell you this, if you have the RAID-5 setup not-optimally to work with the block sizing on your Filesystem you'll never get excellent throughput. - so if i have a block size of 4kb in my filesystem i should also have 4kb blocks on the raid device? is this what you mean? is there any good article about the relationship between block sizes, file systems and raid-subsystems online? i'm very interested in this many thanks in advance!! micha -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/listinfo/samba
Re: [Samba] samba 3 performance issues
1) google for tools to improve windows lan performance. You do things like increasing the default window size, the timeout settings, and many others. You can also tune the Linux network stack as well for high bandwith services like NFS or samba by searching google. 2a) When I setup my raid-5 array ( HW RAID-5 ) I used the largest block size available 128k the filesystem blocks are 4k. This seems to be working well for us, but each system is different and pre-production we tried several blocksizes to see how they each would perform. 2b) Under ext3 you a can tune for RAID-5 by using the -E stride=X ( where x is the number of data stripes in your array or n-1 for a RAID-5 w/o HS ). This gives a hint to the OS to optimize write patterns to try and write data to dirty as few parity blocks as possible. Testing, testing, testing. There are just too many differences between hardware to state any blanket tweaks, you will have to look into all of them and see what works for you. Cheers, Eric On 4/9/06, Michael Gasch [EMAIL PROTECTED] wrote: hi, these questions especially go out to greg and collen: 1) (after some windows tweaking, coz windows isn't gb lan ready by default) - how did you tweak windows in detail? 2) I can tell you this, if you have the RAID-5 setup not-optimally to work with the block sizing on your Filesystem you'll never get excellent throughput. - so if i have a block size of 4kb in my filesystem i should also have 4kb blocks on the raid device? is this what you mean? is there any good article about the relationship between block sizes, file systems and raid-subsystems online? i'm very interested in this many thanks in advance!! micha -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/listinfo/samba -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/listinfo/samba
[Samba] samba 3 performance issues
I believe I have some hardware or configuration related performance issues running samba 3.0.14a-3sarge. Our server is an Intel Celeron 2 Ghz with 512 MB of RAM and a 3ware card using SATA disks in a RAID 5 configuration (3ware controller card). We have a gigabit network and are using Intel Gigabit ethernet cards e1000). When copying large files to the samba shares on the system, the transfer rate maxes out near 100 mb/s. We tested with nttcp and were able to get speeds of nearly 800mb/s. So I think it is safe to conclude this is not a network issue. Various tools like top, xosview and mpstat convinced us that we are bound in the CPU. Stopping the samba file transfer and the cpu idle time exceeds 90%. We are convinced that our CPU is the bottleneck, but not sure why. #cat /proc/cpuinfo processor : 0 vendor_id : GenuineIntel cpu family : 15 model : 2 model name : Intel(R) Celeron(R) CPU 2.00GHz stepping: 9 cpu MHz : 1996.920 cache size : 128 KB fdiv_bug: no hlt_bug : no f00f_bug: no coma_bug: no fpu : yes fpu_exception : yes cpuid level : 2 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe cid bogomips: 3956.73 Does anyone have any advice on how to speed up our file transfers? We regularly have to 18 GB worth of files to this system, and it would be very good if we could speed it up. At current speeds, we get no advantage at all from even having gigabit network cards! Please feel free to ask me any other questions about our system setup. Thanks in advance for any advice, Rohit -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/listinfo/samba
Re: [Samba] samba 3 performance issues
On Thu, Mar 30, 2006 at 01:52:29PM -0500, Rohit Kumar Mehta wrote: I believe I have some hardware or configuration related performance issues running samba 3.0.14a-3sarge. Our server is an Intel Celeron 2 Ghz with 512 MB of RAM and a 3ware card using SATA disks in a RAID 5 configuration (3ware controller card). We have a gigabit network and are using Intel Gigabit ethernet cards e1000). When copying large files to the samba shares on the system, the transfer rate maxes out near 100 mb/s. We tested with nttcp and were able to get speeds of nearly 800mb/s. So I think it is safe to conclude this is not a network issue. Various tools like top, xosview and mpstat convinced us that we are bound in the CPU. Stopping the samba file transfer and the cpu idle time exceeds 90%. We are convinced that our CPU is the bottleneck, but not sure why. Have you tried transferring the files using smbclient ? That will tell you if it's a Windows client issue. I'm assuming you're using Windows clients although you didn't give that information in your message. Jeremy. -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/listinfo/samba
Re: [Samba] samba 3 performance issues
On Thu, 2006-03-30 at 13:52 -0500, Rohit Kumar Mehta wrote: I believe I have some hardware or configuration related performance issues running samba 3.0.14a-3sarge. Our server is an Intel Celeron 2 Ghz with 512 MB of RAM and a 3ware card using SATA disks in a RAID 5 configuration (3ware controller card). We have a gigabit network and are using Intel Gigabit ethernet cards e1000). When copying large files to the samba shares on the system, the transfer rate maxes out near 100 mb/s. We tested with nttcp and were able to get speeds of nearly 800mb/s. So I think it is safe to conclude this is not a network issue. Various tools like top, xosview and mpstat convinced us that we are bound in the CPU. Stopping the samba file transfer and the cpu idle time exceeds 90%. We are convinced that our CPU is the bottleneck, but not sure why. #cat /proc/cpuinfo processor : 0 vendor_id : GenuineIntel cpu family : 15 model : 2 model name : Intel(R) Celeron(R) CPU 2.00GHz stepping: 9 cpu MHz : 1996.920 cache size : 128 KB fdiv_bug: no hlt_bug : no f00f_bug: no coma_bug: no fpu : yes fpu_exception : yes cpuid level : 2 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe cid bogomips: 3956.73 Does anyone have any advice on how to speed up our file transfers? We regularly have to 18 GB worth of files to this system, and it would be very good if we could speed it up. At current speeds, we get no advantage at all from even having gigabit network cards! Please feel free to ask me any other questions about our system setup. Thanks in advance for any advice, Have you done *ANY* system caching parameters, filesystem tuning, or Samba Config tuning? What have you done besides verify it is not the network itself? Have you tested throughput for the 3ware card? I can tell you this, if you have the RAID-5 setup not-optimally to work with the block sizing on your Filesystem you'll never get excellent throughput. I always tend to use largest blocking factors with the 3ware cards for RAID-5. This (for me at least) has proven the fastest and least latency ridden settings for me. But then I am using XFS on all of my 3ware RAID-5 setups. For Mirroring, I typically let the defaults work. Defaults have been by far the best setup for most filesystems. If you still believe you are suffering from CPU overload, I'd suggest sending it to the RAID-5 array with over compressed scp (with mild compression of 4 or 5) and then without compression. See what you get. I am betting the real problem comes from multiple bus-mastering cards conflicting or colliding. The Intel-E1000 and the 3ware card are definitely both bus-mastering. There are a couple of things on the Samba side you can do. Turn off Logging (you don't need it really), change the read and send buffer sizes, change the TCP setting it uses to be more in line with Gigabit, move to using Jumbo frames, get a TOE (TCP Offload Engine) NIC. Then if you still have issues, turn on logging for the stuff you are worried about (auth would be 0, etc...) and then add a sniffer to you connection. You'll definitely find something. My gut reaction is that since this is a Celeron Processor, you really need to goto 64-bit slots on the mother board. Getting a PCI-X capable motherboard would greatly help your problems. One last thing, any of the 95xx cards from 3ware are 3.3V only and are PCI2.3 compliant, they will function incorrectly possibly even be ruined or not recognized by a 5V or Auto-detect 5v/3.3v slot. The 9xxx, 8xxx and 7xxx cards can be used in either a 5V or 3.3V PCI slot. Good luck. -- greg, [EMAIL PROTECTED] The technology that is Stronger, Better, Faster: Linux Use Debian GNU/Linux, its a bazaar thing NOTICE: Due to Presidential Executive Orders, the National Security Agency may have read this email without warning, warrant, or notice, and certainly without probable cause. They may do this without any judicial or legislative oversight. You have no recourse nor protection. signature.asc Description: This is a digitally signed message part -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/listinfo/samba
Re: [Samba] samba 3 performance issues
On Thu, Mar 30, 2006 at 02:46:12PM -0500, Rohit Kumar Mehta wrote: Hi, The tests were done with BartPE/WindowsXP and with Knoppix 4.0 and smbmount. Would smbmount perform much different than smbclient? I can certainly repeat the test using a different client tomorrow. The Celeron CPU may very well be our problem. I wish it were a simple misconfiguration and not a hardware issue. Yes, smbmount might perform differently from smbclient. I don't know the smbfs codebase at all - I know a lot about the smbclient code :-). Jeremy. -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/listinfo/samba
[Samba] samba 3 performance issues
I believe I have some hardware related performance issues running samba 3.0.14a-3sarge. Our server is an Intel Celeron 2 Ghz with 512 MB of RAM and a 3ware card using SATA disks in a RAID 5 configuration (3ware controller card). We have a gigabit network and are using Intel Gigabit ethernet cards e1000). When copying large files to the samba shares on the system, the transfer rate maxes out near 100 mb/s. We tested with nttcp and were able to get speeds of nearly 800mb/s. So I think it is safe to conclude this is a software issue and not a network issue. So running top while doing this large copy, showed that smbd was the top process chewing on 80% of the CPU. Kill the copy, and the cpu idle time exceeds 90%. We are convinced that our CPU is the bottleneck, but not sure why. #cat /proc/cpuinfo processor : 0 vendor_id : GenuineIntel cpu family : 15 model : 2 model name : Intel(R) Celeron(R) CPU 2.00GHz stepping: 9 cpu MHz : 1996.920 cache size : 128 KB fdiv_bug: no hlt_bug : no f00f_bug: no coma_bug: no fpu : yes fpu_exception : yes cpuid level : 2 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe cid bogomips: 3956.73 Does anyone have any advice on how to speed up our file transfers? We regularly have to 18 GB worth of files to this system, and it would be very good if we could speed it up. At current speeds, we get no advantage from even having gigabit network cards! Please feel free to ask me any other questions about our system setup. Thanks in advance for any advice, Rohit -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/listinfo/samba
Re: [Samba] samba 3 performance issues
Beside the story Greg Folkert wrote (witch make sense) remember this about GB network carts: You'll never get a full 1000 mb/s ! i saw you have a celeron processor (witch ain't the fastest in performance) coz' gb nic's tent to use a lot processor overhead, also raid cards use (a little) processor time. hdd through put is an issue, all together makes the performance. I've tested 2 marvel yukons (pci-x) between 2 xp clients, with only memory transfers and got (after some windows tweaking, coz windows isn't gb lan ready by default) 500mb/s (so that is only 50%) and had 99% proc. load. (pentium M 1.8) on realtek gb lan cards it was even worse. so a big processor(s) and real fast hdd's might do you some good! so put this together with Greg's story, and you'll get the fact's. Cheers, and good luck with testing/tweaking Collen. Greg Folkert wrote: On Thu, 2006-03-30 at 13:52 -0500, Rohit Kumar Mehta wrote: I believe I have some hardware or configuration related performance issues running samba 3.0.14a-3sarge. Our server is an Intel Celeron 2 Ghz with 512 MB of RAM and a 3ware card using SATA disks in a RAID 5 configuration (3ware controller card). We have a gigabit network and are using Intel Gigabit ethernet cards e1000). When copying large files to the samba shares on the system, the transfer rate maxes out near 100 mb/s. We tested with nttcp and were able to get speeds of nearly 800mb/s. So I think it is safe to conclude this is not a network issue. Various tools like top, xosview and mpstat convinced us that we are bound in the CPU. Stopping the samba file transfer and the cpu idle time exceeds 90%. We are convinced that our CPU is the bottleneck, but not sure why. #cat /proc/cpuinfo processor : 0 vendor_id : GenuineIntel cpu family : 15 model : 2 model name : Intel(R) Celeron(R) CPU 2.00GHz stepping: 9 cpu MHz : 1996.920 cache size : 128 KB fdiv_bug: no hlt_bug : no f00f_bug: no coma_bug: no fpu : yes fpu_exception : yes cpuid level : 2 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe cid bogomips: 3956.73 Does anyone have any advice on how to speed up our file transfers? We regularly have to 18 GB worth of files to this system, and it would be very good if we could speed it up. At current speeds, we get no advantage at all from even having gigabit network cards! Please feel free to ask me any other questions about our system setup. Thanks in advance for any advice, Have you done *ANY* system caching parameters, filesystem tuning, or Samba Config tuning? What have you done besides verify it is not the network itself? Have you tested throughput for the 3ware card? I can tell you this, if you have the RAID-5 setup not-optimally to work with the block sizing on your Filesystem you'll never get excellent throughput. I always tend to use largest blocking factors with the 3ware cards for RAID-5. This (for me at least) has proven the fastest and least latency ridden settings for me. But then I am using XFS on all of my 3ware RAID-5 setups. For Mirroring, I typically let the defaults work. Defaults have been by far the best setup for most filesystems. If you still believe you are suffering from CPU overload, I'd suggest sending it to the RAID-5 array with over compressed scp (with mild compression of 4 or 5) and then without compression. See what you get. I am betting the real problem comes from multiple bus-mastering cards conflicting or colliding. The Intel-E1000 and the 3ware card are definitely both bus-mastering. There are a couple of things on the Samba side you can do. Turn off Logging (you don't need it really), change the read and send buffer sizes, change the TCP setting it uses to be more in line with Gigabit, move to using Jumbo frames, get a TOE (TCP Offload Engine) NIC. Then if you still have issues, turn on logging for the stuff you are worried about (auth would be 0, etc...) and then add a sniffer to you connection. You'll definitely find something. My gut reaction is that since this is a Celeron Processor, you really need to goto 64-bit slots on the mother board. Getting a PCI-X capable motherboard would greatly help your problems. One last thing, any of the 95xx cards from 3ware are 3.3V only and are PCI2.3 compliant, they will function incorrectly possibly even be ruined or not recognized by a 5V or Auto-detect 5v/3.3v slot. The 9xxx, 8xxx and 7xxx cards can be used in either a 5V or 3.3V PCI slot. Good luck. -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/listinfo/samba
