Re: serious networking (em) performance (ggate and NFS) problem

2004-11-18 Thread Andreas Braukmann
--On Mittwoch, 17. November 2004 20:48 Uhr -0500 Mike Jakubik [EMAIL 
PROTECTED] wrote:
I have two PCs connected together, using the em card. One is FreeBSD 6
from Fri Nov  5 , the other is Windows XP. I am using the default mtu of
1500, no polling, and i get ~ 21MB/s tranfser rates via ftp. Im sure this
would be higher with jumbo frames.
probably
Both computers are AMD cpus with Via
chipsets.
Which AMD Chipset? VIA did some pretty bad PCI implementations
in the past. Once I wondered about suspiciously low transfer
rates in the process of testing 3Ware and Adaptec (2120S, 2200S)
RAID-Controllers. The transfer rates maxed out at ca. 30 MByte/s.
Switching the testboxes mainboard from one with VIA chipset to
one with  an AMD (MP / MPX) chipset was a great success.
-Andreas
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Performance issues in 5.3-RELEASE.

2004-11-18 Thread Ronald Klop
On Wed, 17 Nov 2004 10:40:23 +0100, Krzysztof Kowalik  
[EMAIL PROTECTED] wrote:

Hello,
   Recently I took some time to upgrade my home 4.9 system to
5.3-RELEASE (fortunately, taking full system dump before, so I can
easily get back). In fact just after upgrading I ran into the weird
issue during installation for firefox port.
When firefox-1.0-source.tar.bz2 is getting untared, the system starts to
be *slow*: any music starts to be jittered and the cursor in X stalls
from time to time for ~1 second.
For what I have seen everybody uses snd_emu10k1. Since I use my onboard  
soundcard (snd_ess* (not MPSAFE)) I have less problems with my sound under  
disk load.

Bit is just experience. I don't know about code internals.
Oh, I saw a post a while ago on stable@ or on current@ about a buffer in  
emu10k1. If it was increased it had less problems. Don't have the time to  
look up the post, sorry.

Ronald.
--
 Ronald Klop, Amsterdam, The Netherlands
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: vmstat regression (RELENG_4 - RELENG_5)

2004-11-18 Thread Dmitry Pryanishnikov
Hello!
On Wed, 17 Nov 2004, Paul Mather wrote:
kernel devstat(9) subsystem only sees my ad0. Under 4.10-RELEASE, sysctl
kern.devstat.numdevs gives 3, but under 5.3-RELEASE only 1. How can I enable
disk statistics gathering for disks other than HDD in 5.3-RELEASE?
The gstat(8) command will display statistics for all GEOM disks,
including floppy and CD-{ROM,R,RW}.
   Sure I can use gstat (it actually displays statistics for acd0 and fd0) but
I consider current behaviour regarding devstat(9) as broken. Note that if I
configure atapicam into the kernel, devstat sees ad0, cd0 and pass0, but 
doesn't see acd0 and fd0. What's the problem with those devices? What
makes especially cd0 better than acd0?!

Sincerely, Dmitry
--
Atlantis ISP, System Administrator
e-mail:  [EMAIL PROTECTED]
nic-hdl: LYNX-RIPE
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Pam Authorization Problem

2004-11-18 Thread jesk
Hi, thanks for your reply!
my goal is to authenticate through ldap and to do some specific 
authorization checks.
for failover i have one account in /etc/passwd in case of a downtime of 
ldap so that its still possible to login throught local authentication. 
Further more i have inside of ldap.conf the following:
---
# Group to enforce membership of
pam_groupdn cn=klever,ou=hosts,dc=xxx,dc=xxx,dc=xxx

# Group member attribute
pam_member_attribute uniqueMember
---
this should do authorization and should only allow to login if the account 
who is login in also exists in 'cn=klever,ou=hosts,dc=xxx,dc=xxx,dc=xxx' 
with its full DN inside the uniqueMember attribute.
Authentication is already working with AUTH directive inside of 
/etc/pam.d/sshd.
So i want to allow any user to login if in ACCOUNT the check with pam_ldap 
is true and the user exists also there or if the user exists inside of 
/etc/passwd.

First of all -- be clear on where the user record exists.  Identify if
'klever' exists both in LDAP and locally, or in only one.  You will drive
yourself nuts if you don't keep this straight. I suggest creating local-
and directory-only test users when hacking on PAM.
this is what i have done.
Secondly, understand what checks happen where.  With PADL pam_ldap the
only way you can tell most of this is to read the code, sadly.  In this
case, the various access checks happen in pam_sm_acct_mgmt(), which
corresponds to 'account' in pam.conf.
i dont have much C knowledge so this will be very hard.
Because you have specified that the failure of pam_ldap is not fatal to
the account stack. The sufficient control means:
If this module returns success, then stop stack processing and return
success to the application. Otherwise continue processing.
Since the access check constitutes a failure and sufficient
effectively ignores failures, you've made the access checks useless. :)
You probably want to set it to required, but there are a couple of
options to mask certain failure modes you may need to set so that you get
the proper fallback to local logins.  Those options are
ignore_unknown_user
ignore_authinfo_unavail
Add thesse to the end of the 'account ..pam_ldap' line.
If you don't want to set the options you can move it below pam_unix, but
the control must still be required for the appropriate action to be
taken.  Remember, you need to treat ldap failing as fatal to the stack if
you want the access controls to have any effect.
PAM is horrifically compilicated. I just spent 2 months implementing it at
my employer and getting the cases right is a bitch. In fact, its still
wrong there. :(
I have all combinations tried in the ACCOUNT section but without the 
special attributes you have written about 
'ignore_unknown_user/ignore_authinfo_unavail'.
i will test them, maybe they are the only missing and required things to 
get this working.

___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Performance issues in 5.3-RELEASE.

2004-11-18 Thread Suleiman Souhlal
Hi,

On Thu, 2004-11-18 at 03:46, Ronald Klop wrote:
 For what I have seen everybody uses snd_emu10k1. Since I use my onboard  
 soundcard (snd_ess* (not MPSAFE)) I have less problems with my sound under  
 disk load.

  None of the sound drivers are actually MPSAFE.. The reason people that
use snd_emu10k1 are more affected by this is because it has a smaller
default buffer size (4096) than the other drivers.

-- 
Suleiman Souhlal| [EMAIL PROTECTED]
The FreeBSD Project | [EMAIL PROTECTED]

___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Pam Authorization Problem

2004-11-18 Thread jesk
Because you have specified that the failure of pam_ldap is not fatal to
the account stack. The sufficient control means:
If this module returns success, then stop stack processing and return
success to the application. Otherwise continue processing.
Since the access check constitutes a failure and sufficient
effectively ignores failures, you've made the access checks useless. :)
You probably want to set it to required, but there are a couple of
options to mask certain failure modes you may need to set so that you get
the proper fallback to local logins.  Those options are
ignore_unknown_user
ignore_authinfo_unavail
Add thesse to the end of the 'account ..pam_ldap' line.
in fact, this is really working with such options:
---
# auth
authrequiredpam_nologin.so  no_warn
authsufficient  pam_opie.so no_warn 
no_fake_prompts
authrequisite   pam_opieaccess.so   no_warn allow_local
#auth   sufficient  pam_krb5.so no_warn 
try_first_pass
#auth   sufficient  pam_ssh.so  no_warn 
try_first_pass
authsufficient  /usr/local/lib/pam_ldap.so 
no_warn try_first_pass
authrequiredpam_unix.so no_warn 
try_first_pass

# account
#accountrequiredpam_krb5.so
account requiredpam_login_access.so
account required/usr/local/lib/pam_ldap.so 
ignore_authinfo_unavail ignore_unknown_user
account requiredpam_unix.so

# session
#sessionoptionalpam_ssh.so
session requiredpam_permit.so
# password
#password   sufficient  pam_krb5.so no_warn 
try_first_pass
passwordrequiredpam_unix.so no_warn 
try_first_pass
---

iam very amazed, because i thought that with this ldap line its also 
necessary that
'account  required pam_unix.so' must return 'ok' that the authorization 
part is successfull, but the ldap account is there not available.
but thanks anyway it solved my requirements!

regards,
christian
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Performance issues in 5.3-RELEASE.

2004-11-18 Thread Krzysztof Kowalik
Ronald Klop [EMAIL PROTECTED] wrote:
 
 For what I have seen everybody uses snd_emu10k1. Since I use my onboard  
 soundcard (snd_ess* (not MPSAFE)) I have less problems with my sound under  
 disk load.
 [...]

No, I don't. I use and_emu10kx, which behaves far better under high load
than the standard snd_emu10k1.

 Oh, I saw a post a while ago on stable@ or on current@ about a buffer in  
 emu10k1. If it was increased it had less problems. [...]

Yes, I've read those mails, though it's not sound-under-load issue. Not
only and not mainly. It's more that the interactive work in X(org) under 
the high i/o in certain cases (like the mentioned untaring) is getting 
painful.

Regards,
-- 
There is no satisfaction in hanging a man who does not object to it.
-- G.B. Shaw
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: serious networking (em) performance (ggate and NFS) problem

2004-11-18 Thread Pawel Jakub Dawidek
On Wed, Nov 17, 2004 at 11:57:41PM +0100, Emanuel Strobl wrote:
+ Dear best guys,
+ 
+ I really love 5.3 in many ways but here're some unbelievable transfer rates, 
+ after I went out and bought a pair of Intel GigaBit Ethernet Cards to solve 
+ my performance problem (*laugh*):
[...]

I done some test in the past with ggate and PCI64/GBit NICs and I get
~38MB/s AFAIR.

Remember that when using 32bit PCIs you can get transfer about 500Mbit/s.

Please run those test with netperf (/usr/ports/benchmarks/netperf) and
send results.

-- 
Pawel Jakub Dawidek   http://www.FreeBSD.org
[EMAIL PROTECTED]   http://garage.freebsd.pl
FreeBSD committer Am I Evil? Yes, I Am!


pgpc3pWmAT4AS.pgp
Description: PGP signature


Re: Performance issues in 5.3-RELEASE. (snd_emu10k1)

2004-11-18 Thread Ronald Klop
On Thu, 18 Nov 2004 04:05:04 -0500, Suleiman Souhlal  
[EMAIL PROTECTED] wrote:

Hi,
On Thu, 2004-11-18 at 03:46, Ronald Klop wrote:
For what I have seen everybody uses snd_emu10k1. Since I use my onboard
soundcard (snd_ess* (not MPSAFE)) I have less problems with my sound  
under
disk load.
  None of the sound drivers are actually MPSAFE.. The reason people that
use snd_emu10k1 are more affected by this is because it has a smaller
default buffer size (4096) than the other drivers.
I'm not at home now so I can't check, but I remember that the snd_emu10k1  
doesn't say [GIANT-LOCKED] in dmesg, while all my other soundcards do.

Ronald.
--
 Ronald Klop, Amsterdam, The Netherlands
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


from 5.3 release to 5.3 stable

2004-11-18 Thread Marc Plumet
Dear,

I am still confusing about FreeBSD versioning. 

MY SYSTEM:

- I install the freebsd 5_3 release:
kern.osreldate: 503001
FreeBSD 5.3-RELEASE #0: Tue Nov  9 13:34:27 CET 2004

- I cvsup the ports collection
cvsup -g -L 2 /root/ports-supfile
(ok)

- I upgrade the ports collection
pkgdb -F
portupgrade -a
(14 hours, ok except for mplayer-skins, even with packages : size mismatch)

If I understand correctly, I am
- in the stable branch (RELENG_5)
- but not up-to-date, because i installed a release (RELENG_5_3)


MY QUESTIONS :

- which system do I now have ? a mixed between 5.3R and 5.3STABLE ? :
example:
   for packages
5_STABLE has got teTeX-latex2e but not 5_3R (which sysinstall think I have)
   for ports
/usr/ports/print/tetex-latex2e is present (*but does not make : error reported 
at the end of this mail)

- how to upgrade to 5.3 stable ? 
make world ? (cvs/portupgrade again before ?)


Thanks in advance for your time.

Marc Plumet




*ERROR when I make /usr/ports/print/tetex-latex2e :

...
Defining UNIX/DOS style filename parser.

catcodes, registers, compatibility for TeX 2,  parameters,
LaTeX2e 2003/12/01
hacks, control, par, spacing, files, font encodings, lengths,


Local config file fonttext.cfg used


(fonttext.cfg (fonttext.ltx
=== Don't modify this file, use a .cfg file instead ===

(omlenc.def) (t1enc.def) (ot1enc.def) (omsenc.def) (t1cmr.fd) (ot1cmr.fd)
(ot1cmss.fd) (ot1cmtt.fd)))


Local config file fontmath.cfg used


(fontmath.cfg (fontmath.ltx
=== Don't modify this file, use a .cfg file instead ===

(omlcmm.fd) (omscmsy.fd) (omxcmex.fd) (ucmr.fd)))


Local config file preload.cfg used

=
(preload.cfg (preload.ltxkpathsea: Running mktextfm  line10
mktextfm: Running mf \mode:=ljfour; mag:=1; nonstopmode; input line10
This is METAFONT, Version 2.718 (Web2C 7.2)

kpathsea: Running mktexmf  line10
! I can't find file `line10'.
* ...:=ljfour; mag:=1; nonstopmode; input line10

Please type another input file name
! Emergency stop.
* ...:=ljfour; mag:=1; nonstopmode; input line10

Transcript written on mfput.log.
mktextfm: `mf \mode:=ljfour; mag:=1; nonstopmode; input line10' failed.
kpathsea: Appending font creation commands to missfont.log.

! Font \tenln=line10 not loadable: Metric (TFM) file not found.
to be read again
   \font
l.57 \font\tenln  =line10   \font
 \tenlnw  =linew10\relax
? 

___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: from 5.3 release to 5.3 stable

2004-11-18 Thread Ronald Klop
Hello,
First: Ports are independent of the version of your system.
Second: Updating your system is described here.
http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/cutting-edge.html
But it is not a short howto. :-)
The short path is something like this.
copy and edit /usr/share/examples/cvsup/stable-supfile like you did with  
ports-supfile
run cvsup -g -L 2 your-supfile
read the end of /usr/src/UPDATING where the steps to update your system  
are explained.
It wil be something like:
cd /usr/src
make buildworld
make buildkernel KERNCONF=your-kernel
make installkernel KERNCONF=your-kernel
reboot
if cannot-boot (happens seldom or never)
  boot with old kernel (/boot/kernel.old/kernel) and mv /boot/kernel.old  
to /boot/kernel.
else
  cd /usr/src
  make installworld
reboot

But see UPDATING for explanation.
Ronald.
On Thu, 18 Nov 2004 11:41:38 +0100, Marc Plumet [EMAIL PROTECTED]  
wrote:

Dear,
I am still confusing about FreeBSD versioning.
MY SYSTEM:
- I install the freebsd 5_3 release:
kern.osreldate: 503001
FreeBSD 5.3-RELEASE #0: Tue Nov  9 13:34:27 CET 2004
- I cvsup the ports collection
cvsup -g -L 2 /root/ports-supfile
(ok)
- I upgrade the ports collection
pkgdb -F
portupgrade -a
(14 hours, ok except for mplayer-skins, even with packages : size  
mismatch)

If I understand correctly, I am
- in the stable branch (RELENG_5)
- but not up-to-date, because i installed a release (RELENG_5_3)
MY QUESTIONS :
- which system do I now have ? a mixed between 5.3R and 5.3STABLE ? :
example:
   for packages
5_STABLE has got teTeX-latex2e but not 5_3R (which sysinstall think I  
have)
   for ports
/usr/ports/print/tetex-latex2e is present (*but does not make : error  
reported
at the end of this mail)

- how to upgrade to 5.3 stable ?
make world ? (cvs/portupgrade again before ?)
Thanks in advance for your time.
Marc Plumet

*ERROR when I make /usr/ports/print/tetex-latex2e :
...
Defining UNIX/DOS style filename parser.
catcodes, registers, compatibility for TeX 2,  parameters,
LaTeX2e 2003/12/01
hacks, control, par, spacing, files, font encodings, lengths,

Local config file fonttext.cfg used

(fonttext.cfg (fonttext.ltx
=== Don't modify this file, use a .cfg file instead ===
(omlenc.def) (t1enc.def) (ot1enc.def) (omsenc.def) (t1cmr.fd) (ot1cmr.fd)
(ot1cmss.fd) (ot1cmtt.fd)))

Local config file fontmath.cfg used

(fontmath.cfg (fontmath.ltx
=== Don't modify this file, use a .cfg file instead ===
(omlcmm.fd) (omscmsy.fd) (omxcmex.fd) (ucmr.fd)))

Local config file preload.cfg used
=
(preload.cfg (preload.ltxkpathsea: Running mktextfm  line10
mktextfm: Running mf \mode:=ljfour; mag:=1; nonstopmode; input line10
This is METAFONT, Version 2.718 (Web2C 7.2)
kpathsea: Running mktexmf  line10
! I can't find file `line10'.
* ...:=ljfour; mag:=1; nonstopmode; input line10
Please type another input file name
! Emergency stop.
* ...:=ljfour; mag:=1; nonstopmode; input line10
Transcript written on mfput.log.
mktextfm: `mf \mode:=ljfour; mag:=1; nonstopmode; input line10' failed.
kpathsea: Appending font creation commands to missfont.log.
! Font \tenln=line10 not loadable: Metric (TFM) file not found.
to be read again
   \font
l.57 \font\tenln  =line10   \font
 \tenlnw  =linew10\relax
?
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]

--
 Ronald Klop, Amsterdam, The Netherlands
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Pam Authorization Problem

2004-11-18 Thread jesk
iam very amazed, because i thought that with this ldap line its also
necessary that
'account  required pam_unix.so' must return 'ok' that the authorization
part is successfull, but the ldap account is there not available.
but thanks anyway it solved my requirements!
hi again,
i recognized that if the user is found via AUTH in ldap and authenticated 
there, that its not possible for ACCOUNT to jump from pam_ldap.so to 
pam_unix.so. i checked this as i used 'su' to switch to root but then i 
became the message:
---
You must be a uniqueMember of cn=klever,ou=hosts,dc=x,dc=x,dc=x to login.
su: Sorry
---
root does exist in ldap for AUTH but not for ACCOUNT, but root should be 
used locally via
pam_unix.so.
/etc/pam.d/system is configured like /etc/pam.d/sshd and so /etc/pam.d/su 
should be very likely the same as /etc/pam.d/sshd through the include in it.
maybe you have an answer to this too :)

thanks!
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: serious networking (em) performance (ggate and NFS) problem

2004-11-18 Thread Robert Watson

On Wed, 17 Nov 2004, Emanuel Strobl wrote:

 I really love 5.3 in many ways but here're some unbelievable transfer
 rates, after I went out and bought a pair of Intel GigaBit Ethernet
 Cards to solve my performance problem (*laugh*): 

I think the first thing you want to do is to try and determine whether the
problem is a link layer problem, network layer problem, or application
(file sharing) layer problem.  Here's where I'd start looking:

(1) I'd first off check that there wasn't a serious interrupt problem on
the box, which is often triggered by ACPI problems.  Get the box to be
as idle as possible, and then use vmstat -i or stat -vmstat to see if
anything is spewing interrupts. 

(2) Confirm that your hardware is capable of the desired rates: typically
this involves looking at whether you have a decent card (most if_em
cards are decent), whether it's 32-bit or 64-bit PCI, and so on.  For
unidirectional send on 32-bit PCI, be aware that it is not possible to
achieve gigabit performance because the PCI bus isn't fast enough, for
example.

(3) Next, I'd use a tool like netperf (see ports collection) to establish
three characteristics: round trip latency from user space to user
space (UDP_RR), TCP throughput (TCP_STREAM), and large packet
throughput (UDP_STREAM).  With decent boxes on 5.3, you should have no
trouble at all maxing out a single gig-e with if_em, assuming all is
working well hardware wise and there's no software problem specific to
your configuration.

(4) Note that router latency (and even switch latency) can have a
substantial impact on gigabit performance, even with no packet loss,
in part due to stuff like ethernet flow control.  You may want to put
the two boxes back-to-back for testing purposes.

(5) Next, I'd measure CPU consumption on the end box -- in particular, use
top -S and systat -vmstat 1 to compare the idle condition of the
system and the system under load.

If you determine there is a link layer or IP layer problem, we can start
digging into things like the error statistics in the card, negotiation
issues, etc.  If not, you want to move up the stack to try and
characterize where it is you're hitting the performance issue.

Robert N M Watson FreeBSD Core Team, TrustedBSD Projects
[EMAIL PROTECTED]  Principal Research Scientist, McAfee Research


___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: serious networking (em) performance (ggate and NFS) problem

2004-11-18 Thread Robert Watson

On Thu, 18 Nov 2004, Pawel Jakub Dawidek wrote:

 On Wed, Nov 17, 2004 at 11:57:41PM +0100, Emanuel Strobl wrote:
 + Dear best guys,
 + 
 + I really love 5.3 in many ways but here're some unbelievable transfer 
 rates, 
 + after I went out and bought a pair of Intel GigaBit Ethernet Cards to 
 solve 
 + my performance problem (*laugh*):
 [...]
 
 I done some test in the past with ggate and PCI64/GBit NICs and I get
 ~38MB/s AFAIR. 
 
 Remember that when using 32bit PCIs you can get transfer about
 500Mbit/s. 
 
 Please run those test with netperf (/usr/ports/benchmarks/netperf) and
 send results. 

Be aware, btw, that while netperf is a pretty decent tool, it performs a
lot of socket select and timing operations, so isn't always a good measure
of maximum capabilities of a system.  I.e., it is not unusual to see that
a netperf send test will only see send() as one in three or one in four
system calls -- as a result, it uses a measurable amount of CPU on things
other than sending.  In an environment with CPU constraints (slower CPU or
faster network), this can impact the performance results substantially.

For example, when measuring maximum packet send performance using minimal
packet sizes from user space, several of my test boxes are constrained
with 64-bit gig-e PCI cards based on CPU.  In particular, the combined
cost of the additional system calls and operations cuts into available CPU
for send.  By eliminating the misc.  overheads of netperf using netsend, I
can improve performance by 20%-30%. 

Robert N M Watson FreeBSD Core Team, TrustedBSD Projects
[EMAIL PROTECTED]  Principal Research Scientist, McAfee Research

___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: serious networking (em) performance (ggate and NFS) problem

2004-11-18 Thread Wilko Bulte
On Thu, Nov 18, 2004 at 12:27:44PM +, Robert Watson wrote..
 
 On Wed, 17 Nov 2004, Emanuel Strobl wrote:
 
  I really love 5.3 in many ways but here're some unbelievable transfer
  rates, after I went out and bought a pair of Intel GigaBit Ethernet
  Cards to solve my performance problem (*laugh*): 
 
 I think the first thing you want to do is to try and determine whether the
 problem is a link layer problem, network layer problem, or application
 (file sharing) layer problem.  Here's where I'd start looking:

And you definitely want to look at polling(4)


-- 
Wilko Bulte [EMAIL PROTECTED]


smime.p7s
Description: S/MIME cryptographic signature


Re: serious networking (em) performance (ggate and NFS) problem

2004-11-18 Thread Robert Watson

On Thu, 18 Nov 2004, Wilko Bulte wrote:

 On Thu, Nov 18, 2004 at 12:27:44PM +, Robert Watson wrote..
  
  On Wed, 17 Nov 2004, Emanuel Strobl wrote:
  
   I really love 5.3 in many ways but here're some unbelievable transfer
   rates, after I went out and bought a pair of Intel GigaBit Ethernet
   Cards to solve my performance problem (*laugh*): 
  
  I think the first thing you want to do is to try and determine whether the
  problem is a link layer problem, network layer problem, or application
  (file sharing) layer problem.  Here's where I'd start looking:
 
 And you definitely want to look at polling(4) 

He did, but he set the HZ at 256, which is sufficiently low as to
guarantee a substantial increase in latency, and likely guarantee
interface and socket queue overruns (although I haven't done the math to
verify that is the case).  Between the very finite sizes of ifnet send
queues, socket buffers, and if_em descriptors, and on-board buffers on the
card, high latency polling can result in lots of packet loss and delay
under load.  Hence the recommendation of a relatively high value of HZ so
that the queues in the driver are drained regularly, and sends
acknowledged so that the sent mbufs can be reclaimed and reused.

Robert N M Watson FreeBSD Core Team, TrustedBSD Projects
[EMAIL PROTECTED]  Principal Research Scientist, McAfee Research


___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: flash and libmap.conf?

2004-11-18 Thread Ben Paley
On Wednesday 17 November 2004 18:27, Jon Noack wrote:

  # Flash6 with Mozilla/Firebird/Galeon/Epiphany
  #[/usr/local/lib/linux-flashplugin6/libflashplayer.so]
  [/usr/X11R6/lib/browser_plugins/libflashplayer.so]
  #libpthread.so.0 liblthread.so.3
  libpthread.so.0   pluginwrapper/flash6.so
  libdl.so.2  pluginwrapper/flash6.so
  libz.so.1   libz.so.2
  libstdc++-libc6.2-2.so.3liblstdc++.so.4
  libm.so.6   libm.so.3
  libc.so.6   pluginwrapper/flash6.so

 The following works fine for me (note the path I use is what you have
 commented out):

 # Flash6 with Mozilla/Firebird/Galeon/Epiphany/Konqueror
 [/usr/local/lib/linux-flashplugin6/libflashplayer.so]
 libpthread.so.0 pluginwrapper/flash6.so
 libdl.so.2  pluginwrapper/flash6.so
 libz.so.1   libz.so.2
 libstdc++-libc6.2-2.so.3libstdc++.so.4
 libm.so.6   libm.so.3
 libc.so.6   pluginwrapper/flash6.so

Interesting. This makes everything bad on my machine. I get this:

bash-2.05b$ mozilla
Error: No running window found.
mozilla-bin: Fatal IO error 78 (Function not implemented) on X server :0.0.
bash-2.05b$

I even noticed another small error in my file, where I had liblstdc++ instead 
of libstdc++ (a lower-case L too many) but that doesn't help either.

 For Konqueror I just added /usr/local/lib/linux-flashplugin6 to the
 plugins path so that I only need one libmap.conf entry.  This works fine
 as well.

Perhaps I'll try that when I gat mozilla and flash working - at the moment 
konqueror is the only browser I've got that's working properly, so I'm not 
going to mess with it!

Thanks for your help,
Ben
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: from 5.3 release to 5.3 stable

2004-11-18 Thread Dirk Arlt
i would add mergemaster to this

Ronald Klop [EMAIL PROTECTED] schrieb:
 Hello,
 
 First: Ports are independent of the version of your system.
 Second: Updating your system is described here.
 
 http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/cutting-edge.html
 
 But it is not a short howto. :-)
 
 The short path is something like this.
 
 copy and edit /usr/share/examples/cvsup/stable-supfile like you did with  
 ports-supfile
 run cvsup -g -L 2 your-supfile
 read the end of /usr/src/UPDATING where the steps to update your system  
 are explained.
 It wil be something like:
 cd /usr/src
 make buildworld
 make buildkernel KERNCONF=your-kernel
 make installkernel KERNCONF=your-kernel
 reboot
 if cannot-boot (happens seldom or never)
boot with old kernel (/boot/kernel.old/kernel) and mv /boot/kernel.old  
 to /boot/kernel.
 else
cd /usr/src
make installworld
 reboot
 
 But see UPDATING for explanation.
 
 Ronald.
 
 On Thu, 18 Nov 2004 11:41:38 +0100, Marc Plumet [EMAIL PROTECTED]  
 wrote:
 
  Dear,
 
  I am still confusing about FreeBSD versioning.
 
  MY SYSTEM:
 
  - I install the freebsd 5_3 release:
  kern.osreldate: 503001
  FreeBSD 5.3-RELEASE #0: Tue Nov  9 13:34:27 CET 2004
 
  - I cvsup the ports collection
  cvsup -g -L 2 /root/ports-supfile
  (ok)
 
  - I upgrade the ports collection
  pkgdb -F
  portupgrade -a
  (14 hours, ok except for mplayer-skins, even with packages : size  
  mismatch)
 
  If I understand correctly, I am
  - in the stable branch (RELENG_5)
  - but not up-to-date, because i installed a release (RELENG_5_3)
 
 
  MY QUESTIONS :
 
  - which system do I now have ? a mixed between 5.3R and 5.3STABLE ? :
  example:
 for packages
  5_STABLE has got teTeX-latex2e but not 5_3R (which sysinstall think I  
  have)
 for ports
  /usr/ports/print/tetex-latex2e is present (*but does not make : error  
  reported
  at the end of this mail)
 
  - how to upgrade to 5.3 stable ?
  make world ? (cvs/portupgrade again before ?)
 
 
  Thanks in advance for your time.
 
  Marc Plumet
 
 
 
 
  *ERROR when I make /usr/ports/print/tetex-latex2e :
 
  ...
  Defining UNIX/DOS style filename parser.
 
  catcodes, registers, compatibility for TeX 2,  parameters,
  LaTeX2e 2003/12/01
  hacks, control, par, spacing, files, font encodings, lengths,
  
 
  Local config file fonttext.cfg used
 
  
  (fonttext.cfg (fonttext.ltx
  === Don't modify this file, use a .cfg file instead ===
 
  (omlenc.def) (t1enc.def) (ot1enc.def) (omsenc.def) (t1cmr.fd) (ot1cmr.fd)
  (ot1cmss.fd) (ot1cmtt.fd)))
  
 
  Local config file fontmath.cfg used
 
  
  (fontmath.cfg (fontmath.ltx
  === Don't modify this file, use a .cfg file instead ===
 
  (omlcmm.fd) (omscmsy.fd) (omxcmex.fd) (ucmr.fd)))
  
 
  Local config file preload.cfg used
 
  =
  (preload.cfg (preload.ltxkpathsea: Running mktextfm  line10
  mktextfm: Running mf \mode:=ljfour; mag:=1; nonstopmode; input line10
  This is METAFONT, Version 2.718 (Web2C 7.2)
 
  kpathsea: Running mktexmf  line10
  ! I can't find file `line10'.
  * ...:=ljfour; mag:=1; nonstopmode; input line10
 
  Please type another input file name
  ! Emergency stop.
  * ...:=ljfour; mag:=1; nonstopmode; input line10
 
  Transcript written on mfput.log.
  mktextfm: `mf \mode:=ljfour; mag:=1; nonstopmode; input line10' failed.
  kpathsea: Appending font creation commands to missfont.log.
 
  ! Font \tenln=line10 not loadable: Metric (TFM) file not found.
  to be read again
 \font
  l.57 \font\tenln  =line10   \font
   \tenlnw  =linew10\relax
  ?
  ___
  [EMAIL PROTECTED] mailing list
  http://lists.freebsd.org/mailman/listinfo/freebsd-stable
  To unsubscribe, send any mail to [EMAIL PROTECTED]
 
 
 
 -- 
   Ronald Klop, Amsterdam, The Netherlands
 ___
 [EMAIL PROTECTED] mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-stable
 To unsubscribe, send any mail to [EMAIL PROTECTED]
 


-- 
MfG
 Dirk Arlt
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: flash and libmap.conf?

2004-11-18 Thread Jon Noack
Ben Paley wrote:
 On Wednesday 17 November 2004 18:27, Jon Noack wrote:
 # Flash6 with Mozilla/Firebird/Galeon/Epiphany
 #[/usr/local/lib/linux-flashplugin6/libflashplayer.so]
 [/usr/X11R6/lib/browser_plugins/libflashplayer.so]
 #libpthread.so.0 liblthread.so.3
 libpthread.so.0   pluginwrapper/flash6.so
 libdl.so.2  pluginwrapper/flash6.so
 libz.so.1   libz.so.2
 libstdc++-libc6.2-2.so.3liblstdc++.so.4
 libm.so.6   libm.so.3
 libc.so.6   pluginwrapper/flash6.so

 The following works fine for me (note the path I use is what you have
 commented out):

 # Flash6 with Mozilla/Firebird/Galeon/Epiphany/Konqueror
 [/usr/local/lib/linux-flashplugin6/libflashplayer.so]
 libpthread.so.0 pluginwrapper/flash6.so
 libdl.so.2  pluginwrapper/flash6.so
 libz.so.1   libz.so.2
 libstdc++-libc6.2-2.so.3libstdc++.so.4
 libm.so.6   libm.so.3
 libc.so.6   pluginwrapper/flash6.so

 Interesting. This makes everything bad on my machine. I get this:

 bash-2.05b$ mozilla
 Error: No running window found.
 mozilla-bin: Fatal IO error 78 (Function not implemented) on X server
 :0.0.
 bash-2.05b$

 I even noticed another small error in my file, where I had liblstdc++
 instead of libstdc++ (a lower-case L too many) but that doesn't help
 either.

 For Konqueror I just added /usr/local/lib/linux-flashplugin6 to the
 plugins path so that I only need one libmap.conf entry.  This works fine
 as well.

 Perhaps I'll try that when I gat mozilla and flash working - at the moment
 konqueror is the only browser I've got that's working properly, so I'm not
 going to mess with it!

Did you recompile all your ports recently (portupgrade -af)?  You should
certainly do this after upgrading from 4-stable and there was ABI breakage
right before 5.3 that required a recompile to use the new libraries.  You
could try setting the following values in libmap.conf to take care of the
recent ABI breakage (as mentioned in UPDATING):

# use new libraries
libm.so.2   libm.so.3
libreadline.so.4libreadline.so.5
libhistory.so.4 libhistory.so.5
libopie.so.2libopie.so.3
libpcap.so.2libpcap.so.3

Jon

___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: from 5.3 release to 5.3 stable

2004-11-18 Thread Ronald Klop
On Thu, 18 Nov 2004 15:50:11 +0100, Dirk Arlt [EMAIL PROTECTED] wrote:
i would add mergemaster to this
Oops.
(or ports/sysinstall/etcmerge)
Ronald Klop [EMAIL PROTECTED] schrieb:
Hello,
First: Ports are independent of the version of your system.
Second: Updating your system is described here.
http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/cutting-edge.html
But it is not a short howto. :-)
The short path is something like this.
copy and edit /usr/share/examples/cvsup/stable-supfile like you did with
ports-supfile
run cvsup -g -L 2 your-supfile
read the end of /usr/src/UPDATING where the steps to update your system
are explained.
It wil be something like:
cd /usr/src
make buildworld
make buildkernel KERNCONF=your-kernel
make installkernel KERNCONF=your-kernel
reboot
if cannot-boot (happens seldom or never)
   boot with old kernel (/boot/kernel.old/kernel) and mv  
/boot/kernel.old
to /boot/kernel.
else
   cd /usr/src
   make installworld
reboot

But see UPDATING for explanation.
Ronald.
On Thu, 18 Nov 2004 11:41:38 +0100, Marc Plumet [EMAIL PROTECTED]
wrote:
 Dear,

 I am still confusing about FreeBSD versioning.

 MY SYSTEM:

 - I install the freebsd 5_3 release:
 kern.osreldate: 503001
 FreeBSD 5.3-RELEASE #0: Tue Nov  9 13:34:27 CET 2004

 - I cvsup the ports collection
 cvsup -g -L 2 /root/ports-supfile
 (ok)

 - I upgrade the ports collection
 pkgdb -F
 portupgrade -a
 (14 hours, ok except for mplayer-skins, even with packages : size
 mismatch)

 If I understand correctly, I am
 - in the stable branch (RELENG_5)
 - but not up-to-date, because i installed a release (RELENG_5_3)


 MY QUESTIONS :

 - which system do I now have ? a mixed between 5.3R and 5.3STABLE ? :
 example:
for packages
 5_STABLE has got teTeX-latex2e but not 5_3R (which sysinstall think I
 have)
for ports
 /usr/ports/print/tetex-latex2e is present (*but does not make : error
 reported
 at the end of this mail)

 - how to upgrade to 5.3 stable ?
 make world ? (cvs/portupgrade again before ?)


 Thanks in advance for your time.

 Marc Plumet




 *ERROR when I make /usr/ports/print/tetex-latex2e :

 ...
 Defining UNIX/DOS style filename parser.

 catcodes, registers, compatibility for TeX 2,  parameters,
 LaTeX2e 2003/12/01
 hacks, control, par, spacing, files, font encodings, lengths,
 

 Local config file fonttext.cfg used

 
 (fonttext.cfg (fonttext.ltx
 === Don't modify this file, use a .cfg file instead ===

 (omlenc.def) (t1enc.def) (ot1enc.def) (omsenc.def) (t1cmr.fd)  
(ot1cmr.fd)
 (ot1cmss.fd) (ot1cmtt.fd)))
 

 Local config file fontmath.cfg used

 
 (fontmath.cfg (fontmath.ltx
 === Don't modify this file, use a .cfg file instead ===

 (omlcmm.fd) (omscmsy.fd) (omxcmex.fd) (ucmr.fd)))
 

 Local config file preload.cfg used

 =
 (preload.cfg (preload.ltxkpathsea: Running mktextfm  line10
 mktextfm: Running mf \mode:=ljfour; mag:=1; nonstopmode; input line10
 This is METAFONT, Version 2.718 (Web2C 7.2)

 kpathsea: Running mktexmf  line10
 ! I can't find file `line10'.
 * ...:=ljfour; mag:=1; nonstopmode; input line10

 Please type another input file name
 ! Emergency stop.
 * ...:=ljfour; mag:=1; nonstopmode; input line10

 Transcript written on mfput.log.
 mktextfm: `mf \mode:=ljfour; mag:=1; nonstopmode; input line10'  
failed.
 kpathsea: Appending font creation commands to missfont.log.

 ! Font \tenln=line10 not loadable: Metric (TFM) file not found.
 to be read again
\font
 l.57 \font\tenln  =line10   \font
  \tenlnw  =linew10\relax
 ?
 ___
 [EMAIL PROTECTED] mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-stable
 To unsubscribe, send any mail to  
[EMAIL PROTECTED]


--
  Ronald Klop, Amsterdam, The Netherlands
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to  
[EMAIL PROTECTED]



--
 Ronald Klop, Amsterdam, The Netherlands
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: serious networking (em) performance (ggate and NFS) problem

2004-11-18 Thread Mike Jakubik
Andreas Braukmann said:
 --On Mittwoch, 17. November 2004 20:48 Uhr -0500 Mike Jakubik
 [EMAIL PROTECTED] wrote:

 I have two PCs connected together, using the em card. One is FreeBSD 6
 from Fri Nov  5 , the other is Windows XP. I am using the default mtu of
 1500, no polling, and i get ~ 21MB/s tranfser rates via ftp. Im sure
 this
 would be higher with jumbo frames.

 probably

 Both computers are AMD cpus with Via
 chipsets.

 Which AMD Chipset? VIA did some pretty bad PCI implementations
 in the past. Once I wondered about suspiciously low transfer
 rates in the process of testing 3Ware and Adaptec (2120S, 2200S)
 RAID-Controllers. The transfer rates maxed out at ca. 30 MByte/s.
 Switching the testboxes mainboard from one with VIA chipset to
 one with  an AMD (MP / MPX) chipset was a great success.

The FreeBSD box is KT133A and Windows is KT266A. The VIA chipsets had
bandwith or latency (i cant remember) issues with the PCI bus. Perhaps you
are maxing out your PCI bus, or the HDs cant keep up?


___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: serious networking (em) performance (ggate and NFS) problem

2004-11-18 Thread M. Warner Losh
In message: [EMAIL PROTECTED]
Robert Watson [EMAIL PROTECTED] writes:
: (1) I'd first off check that there wasn't a serious interrupt problem on
: the box, which is often triggered by ACPI problems.  Get the box to be
: as idle as possible, and then use vmstat -i or stat -vmstat to see if
: anything is spewing interrupts. 

Also, make sure that you aren't sharing interrupts between
GIANT-LOCKED and non-giant-locked cards.  This might be exposing bugs
in the network layer that debug.mpsafenet=0 might correct.  Just
noticed that our setup here has that setup, so I'll be looking into
that area of things.

Warner
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


RE: serious networking (em) performance (ggate and NFS) problem

2004-11-18 Thread Daniel Eriksson
M. Warner Losh wrote:

 Also, make sure that you aren't sharing interrupts between
 GIANT-LOCKED and non-giant-locked cards.  This might be exposing bugs
 in the network layer that debug.mpsafenet=0 might correct.  Just
 noticed that our setup here has that setup, so I'll be looking into
 that area of things.

I have a Tyan Tiger MPX board (dual AthlonMP) that has two 64bit PCI slots.
I have an Adaptec 29160 and a dual port Intel Pro/1000 MT plugged into those
slots.

As can be seen from the vmstat -i output below, em1 shares ithread with
ahc0. This is with ACPI disabled. With ACPI enabled all devices get their
own ithread (I think, not 100% sure). However, because of some hardware
problem (interrupt routing?), em0 interrupts will somehow leak into
atapci1+, generating a higher interrupt load. I'm not sure how expensive
this is.

Finally, my question. What would you recommend:
1) Run with ACPI disabled and debug.mpsafenet=1 and hope that the mix of
giant-safe and giant-locked (em and ahc) doesn't trigger any bugs. This is
what I currently do.
2) Run with ACPI disabled and debug.mpsafenet=0 and accept lower network
performance (it is a high-traffic server, so I'm not sure this is a valid
option).
3) Run with ACPI enabled and debug.mpsafenet=1 and accept that em0
interrupts leak to the atapci1+ ithread. This I have done in the past.


# vmstat -i
interrupt  total   rate
irq1: atkbd0   2  0
irq4: sio0   710  0
irq6: fdc0 8  0
irq8: rtc   11470937127
irq13: npx01  0
irq14: ata0  1744545 19
irq15: ata1  1749617 19
irq16: em0 atapci1+186062858   2074
irq17: em1 ahc0 27028088301
irq18: atapci3   7393468 82
irq19: atapci4+  7129446 79
irq0: clk  179054582   1995
Total  421634262   4699

/Daniel Eriksson


___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


RE: serious networking (em) performance (ggate and NFS) problem

2004-11-18 Thread Robert Watson

On Thu, 18 Nov 2004, Daniel Eriksson wrote:

 I have a Tyan Tiger MPX board (dual AthlonMP) that has two 64bit PCI
 slots.  I have an Adaptec 29160 and a dual port Intel Pro/1000 MT
 plugged into those slots. 
 
 As can be seen from the vmstat -i output below, em1 shares ithread with
 ahc0. This is with ACPI disabled. With ACPI enabled all devices get
 their own ithread (I think, not 100% sure). However, because of some
 hardware problem (interrupt routing?), em0 interrupts will somehow leak
 into atapci1+, generating a higher interrupt load. I'm not sure how
 expensive this is. 

I see precisely this problem on several motherboards, including the Intel
Westville.  There's some speculation on the source of the problem, but I
see related problems in 4.x as well.  Either I get them on different
interrupts but both fire, or on the same interrupt.  FYI, picking the
right one depends a bit on your configuration, but generally scheduling
multiple ithreads is more expensive than running multiple handlers in the
same ithread, so I think it's generally preferable to run with them on the
same interrupt.  Especially if nothing on the same interrupt is acquiring
Giant.  Acquiring and dropping Giant uncontended is cheaper than context
switching, however.

 Finally, my question. What would you recommend:
 1) Run with ACPI disabled and debug.mpsafenet=1 and hope that the mix of
 giant-safe and giant-locked (em and ahc) doesn't trigger any bugs. This is
 what I currently do.

This shouldn't cause bugs; the ithread handler is smart and will acquire
Giant around the ahc code.  That will also make it slower due to the extra
mutex operations, however.

 2) Run with ACPI disabled and debug.mpsafenet=0 and accept lower network
 performance (it is a high-traffic server, so I'm not sure this is a valid
 option).
 3) Run with ACPI enabled and debug.mpsafenet=1 and accept that em0
 interrupts leak to the atapci1+ ithread. This I have done in the past.

I think you want to run the ahc stuff, unfortunately.  The good news is
that the higher the load, the more interrupt mitigation/coalescing will
kick in for if_em, so the fewer you'll see.  Under load, usually my boxes
hang out at 4k-6k interrupts/sec for if_em and don't go much above that. 

Robert N M Watson FreeBSD Core Team, TrustedBSD Projects
[EMAIL PROTECTED]  Principal Research Scientist, McAfee Research



___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: portupgrade crash on 4.9-stable

2004-11-18 Thread Michael Nottebrock
On Thursday, 18. November 2004 01:31, Michael Nottebrock wrote:
 On Thursday, 18. November 2004 00:03, Ronald Klop wrote:
   But the real problem is
   the segfault with ruby, which can be reliably reproduced ad infinitum.
 
  About the ruby thing. Try deinstall/reinstall of ruby and portupgrade
  manually and try again. (This is my best guess.)

 Known problem - the berkeley db in libc is buggy and causes the crash.

 Workaround:

 Set PORTS_DBDRIVER in your environment (or in pkgtools.conf) to bdb_hash
  
Typo, meant bdb1_hash. There's now an entry in /usr/ports/UPDATING about this 
issue, too (20041118).

-- 
   ,_,   | Michael Nottebrock   | [EMAIL PROTECTED]
 (/^ ^\) | FreeBSD - The Power to Serve | http://www.freebsd.org
   \u/   | K Desktop Environment on FreeBSD | http://freebsd.kde.org


pgpJqGT5tu1fW.pgp
Description: PGP signature


Re: serious networking (em) performance (ggate and NFS) problem

2004-11-18 Thread Matthew Dillon
Polling should not produce any improvement over interrupts for EM0.
The EM0 card will aggregate 8-14+ packets per interrupt, or more.
which is only around 8000 interrupts/sec.  I've got a ton of these 
cards installed.

# mount_nfs -a 4 dhcp61:/home /mnt
# dd if=/mnt/x of=/dev/null bs=32k
# netstat -in 1
input(Total)   output
   packets  errs  bytespackets  errs  bytes colls
 66401 0   93668746   5534 0 962920 0
 66426 0   94230092   5537 01007108 0
 66424 0   93699848   5536 0 963268 0
 66422 0   94222372   5536 01007290 0
 66391 0   93654846   5534 0 962746 0
 66375 0   94154432   5532 01006404 0

  zfod   Interrupts
Proc:r  p  d  s  wCsw  Trp  Sys  Int  Sof  Fltcow8100 total
 19  62117   75 81004   12  88864 wire   7873 mux irq10
10404 act ata0 irq14
19.2%Sys   0.0%Intr  0.0%User  0.0%Nice 80.8%Idl   864476 inact   ata1 irq15
||||||||||  58152 cache   mux irq11
==   2992 free227 clk irq0


Note that the interrupt rate is only 7873 interrupts per second
while I am transfering 94 MBytes/sec over NFS (UDP) and receiving
over 66000 packets per second (~8 packets per interrupt).

If I use a TCP mount I get just about the same thing:

# mount_nfs -T -a 4 dhcp61:/home /mnt
# dd if=/mnt/x of=/dev/null bs=32k
# netstat -in 1

input(Total)   output
   packets  errs  bytespackets  errs  bytes colls
 61752 0   93978800   8091 0 968618 0
 61780 0   93530484   8098 0 904370 0
 61710 0   93917880   8093 0 968128 0
 61754 0   93491260   8095 0 903940 0
 61756 0   93986320   8097 0 968336 0


Proc:r  p  d  s  wCsw  Trp  Sys  Int  Sof  Fltcow8145 total
   5  8 22828   13 5490 8146   13   11 141556 wire   7917 mux irq10
 7800 act ata0 irq14
26.4%Sys   0.0%Intr  0.0%User  0.0%Nice 73.6%Idl   244872 inact   ata1 irq15
||||||||||  8 cache   mux irq11
=  630780 free228 clk irq0

In this case around 8000 interrupts per second with 61700 packet per
second incoming on the interface (around ~8 packets per interrupt).
The extra interrupts are due to the additional outgoing TCP ack traffic.

If I look at the systat -vm 1 output on the NFS server it also sees
only around 8000 interrupts per second, which isn't saying much other
then it's transmit path (61700 pps outoging) is not creating an undue
interrupt burden relative to the receive path.

-Matt

___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


serious networking (em) performance (ggate and NFS)/Performance issues

2004-11-18 Thread Michael Schuh
From: Michael Schuh [EMAIL PROTECTED]
Date: Thu, 18 Nov 2004 22:13:00 +0100
Subject: Re: serious networking (em) performance (ggate and
NFS)/Performance issues
To: [EMAIL PROTECTED]


Hi,

i have same serious problems.
I don't repeate the posting, and describe my tests that i have made
with RELENG_5 (Original Release)  and RELENG_4

My Hardware scenario:
Server
PIII 866MHz
512MB RAM
OS-Disk
SCSI- DNES IBM
3*UDMA66-Drives as Concat with ~140G
Rsync with SO_KEEPALIVE
3COMXL (3C905-Combo)

Client
AMD K6-2 450MHz
384 MB RAM
UDMA33-Disks
3COMXL (xl,all models)
DEC21143 (Tulip, dc)
RTL8139(rl)

The only differences between the Tests are the OS_versions.
In Both OS-Versions all the Binaries and the Kernel are compiled on the
Client. For RELENG_4 CPUTYPE=i586, RELENG_5 CPUTYPE is overwritten in
/etc/make.conf as k6-2. Both kernels are GENERIC except the following Options:

cpu i586 #only
options HZ=2000
options DEVICE_POLLING

The Serverside was constant RELENG_4 with same options.
On the Server i has pure DISK I/o-Rates from ~20 MB for wirte and
~30MB for read, so that these not could be the bottleneck.

The only bottleneck in the system are the capability of max working interrupts
and physically the Network. The Boxes are connectet with daetwyler
cat. 5e through
an 100MBit exclusive switch that would only be used from these two boxes.

In all the Tests i have made only a Push from Client to server, while
i have seen that the
Server is not the Problem. I have alwas used the same Data to transfer
(gziped dump -0 from
my systems ca 5.3G)
All the tests are made with only one of the described networkadapters
on the same Time,
the problems seems not to be on the driver side.Maybe?

The interruptrates and transfers disk I/Os:
RELENG_4
Client maxinterrupt ~11000/s
Client maxpackages ~6000/s
Client Disk i/o read~7-8MB/s
Transferrates  ~7-8MB/s similar to Disktraffic

RELENG_5
Cleint maxinterrupt ~7000/s
Client maxpackages ~2500-3000/s
Client Disk i/o read ~3-4MB/s
Transferrates ~3-4MB similar to Disktraffic

Is now the Diskdriver the Problem or the networklayer?
Who has also these expieriences?

This made me a little bit ugly, and i think i should be conservative
and stay on RELENG_4. Or is this the price for the new technologie features?
In the first moment i have thinking i have a linux box and not FreeBSD.

Can the Developers made us happy with the good old high performance from
RELENG_4 on RELENG_5??

we hope the best.

best regards
sicerelly
michael
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: serious networking (em) performance (ggate and NFS)/Performance issues

2004-11-18 Thread Kris Kennaway
On Thu, Nov 18, 2004 at 10:29:17PM +0100, Michael Schuh wrote:
 From: Michael Schuh [EMAIL PROTECTED]
 Date: Thu, 18 Nov 2004 22:13:00 +0100
 Subject: Re: serious networking (em) performance (ggate and
 NFS)/Performance issues
 To: [EMAIL PROTECTED]
 
 
 Hi,
 
 i have same serious problems.
 I don't repeate the posting, and describe my tests that i have made
 with RELENG_5 (Original Release)  and RELENG_4

It's already been mentioned in this thread that 5.3-R contained a
performance bug in the em driver, and you should update to 5.3-STABLE.
From the above it sounds like you've only tried 5.3-RELEASE.

Kris


pgp8eUpmcXiRv.pgp
Description: PGP signature


Re[2]: serious networking (em) performance (ggate and NFS) problem

2004-11-18 Thread Shunsuke SHINOMIYA

 Hi list,
if you suppose your computer has sufficient performance, please try to
disable or adjust parameters of Interrupt Moderation of em.
 
 In my router(Xeon 2.4GHz and on-board two em interfaces) case, it
improves a router's packet forwarding performance. I think the
interrupt delay by Interrupt Moderation caused NIF's input buffer
overflow or output buffer underrun in this case.


 In order to disable Interrupt Moderation, modify src/sys/dev/em/if_em.c
like the following patch and set hw.em.{rx,tx}_{,abs_}int_delay zero by
sysctl.


 *** if_em.c-1.44.2.3.orig   Fri Nov 19 11:22:48 2004
--- if_em.c Fri Nov 19 11:23:39 2004
*** em_initialize_receive_unit(struct adapte
*** 2611,2618 
--- 2611,2622 

  /* Set the interrupt throttling rate.  Value is calculated
   * as DEFAULT_ITR = 1/(MAX_INTS_PER_SEC * 256ns) */
+ #if 1
+ #define DEFAULT_ITR 0
+ #else
  #define MAX_INTS_PER_SEC8000
  #define DEFAULT_ITR 10/(MAX_INTS_PER_SEC * 256)
+ #endif
  E1000_WRITE_REG(adapter-hw, ITR, DEFAULT_ITR);
  }

-- 
Shunsuke SHINOMIYA [EMAIL PROTECTED]

___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]