Paul wrote:
kern.ipc.nmbclusters=128000
changed - no effect

Check output from netstat -m, this shows network buffers.
770/8200/8970 mbufs in use (current/cache/total)
768/5426/6194/128000 mbuf clusters in use (current/cache/total/max)
768/5248 mbuf+clusters out of packet secondary zone in use (current/cache)
0/677/677/12800 4k (page size) jumbo clusters in use (current/cache/total/max)
0/0/0/6400 9k jumbo clusters in use (current/cache/total/max)
0/0/0/3200 16k jumbo clusters in use (current/cache/total/max)
1728K/15610K/17338K bytes allocated to network (current/cache/total)
0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
0/0/0 requests for jumbo clusters denied (4k/9k/16k)
0/0/0 sfbufs in use (current/peak/max)
0 requests for sfbufs denied
0 requests for sfbufs delayed
73 requests for I/O initiated by sendfile
0 calls to protocol drain routines

This output is in the same second as I see no buffer space available .. isn't this weird?


Stefan Lambrev wrote:
Greetings,

I'm experimenting with jboss4 cluster under freebsd 7 (amd64).
In my configuration I have 2 jboss instances which are in cluster and they communicate via separate network (used only for shared data)
When I create some load on the application sometimes I see this error:

2008-06-24 14:46:21,602 ERROR [org.jgroups.protocols.UDP] failed sending message to 10.50.1.1:57680 (59800 bytes)
java.io.IOException: No buffer space available

It looks very much, that jboss can't handle properly such error as on linux there is no such thing as no network buffers ;) - http://wiki.freebsd.org/AvoidingLinuxisms

But what really bothers me is that I see "No buffer space available" on very low network IO -

           input          (em2)           output
  packets  errs      bytes    packets  errs      bytes colls
      144     0    2203390        292     0    2072771     0
     1568     0    2329764         63     0       9099     0
       76     0     231562         34     0     148306     0
      563     0    1152531       1009     0    1768748     0
     1625     0    2601502        104     0     229728     0
       65     0     467296         85     0     441566     0
      464     0     680082        973     0    1439442     0
      357     0    1940361         55     0     222484     0
     1651     0    2827932        145     0     450265     0

E.g. traffic between 1-3MB/s.

I'm using:
em2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000 options=19b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4>
       ether 00:15:17:60:04:c8
       inet 10.3.3.117 netmask 0xffffff00 broadcast 10.3.3.255
       media: Ethernet autoselect (1000baseTX <full-duplex>)
       status: active

em2: <Intel(R) PRO/1000 Network Connection 6.9.5> port 0x2020-0x203f mem 0xb8820000-0xb883ffff,0xb8400000-0xb87fffff irq 18 at device 0.0 on pci5
em2: Using MSI interrupt
em2: [FILTER]

and my sysctl.conf is:
kern.maxfiles=65000
kern.ipc.shmmax=67108864
kern.fallback_elf_brand=3
kern.threads.max_threads_per_proc=6000
kern.ipc.somaxconn=512
#jboss extra
net.inet.udp.maxdgram=73728
kern.ipc.maxsockbuf=1048576
net.inet.udp.recvspace=147456
kern.ipc.maxsockets=49312

Any ideas how I can improve things?



--

Best Wishes,
Stefan Lambrev
ICQ# 24134177

_______________________________________________
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "[EMAIL PROTECTED]"

Reply via email to