Re: Servers Crash every few days

2007-08-23 Thread Kris Kennaway
On Wed, Aug 22, 2007 at 09:33:50PM +0300, Ovi wrote:

 Consult the developers handbook for tips on how to obtain sufficient
 debugging information to identify and debug a panic or hang.
 
 Kris
 
 I had the same issue, kernel panic and server reboot after tuning to 
 high sysctl variable (like maxsockbuf, but others too)
 but having only 1 GB of RAM.

It's possible you tuned it incorrectly.  

 Another rebooting problem was caused by running tcpdump on high used router.
 
 Other problem can be caused by hardware problems (I had those too).
 
 I disabled once creation of coredump by kernel, and I had problem (with 
 6.2), when an userland app crash, the kernel panicked because of that.
 
 Last, some userland apps. can cause kernel panic and reboot.

Neither of those two things should happen.

When you encounter panics, you need to report them.

Kris
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Servers Crash every few days

2007-08-22 Thread amin
Hi,
I have six servers running FreeBSD 6.2 and all of them have the same config.
My servers are configured to run as a socks5 proxy server.

Lately the servers are going down without any good reasons. How do I check
what are the errors or processes or the state of the server before it goes
down. All of them are running quite well without any reboots for the last
few weeks. My sysctl.conf is as follows:
kern.maxfiles=32768
kern.maxfilesperproc=32768
kern.maxprocperuid=32768
kern.ipc.somaxconn=32768
kern.ipc.maxsockbuf=8388608

net.inet.ip.portrange.first=3
net.inet.ip.portrange.hifirst=3
net.inet.ip.rtexpire= 1200
net.inet.ip.intr_queue_maxlen=1000

net.inet.tcp.rfc1323=1
#net.inet.tcp.mssdflt=1460

net.inet.udp.recvspace=65535
net.inet.udp.maxdgram=57344

net.inet.tcp.sendspace=65535
net.inet.tcp.recvspace=65535
net.local.stream.recvspace=65535
net.local.stream.sendspace=65535
net.inet.tcp.keepidle=72000
net.inet.tcp.keepintvl=1800

net.inet.icmp.icmplim=300
net.inet.tcp.delayed_ack=0

--
Loader.conf
kern.maxusers=128
kern.maxproc=32768
kern.ipc.nmbclusters=65536
kern.ipc.maxsockets=32768



The servers are sending in and out traffic of 30mbit upload and 30mbit
download 24x7 with incoming connections to the proxy server (running ss5
proxy) numbering between 6000-12000 connection. Memory for the servers are
2GB but using top I can get something like below:

last pid:  9269;  load averages:  2.60,  2.30,  2.23
up 1+01:18:38  21:01:47
10114 processes88 running, 10026 sleeping
CPU states: 25.2% user,  0.0% nice, 24.7% system, 17.9% interrupt, 32.2%
idle
Mem: 731M Active, 255M Inact, 796M Wired, 1284K Cache, 112M Buf, 155M Free

This server is running P2P proxy for 100 users connecting thru openvpn.

Is this a configuration issues or hardware issues?
Servers seem to go down at random timing, some last for 3-4 days before it
crashed sometime few hours and sometimes it goes down when have less than
1000 connection and sometimes when the connections is more 1.

Like now, with 1 connections, it has been running good for the last 12
hours.

Any pointers?

-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of
[EMAIL PROTECTED]
Sent: Wednesday, August 22, 2007 8:00 PM
To: freebsd-questions@freebsd.org
Subject: freebsd-questions Digest, Vol 191, Issue 26

Send freebsd-questions mailing list submissions to
freebsd-questions@freebsd.org

To subscribe or unsubscribe via the World Wide Web, visit
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
or, via email, send a message with subject or body 'help' to
[EMAIL PROTECTED]

You can reach the person managing the list at
[EMAIL PROTECTED]

When replying, please edit your Subject line so it is more specific
than Re: Contents of freebsd-questions digest...


Today's Topics:

   1. Re: wildcard usage in fetch (Philip Hallstrom)
   2. Problem with cardbus cards being recognized in my laptop
  ([EMAIL PROTECTED])
   3. What is a sane setting for maxdsize when running amd64? it
  seems many normal suggestions do not apply. (N. Harrington)
   4. Re: What is a sane setting for maxdsize when running amd64?
  itseems many normal suggestions do not apply. (Chuck Swiger)
   5. DJBDNS  IPv6 (Steve Bertrand)
   6. Re: DJBDNS  IPv6 (Steve Bertrand)
   7. ldconfig problem after upgrade 4.11 to 5.5 (Martin Schweizer)
   8. Re: ldconfig problem after upgrade 4.11 to 5.5 (Kris Kennaway)
   9. Re: wildcard usage in fetch (Rakhesh Sasidharan)
  10. Re: ldconfig problem after upgrade 4.11 to 5.5 (Martin Schweizer)
  11. Re: GEOM, Vinum difference (Rakhesh Sasidharan)
  12. Re: ldconfig problem after upgrade 4.11 to 5.5 (Martin Schweizer)
  13. Re: DJBDNS  IPv6 (Matthew Seaman)
  14. Re: Gnome  FreeBSD (Ghirai)
  15. Re: ldconfig problem after upgrade 4.11 to 5.5 (Kris Kennaway)
  16. Re: ldconfig problem after upgrade 4.11 to 5.5 (Kris Kennaway)
  17. Re: ldconfig problem after upgrade 4.11 to 5.5 (Martin Schweizer)
  18. Unlimited CEUs for $49.99 ([EMAIL PROTECTED])
  19. ps2ascii. c. (Gary Kline)
  20. Re: ps2ascii. c. (Yuri Pankov)
  21. Ports build parameters (knobs) (Gabriel Linder)
  22. Re: ps2ascii. c. (Predrag Punosevac)
  23. Re: GEOM, Vinum difference (Michel Talon)
  24. It's top shows wrong load percent? (Nguyen Tam Chinh)
  25. Ethernet controllers (King Wong)
  26. Re: What is a sane setting for maxdsize when running amd64?
  itseems many normal suggestions do not apply. (Dag-Erling
Sm?rgrav)
  27. Re: What is a sane setting for maxdsize when running amd64?
  it seems many normal suggestions do not apply. (Ganbold)
  28. Re: Ports build parameters (knobs) (Roland Smith)
  29. FreeBSD MBRs (Christopher Key)


--

Message: 1
Date: Tue, 21 Aug 2007 16:04:47 -0700 (PDT)
From: Philip Hallstrom [EMAIL PROTECTED]
Subject: Re: wildcard usage in 

Re: Servers Crash every few days

2007-08-22 Thread Kris Kennaway
On Wed, Aug 22, 2007 at 09:06:50PM +0800, amin wrote:
 Hi,
 I have six servers running FreeBSD 6.2 and all of them have the same config.
 My servers are configured to run as a socks5 proxy server.
 
 Lately the servers are going down without any good reasons. How do I check
 what are the errors or processes or the state of the server before it goes
 down. All of them are running quite well without any reboots for the last
 few weeks. My sysctl.conf is as follows:

You need to characterise going down.  Is it panicking?  Is it
rebooting?  Is it hanging?

Consult the developers handbook for tips on how to obtain sufficient
debugging information to identify and debug a panic or hang.

Kris

pgpHIZF7Yemgk.pgp
Description: PGP signature


Re: Servers Crash every few days

2007-08-22 Thread Roland Smith
On Wed, Aug 22, 2007 at 09:06:50PM +0800, amin wrote:
 Hi,
 I have six servers running FreeBSD 6.2 and all of them have the same config.
 My servers are configured to run as a socks5 proxy server.
 
 Lately the servers are going down without any good reasons. How do I check
 what are the errors or processes or the state of the server before it goes
 down. All of them are running quite well without any reboots for the last
 few weeks.

Do what Kris mentioned, but check for hardware issues as well; overheating,
voltage drops etc. The mbmon port running from cron and logging to another
machine can be helpfull here.

Roland
-- 
R.F.Smith   http://www.xs4all.nl/~rsmith/
[plain text _non-HTML_ PGP/GnuPG encrypted/signed email much appreciated]
pgp: 1A2B 477F 9970 BA3C 2914  B7CE 1277 EFB0 C321 A725 (KeyID: C321A725)


pgpYXxsle56zT.pgp
Description: PGP signature


RE: Servers Crash every few days

2007-08-22 Thread Aminuddin
Thanks.
But the servers are dedicated servers rented from a datacenter. I'm not sure
if it hangs or panic. The provider just keep rebooting when we said servers
not responding.
 Will try to use mbmon. Is there any ports I can use to log what actually
happened before it hangs or crashes?


-Original Message-
From: Roland Smith [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, August 22, 2007 10:59 PM
To: amin
Cc: freebsd-questions@freebsd.org
Subject: Re: Servers Crash every few days

On Wed, Aug 22, 2007 at 09:06:50PM +0800, amin wrote:
 Hi,
 I have six servers running FreeBSD 6.2 and all of them have the same
config.
 My servers are configured to run as a socks5 proxy server.
 
 Lately the servers are going down without any good reasons. How do I check
 what are the errors or processes or the state of the server before it goes
 down. All of them are running quite well without any reboots for the last
 few weeks.

Do what Kris mentioned, but check for hardware issues as well; overheating,
voltage drops etc. The mbmon port running from cron and logging to another
machine can be helpfull here.

Roland
-- 
R.F.Smith   http://www.xs4all.nl/~rsmith/
[plain text _non-HTML_ PGP/GnuPG encrypted/signed email much appreciated]
pgp: 1A2B 477F 9970 BA3C 2914  B7CE 1277 EFB0 C321 A725 (KeyID: C321A725)

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Servers Crash every few days

2007-08-22 Thread Roland Smith
On Thu, Aug 23, 2007 at 01:19:10AM +0800, Aminuddin wrote:
 Thanks.
 But the servers are dedicated servers rented from a datacenter.

Then get their tech support involved. See if they can log in on the console.

 I'm not sure if it hangs or panic. The provider just keep rebooting
 when we said servers not responding.

Which service doesn't respond anymore? Are you sure that the problem
isn't in the datacenter's hardware. e.g. faulty router or switch.

  Will try to use mbmon. Is there any ports I can use to log what actually
 happened before it hangs or crashes?

Syslogd(8) from the base system can log to a syslogd on another machine.

Set the services that you use to log more than normal. That might make
it easier to catch the event that causes the problems.

Does it hang or does it crash? Those are different things.  If the
kernel panics, there's not a lot you can do remotely. Obviously it can't
log it to another machine. Enable crashdumps and analyze them as the
machine comes up.

I'm guessing a lot here because I don't know your setup. If you want
better help, provide more information.

Roland
-- 
R.F.Smith   http://www.xs4all.nl/~rsmith/
[plain text _non-HTML_ PGP/GnuPG encrypted/signed email much appreciated]
pgp: 1A2B 477F 9970 BA3C 2914  B7CE 1277 EFB0 C321 A725 (KeyID: C321A725)


pgpZd9OY52KnC.pgp
Description: PGP signature


Re: Servers Crash every few days

2007-08-22 Thread Ovi

Kris Kennaway wrote:


On Wed, Aug 22, 2007 at 09:06:50PM +0800, amin wrote:
 


Hi,
I have six servers running FreeBSD 6.2 and all of them have the same config.
My servers are configured to run as a socks5 proxy server.

Lately the servers are going down without any good reasons. How do I check
what are the errors or processes or the state of the server before it goes
down. All of them are running quite well without any reboots for the last
few weeks. My sysctl.conf is as follows:
   



You need to characterise going down.  Is it panicking?  Is it
rebooting?  Is it hanging?

Consult the developers handbook for tips on how to obtain sufficient
debugging information to identify and debug a panic or hang.

Kris

I had the same issue, kernel panic and server reboot after tuning to 
high sysctl variable (like maxsockbuf, but others too)

but having only 1 GB of RAM.

Another rebooting problem was caused by running tcpdump on high used router.

Other problem can be caused by hardware problems (I had those too).

I disabled once creation of coredump by kernel, and I had problem (with 
6.2), when an userland app crash, the kernel panicked because of that.


Last, some userland apps. can cause kernel panic and reboot.

ovi

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]