Re: server crashing out of memory - SOLVED

2012-08-09 Thread Orion Poplawski
On 07/17/2012 11:22 AM, Orion Poplawski wrote: Our SL6.2 KVM and nfs/backup server has been crashing frequently recently (starting around Fri 13th - yikes!) with Kernel panic - Out of memory and no killable processes. The server has 48GB ram, 2GB swap, only about 15GB dedicated to VM guests.

Re: server crashing out of memory

2012-07-18 Thread Orion Poplawski
On 07/17/2012 11:22 AM, Orion Poplawski wrote: Our SL6.2 KVM and nfs/backup server has been crashing frequently recently (starting around Fri 13th - yikes!) with Kernel panic - Out of memory and no killable processes. The server has 48GB ram, 2GB swap, only about 15GB dedicated to VM guests.

Re: server crashing out of memory

2012-07-18 Thread David Sommerseth
On 18/07/12 18:35, Orion Poplawski wrote: On 07/17/2012 11:22 AM, Orion Poplawski wrote: Our SL6.2 KVM and nfs/backup server has been crashing frequently recently (starting around Fri 13th - yikes!) with Kernel panic - Out of memory and no killable processes. The server has 48GB ram, 2GB

Re: server crashing out of memory

2012-07-18 Thread Orion Poplawski
On 07/18/2012 11:32 AM, David Sommerseth wrote: On 18/07/12 18:35, Orion Poplawski wrote: On 07/17/2012 11:22 AM, Orion Poplawski wrote: Our SL6.2 KVM and nfs/backup server has been crashing frequently recently (starting around Fri 13th - yikes!) with Kernel panic - Out of memory and no

Re: server crashing out of memory

2012-07-18 Thread Steven J. Yellin
The fact that both free and total swap are said to be 0kB seems so unreasonable that it may mean I just don't understand the output. Another possibility is that there's a hardware error on the drive containing the swap data, in which case perhaps the computer would stay up after the error

Re: server crashing out of memory

2012-07-18 Thread Orion Poplawski
On 07/18/2012 01:36 PM, Steven J. Yellin wrote: The fact that both free and total swap are said to be 0kB seems so unreasonable that it may mean I just don't understand the output. Another possibility is that there's a hardware error on the drive containing the swap data, in which case

server crashing out of memory

2012-07-17 Thread Orion Poplawski
Our SL6.2 KVM and nfs/backup server has been crashing frequently recently (starting around Fri 13th - yikes!) with Kernel panic - Out of memory and no killable processes. The server has 48GB ram, 2GB swap, only about 15GB dedicated to VM guests. I've tried bumping up vm.min_free_kbytes to

Re: server crashing out of memory

2012-07-17 Thread Stephan Wiesand
On Jul 17, 2012, at 19:22 , Orion Poplawski wrote: Our SL6.2 KVM and nfs/backup server has been crashing frequently recently (starting around Fri 13th - yikes!) with Kernel panic - Out of memory and no killable processes. The server has 48GB ram, 2GB swap, only about 15GB dedicated to VM

Re: server crashing out of memory

2012-07-17 Thread Steven J. Yellin
If your atop service is on, you should be able to see something about what was happening shortly before the crash by viewing the appropriate /var/log/atop/file with the atop -r file command. You could just try increasing your swap space; you don't have very much compared with your ram.

Re: server crashing out of memory

2012-07-17 Thread Orion Poplawski
On 07/17/2012 12:21 PM, Steven J. Yellin wrote: If your atop service is on, you should be able to see something about what was happening shortly before the crash by viewing the appropriate /var/log/atop/file with the atop -r file command. You could just try increasing your swap space;

Re: server crashing out of memory

2012-07-17 Thread Orion Poplawski
On 07/17/2012 11:46 AM, Stephan Wiesand wrote: On Jul 17, 2012, at 19:22 , Orion Poplawski wrote: Our SL6.2 KVM and nfs/backup server has been crashing frequently recently (starting around Fri 13th - yikes!) with Kernel panic - Out of memory and no killable processes. The server has 48GB

Re: server crashing out of memory

2012-07-17 Thread Vladimir Mosgalin
Hi Orion Poplawski! On 2012.07.17 at 13:38:50 -0600, Orion Poplawski wrote next: If your atop service is on, you should be able to see something about what was happening shortly before the crash by viewing the appropriate /var/log/atop/file with the atop -r file command. You could