Re: [Bacula-users] High memory usage when backing up
Are you on a x86-64 machine? (I'm on Centos 4.1, though updated) If I run anything above 1.38.0, my jobs will eventually run the system out of RAM, and the system won't be able to start more processes: 31-Mar 11:30 duct-dir: bedlam.cse.2006-03-31_04.05.46 Error: open mail pipe /export/bacula/sbin/bsmtp -h localhost -f (Bacula) [EMAIL PROTECTED] -s Bacula: Intervention needed for bedlam.cse.2006-03-31_04.05.46 [EMAIL PROTECTED] failed: ERR=Cannot allocate memory I'd tried all the way up to 1.38.5 I think, with and without -O0, etc, etc. I *think* it specifically started at 1.38.2 or .3, I'd have to check my notes. It's really rather boggling - I'd guess there's a leak someplace. Mark On Tue, Apr 11, 2006 at 02:23:54PM -0400, Aaron Zschau wrote: I'm noticing extremely heavy memory loads when running a large bacula job. The system running the fd and director processes spikes to using all but about 18mb of the 5gb of memory installed. If I sort by memory usage in Top, no processes are using anywhere near the missing memory, however the usage only spikes when I run a large backup job ~100 GB) from this machine. If I shut down bacula completely, the memory loads don't go back down the results from free show that its not being taken up by the buffers (only about 178mb used by buffers) , total used free shared buffers cached Mem: 50739565056120 17836 0 7528 4877864 -/+ buffers/cache: 1707284903228 Swap: 20981521602097992 Things aren't getting bad enough to start swapping, however this is setting off alarms in Nagios as the % of free memory is well below the warning point, and I've had an unexplained crash or two on this server. Some memory does seem to free up as its needed (for example if I open firefox and load up several tabs) but when a job is running, things always settle back down to around 18mb free. I am running CentOS 4.1 and the latest version of bacula-fd. any help would be appreciated, -- -- -- -- -- -- -- -- Aaron Zschau - [EMAIL PROTECTED] Network and Systems Engineer Z-Tech Associates - 781.863.8884 x120 --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] High memory usage when backing up
I'm noticing extremely heavy memory loads when running a large bacula job. The system running the fd and director processes spikes to using all but about 18mb of the 5gb of memory installed. If I sort by memory usage in Top, no processes are using anywhere near the missing memory, however the usage only spikes when I run a large backup job ~100 GB) from this machine. If I shut down bacula completely, the memory loads don't go back down the results from free show that its not being taken up by the buffers (only about 178mb used by buffers) , total used free shared buffers cached Mem: 50739565056120 17836 0 7528 4877864 -/+ buffers/cache: 1707284903228 Swap: 20981521602097992 Things aren't getting bad enough to start swapping, however this is setting off alarms in Nagios as the % of free memory is well below the warning point, and I've had an unexplained crash or two on this server. Some memory does seem to free up as its needed (for example if I open firefox and load up several tabs) but when a job is running, things always settle back down to around 18mb free. I am running CentOS 4.1 and the latest version of bacula-fd. any help would be appreciated, -- -- -- -- -- -- -- -- Aaron Zschau - [EMAIL PROTECTED] Network and Systems Engineer Z-Tech Associates - 781.863.8884 x120 --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] High memory usage when backing up
What you are seeing appears to be normal block device caching under the linux kernel and nothing to worry about. Cheers, Eric On 4/11/06, Aaron Zschau [EMAIL PROTECTED] wrote: I'm noticing extremely heavy memory loads when running a large bacula job. The system running the fd and director processes spikes to using all but about 18mb of the 5gb of memory installed. If I sort by memory usage in Top, no processes are using anywhere near the missing memory, however the usage only spikes when I run a large backup job ~100 GB) from this machine. If I shut down bacula completely, the memory loads don't go back down the results from free show that its not being taken up by the buffers (only about 178mb used by buffers) , total used free shared buffers cached Mem: 50739565056120 17836 0 7528 4877864 -/+ buffers/cache: 1707284903228 Swap: 20981521602097992 Things aren't getting bad enough to start swapping, however this is setting off alarms in Nagios as the % of free memory is well below the warning point, and I've had an unexplained crash or two on this server. Some memory does seem to free up as its needed (for example if I open firefox and load up several tabs) but when a job is running, things always settle back down to around 18mb free. I am running CentOS 4.1 and the latest version of bacula-fd. any help would be appreciated, -- -- -- -- -- -- -- -- Aaron Zschau - [EMAIL PROTECTED] Network and Systems Engineer Z-Tech Associates - 781.863.8884 x120 --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid0944bid$1720dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] High memory usage when backing up
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I've noticed when running 2.6, the machine appears to want to use all of the RAM. However, running more processes will not make it swap until it would have otherwise begun swapping. Seems to handle the memory usage pretty well, IMO. _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - User Support Spec. III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 Eric Warnke wrote: What you are seeing appears to be normal block device caching under the linux kernel and nothing to worry about. Cheers, Eric On 4/11/06, Aaron Zschau [EMAIL PROTECTED] wrote: I'm noticing extremely heavy memory loads when running a large bacula job. The system running the fd and director processes spikes to using all but about 18mb of the 5gb of memory installed. If I sort by memory usage in Top, no processes are using anywhere near the missing memory, however the usage only spikes when I run a large backup job ~100 GB) from this machine. If I shut down bacula completely, the memory loads don't go back down the results from free show that its not being taken up by the buffers (only about 178mb used by buffers) , total used free shared buffers cached Mem: 50739565056120 17836 0 7528 4877864 -/+ buffers/cache: 1707284903228 Swap: 20981521602097992 Things aren't getting bad enough to start swapping, however this is setting off alarms in Nagios as the % of free memory is well below the warning point, and I've had an unexplained crash or two on this server. Some memory does seem to free up as its needed (for example if I open firefox and load up several tabs) but when a job is running, things always settle back down to around 18mb free. I am running CentOS 4.1 and the latest version of bacula-fd. any help would be appreciated, -- -- -- -- -- -- -- -- Aaron Zschau - [EMAIL PROTECTED] Network and Systems Engineer Z-Tech Associates - 781.863.8884 x120 --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=kkid0944bid$1720dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.2.2 (MingW32) iD8DBQFEO/vmmb+gadEcsb4RAkylAJ9N7oR+lWCNbfCu2WOTBu2ad8MF0wCgjWgf 4XgECRzxCjDQZxLiSf6IWOY= =QrTZ -END PGP SIGNATURE- --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] High memory usage when backing up
On Tue, 11 Apr 2006, Eric Warnke wrote: What you are seeing appears to be normal block device caching under the linux kernel and nothing to worry about. To explain: buffers = i/o (disk) write buffers cache = i/o (disk) read cache These are dynamic. Linux works on the principle that if the memory isn't being used by software then it can be used for housekeeping. As software demands increase, buffers and cache will decrease. I'm noticing extremely heavy memory loads when running a large bacula job. The system running the fd and director processes spikes to using all but about 18mb of the 5gb of memory installed. If I sort by memory usage in Top, no processes are using anywhere near the missing memory, however the usage only spikes when I run a large backup job ~100 GB) from this machine. That's what I would expect. If I shut down bacula completely, the memory loads don't go back down It won't. See above. free memory in Linux is the amount of ram not being used for i/o buffering or the programs themselves - if you are seeing large amounts of free memory after a few days of operation then you probably have more ram in the machine than it actually needs for the tasks it is performing. AB --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
