Re: [Bacula-users] Bacula and memory usage
On 2020-01-27 19:39, Jean Mark Orfali wrote: > Sorry, I meant to say: I had to reboot the server. > Her is the result of top: So having rebooted the server, there is CURRENTLY nothing to see. You can't diagnose a problem when it isn't there. If your backup jobs stall again, please try to report what is happening on the system when the jobs are actually stalled. We need to be able to see what is going wrong to be able to help you diagnose the problem. -- Phil Stracchino Babylon Communications ph...@caerllewys.net p...@co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula and memory usage
Sorry, I meant to say: I had to reboot the server. Her is the result of top: top - 19:38:12 up 4:44, 2 users, load average: 3.67, 5.03, 4.62 Tasks: 202 total, 2 running, 200 sleeping, 0 stopped, 0 zombie %Cpu(s): 0.1 us, 0.2 sy, 0.0 ni, 92.0 id, 7.6 wa, 0.0 hi, 0.1 si, 0.0 st KiB Mem : 29987532 total, 224088 free, 653832 used, 29109612 buff/cache KiB Swap: 15138812 total, 15138812 free,0 used. 28932832 avail Mem PID USER PR NIVIRTRESSHR S %CPU %MEM TIME+ COMMAND 2093 bacula20 0 395308 4300 3100 S 5.3 0.0 5:09.74 bacula-sd 5634 root 20 0 162036 2316 1524 R 0.7 0.0 0:00.03 top 2088 bacula20 0 554584 7232 3828 S 0.3 0.0 0:24.96 bacula-dir 5591 root 20 0 0 0 0 S 0.3 0.0 0:00.31 kworker/0:2 1 root 20 0 191156 4096 2512 S 0.0 0.0 0:02.76 systemd 2 root 20 0 0 0 0 S 0.0 0.0 0:00.02 kthreadd 4 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/0:0H 6 root 20 0 0 0 0 R 0.0 0.0 0:53.52 ksoftirqd/0 7 root rt 0 0 0 0 S 0.0 0.0 0:00.00 migration/0 8 root 20 0 0 0 0 S 0.0 0.0 0:00.00 rcu_bh 9 root 20 0 0 0 0 S 0.0 0.0 0:03.34 rcu_sched 10 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 lru-add-drain 11 root rt 0 0 0 0 S 0.0 0.0 0:00.13 watchdog/0 12 root rt 0 0 0 0 S 0.0 0.0 0:00.08 watchdog/1 13 root rt 0 0 0 0 S 0.0 0.0 0:00.02 migration/1 14 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/1 16 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/1:0H 17 root rt 0 0 0 0 S 0.0 0.0 0:00.08 watchdog/2 18 root rt 0 0 0 0 S 0.0 0.0 0:00.01 migration/2 19 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/2 21 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/2:0H 22 root rt 0 0 0 0 S 0.0 0.0 0:00.08 watchdog/3 23 root rt 0 0 0 0 S 0.0 0.0 0:00.00 migration/3 24 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/3 26 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/3:0H 27 root rt 0 0 0 0 S 0.0 0.0 0:00.08 watchdog/4 28 root rt 0 0 0 0 S 0.0 0.0 0:00.00 migration/4 29 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/4 31 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/4:0H 32 root rt 0 0 0 0 S 0.0 0.0 0:00.08 watchdog/5 33 root rt 0 0 0 0 S 0.0 0.0 0:00.00 migration/5 34 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/5 35 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kworker/5:0 36 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/5:0H 37 root rt 0 0 0 0 S 0.0 0.0 0:00.08 watchdog/6 38 root rt 0 0 0 0 S 0.0 0.0 0:00.00 migration/6 39 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/6 41 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/6:0H 42 root rt 0 0 0 0 S 0.0 0.0 0:00.08 watchdog/7 Jean Mark Orfali • Sys admin T. 1-877-258-4542 P. 227 bravad.ca/Fabrique Avis de confidentialité Le contenu de ce message ainsi que du ou des fichiers qui y sont joints est strictement confidentiel et destiné exclusivement à son ou sa destinataire. Si vous n’êtes pas cette personne, nous attirons votre attention sur le fait qu’il est strictement interdit de copier, de faire suivre ou d’utiliser les informations contenues dans ce courriel. Si vous l’avez reçu par erreur, nous vous remercions de nous le faire savoir. -Message d'origine- De : Phil Stracchino Envoyé : Monday, 27 January, 2020 7:02 PM À : Jean Mark Orfali ; bacula-users@lists.sourceforge.net Objet : Re: [Bacula-users] Bacula and memory usage On 2020-01-27 18:50, Jean Mark Orfali wrote: > Hello Phil, > > It indicates less than 24 hours of function because I had to leave it to > access SSH. The RAM was too high and I had no access to anything ... I do not > have Plesk or Cpanel on the server. Only what is needed to run Bacula. I left > a single backup and the memory went up to 96% ... "Had to leave it to access SSH"? What exactly do you mean by that? What processes does top tell you are the highest memory users? -- Phil Stracchino Babylon Communications ph...@caerllewys.net p...@co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958
Re: [Bacula-users] Bacula and memory usage
On 2020-01-27 18:50, Jean Mark Orfali wrote: > Hello Phil, > > It indicates less than 24 hours of function because I had to leave it to > access SSH. The RAM was too high and I had no access to anything ... I do not > have Plesk or Cpanel on the server. Only what is needed to run Bacula. I left > a single backup and the memory went up to 96% ... "Had to leave it to access SSH"? What exactly do you mean by that? What processes does top tell you are the highest memory users? -- Phil Stracchino Babylon Communications ph...@caerllewys.net p...@co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula and memory usage
Hello Phil, It indicates less than 24 hours of function because I had to leave it to access SSH. The RAM was too high and I had no access to anything ... I do not have Plesk or Cpanel on the server. Only what is needed to run Bacula. I left a single backup and the memory went up to 96% ... Jean Mark Orfali • Sys admin T. 1-877-258-4542 P. 227 bravad.ca/Fabrique Avis de confidentialité Le contenu de ce message ainsi que du ou des fichiers qui y sont joints est strictement confidentiel et destiné exclusivement à son ou sa destinataire. Si vous n’êtes pas cette personne, nous attirons votre attention sur le fait qu’il est strictement interdit de copier, de faire suivre ou d’utiliser les informations contenues dans ce courriel. Si vous l’avez reçu par erreur, nous vous remercions de nous le faire savoir. -Message d'origine- De : Phil Stracchino Envoyé : Monday, 27 January, 2020 6:27 PM À : Jean Mark Orfali ; bacula-users@lists.sourceforge.net Objet : Re: [Bacula-users] Bacula and memory usage On 2020-01-27 15:34, Jean Mark Orfali wrote: > Hello Phil, > > Her is the result : OK, there's good news and bad news here. The good news is, your Bacula DB is, so far, so tiny that you're getting by just fine with out-of-the-box MariaDB default settings. In fact, it's smaller than it *SHOULD* be if you're backing up 6TB of data. The bad news is, you said your backups have been running for five days, but mysqltuner says mariadb has been up less than 24 hours. There's two obvious possibilities here. 1: mariadb keeps crashing. If this is the case, you need to find out why. 2: something keeps restarting mariadb. You're not running Plesk, are you...? Check your MariaDB error log and syslog. If you're saying that system memory usage is constantly high, what MAY be happening here is that your system is running out of memory and the kernel is killing mysqld because it sees it as the largest single consumer of memory. (Though with only a 128.0MB InnoDB buffer pool I would find that surprising.) What ELSE runs on your Bacula server? Are you running a webserver on it as well? Do you have resource limits set on the webserver to stop it from spawning httpd processes until it consumes all free memory? (A common error.) Whatever the reason, if the running mysqld process goes away while the Director is trying to read from or write to it, Bacula is going to have a problem. If MariaDB *really is* being constantly restarted before any jobs can finish, then that's a large part of why your jobs can't finish, and you need to solve that problem before you can get anywhere further. -- Phil Stracchino Babylon Communications ph...@caerllewys.net p...@co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula and memory usage
On 2020-01-27 15:34, Jean Mark Orfali wrote: > Hello Phil, > > Her is the result : OK, there's good news and bad news here. The good news is, your Bacula DB is, so far, so tiny that you're getting by just fine with out-of-the-box MariaDB default settings. In fact, it's smaller than it *SHOULD* be if you're backing up 6TB of data. The bad news is, you said your backups have been running for five days, but mysqltuner says mariadb has been up less than 24 hours. There's two obvious possibilities here. 1: mariadb keeps crashing. If this is the case, you need to find out why. 2: something keeps restarting mariadb. You're not running Plesk, are you...? Check your MariaDB error log and syslog. If you're saying that system memory usage is constantly high, what MAY be happening here is that your system is running out of memory and the kernel is killing mysqld because it sees it as the largest single consumer of memory. (Though with only a 128.0MB InnoDB buffer pool I would find that surprising.) What ELSE runs on your Bacula server? Are you running a webserver on it as well? Do you have resource limits set on the webserver to stop it from spawning httpd processes until it consumes all free memory? (A common error.) Whatever the reason, if the running mysqld process goes away while the Director is trying to read from or write to it, Bacula is going to have a problem. If MariaDB *really is* being constantly restarted before any jobs can finish, then that's a large part of why your jobs can't finish, and you need to solve that problem before you can get anywhere further. -- Phil Stracchino Babylon Communications ph...@caerllewys.net p...@co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula and memory usage
Hello Phil, Her is the result : >> MySQLTuner 1.7.19 - Major Hayden >> Bug reports, feature requests, and downloads at http://mysqltuner.com/ >> Run with '--help' for additional options and output filtering [--] Skipped version check for MySQLTuner script Please enter your MySQL administrative login: root Please enter your MySQL administrative password: [!!] Your MySQL version 5.5.64-MariaDB is EOL software! Upgrade soon! [OK] Operating on 64-bit architecture Log file Recommendations -- [OK] Log file /var/log/mariadb/mariadb.log exists [--] Log file: /var/log/mariadb/mariadb.log(26K) [OK] Log file /var/log/mariadb/mariadb.log is readable. [OK] Log file /var/log/mariadb/mariadb.log is not empty [OK] Log file /var/log/mariadb/mariadb.log is smaller than 32 Mb [!!] /var/log/mariadb/mariadb.log contains 1 warning(s). [OK] /var/log/mariadb/mariadb.log doesn't contain any error. [--] 18 start(s) detected in /var/log/mariadb/mariadb.log [--] 1) 200127 14:53:46 [Note] /usr/libexec/mysqld: ready for connections. [--] 2) 200127 14:31:06 [Note] /usr/libexec/mysqld: ready for connections. [--] 3) 200127 13:42:01 [Note] /usr/libexec/mysqld: ready for connections. [--] 4) 200123 10:30:09 [Note] /usr/libexec/mysqld: ready for connections. [--] 5) 200123 9:30:38 [Note] /usr/libexec/mysqld: ready for connections. [--] 6) 200122 13:40:50 [Note] /usr/libexec/mysqld: ready for connections. [--] 7) 200122 11:25:59 [Note] /usr/libexec/mysqld: ready for connections. [--] 8) 200121 20:22:27 [Note] /usr/libexec/mysqld: ready for connections. [--] 9) 200121 18:11:25 [Note] /usr/libexec/mysqld: ready for connections. [--] 10) 200121 8:59:06 [Note] /usr/libexec/mysqld: ready for connections. [--] 13 shutdown(s) detected in /var/log/mariadb/mariadb.log [--] 1) 200127 14:53:14 [Note] /usr/libexec/mysqld: Shutdown complete [--] 2) 200127 14:30:34 [Note] /usr/libexec/mysqld: Shutdown complete [--] 3) 200122 11:25:23 [Note] /usr/libexec/mysqld: Shutdown complete [--] 4) 200121 20:21:55 [Note] /usr/libexec/mysqld: Shutdown complete [--] 5) 200121 18:10:56 [Note] /usr/libexec/mysqld: Shutdown complete [--] 6) 200121 8:58:36 [Note] /usr/libexec/mysqld: Shutdown complete [--] 7) 200117 15:17:29 [Note] /usr/libexec/mysqld: Shutdown complete [--] 8) 200117 13:32:59 [Note] /usr/libexec/mysqld: Shutdown complete [--] 9) 200117 11:08:05 [Note] /usr/libexec/mysqld: Shutdown complete [--] 10) 200116 14:37:52 [Note] /usr/libexec/mysqld: Shutdown complete Storage Engine Statistics - [--] Status: +ARCHIVE +Aria +BLACKHOLE +CSV +FEDERATED +InnoDB +MEMORY +MRG_MYISAM +MyISAM +PERFORMANCE_SCHEMA [--] Data in MyISAM tables: 1.0K (Tables: 1) [--] Data in InnoDB tables: 1.6M (Tables: 41) [OK] Total fragmented tables: 0 Analysis Performance Metrics -- [--] innodb_stats_on_metadata: ON [!!] Stat are updated during querying INFORMATION_SCHEMA. Security Recommendations -- [OK] There are no anonymous accounts for any database users [OK] All database users have passwords assigned [!!] There is no basic password file list! CVE Security Recommendations -- [--] Skipped due to --cvefile option undefined Performance Metrics --- [--] Up for: 37m 48s (54 q [0.024 qps], 10 conn, TX: 50K, RX: 6K) [--] Reads / Writes: 73% / 27% [--] Binary logging is disabled [--] Physical Memory : 28.6G [--] Max MySQL memory: 987.0M [--] Other process memory: 0B [--] Total buffers: 416.0M global + 3.8M per thread (151 max threads) [--] P_S Max memory usage: 0B [--] Galera GCache Max memory usage: 0B [OK] Maximum reached memory usage: 419.8M (1.43% of installed RAM) [OK] Maximum possible memory usage: 987.0M (3.37% of installed RAM) [OK] Overall possible memory usage with other process is compatible with memory available [OK] Slow queries: 0% (0/54) [OK] Highest usage of available connections: 0% (1/151) [!!] Aborted connections: 20.00% (2/10) [!!] name resolution is active : a reverse name resolution is made for each new connection and can reduce performance [!!] Query cache may be disabled by default due to mutex contention. [!!] Query cache efficiency: 0.0% (0 cached / 30 selects) [OK] Query cache prunes per day: 0 [OK] No Sort requiring temporary tables [OK] No joins without indexes [OK] Temporary tables created on disk: 0% (0 on disk / 5 total) [!!] Thread cache is disabled [OK] Table cache hit rate: 471% (33 open / 7 opened) [OK] table_definition_cache(400) is upper than number of tables(145) [OK] Open file limit used: 2% (21/962) [OK] Table locks acquired immediately: 100% (71 immediate / 71 locks)
Re: [Bacula-users] Bacula and memory usage
Hi,
How many files and total space on each client? 6 TB is not necessarily
a huge total amount but you may want to consider splitting each client
job into smaller chunks. Also, what does the status of the jobs show?
Does it show that it is indeed backing up data? Unfortunately, if they
are not close to finishing, you most likely are going to run into the
hard limit on job run time (6 days?) and the jobs will be canceled. I'm
assuming that this hard coded limitation is still in the 7.0.5 code base.
Also, to avoid queuing up additional backup runs for the same job, you
may to look into the various options that allow one to cancel jobs of
they are already running, already queued, etc.
--tom
On 1/27/20 2:11 PM, Jean Mark Orfali wrote:
Hello,
Thank you for your reply. Here is the missing information. My Bacula server and
the four clients are on Linux Centos 7 servers. I use Webmin version 1.941 to
access bacula. The bacula version is 7.0.5. The SQL server is a MariaDB version
5.5.64. The server has 30TB of hard drive and 30GB of memory. Backups are saved
in a directory directly on the backup server. No backup is kept on clients
side. At the moment there is 6 TB of data to backup. On each of the 4 clients I
have an incremental backup task schedule every day at 11 p.m. Right now I have
4 backups running for 5 days and 14 waiting.
Here is the server configuration information:
Thank you so much!
Bacula-dir.conf
#
# Default Bacula Director Configuration file
#
# The only thing that MUST be changed is to add one or more
# file or directory names in the Include directive of the
# FileSet resource.
#
# For Bacula release 7.0.5 (28 July 2014) -- redhat Enterprise release
#
# You might also want to change the default email address
# from root to your address. See the "mail" and "operator"
# directives in the Messages resource.
#
Director {# define myself
Name = bacula-dir
DIRport = 9101
QueryFile = "/etc/bacula/query.sql"
WorkingDirectory = /var/spool/bacula
PidDirectory = "/var/run"
Maximum Concurrent Jobs = 100
Password = "" # Console password
Messages = Daemon
}
#
# Define the main nightly save backup job
# By default, this job will back up to disk in /tmp
#Job {
# Name = "BackupClient2"
# Client = bacula2-fd
# JobDefs = "DefaultJob"
#}
#Job {
# Name = "BackupClient1-to-Tape"
# JobDefs = "DefaultJob"
# Storage = LTO-4
# Spool Data = yes# Avoid shoe-shine
# Pool = Default
#}
#}
# Backup the catalog database (after the nightly save)
#
# Standard Restore template, to be changed by Console program
# Only one such job is needed for all Jobs/Clients/Storage ...
#
# List of files to be backed up
FileSet {
Name = "Full Set"
Include {
Options {
signature = MD5
compression = GZIP
}
#
# Put your list of files here, preceded by 'File =', one per line
#or include an external list with:
#
#File = \" -s \"Bacula:
%t %e of %c %l\" %r"
operatorcommand = "/usr/sbin/bsmtp -h 51.79.119.27 -f \"\(Bacula\) \<%r\>\" -s
\"Bacula: Intervention needed for %j\" %r"
mail = root@51.79.119.27 = all, !skipped
operator = root@51.79.119.27 = mount
console = all, !skipped, !saved
#
# WARNING! the following will create a file that you must cycle from
# time to time as it will grow indefinitely. However, it will
# also keep all your messages if they scroll off the console.
#
append = "/var/log/bacula/bacula.log" = all, !skipped
catalog = all, !skipped, !saved
}
#
# Message delivery for daemon messages (no job).
Messages {
Name = Daemon
mailcommand = "/usr/sbin/bsmtp -h 51.79.119.27 -f \"\(Bacula\) \<%r\>\" -s \"Bacula
daemon message\" %r"
mail = root@51.79.119.27 = all, !skipped
console = all, !skipped, !saved
append = "/var/log/bacula/bacula.log" = all, !skipped
}
# Default pool definition
Pool {
Name = Default
Pool Type = Backup
Recycle = yes # Bacula can automatically recycle
Volumes
AutoPrune = yes # Prune expired volumes
Volume Retention = 365 days # one year
Maximum Volume Bytes = 50G # Limit Volume size to something
reasonable
Maximum Volumes = 100 # Limit number of Volumes in Pool
}
# File Pool definition
Pool {
Name = File
Pool Type = Backup
Label Format = Local-
Recycle = yes # Bacula can automatically recycle
Volumes
AutoPrune = yes # Prune expired volumes
Volume Retention = 365 days # one year
Maximum Volume Bytes = 50G # Limit Volume size to something
reasonable
Maximum Volumes = 100 # Limit number of Volumes in Pool
#Label Format = "Vol-" # Auto label
}
# Scratch pool definition
Pool {
Name = Scratch
Pool Type = Backup
}
#
# Restricted console used by tray-monitor to get the status of the
Re: [Bacula-users] Bacula and memory usage
On 2020-01-27 14:11, Jean Mark Orfali wrote: > Hello, > > Thank you for your reply. Here is the missing information. My Bacula server > and the four clients are on Linux Centos 7 servers. I use Webmin version > 1.941 to access bacula. The bacula version is 7.0.5. The SQL server is a > MariaDB version 5.5.64. The server has 30TB of hard drive and 30GB of memory. > Backups are saved in a directory directly on the backup server. No backup is > kept on clients side. At the moment there is 6 TB of data to backup. On each > of the 4 clients I have an incremental backup task schedule every day at 11 > p.m. Right now I have 4 backups running for 5 days and 14 waiting. Jean, How is that MariaDB instance configured? As a quick-and-dirty first approximation, what does mysqltuner tell you? -- Phil Stracchino Babylon Communications ph...@caerllewys.net p...@co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula and memory usage
Hello,
Thank you for your reply. Here is the missing information. My Bacula server and
the four clients are on Linux Centos 7 servers. I use Webmin version 1.941 to
access bacula. The bacula version is 7.0.5. The SQL server is a MariaDB version
5.5.64. The server has 30TB of hard drive and 30GB of memory. Backups are saved
in a directory directly on the backup server. No backup is kept on clients
side. At the moment there is 6 TB of data to backup. On each of the 4 clients I
have an incremental backup task schedule every day at 11 p.m. Right now I have
4 backups running for 5 days and 14 waiting.
Here is the server configuration information:
Thank you so much!
Bacula-dir.conf
#
# Default Bacula Director Configuration file
#
# The only thing that MUST be changed is to add one or more
# file or directory names in the Include directive of the
# FileSet resource.
#
# For Bacula release 7.0.5 (28 July 2014) -- redhat Enterprise release
#
# You might also want to change the default email address
# from root to your address. See the "mail" and "operator"
# directives in the Messages resource.
#
Director {# define myself
Name = bacula-dir
DIRport = 9101
QueryFile = "/etc/bacula/query.sql"
WorkingDirectory = /var/spool/bacula
PidDirectory = "/var/run"
Maximum Concurrent Jobs = 100
Password = "" # Console password
Messages = Daemon
}
#
# Define the main nightly save backup job
# By default, this job will back up to disk in /tmp
#Job {
# Name = "BackupClient2"
# Client = bacula2-fd
# JobDefs = "DefaultJob"
#}
#Job {
# Name = "BackupClient1-to-Tape"
# JobDefs = "DefaultJob"
# Storage = LTO-4
# Spool Data = yes# Avoid shoe-shine
# Pool = Default
#}
#}
# Backup the catalog database (after the nightly save)
#
# Standard Restore template, to be changed by Console program
# Only one such job is needed for all Jobs/Clients/Storage ...
#
# List of files to be backed up
FileSet {
Name = "Full Set"
Include {
Options {
signature = MD5
compression = GZIP
}
#
# Put your list of files here, preceded by 'File =', one per line
#or include an external list with:
#
#File = \" -s
\"Bacula: %t %e of %c %l\" %r"
operatorcommand = "/usr/sbin/bsmtp -h 51.79.119.27 -f \"\(Bacula\) \<%r\>\"
-s \"Bacula: Intervention needed for %j\" %r"
mail = root@51.79.119.27 = all, !skipped
operator = root@51.79.119.27 = mount
console = all, !skipped, !saved
#
# WARNING! the following will create a file that you must cycle from
# time to time as it will grow indefinitely. However, it will
# also keep all your messages if they scroll off the console.
#
append = "/var/log/bacula/bacula.log" = all, !skipped
catalog = all, !skipped, !saved
}
#
# Message delivery for daemon messages (no job).
Messages {
Name = Daemon
mailcommand = "/usr/sbin/bsmtp -h 51.79.119.27 -f \"\(Bacula\) \<%r\>\" -s
\"Bacula daemon message\" %r"
mail = root@51.79.119.27 = all, !skipped
console = all, !skipped, !saved
append = "/var/log/bacula/bacula.log" = all, !skipped
}
# Default pool definition
Pool {
Name = Default
Pool Type = Backup
Recycle = yes # Bacula can automatically recycle Volumes
AutoPrune = yes # Prune expired volumes
Volume Retention = 365 days # one year
Maximum Volume Bytes = 50G # Limit Volume size to something
reasonable
Maximum Volumes = 100 # Limit number of Volumes in Pool
}
# File Pool definition
Pool {
Name = File
Pool Type = Backup
Label Format = Local-
Recycle = yes # Bacula can automatically recycle Volumes
AutoPrune = yes # Prune expired volumes
Volume Retention = 365 days # one year
Maximum Volume Bytes = 50G # Limit Volume size to something
reasonable
Maximum Volumes = 100 # Limit number of Volumes in Pool
#Label Format = "Vol-" # Auto label
}
# Scratch pool definition
Pool {
Name = Scratch
Pool Type = Backup
}
#
# Restricted console used by tray-monitor to get the status of the director
#
Console {
Name = bacula-mon
Password = ""
CommandACL = status, .status
}
#@|"find /etc/bacula/conf.d -name '*.conf' -type f -exec echo @{} \;"
Schedule {
Name = Daily
Run = Level=Incremental Pool=Default at 23:00
}
###BACK OVH
FileSet {
Name = BackOVH
Include {
File = /root/home2
Options {
signature = MD5
Compression = GZIP1
}
}
}
Job {
Name = BackOVH
Type = Backup
Level = Incremental
Client = 54.39.187.124-fd
FileSet = BackOVH
Schedule = Daily
Storage = File1
Pool = jm
Messages = Standard
}
Pool {
Name = jm
Pool Type = Backup
Volume Retention = 365 days
Recycle = yes
AutoPrune = yes
Maximum Volume Bytes = 28000G
LabelFormat = ovh-
}
# Standard Restore template, to be changed by Console
Re: [Bacula-users] Bacula and memory usage
On 2020-01-27 10:38, Jean Mark Orfali wrote: > Hello, > > > > I have a Bacula server and 4 clients. The server has 8 cpu and 30 GIB of > ram. I don't know why, it's been 5 days since the first backup started > and they are still not finished. The ram on the server is still used at > almost 100%, 29.30GIB. Do you know why Bacula uses so much memory? > > thank you so much This is not nearly enough information from which to diagnose the problem. What back-end catalog database are you running? How is it configured? Does it have enough memory? How much data are you backing up, and where are you backing it up to? What are the concurrency settings on ALL of your Bacula daemons? What is the Director currently *doing*? What jobs are running, what jobs are pending, what jobs are scheduled? This would probably be enough to start troubleshooting. Tell us how your system is set up, at high level, and give us an overview of your configuration (with passwords obscured, of course). One unfortunate beginner mistake that I have seen people run into is to run disk-to-disk backups stored on one of the filesystems that is backed up, leading to a job that will effectively run forever as it recursively backs up its own backups. Another common mistake is to put the catalog on a fresh-out-of-the-box, unconfigured, untuned MySQL instance. The only thing that can be said of the typical fresh-from-the-box default MySQL configuration file is that it's usually no longer actively harmful. Whichever database you are using for your catalog, make sure it is properly configured and tuned before you start. (And don't use SQLite as a production catalog DB. Seriously.) -- Phil Stracchino Babylon Communications ph...@caerllewys.net p...@co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula and memory usage
Hello, I have a Bacula server and 4 clients. The server has 8 cpu and 30 GIB of ram. I don't know why, it's been 5 days since the first backup started and they are still not finished. The ram on the server is still used at almost 100%, 29.30GIB. Do you know why Bacula uses so much memory? thank you so much [cid:image001.png@01D2B43F.D4E82A50] Jean Mark Orfali * Sys admin T. 1-877-258-4542 P. 227 bravad.ca/Fabrique Avis de confidentialité Le contenu de ce message ainsi que du ou des fichiers qui y sont joints est strictement confidentiel et destiné exclusivement à son ou sa destinataire. Si vous n'êtes pas cette personne, nous attirons votre attention sur le fait qu'il est strictement interdit de copier, de faire suivre ou d'utiliser les informations contenues dans ce courriel. Si vous l'avez reçu par erreur, nous vous remercions de nous le faire savoir. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
