[Bacula-users] About backup speed in reports
Hello, Now in reports that Bacula sends after backup Rate is calculated simply dividing SD Bytes written by Elapsed time. But since I'm using data spooling and doing multiple backups at the same time this number means absolutely nothing. It would be much more useful to get another two numbers: - data spool rate. Which would indicate how fast data was received from FD to SD spool. - write to tape rate. How fast data was despooled to tape drive. Then first number would show network and spool drive performance and usage. Second one will show if my hardware is capable to feed tape drive fast enough that drive does not have to stop tape. Such stops/starts reduces not only backup speed but also tape life dramatically. I think I remember some thoughts from Kern about implementing this ;). Back from the end of 2004. Mindaugas Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] About backup speed in reports
On Saturday 01 July 2006 09:39, Mindaugas wrote:
> Hello,
>
> Now in reports that Bacula sends after backup Rate is calculated simply
> dividing
> SD Bytes written by Elapsed time.
> But since I'm using data spooling and doing multiple backups at the same
> time this
> number means absolutely nothing.
>
> It would be much more useful to get another two numbers:
> - data spool rate. Which would indicate how fast data was received from
> FD to SD spool.
> - write to tape rate. How fast data was despooled to tape drive.
>
> Then first number would show network and spool drive performance and
> usage. Second one
> will show if my hardware is capable to feed tape drive fast enough that
> drive does not
> have to stop tape. Such stops/starts reduces not only backup speed but also
> tape life
> dramatically.
>
> I think I remember some thoughts from Kern about implementing this ;).
> Back from the end
> of 2004.
I don't have any problem implementing better statistics, but it is not on the
top of my personal priority list (nor what users voted on), so I am waiting
for a patch to arrive.
--
Best regards,
Kern
(">
/\
V_V
PS: Once version 1.40.0 is release, aside from continuing to fix bugs, I will
be concentrating my personal efforts on two things: 1. GUI interfaces 2.
Performance (including documentation on how to improve it).
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Turning prompt off?
On Fri, Jun 30, 2006 at 07:37:36PM -0400, Francisco Reyes wrote: > Alternatively is there are a way to specify multiple volumes or a > range, for deletion? Tried comma separated and dash. You could use a shell script to automate the task. Something like: for n in $(seq 27 42); do echo -e "delete volume=junk-$n\nyes" | bconsole done Just make sure that you've got the range of volumes right first! -- John Kodis. Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] About backup speed in reports
> > I think I remember some thoughts from Kern about implementing this ;). > > Back from the end > > of 2004. > > I don't have any problem implementing better statistics, but it is not on the > top of my personal priority list (nor what users voted on), so I am waiting > for a patch to arrive. I did quick glance into the code and understood that it isn't so trivial. There is no such properties in JCR class as spool_end and despool_begin. With them it looks like new statistics would be quite easy to implement. Mindaugas Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] console
Im trying to install bconsole and gconsole: But im getting an error : make[1]: Entering directory `/root/bacula/src/console' /usr/bin/g++ -c -I. -I.. -g -O2 -Wall conio.c conio.c:66:21: error: termcap.h: No such file or directory conio.c: In function 'void rawmode(FILE*)': conio.c:976: error: 'tgetent' was not declared in this scope conio.c:982: error: 'tgetnum' was not declared in this scope conio.c:986: error: 'tgetstr' was not declared in this scope conio.c: In function 'void ascurs(int, int)': conio.c:1152: error: 'tgoto' was not declared in this scope make[1]: *** [conio.o] Error 1 --- Regard, James Kiiru Swift Global [K] Network Operations Center tel: 229229 Email: [EMAIL PROTECTED] Msn: [EMAIL PROTECTED] Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Automatic recycling vs purged volumes
Jo Rhett writes: > Do you have a "max volumes" statement? This is how we control it. No. So if I had a max volumes that would force Bacula to use those purged volumes? What happens if you run out of purged volumes? > But yes, I agree that Bacula should be smarter about reusing volumes which > are completely purged. I thought maybe I missed a setting somewhere, but the behavior I see doesn't seem consistant with the description about automatic recycling. From that description I think the intent is for those volumes to be reused. Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Turning prompt off?
John Kodis writes: > You could use a shell script to automate the task. Something like: > for n in $(seq 27 42); do > echo -e "delete volume=junk-$n\nyes" | bconsole > done What does "-e" does? That option doesn't exist in FreeBSD. > Just make sure that you've got the range of volumes right first! Didn't know one could call bconsole that way.. I can think of all kind of wonderfull scripts I can write now that I know this. :-) Thanks! Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Turning prompt off?
On Sat, Jul 01, 2006 at 12:02:45PM -0400, Francisco Reyes wrote: > John Kodis writes: > > >You could use a shell script to automate the task. Something like: > > for n in $(seq 27 42); do > >echo -e "delete volume=junk-$n\nyes" | bconsole > > done > > What does "-e" does? > That option doesn't exist in FreeBSD. The -e switch causes echo to interpret backslash escapes, similar to how they're interpreted in C strings. This causes the \n to output a newline, generating two lines of output with one echo statement. If this isn't available, you can replace it with two echo statements in a subshell, like so: ( echo -e "delete volume=junk-$n"; echo yes ) | bconsole > Thanks! Glad to be of assistance. -- John Kodis. Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] It's really killing me waiting on max Storage
Hi,
On 6/30/2006 8:51 AM, Przemysław Staniszewski wrote:
> Arno Lehmann wrote:
>
>>I have tried to help you, but you did not supply any useful informaton.
>>
>>Debug logs from bacula-dir and actual console output, together with
>>configuration samples would be useful. Without these, I don't think
>>anybody can help you any further.
>>
>
> I happens one again (1.38.9). In log's there no information about it.
Today, I tested 1.38.11 and the problem that rescheduled jobs end in
some inconsistent state has disappeared. (Still I get no job report for
them, but that is something I won't investigate now.)
> All it happens it was something like that: when I look after 2 days to
> bconsole and
> run status directory i can see only:
>
> Running Jobs:
> something like _job_name_ is waiting on _client_name_ to connect to
> storage file.
> all jobs scheduled after this one was canceled.
Try 1.38.11 - there are some fixes to the scheduler in there. I don't
understand how they are related to what you observed, but at least here,
the problem has disapperaed.
> (I couldn't paste output from console - maybe next time :( )
> And in my director con'f file there was SD Connect Timeout = 4 minutes.
> So the entry should not bee there ?
> Right? Then I realize if another jobs scheduled in this time to - take
> more then 4 minutes the first one be canceled.
Erm. I never needed to modify the timeout values, so I have no
experiences there. I know the default timeouts are quite long, but that
never bothered me.
> So it's my new config file for director:
>
> Director {# define myself
> Name = backup-dir
> DIRport = 9101# where we listen for UA connections
> QueryFile = "/usr/lib/bacula/query.sql"
> WorkingDirectory = "/var/lib/bacula"
> PidDirectory = "/var/run"
> Maximum Concurrent Jobs = 1
> FD Connect Timeout = 1 minutes
I would comment out this setting, too, and rather use a run before job
script to ensure the clients are up and the FD is running. But that
might be a matter of taste.
> #SD Connect Timeout = 4 minutes
> # jesli beda 2 na ten sam czas to jedno po 4 minutach
> # sie przeterminuje
> Password =
> Messages = Daemon
> }
>
> Schedule {
> Name="KopiaZLanu"
> Run = Incremental mon-thu at 08:30
> Run = Full fri at 08:30
> #Run = Incremental fri at 12:26
> }
>
> Storage {
> Name = File
> Address =
> SDPort = 9103
> Password =
> Device = FileStorage
> Media Type = File
> }
>
> Catalog and Messages of course...
>
> Pool {
> Name = Default
> Pool Type = Backup
> Recycle = yes # Bacula can automatically recycle
> Volumes
> AutoPrune = yes # Prune expired volumes
> Volume Retention = 60 days # one year
> Maximum Volume Bytes = 102949672960
> #Maximum Volume Files = 2 #
> Accept Any Volume = yes # write on any volume in the pool
> # Label Format = "BackupFile-"
> # Use Volume Once = yes
> }
>
> Console..
> Client {
> Name = DanielKaminski
> Address =
> FDPort = 9102
> Catalog = MyCatalog
> Password =
> File Retention = 30 days# 30 days
> Job Retention = 30 days# six months
> AutoPrune = yes # Prune expired Jobs/Files
> }
>
> !!!
>
> Job {
> Name = "xxBackup"
> JobDefs = "JobDefxx"
> Write Bootstrap = "/var/lib/bacula/xx.bsr"
> Client = xx
> FileSet = "FileSetxx"
> Rerun Failed Levels = yes
> Reschedule On Error = yes
> Reschedule Times = 5
> Reschedule Interval = 1 hours
> Max Run Time = 220 minutes
> #Max Wait Time = 2 minutes
> #Max Start Delay = 2 minutes
> }
>
> JobDefs {
> Schedule = "Schedulexx"
> Name = "JobDefxx"
> Type = Backup
> Storage = File
> Messages = Standard
> Pool = Default
> Priority = 10
> Level = Full
> }
>
>
> Job {
> Name = "RestoreFilesxx"
> Type = Restore
> Client = xx
> FileSet="Filexx"
> Storage = File
> Pool = Default
> Messages = Standard
> Where = /tmp/bacula-restores
> #Max Wait Time = 2 minutes
> }
>
> FileSet {
> Name = "FileSetxx"
> Include {
> Options {
> signature = MD5
> }
> File =
> }
> Exclude {
> File =
> }
> }
>
> So, from line with !!! to here, for any client in my lan its only copy
> of that with another Client Name, File Set , Schedule Time and Password.
> I start 2 client and the same time. for example for that Schedule
> "KopiaZLanu" another job is planned.
>
> In logs is only information about successfully complete previous jobs.
>
> Is there any option to get more verbose logs?
Yes, you can run the DIR with debug output, for example like 'bacula-dir
-c /etc/bacula/bacula-dir.conf -d 200 2>&1 >>/tmp/bacula-dir.debuglog'
or similar.
> If you don't understand some part of it please write me, I will try to
> be more clearly.
>
> I will be unhappy to buy some commercial programs to backup 30
> c
Re: [Bacula-users] error warning with changer
> Users tend to forget that in order for Bacula to label a tape, it > must first read the tape to ensure it is not destroying an already > labeled tape. > > If you try to read a perfectly blank tape, lots of ugly things happen. > > Thus you can avoid a lot of pains by *always* writing an EOF > mark at the beginning of a new tape. > Yes, when it's explained that way, it's quite logical. I've must been using some previously written tapes in the past, or I simply have neglected the error messge since I can't recall it. It looks I'm not the only one who's been wondering this lately. Maybe it were possible to add some note about this into the label- command's error handling? It always looks bad when software reports about i/o error. I think that isn't mentioned in the manual either -not at least under "label console command" topic. -- TiN Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] error warning with changer
> handling? It always looks bad when software reports about i/o error. I think > that isn't mentioned in the manual either -not at least under "label console > command" topic. > I'm shamed. It is there in the manual, sorry! -- TiN Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
