Re: [Bacula-users] Bacula catalog database locking
Am Dienstag, 20. November 2007 17:12 schrieb Martin Simmons: On Tue, 20 Nov 2007 14:03:30 +0100, Christian Schneider said: Maybe I am missinterpreting something, but the backup job seems to be paused during tree-build-phase. Should I switch to a different maschine with another bacula dir and mysql db instance to do the restores? Having a separate catalog would work, but you would need to schedule a time to copy from one to the other. I would push the SQL dump after catalog backup to the second maschine. Having faster tapedrives would also bring some idle time and let the backup complete in 2-3 days or maybe faster. :) I there a chance, that this problem went away with an update to the latest 2.2.x version of bacula? A little kick in the right direction would be very appreciated! What indexes does your catalog have? Maybe it is missing one that would make the tree building run faster? I have checked that months ago but let's have a look... The attached indexes.txt contains the actual configuration. Did I miss something? The catalog contains one year of weekly backkups - every single backup contains about 800-1000GB of data and about 10 million files. Have you considered splitting the fileset into several smaller filesets? If you have lots of data that never changes much, then that could be backed up less often. Hmm, not really. There is only one client who is collects the data from our whole network and does every sunday an export to a seperate directory. This directory (containing subdirectories of servergroups) is weekly backed up to tape using bacula. Splitting this directory tree isn't impossible, but it's also not so simple... Also this could give us a performancy gain during spooling the small files over gigabit ethernet... I will think about it. Thanks in advance, Christian mysql show index from Filename; +--++--+--+-+---+-+--++--++-+ | Table| Non_unique | Key_name | Seq_in_index | Column_name | Collation | Cardinality | Sub_part | Packed | Null | Index_type | Comment | +--++--+--+-+---+-+--++--++-+ | Filename | 0 | PRIMARY |1 | FilenameId | A | 6897774 | NULL | NULL | | BTREE | NULL| | Filename | 1 | Name |1 | Name| A | 6897774 | 255 | NULL | | BTREE | NULL| +--++--+--+-+---+-+--++--++-+ 2 rows in set (0.01 sec) mysql show index from Path; +---++--+--+-+---+-+--++--++-+ | Table | Non_unique | Key_name | Seq_in_index | Column_name | Collation | Cardinality | Sub_part | Packed | Null | Index_type | Comment | +---++--+--+-+---+-+--++--++-+ | Path | 0 | PRIMARY |1 | PathId | A | 90115814 | NULL | NULL | | BTREE | NULL| | Path | 1 | Path |1 | Path| A | 90115814 | 255 | NULL | | BTREE | NULL| +---++--+--+-+---+-+--++--++-+ 2 rows in set (0.00 sec) mysql show index from File; +---+++--+-+---+-+--++--++-+ | Table | Non_unique | Key_name | Seq_in_index | Column_name | Collation | Cardinality | Sub_part | Packed | Null | Index_type | Comment | +---+++--+-+---+-+--++--++-+ | File | 0 | PRIMARY|1 | FileId | A | 54933091 | NULL | NULL | | BTREE | NULL| | File | 1 | JobId |1 | JobId | A | 10 | NULL | NULL | | BTREE | NULL| | File | 1 | PathId |1 | PathId | A | 7847584 | NULL | NULL | | BTREE | NULL| | File | 1 | FilenameId |1 | FilenameId | A | 3433318 | NULL | NULL | | BTREE | NULL| | File | 1 | FilenameId |2 | PathId | A | 54933091 | NULL | NULL | | BTREE | NULL| | File | 1 | JobId_2|1 | JobId | A | 10 | NULL | NULL | | BTREE | NULL|
Re: [Bacula-users] Bacula catalog database locking
Am Dienstag, 20. November 2007 15:27 schrieb John Drescher: I need a litte bit help with Baculas catalog database locking mechanisms. Is there anything I can do, to avoid locking the whole catalog db during pruning or restore (tree build)? I have used bacula for 4 years and I have never seen this behavior. However I have never ran a job that took more than a day. My biggest backup was around 2TB which I believe completed in 15 to 17 hours to my LTO2 tape archive which is located on a different server than the director and also the bacula database. Oh wonderfull! For 2TB we would need a half month or someone who's feeding the tapedrives at night. :( During this and any other backup I am completely free to run other jobs (backup, restore, label ...) on my other tape drives as long as the jobs do not use any of the tapes that are used in the current running backup. That sounds really great. There must be a mistake in my setup and I have to find it this weekend... Do you have maximum concurrent jobs set in your bacula-dir.conf? There are several places that this needs to be set depending on what concurrency you need. If you like to have a look, the bacula-dir.conf was attached to my first posting in this thread. I have Maximum Concurrent Jobs = 10 for testing purposes in the JobDefs section. This was 1 months ago, but changed nothing. Another Maximum Concurrent Jobs is in my Director sektion and is set to 3. That may be not enough. Hmmm may... Have to read the docs here :) There is running one client backup with prio 10, one catalog backup with prio 11 and eventually one restore job with prio 10. And of course there's a minimum of one bconsole connection at the same time, when I try to start the restore... Also I know that your version of bacula is has a bug that sometimes causes problems when doing concurrent restores in which some of the files may not be restored. This was fixed in bacula 2.2.3. I know about this bug and think that we aren't affected. We only have one client (+localhost for the catalog backup) which is backed up once a week. During an upgrade to Debian Etch in 2008, I plan to also upgrade bacula to it's latest stable version. Hopefully I get a new colleague next year. Thanks in advance, Christian - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] All the problems with Bacula
--- Robert LeBlanc [EMAIL PROTECTED] wrote: On 11/21/07 7:11 AM, Foo Bar [EMAIL PROTECTED] wrote: all set up (I can't get BAT to compile for example, hopefully the Debian stable package will be updated soon). Debian stable will never get the new version until Lenny is released as stable. I've used the testing and sid packages in Lenny without any problems. Beware that 2.2.5 is stuck in sid until the new version of qt4 fixes dependencies. For stability reasons I cannot run unstable/testing on production servers, and I prefer not to on my own machines. I did download depkgs-qt/qwt-5.0.2, compiled qt4 from source (/usr/local/Trolltech/Qt-4.3.0/) and whatnot but am still getting errors while compiling BAT (undefined reference this and that). I'm clueless on fixing this myself and cannot spend the time to learn. ___ Want ideas for reducing your carbon footprint? Visit Yahoo! For Good http://uk.promotions.yahoo.com/forgood/environment.html - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] All the problems with Bacula
Foo Bar schrieb: all set up (I can't get BAT to compile for example, hopefully the Debian stable package will be updated soon). Debian stable will never get the new version until Lenny is released as stable. I've used the testing and sid packages in Lenny without any problems. Beware that 2.2.5 is stuck in sid until the new version of qt4 fixes dependencies. For stability reasons I cannot run unstable/testing on production servers, and I prefer not to on my own machines. 2.2.5 is available for etch at backports.org and in the PackMan repo. http://packages.debian.org/search?keywords=baculasearchon=namessection=allsuite=etch-backports http://wiki.links2linux.de/en/index.php/PackMan_repo_instructions_for_Debian/Ubuntu_(en)#Debian_4.0_.28etch.29 Ralf - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Problems building tray-monitor and wx-console (2.2.6)
Hi,
i'm trying to compile bacula-2.2.6 on a debian etch machine. Configure
went through without any problems, but make not:
==Entering directory /usr/src/bacula-2.2.6/src/tray-monitor
make[1]: Entering directory `/usr/src/bacula-2.2.6/src/tray-monitor'
Compiling tray-monitor.c
tray-monitor.c:94: error: expected initializer before â*â token
tray-monitor.c: In function âint main(int, char**)â:
tray-monitor.c:320: error: âmTrayIconâ was not declared in this scope
tray-monitor.c:320: error: âgtk_status_icon_new_from_pixbufâ was not
declared in this scope
tray-monitor.c:321: error: âgtk_status_icon_set_tooltipâ was not
declared in this scope
tray-monitor.c: In function âvoid updateStatusIcon(monitoritem*)â:
tray-monitor.c:1126: error: âmTrayIconâ was not declared in this scope
tray-monitor.c:1126: error: âgtk_status_icon_set_from_pixbufâ was not
declared in this scope
make[1]: *** [tray-monitor.o] Error 1
make[1]: Leaving directory `/usr/src/bacula-2.2.6/src/tray-monitor'
== Error in /usr/src/bacula-2.2.6/src/tray-monitor ==
==Entering directory /usr/src/bacula-2.2.6/src/wx-console
make[1]: Entering directory `/usr/src/bacula-2.2.6/src/wx-console'
Compiling main.cpp
wxbutils.h:123: error: expected class-name before â{â token
wxbutils.h:123: warning: âclass wxbPanelâ has virtual functions but
non-virtual destructor
wxbutils.h: In constructor âwxbPanel::wxbPanel(wxWindow*)â:
wxbutils.h:125: error: class âwxbPanelâ does not have any field named
âwxPanelâ
wxbhistorytextctrl.h: At global scope:
wxbhistorytextctrl.h:51: error: expected class-name before â{â token
wxbhistorytextctrl.h:53: error: expected `)' before â*â token
wxbhistorytextctrl.h:69: error: ISO C++ forbids declaration of
âwxStaticTextâ with no type
wxbhistorytextctrl.h:69: error: expected â;â before â*â token
wxbhistorytextctrl.h:71: error: âwxKeyEventâ has not been declared
wxbhistorytextctrl.h:72: error: âwxKeyEventâ has not been declared
wxbhistorytextctrl.h:51: warning: âclass wxbHistoryTextCtrlâ has virtual
functions but non-virtual destructor
wxbmainframe.h:102: error: invalid use of undefined type âstruct wxFrameâ
/usr/include/wx-2.6/wx/utils.h:52: error: forward declaration of âstruct
wxFrameâ
wxbmainframe.h:106: error: expected â,â or â...â before ââ token
wxbmainframe.h:106: error: ISO C++ forbids declaration of âwxSizeâ with
no type
wxbmainframe.h:110: error: âwxCommandEventâ has not been declared
wxbmainframe.h:111: error: âwxCommandEventâ has not been declared
wxbmainframe.h:112: error: âwxCommandEventâ has not been declared
wxbmainframe.h:113: error: âwxCommandEventâ has not been declared
wxbmainframe.h:114: error: âwxCommandEventâ has not been declared
wxbmainframe.h:115: error: âwxCommandEventâ has not been declared
wxbmainframe.h:116: error: âwxCommandEventâ has not been declared
wxbmainframe.h:150: error: expected â,â or â...â before ââ token
wxbmainframe.h:150: error: ISO C++ forbids declaration of âwxSizeâ with
no type
wxbmainframe.h:155: error: ISO C++ forbids declaration of âwxMenuâ with
no type
wxbmainframe.h:155: error: expected â;â before â*â token
wxbmainframe.h:157: error: ISO C++ forbids declaration of âwxNotebookâ
with no type
wxbmainframe.h:157: error: expected â;â before â*â token
wxbmainframe.h:158: error: ISO C++ forbids declaration of âwxTextCtrlâ
with no type
wxbmainframe.h:158: error: expected â;â before â*â token
wxbmainframe.h:159: error: ISO C++ forbids declaration of âwxStaticTextâ
with no type
wxbmainframe.h:159: error: expected â;â before â*â token
wxbmainframe.h:161: error: ISO C++ forbids declaration of âwxButtonâ
with no type
wxbmainframe.h:161: error: expected â;â before â*â token
main.cpp: In function âwxAppConsole* wxCreateApp()â:
main.cpp:81: error: cannot allocate an object of abstract type âMyAppâ
main.cpp:72: note: because the following virtual functions are pure
within âMyAppâ:
/usr/include/wx-2.6/wx/app.h:100: note: virtual int
wxAppConsole::OnRun()
main.cpp: In member function âvirtual bool MyApp::OnInit()â:
main.cpp:104: error: âwxDisplaySizeâ was not declared in this scope
main.cpp:120: error: invalid use of undefined type âstruct wxPointâ
/usr/include/wx-2.6/wx/utils.h:55: error: forward declaration of âstruct
wxPointâ
main.cpp:120: error: âwxSizeâ was not declared in this scope
main.cpp:122: error: âclass wxbMainFrameâ has no member named âShowâ
make[1]: *** [main.o] Error 1
make[1]: Leaving directory `/usr/src/bacula-2.2.6/src/wx-console'
== Error in /usr/src/bacula-2.2.6/src/wx-console ==
Can someone help me?
Kind Regards,
Andreas
-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using Volume xx from 'Scratch' Pool, but no running backup or other need to do that
Ralf Gross schrieb: So, what is this message 'Using Volume 06D140L3 from 'Scratch' pool.' about, if no backup is running or scheduled for the next 10+ days? I updated to 2.2.6 this week, but today it happend again after issuing 'status dir days=4'. You have messages. *mess 22-Nov 13:46 VU0EM005-dir JobId 0: Max configured use duration exceeded. Marking Volume 06D137L3 as Used. 22-Nov 13:46 VU0EM005-dir JobId 0: Using Volume 06D141L3 from 'Scratch' pool. No backup was running but volume 06D141L3 was moved from the Scratch pool to the Differential pool. The next diff backup will be on sunday. Furthermore, why didn't bacula recycle volumes 06D125L3 or 06D126L3? The volume retention time is set to 31 days. Pool: Differential +-++---+-++--+--+-+--+---+---+-+ | mediaid | volumename | volstatus | enabled | volbytes | volfiles | volretention | recycle | slot | inchanger | mediatype | lastwritten | +-++---+-++--+--+-+--+---+---+-+ | 6 | 06D125L3 | Used | 1 | 9,816,468,480 | 11 | 2,678,400 | 1 |6 | 1 | LTO3 | 2007-10-14 00:25:18 | | 7 | 06D126L3 | Used | 1 | 18,565,585,920 | 20 | 2,678,400 | 1 |7 | 1 | LTO3 | 2007-10-21 00:33:04 | | 8 | 06D127L3 | Used | 1 | 29,770,094,592 | 31 | 2,678,400 | 1 |8 | 1 | LTO3 | 2007-10-28 00:46:41 | | 19 | 06D137L3 | Used | 1 | 74,883,142,656 | 76 | 2,678,400 | 1 | 18 | 1 | LTO3 | 2007-11-18 01:10:57 | | 37 | 06D124L3 | Used | 1 | 10,923,623,424 | 12 | 2,678,400 | 1 |5 | 1 | LTO3 | 2007-11-11 00:31:07 | | 49 | 06D141L3 | Append| 1 | 64,512 |0 | 2,678,400 | 1 | 22 | 1 | LTO3 | | +-++---+-++--+--+-+--+---+---+-+ This is the detailed info about the oldest volume in the pool. Why didn't bacula just prune/recycle volume 06D125L3 instead of taking an volume from the scratch pool? AutoPrune is set to yes. *llist media=06D125L3 mediaid: 6 volumename: 06D125L3 slot: 6 poolid: 5 mediatype: LTO3 firstwritten: 2007-10-14 00:07:06 lastwritten: 2007-10-14 00:25:18 labeldate: 2007-10-14 00:07:06 voljobs: 3 volfiles: 11 volblocks: 152,164 volmounts: 6 volbytes: 9,816,468,480 volerrors: 0 volwrites: 1,480,258 volcapacitybytes: 0 volstatus: Used enabled: 1 recycle: 1 volretention: 2,678,400 voluseduration: 345,600 maxvoljobs: 0 maxvolfiles: 0 maxvolbytes: 0 inchanger: 1 endfile: 10 endblock: 13,870 volparts: 0 labeltype: 0 storageid: 2 deviceid: 0 locationid: 0 recyclecount: 0 initialwrite: scratchpoolid: 0 recyclepoolid: 0 comment: The last entry in the log file about volume 06D125L3 was 18-Okt 18:05 VU0EM005-dir: Max configured use duration exceeded. Marking Volume 06D125L3 as Used. After that: nothing. No message like that (other volume as example) about pruned records or recycling. 07-Okt 11:03 VU0EM005-dir: ua_purge.c:611 All records pruned from Volume 06D132L3; marking it Purged 07-Okt 11:03 VU0EM005-dir: Recycled volume 06D136L3 This makes a scratch pool completely useless. Questions: * why did bacula not prune the records from volume 06D125L3 and recyle it as needed? * why does bacula 'use' a new volume days before the next backup happens? Ralf - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] MaxVolBytes 1?
Foo Bar [EMAIL PROTECTED] wrote:
Foo Bar [EMAIL PROTECTED] wrote:
[..]
I will of course label at least one new volume, but out of curiosity,
when,
if ever, will the single volume I have now be recycled and reused? Was
it
blocked because of the 1 byte limit I set yesterday and should it work
during the backup tonight? (or after 16 hours, whichever comes first)
I meant to say 8 hours here. Found in the documentation that it will keep
trying for at most a day, at which point I presume it will be cancelled
and other jobs behind it will continue, so some of my questions will be
answered tomorrow.
The job warned again after 16 hours, so it didn't cancel itself. I found
how to update the volume from Error to Append again ('update volume') and
when I manually canceled the job the volume was recycled and written to
again.
Now I had a new problem, due to the 1 GiB limit I set, the job blocked
again during the backup. Instead of canceling it, I removed the limit in
the config file, did a reload and update, which didn't do much so this time
I stopped and restarted the bacula-director process. Now, using 'status
dir' the job listing doesn't show any running jobs (all scheduled/waiting
jobs are gone), but using 'status client' the job seems to be still running
(showing the filename where it stopped due to the volume byte limit).
When trying to use 'cancel' it says there are no jobs running. How do I fix
this?
Still remaining questions:
- why does the job output say 2 files were deleted from the catalog
when
there were many thousands of files (in dozens of jobs) in the volume
(and catalog) already?
- how do I make sure such an error does not block any other backups
without resorting to parallel backups and/or autolabeling?
___
Yahoo! Answers - Got a question? Someone out there knows the answer. Try it
now.
http://uk.answers.yahoo.com/
-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] old (deleted) clients still appear in the list clients on bconsole
Hello, 22.11.2007 14:55,, Vladimirs Vecgailis wrote:: Hi all, following question: i installed bacula for testing-purposes and now i want to use it in production. And of course i want to delete the test-client-entries, test-pools, stored data etc. If you prefer that... So i commented the appropriate lines in my configuration-files out, and then deleted with the bconsole test-volumes and test-pools. And although i commented out the client-definitions in my conf-files - i still see them if i enter list clients. Thats my problem - old clients, that are not even defined - still appear in the list clients-listing. Is it a bug? No. The actual data is held in the catalog. Once thee is no more data related to these clients in the catalog - i.e., all jobs are purged - you can use dbcheck to delete orphaned Client records. Of course, you can manually delete the relevant catalog entries, using the delete command. Just be sure you know what you do... Arno Greeting Mit freundlichen Grüßen Vladimirs Vecgailis -- == Vladimirs Vecgailis Second Level IT primacall Vertriebs-GmbH Postfach 08 04 55 10004 Berlin Leipziger Str. 124 10117 Berlin GERMANY Phone +49 30 206143 875 eMail [EMAIL PROTECTED] Web http://www.primacall.de == Amtsgericht und Sitz: Berlin, HRB 98348 B Steuernummer: 37-199-20919 Geschäftsführer: M. Vukusic Die in dieser E-Mail enthaltenen Informationen sind vertraulich und können rechtlich bedeutsam sein. Sie sind ausschließlich für den Adressaten bestimmt und jeglicher Zugriff durch andere Personen ist unzulässig. Falls Sie nicht der beabsichtigte Empfänger sind, ist jegliche Veröffentlichung, Verteilung oder sonstige in diesem Zusammenhang stehende Handlung untersagt und unter Umständen rechtswidrig. Herkömmliche E-Mails sind zudem nicht gegen Zugriff geschützt und können mit und ohne Einfluss von Dritten verloren gehen, verändert oder verfälscht werden. Eine Haftung für die Unversehrtheit von E-Mails oder hieraus entstandene Schäden kann daher nicht übernommen werden. The information in this e-mail is confidential and may be legally privileged. It is intended solely for the addressee and access to the e-mail by anyone else is prohibited. If you are not the intended recipient, any disclosure, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. Common e-mails are not protected against access by third persons and therefore might be lost, changed or falsified, with or without any interference by third persons. We cannot accept any responsibility for the integrity of e-mails or for any damages resulting out of these circumstances. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Arno Lehmann IT-Service Lehmann www.its-lehmann.de - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Multiple rows when upgradring från 2.0.3
Hello, I upgraded from 2.0.3 (I think) to 2.2.6. And after that I got multiple rows when bacula list JobIds needed for restore. Any ideas why? ++---+---++-++ | JobId | Level | JobFiles | JobBytes | StartTime | | VolumeName | ++---+---++-++ | 17,879 | F | 2,459,735 | 83,970,916,158 | 2007-11-10 09:56:58 | | storagenode01-2months-0026 | | 17,879 | F | 2,459,735 | 83,970,916,158 | 2007-11-10 09:56:58 | | storagenode01-2months-0027 | | 17,879 | F | 2,459,735 | 83,970,916,158 | 2007-11-10 09:56:58 | | storagenode01-2months-0028 | | 17,879 | F | 2,459,735 | 83,970,916,158 | 2007-11-10 09:56:58 | | storagenode01-2months-0029 | | 17,879 | F | 2,459,735 | 83,970,916,158 | 2007-11-10 09:56:58 | | storagenode01-2months-0030 | | 17,879 | F | 2,459,735 | 83,970,916,158 | 2007-11-10 09:56:58 | | storagenode01-2months-0031 | | 17,879 | F | 2,459,735 | 83,970,916,158 | 2007-11-10 09:56:58 | | storagenode01-2months-0032 | | 17,879 | F | 2,459,735 | 83,970,916,158 | 2007-11-10 09:56:58 | | storagenode01-2months-0033 | | 17,904 | I |13,642 |733,091,264 | 2007-11-11 00:05:23 | | storagenode01-2months-0035 | | 17,968 | I |10,057 | 2,960,736,103 | 2007-11-12 00:05:25 | | storagenode01-2months-0035 | | 18,031 | I | 153,498 | 7,915,411,433 | 2007-11-13 00:05:24 | | storagenode01-2months-0035 | | 18,031 | I | 153,498 | 7,915,411,433 | 2007-11-13 00:05:24 | | storagenode01-2months-0036 | | 18,094 | I |55,453 | 2,043,107,578 | 2007-11-14 00:05:23 | | storagenode01-2months-0036 | | 18,161 | I |23,953 | 2,006,296,594 | 2007-11-15 00:05:24 | | storagenode01-2months-0036 | | 18,222 | I |11,399 | 1,874,365,549 | 2007-11-16 00:05:23 | | storagenode01-2months-0036 | | 18,222 | I |11,399 | 1,874,365,549 | 2007-11-16 00:05:23 | | storagenode01-2months-0037 | | 18,345 | I |16,230 | 3,437,278,574 | 2007-11-18 00:05:24 | | storagenode01-2months-0038 | | 18,408 | I |10,658 | 1,735,423,489 | 2007-11-19 00:05:24 | | storagenode01-2months-0038 | | 18,472 | I |27,487 | 1,927,003,335 | 2007-11-20 00:05:23 | | storagenode01-2months-0038 | | 18,535 | I |43,237 | 3,028,158,732 | 2007-11-21 00:05:24 | | storagenode01-2months-0038 | | 18,535 | I |43,237 | 3,028,158,732 | 2007-11-21 00:05:24 | | storagenode01-2months-0039 | | 18,598 | I |71,540 | 3,070,965,622 | 2007-11-22 00:05:24 | | storagenode01-2months-0039 | ++---+---++-++ You have selected the following JobIds: 17879,17904,17968,18031,18094,18161,18222,18345,18408,18472,18535,18598 /Jonas - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] MaxVolBytes 1?
Solved the issue of the ghost-job by running dbcheck (which fixed thousands of orphaned files/paths, probably from previous tests), then stopping/restarting the involved storage and file daemons. This list is really helpful ;) (well, I only read about 200 pages of the manual so far and saw dbcheck mentioned) Foo Bar [EMAIL PROTECTED] wrote: I stopped and restarted the bacula-director process. Now, using 'status dir' the job listing doesn't show any running jobs (all scheduled/waiting jobs are gone), but using 'status client' the job seems to be still running (showing the filename where it stopped due to the volume byte limit). When trying to use 'cancel' it says there are no jobs running. How do I fix this? ___ Want ideas for reducing your carbon footprint? Visit Yahoo! For Good http://uk.promotions.yahoo.com/forgood/environment.html - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] old (deleted) clients still appear in the list clients on bconsole
On Thu, 22 Nov 2007 15:19:09 +0100 Arno Lehmann [EMAIL PROTECTED] wrote: Hello, 22.11.2007 14:55,, Vladimirs Vecgailis wrote:: Hi all, following question: i installed bacula for testing-purposes and now i want to use it in production. And of course i want to delete the test-client-entries, test-pools, stored data etc. If you prefer that... So i commented the appropriate lines in my configuration-files out, and then deleted with the bconsole test-volumes and test-pools. And although i commented out the client-definitions in my conf-files - i still see them if i enter list clients. Thats my problem - old clients, that are not even defined - still appear in the list clients-listing. Is it a bug? No. The actual data is held in the catalog. Once thee is no more data related to these clients in the catalog - i.e., all jobs are purged - you can use dbcheck to delete orphaned Client records. yep, that's it what i needed. worked fine. Thanks. Mit freundlichen Grüßen Vladimirs Vecgailis -- == Vladimirs Vecgailis Second Level IT primacall Vertriebs-GmbH Postfach 08 04 55 10004 Berlin Leipziger Str. 124 10117 Berlin GERMANY Phone +49 30 206143 875 eMail [EMAIL PROTECTED] Web http://www.primacall.de == Amtsgericht und Sitz: Berlin, HRB 98348 B Steuernummer: 37-199-20919 Geschäftsführer: M. Vukusic Die in dieser E-Mail enthaltenen Informationen sind vertraulich und können rechtlich bedeutsam sein. Sie sind ausschließlich für den Adressaten bestimmt und jeglicher Zugriff durch andere Personen ist unzulässig. Falls Sie nicht der beabsichtigte Empfänger sind, ist jegliche Veröffentlichung, Verteilung oder sonstige in diesem Zusammenhang stehende Handlung untersagt und unter Umständen rechtswidrig. Herkömmliche E-Mails sind zudem nicht gegen Zugriff geschützt und können mit und ohne Einfluss von Dritten verloren gehen, verändert oder verfälscht werden. Eine Haftung für die Unversehrtheit von E-Mails oder hieraus entstandene Schäden kann daher nicht übernommen werden. The information in this e-mail is confidential and may be legally privileged. It is intended solely for the addressee and access to the e-mail by anyone else is prohibited. If you are not the intended recipient, any disclosure, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. Common e-mails are not protected against access by third persons and therefore might be lost, changed or falsified, with or without any interference by third persons. We cannot accept any responsibility for the integrity of e-mails or for any damages resulting out of these circumstances. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] 2.2.6 Client OS/X / Darwin Packages?
On Wed, 21 Nov 2007 13:53:43 -0500, Brian A Seklecki (Mobile) wrote: Anyone feel free to share? Also, how are you building? Native DarwinCode building environment? i am working on a port for macports, http://www.macports.org/ i thought that i would better test thoroughly before contributing. on the other side, if there is a lot of interest in an up to date macports bacula package, i could put it up in my priority. anyhow, if you are in to packaging i would be glad to mail you the portfile. anyone else interested ? regards, markus - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] pruning/recycling: file-, job- and volume retention clarification
Hi,
I may have misunderstood recycling or the different retention periods. So I
need some clarification.
At the moment I'm looking for the reason why a volume in my Differential pool
wasn't recycled and a volume from the Scratch pool was used.
What I want:
* daily incr. backups to the Incremantal pool
* volume can be wiped after 14 days - volume retention 14 days
* weekly diff. backups to the Differential pool
* volume can be wiped after 31 days - volume retention 31 days
* monthly full backups to the Full pool
* volume can be wiped after 180 days - volume retention 180 days
I've set the following for the client:
File Retention = 90 days
Job Retention = 6 months
And the different volume retention periods above.
The short question is: what prevents volume 06D125L (more details below) from
being recycled?
Does File or Job retention periods which are larger than the Volume retention
period prevent recycling?
My understanding of the different retention periods an recycling is:
* the shortest retention period defines if a volume can be recycled
- example: a volume in the Differential pool can be recycled and reused if
its state is Used and the first written date is older than 31 days (volume
retention period of that pool). It doesn't matter if 'File Retention' or
'Job Retention' is set to more than 31 days.
Some parts of the manual, which makes me think I'm right:
http://www.bacula.org/rel-manual/Configuring_Director.html#SECTION001413
| File records may actually be retained for a shorter period than you specify
| on this directive if you specify either a shorter Job Retention or a
| shorter Volume Retention period. The shortest retention period of the three
| takes precedence.
http://www.bacula.org/rel-manual/Automatic_Volume_Recycling.html
# If the request is for an Autochanger device, look only for Volumes in the
Autochanger (i.e. with InChanger set and that have the correct Storage device).
# Search the Pool for a Volume with VolStatus=Append (if there is more than
one, the Volume with the oldest date last written is chosen. If two have the
same date then the one with the lowest MediaId is chosen).
# Search the Pool for a Volume with VolStatus=Recycle and the InChanger flag is
set true (if there is more than one, the Volume with the oldest date last
written is chosen. If two have the same date then the one with the lowest
MediaId is chosen).
# Try recycling any purged Volumes.
# Prune volumes applying Volume retention period (Volumes with VolStatus
Full,
Used, or Append are pruned). Note, even if all the File and Job records are
pruned from a Volume, the Volume will not be marked Purged until the Volume
retention period expires.
Now there is volume 06D125L3, which I think sould be recycled.
Pool: Differential
+-++---+-++--+--+-+--+---+---+-+
| mediaid | volumename | volstatus | enabled | volbytes | volfiles |
volretention | recycle | slot | inchanger | mediatype | lastwritten |
+-++---+-++--+--+-+--+---+---+-+
| 6 | 06D125L3 | Used | 1 | 9,816,468,480 | 11 |
2,678,400 | 1 |6 | 1 | LTO3 | 2007-10-14 00:25:18 |
There is a job record (BackupCatalog) on that volume that is a Full backup the
other two are differential backups.
Enter Volume name: 06D125L3
+---+---+-+--+---+---+---++
| jobid | name | starttime | type | level | files | bytes
| status |
+---+---+-+--+---+---+---++
| 743 | SMTCZB0003| 2007-10-14 00:07:06 | B| D | 7,241 |
1,195,019,960 | T |
| 744 | VU0EM003 | 2007-10-14 00:13:38 | B| D | 6,467 |
7,716,783,290 | T |
| 745 | BackupCatalog | 2007-10-14 00:25:03 | B| F | 1 |
894,160,054 | T |
+---+---+-+--+---+---+---++
Instead of recycling this volume a fresh volume from the Scratch pool was used.
Here are some config details.
client config:
Client {
Name = VU0EM003
Address = 10.60.1.252
FDPort = 9102
Catalog = MyCatalog
Password = wiped
File Retention = 90 days# 30 days
Job Retention = 6 months# six months
AutoPrune = yes # Prune expired Jobs/Files
}
pool config:
Pool {
Name = Full
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Recycle Oldest Volume = yes
Volume Use Duration = 96 hours
Volume Retention = 180 days
}
#
# differential pool
#
Pool {
Name = Differential
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Recycle Oldest Volume
[Bacula-users] Restoring encrypted backups with a master key
Hi, currently, I'm struggling with Baculas encryption scheme. I have set up a client to back up data encrypted. This works; I see Encryption: yes in the job report, the volume contains encrypted blocks, and the clear text files I back up for testing are not recognizable in the volume files. Restoring to the same client works, too. Restoring to a different client, using the master key file I produced, doesn't work, though. The error message is No private decryption keys have been defined ... snip nice and detailed description :-) My question is - has anyone experience with this sort of setup, and can point me to where I missed something in TFM? ... And now I noticed this mail didn't get sent when it should have been. Another round of testing brought the following results: - You need to set PKI Encryption (and probably PKI Signature) to yes on the FD where you try to restore. This needs to get added to the manual, IMO. - The file was restored successfully, but: 22-Nov 22:59 Host-fd: RestoreFiles.2007-11-22_22.59.48 Error: ../../findlib/attribs.c:458 Unable to set file times /tmp/bacula-restores/daten/encrypted_now: ERR=Das System kann den angegebenen Pfad nicht finden. The last bit means The system can't find that path. Probably the translation to windows conventions, i.e. add drive letter and swap / with \ is missing here. Anyway, the file contents was restored correctly, the file date wasn't. And, by the way, the target FD is 2.1.22, so it might be fixed already... it's running on Vista here. The rest of this setup is 2.2.6, installed from rpm. So take this not as a question, but rather as confirmation that encryption, decryption with the master key, and FD on Vista works :-) Arno -- Arno Lehmann IT-Service Lehmann www.its-lehmann.de - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] pruning/recycling: file-, job- and volume retention clarification
Hi, 22.11.2007 19:02,, Ralf Gross wrote:: Hi, I may have misunderstood recycling or the different retention periods. So I need some clarification. At the moment I'm looking for the reason why a volume in my Differential pool wasn't recycled and a volume from the Scratch pool was used. What I want: * daily incr. backups to the Incremantal pool * volume can be wiped after 14 days - volume retention 14 days * weekly diff. backups to the Differential pool * volume can be wiped after 31 days - volume retention 31 days * monthly full backups to the Full pool * volume can be wiped after 180 days - volume retention 180 days I've set the following for the client: File Retention = 90 days Job Retention = 6 months And the different volume retention periods above. Ok. Looks familiar :-) The short question is: what prevents volume 06D125L (more details below) from being recycled? Does File or Job retention periods which are larger than the Volume retention period prevent recycling? No, they don't. Or at least they shouldn't. My understanding of the different retention periods an recycling is: * the shortest retention period defines if a volume can be recycled - example: a volume in the Differential pool can be recycled and reused if its state is Used and the first written date is older than 31 days (volume retention period of that pool). It doesn't matter if 'File Retention' or 'Job Retention' is set to more than 31 days. I may be wrong, but I think LastWritten is what counts for recycling. Anyway, File or JobRetention really don't matter. Some parts of the manual, which makes me think I'm right: http://www.bacula.org/rel-manual/Configuring_Director.html#SECTION001413 | File records may actually be retained for a shorter period than you specify | on this directive if you specify either a shorter Job Retention or a | shorter Volume Retention period. The shortest retention period of the three | takes precedence. Yup... although, reading this quote, I think File Retention is not the point here. http://www.bacula.org/rel-manual/Automatic_Volume_Recycling.html # If the request is for an Autochanger device, look only for Volumes in the Autochanger (i.e. with InChanger set and that have the correct Storage device). # Search the Pool for a Volume with VolStatus=Append (if there is more than one, the Volume with the oldest date last written is chosen. If two have the same date then the one with the lowest MediaId is chosen). # Search the Pool for a Volume with VolStatus=Recycle and the InChanger flag is set true (if there is more than one, the Volume with the oldest date last written is chosen. If two have the same date then the one with the lowest MediaId is chosen). # Try recycling any purged Volumes. # Prune volumes applying Volume retention period (Volumes with VolStatus Full, Used, or Append are pruned). Note, even if all the File and Job records are pruned from a Volume, the Volume will not be marked Purged until the Volume retention period expires. Now there is volume 06D125L3, which I think sould be recycled. Pool: Differential +-++---+-++--+--+-+--+---+---+-+ | mediaid | volumename | volstatus | enabled | volbytes | volfiles | volretention | recycle | slot | inchanger | mediatype | lastwritten | +-++---+-++--+--+-+--+---+---+-+ | 6 | 06D125L3 | Used | 1 | 9,816,468,480 | 11 | 2,678,400 | 1 |6 | 1 | LTO3 | 2007-10-14 00:25:18 | Volume retention 31 days, LastWritten on Oct 14... yup, looks like this one qualifies. It's also Used, Enabled, and Recycling is allowed. There is a job record (BackupCatalog) on that volume that is a Full backup the other two are differential backups. They shouldn't matter, because Volume retention is over anyway. Enter Volume name: 06D125L3 +---+---+-+--+---+---+---++ | jobid | name | starttime | type | level | files | bytes | status | +---+---+-+--+---+---+---++ | 743 | SMTCZB0003| 2007-10-14 00:07:06 | B| D | 7,241 | 1,195,019,960 | T | | 744 | VU0EM003 | 2007-10-14 00:13:38 | B| D | 6,467 | 7,716,783,290 | T | | 745 | BackupCatalog | 2007-10-14 00:25:03 | B| F | 1 | 894,160,054 | T | +---+---+-+--+---+---+---++ Instead of recycling this volume a fresh volume from the Scratch pool was used. I haven't done
Re: [Bacula-users] pruning/recycling: file-, job- and volume retention clarification
On 22 Nov 2007 at 23:54, Arno Lehmann wrote: What I really think we need is a) a better documentation of the current recycling algorithm. It's really too complicated... If someone tells me what needs to be altered, I'll write it. Of course, patches accepted. b) ways to configure the recycling behavior, so you can prefer to re-use volume over using scratch volumes, and vice versa. i.e. step a given item so it is not under consideration. I don't know the code, but it may be simple. -- Dan Langille PGCon - The PostgreSQL Conference: http://www.pgcon.org/ - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
