Re: [Bacula-users] LTO via USB
Dear Adam, In message you wrote: > > This might be considered slightly off topic but has anybody tried > installing USB3 PCIe card in an external LTO tape drive? > > Many models appear to have 2 slots with only one occupied by SAS by > default, e.g: > https://www.bechtle.com/de-en/shop/quantum-lto-7-hh-sas-external-drive--4038311--p Did you ever take a look at a LTO drive and inside an external case? Those cases may appear to have "slots", but I have never seen a case where an external case / drive actually used a PCIe card or such: the SAS interface is builtin to the drive itself, and there is usually only a cable adapter to match to the external connectors of the case. There are no PCIe or any other slots there, and there is no processor to drive any such cards. > The idea would be for the tape drive to operate via SAS 99% of the time > but occasionally move it elsewhere and easily access via USB (from any > desktop or laptop). > > Somebody has done it before on a factory level: > https://www.fujifilm.com/in/en/business/data-management/datastorage/lto-tape-drive/brochure > but I would prefer not to be limited and locked to this one particular > model + software. Apparently this is indeed a custom solution adding a USB3 interface - probably as some kind of adapter between the drive (and I bet that the drive itself has only a native SAS interface), similar to the adapters you find in many HDD enclosures converting SATA to USB. And this is certainly not a PCIe card either. > I'm assuming that I should still be able to run Bacula with the above? I would think so, too. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr. 5, 82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "There are three principal ways to lose money: wine, women, and en- gineers. While the first two are more pleasant, the third is by far the more certain." -- Baron Rothschild, ca. 1800 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Change expiration date of a single volume
Dear Martin, In message <202207151613.26fgde4e007...@higson.cam.lispworks.com> you wrote: > > > The only difference between these that I can see is that the disk > > volumes have recycle=1 set, while the tape volumes have recycle=0 . > > > > Does this make the difference? > > Yes, that is the purpose of the recycle field. > > See the doc for Recycle = in the Pool directive: Hm, yes, but this is an attribute of the whole pool. And I do not want to have this for the whole pool, just for a single tape. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr. 5, 82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de All I ask is a chance to prove that money can't make me happy. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Change expiration date of a single volume
Dear Phil, In message <85992ad9-f6e9-de5e-d434-b2efc9fbb...@caerllewys.net> you wrote: > > What, if any, 'Recycle ...' directives do you have in your Pool definitions? > > Please post your Pool definitions. Is this what you want to see? *show pool=ARCH Pool: name=ARCH PoolType=Backup use_cat=1 use_once=0 cat_files=1 max_vols=0 auto_prune=1 VolRetention=12 years 3 days VolUse=0 secs recycle=0 LabelFormat=*None* CleaningPrefix=*None* LabelType=0 RecyleOldest=0 PurgeOldest=0 ActionOnPurge=0 MaxVolJobs=0 MaxVolFiles=0 MaxVolBytes=0 MaxPoolBytes=0 MigTime=0 secs MigHiBytes=0 MigLoBytes=0 CacheRetention=0 secs JobRetention=0 secs FileRetention=0 secs Please let me know what else you might want to see. Thanks! Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr. 5, 82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "Ahead warp factor 1" - Captain Kirk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Change expiration date of a single volume
Dear Bill, In message <3a4154cc-8c44-6d18-17b5-c5a91450e...@protonmail.com> you wrote: > > > > I would like to reuse a specific volume before it's expiration date. > > What I do so far is that I purge the volume, then use btape to > > rewrite the label and this remove the data. ... > Simply by purging the volume, all Job and File records related to > it are pruned from the catalog database with no concern for > retention periods, and the volume will become eligible for Bacula > to re-use it. There is no need to do all the extra steps you have > done. This was my expectation, too, but apparently this is not the case. As long as the tape has not expired, it will not be reused by Bacula. When I change the status from "purged" to "append", Bacula will happyly use the tape - and append to the end of the existing data. > Matter of fact, in normal situations, once Bacula labels a volume, > there is never a time when you need to manually erase and relable > it. Probably meddling with the expiration period is not considered to be a normal situation ;-) > If Bacula is not using this volume straight away, it may just be > that other volumes are available in your environment. No. The situation came up when a backup job was hanging waiting for appendable data, and I didn'd have physical access to swap tapes. So I decided to overwrite the oldest volume in the library - but simply purging it did *not* work. > Can you tell us more about this volume, the pool it is in, other > eligible volumes, and the Job? There was nothing special about this volume or job; all tapes in this library were the same media, same pool, and all other paramters same, too. Note that I am talking about volumes on tape here! I can see that this works fine for disk volumes used for backing up the catalog. The only difference between these that I can see is that the disk volumes have recycle=1 set, while the tape volumes have recycle=0 . Does this make the difference? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr. 5, 82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de GUIs are virtually useless. Learn tools. They're configurable, scriptable, automatable, cron-able, interoperable, etc. We don't need no brain-dead winslurping monolithic claptrap. -- Tom Christiansen in 371140df@csnews ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Change expiration date of a single volume
Hi, I would like to reuse a specific volume before it's expiration date. What I do so far is that I purge the volume, then use btape to rewrite the label and this remove the data. This is IMHO more complicated than it should be, especially as I have to use different tools for a single task. I'm looking for a way to do this all just from the bconsole, for example. But "update volume" does not alow to change the expiration date - or am I missing something? [This is with Bacula 11.0.6 under Fedora 36.] Thanks in advance. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr. 5, 82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Software entities are more complex for their size than perhaps any other human construct because no two parts are alike. If they are, we make the two similar parts into a subroutine -- open or closed. In this respect, software systems differ profoundly from computers, buildings, or automobiles, where repeated elements abound. - Fred Brooks, Jr. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Query failed: ERROR: relation "filename" does not exist
Dear Gary, In message <47e756d8-782b-12a6-8f1d-e210eb90b...@mcleod-schmidt.id.au> you wrote: > On 14/12/2021 21:59, Uwe Schuerkamp wrote: > > Hi folks, > > > > I think it's a problem with the query file. Something changed in 11.x > > that broke the standard queries I've been using since 5.x or > > thereabouts. Maybe you can check the mailing list archives for earlier > > posts w/r to that issue, I seem to recall someone posted a patch. I can confirm that the query.sql file is the culprit. > The query.sql file got deprecated, and subsequently nulled (I think) a > while ago. > > What is in the current source archive? That's canon, as opposed to > anything else. The problem is that the version of /usr/share/doc/bacula-director/sample-query.sql as sipped with the current Fedora packages still uses the old syntax. The difference is mostly using "Filename.Name" in the old code, while "File.FileName" is needed now. To fix, I copied the bacula/examples/sample-query.sql file from the top-of-tree in the git repository, and this works fine. Thanks for all who replied! Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Make it right before you make it faster. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Query failed: ERROR: relation "filename" does not exist
Dear Larry, In message you wrote: > > > Are you using the most recent version of bconsole? The most recent one that is available for Fedora 34, i. e. bacula-director-11.0.5-1.fc34.x86_64 > > *restore ... I can do restores similar to this fine. The problem comes with the "query" command, For example: *query Available queries: 1: List up to 20 places where a File is saved regardless of the directory 2: List where the most recent copies of a file are saved 3: List last 20 Full Backups for a Client 4: List all backups for a Client after a specified time 5: List all backups for a Client 6: List Volume Attributes for a selected Volume 7: List Volumes used by selected JobId 8: List Volumes to Restore All Files 9: List Pool Attributes for a selected Pool 10: List total files/bytes by Job 11: List total files/bytes by Volume 12: List Files for a selected JobId 13: List Jobs stored on a selected MediaId 14: List Jobs stored for a given Volume name 15: List Volumes Bacula thinks are in changer 16: List Volumes likely to need replacement from age or errors 17: List Volumes Bacula thinks are eligible for the changer 18: List Volumes by Volume: 19: List Volumes by Jobs: 20: List Volumes for a jobname: Choose a query (1-20): 2 Enter path with trailing slash: /ssd/mail/ Enter filename: inbox Enter Client name: gemini-fd Query failed: ERROR: relation "filename" does not exist LINE 1: ...ame,Client.Name AS ClientName FROM Job,File,Path,Filename,M... ^ SELECT DISTINCT Job.JobId,StartTime AS JobStartTime,VolumeName,Client.Name AS ClientName FROM Job,File,Path,Filename,Media,JobMedia,Client WHERE File.JobId=Job.JobId AND File.FileIndex > 0 AND Path.Path='/ssd/mail/' AND Filename.Name='inbox' AND Client.Name='gemini-fd' AND Path.PathId=File.PathId AND Filename.FilenameId=File.FilenameId AND JobMedia.JobId=Job.JobId AND JobMedia.MediaId=Media.MediaId AND Client.ClientId=Job.ClientId ORDER BY Job.StartTime DESC LIMIT 5; I start to wonder if this is a problem with my database, or rather a problem with /etc/bacula/query.sql ? I copied the one from /usr/share/doc/bacula-director/sample-query.sql unchanged ... Or this: ... Choose a query (1-20): 12 Enter JobId: 92777 Query failed: ERROR: relation "filename" does not exist LINE 1: SELECT Path.Path,Filename.Name FROM File,Filename,Path WHERE... ^ SELECT Path.Path,Filename.Name FROM File,Filename,Path WHERE File.JobId=92777 AND File.FileIndex > 0 AND Filename.FilenameId=File.FilenameId AND Path.PathId=File.PathId ORDER BY Path.Path,Filename.Name; Is this working for you? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de You see things; and you say ``Why?'' But I dream things that never were; and I say ``Why not?'' - George Bernard Shaw _Back to Methuselah_ (1921) pt. 1, act 1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Query failed: ERROR: relation "filename" does not exist
Dear Larry, In message <0f11700a6a58d852a04b058fabe46...@lerctr.org> you wrote: > > > > In message <6f0199d2227115785c7bcb94e3250...@lerctr.org> you wrote: > >> > >> > I thought I had succesfully run all DB upgrades during that time, > >> > but apparently something is missing: > > ... > > > >> Did you run the bacula database upgrade?? > > > > I was sure I did, but maybe I missed one. Do you have a hint, which > > one? And, of this was an older one, how to fix it? ... > there should be a update_bacula_tables script (and it's associated > DB-Specific SQL files) > in the share/ directory from the package. Yes, I know that. And I _think_ I always ran these scripts (usually because bacula-dir would complain). But what I see is this: # /usr/libexec/bacula/update_bacula_tables Altering postgresql tables This script will update a Bacula PostgreSQL database from any from version 12-16 or 1014-1021 to version 1022 which is needed to convert from any Bacula Enterprise version 4.0.x, 6.x.y, 8.x.y, 10.x.y to version 12.4.x The existing database is version 1022 !! This script can only update an existing version 12-16, 1014-1021 database to version 1022. Error. Cannot update this database. So the database version _is_ correct, and it seems something went wrong with the update. And it must be a systematic problem, as I see this in two independent installations. As far as I can reproduce from old system logs, the problem _might_ have happened during the upgrade from Bacula 9.6.6-1 (FC32) to Bacula 11.0.2-3 (FC33). I have kept the log: # su - postgres -s /bin/bash $ sh /usr/libexec/bacula/update_bacula_tables Altering postgresql tables This script will update a Bacula PostgreSQL database from any from version 12-16 or 1014-1021 to version 1022 which is needed to convert from any Bacula Enterprise version 4.0.x, 6.x.y, 8.x.y, 10.x.y to version 12.4.x Dumping File table to /data/pgsql/file1017.data. The process may fail if the current user doesn't have write permission on the current directory, or if the system doesn't have enough space to store a compressed export of the File table BEGIN DROP TABLE DROP TABLE CREATE TABLE COMMIT Loading the File table from /data/pgsql/file.748011.data... COMMIT Creation of indexes and PK on the File table... SET BEGIN CREATE SEQUENCE ALTER SEQUENCE setval 8269427750 (1 row) ALTER TABLE ANALYZE ALTER TABLE ALTER TABLE ALTER TABLE UPDATE 2 COMMIT Upgrade of the File table succeeded. Version 1017 BEGIN CREATE TABLE CREATE INDEX UPDATE 2 COMMIT Update of Bacula PostgreSQL tables 1017 to 1018 succeeded. UPDATE 2 Update of Bacula PostgreSQL tables 1018 to 1019 succeeded. BEGIN ALTER TABLE ALTER TABLE ALTER TABLE UPDATE 2 COMMIT Update of Bacula PostgreSQL tables 1019 to 1020 succeeded. BEGIN UPDATE 2 COMMIT Update of Bacula PostgreSQL tables 1020 to 1021 succeeded. BEGIN CREATE TABLE CREATE TABLE CREATE TABLE CREATE TABLE CREATE TABLE CREATE INDEX CREATE INDEX CREATE INDEX CREATE INDEX CREATE TABLE CREATE INDEX UPDATE 2 COMMIT Update of Bacula PostgreSQL tables 1021 to 1022 succeeded. As you can see, there were no error messages. The big question is: what can I do to fix the problem? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Speculation is always more interesting than facts. - Terry Pratchett, _Making_Money_ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Query failed: ERROR: relation "filename" does not exist
Dear Larry, In message <6f0199d2227115785c7bcb94e3250...@lerctr.org> you wrote: > > > I thought I had succesfully run all DB upgrades during that time, > > but apparently something is missing: ... > Did you run the bacula database upgrade?? I was sure I did, but maybe I missed one. Do you have a hint, which one? And, of this was an older one, how to fix it? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "Engineering without management is art." - Jeff Johnson ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Query failed: ERROR: relation "filename" does not exist
Hello, I'm running on a fedora host using latest Fedora packages: bacula is version 11.0.5-1.fc34.x86_64; DB is postgresql-13.4-1.fc34.x86_64 The system has been installed _many_ years ago. I thought I had succesfully run all DB upgrades during that time, but apparently something is missing: When trying to run query # 2 "List where the most recent copies of a file are saved", I get the following error message: ... Choose a query (1-17): 2 Enter path with trailing slash: XX Enter filename: YY Enter Client name: ZZ Query failed: ERROR: relation "filename" does not exist LINE 1: ...ame,Client.Name AS ClientName FROM Job,File,Path,Filename,M... ^ SELECT DISTINCT Job.JobId,StartTime AS JobStartTime,VolumeName,Client.Name AS ClientName FROM Job,File,Path,Filename,Media,JobMedia,Client WHERE File.JobId=Job.JobId AND Path.Path='XX' AND Filename.Name='YY' AND Client.Name='ZZ' AND Path.PathId=File.PathId AND Filename.FilenameId=File.FilenameId AND JobMedia.JobId=Job.JobId AND JobMedia.MediaId=Media.MediaId AND Client.ClientId=Job.ClientId ORDER BY Job.StartTime DESC LIMIT 20; Does this ring a bell to somebody? Any ideas how to fix that? Thanks in advance. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de There is is no reason for any individual to have a computer in their home. -- Ken Olsen (President of Digital Equipment Corporation), Convention of the World Future Society, in Boston, 1977 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Hanging w. Dir inserting Attributes
Dear Erik, In message <20210723103511.31a55...@erik-pc.epolan.dk> you wrote: > On status dir I get: > 1868 Back Incr 17,4442.317 G BackupUlla-pc Dir inserting > Attributes ... > What is wrong? What can I do about it? Attribute insertion is basically database activity. Check if your DB is running and make sure it is tuned for your system configuration. If you are not already using PostgreSQL, you may consider migrating to it. Hope this helps. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "Plan to throw one away. You will anyway." - Fred Brooks, "The Mythical Man Month" ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to convert the catalogue to Bacula 11.0.2 mode.
Dear "Erik P. Olsen", In message <20210430134346.15320...@erik-pc.epolan.dk> you wrote: > > > > [erik@Erik-PC bacula]$ /usr/libexec/bacula/update_mysql_tables > > > > You should run this script as user "postgres". > > Even when I'm using mysql? Ah, no, of course not. Sorry, I didn't pay attention. In this case the user should probably be "mysql", but I can't test this as none of my Bacula systems uses MySQL any more [I converted to PostreSQL many years ago, as it was _significantly_ faster.] Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Steal five dollars and you were a petty thief. Steal thousands of dollars and you are either a government or a hero. - Terry Pratchett, _Going_Postal_ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to convert the catalogue to Bacula 11.0.2 mode.
Dear Erik, In message <20210430120348.3d15c...@erik-pc.epolan.dk> you wrote: > > OK, so I went ahead to update bacula from 9.6.5 to 11.0.2 and now my bacula > installation > is broken as I feared. I guess my situation is unnormal. The director wont > start and if I > run the catalogue update script I get: ... > [erik@Erik-PC bacula]$ /usr/libexec/bacula/update_mysql_tables You should run this script as user "postgres". See my message from yesterday for details. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Here is an Appalachian version of management's answer to those who are concerned with the fate of the project: "Don't worry about the mule. Just load the wagon." - Mike Dennison's hillbilly uncle ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to convert the catalogue to Bacula 11.0.2 mode.
Dear Kern, In message you wrote: > > Normally, it is automatic if you upgrade from a package. In Fedora, this never worked for me, last time just a few days ago when upgrading from 9.6.7-1.fc33.x86_64 to 11.0.2-3.fc33.x86_64 > If you do the > upgrade manually, you must run the "update_bacula_tables" script that is > in the new version. It is normally found in the /src/cats > directory. In Fedora, it gets installed as /usr/libexec/bacula/update_bacula_tables Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de There are bugs and then there are bugs. And then there are bugs. - Karl Lehenbauer ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to convert the catalogue to Bacula 11.0.2 mode.
Dear "Erik P. Olsen", In message <20210428151738.2ad7f...@erik-pc.epolan.dk> you wrote: > Hello, > > I am planning to upgrade to Bacula 11.0.2 but reading about how to convert > the catalogue > makes me a bit uneasy. The statement is: "Normally, it is automatic". What > does it mean > that it is automatic? Does it actually run the script by itself first time > Bacula 11.02 > is started? Just did the upgrade in Fedora 33; it was not automatic here. After running the usual "dnf upgrade", the director could no longer connect to the PostgreSQL DB. To migrate the DB, run as user "postgres" (!): $ /usr/libexec/bacula/update_bacula_tables Altering postgresql tables This script will update a Bacula PostgreSQL database from any from version 12-16 or 1014-1021 to version 1022 which is needed to convert from any Bacula Enterprise version 4.0.x, 6.x.y, 8.x.y, 10.x.y to version 12.4.x Dumping File table to /data/pgsql/file1017.data. The process may fail if the current user doesn't have write permission on the current directory, or if the system doesn't have enough space to store a compressed export of the File table BEGIN DROP TABLE DROP TABLE CREATE TABLE COMMIT Loading the File table from /data/pgsql/file.748011.data... COMMIT Creation of indexes and PK on the File table... SET BEGIN CREATE SEQUENCE ALTER SEQUENCE setval 8269427750 (1 row) ALTER TABLE ANALYZE ALTER TABLE ALTER TABLE ALTER TABLE UPDATE 2 COMMIT Upgrade of the File table succeeded. Version 1017 BEGIN CREATE TABLE CREATE INDEX UPDATE 2 COMMIT Update of Bacula PostgreSQL tables 1017 to 1018 succeeded. UPDATE 2 Update of Bacula PostgreSQL tables 1018 to 1019 succeeded. BEGIN ALTER TABLE ALTER TABLE ALTER TABLE UPDATE 2 COMMIT Update of Bacula PostgreSQL tables 1019 to 1020 succeeded. BEGIN UPDATE 2 COMMIT Update of Bacula PostgreSQL tables 1020 to 1021 succeeded. BEGIN CREATE TABLE CREATE TABLE CREATE TABLE CREATE TABLE CREATE TABLE CREATE INDEX CREATE INDEX CREATE INDEX CREATE INDEX CREATE TABLE CREATE INDEX UPDATE 2 COMMIT Update of Bacula PostgreSQL tables 1021 to 1022 succeeded. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de What we think, or what we know, or what we believe, is in the end, of little consequence. The only thing of consequence is what we do. - John Ruskin ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Spooling vs buffering
Dear Adam, In message <20190207185030.35830...@teln.shikadi.net> you wrote: > > It may also help in this case, but so would buffering instead of > spooling. I was under the impression that in the case of slow clients, > Bacula is designed to read from many clients at the same time, so that > it can get the throughput required for the tape without spooling. You can backups from several clients in parallel, and this will create a higher total data rate, but it has also disadvantages: there is still no guarantee that there is a continuous flow of sufficient data at all times, and that data for each client are scattered all over the tape, which will significantly decrease efficientcy for a restore. It is much better to spool all the date for a client, and then write it to tape as a single chunk. Note that this is something you have to configure - there is no automatism. > This is true, but the drawback of the spool file is that you need > enough disk space to hold a full tape's worth of data for it to > perform optimally. If the spool file is not an exact multiple of the > tape size, performance will drop. This is wrong. It does not hurt if if the tape stops a few times, after writing a sufficiently big chunk of data. You just don't want to have it shoe-shining because the incoming data stream is too slow. > > This is not necessary. Or only one possible special case. > > It's not necessary, but if you do not do this, performance will suffer > and your tape will shoe shine. No, it will not. Shoe-shining happens when you cannot supply data fast enough while writing. There is absolutely no problem when the tape stops a few times between writing independent backups. > I am only referring to getting data from the spool file onto tape. > Let's say you have a 100GB spool file and you are writing to an 800GB > tape. The process will go like this: > > * Read 100GB from client, tape is idle > * Write 100GB to tape, pause tape > * Read next 100GB from client while tape is paused > * Start up tape again and write next 100GB > > Thus even if your clients can keep up with the tape 100% of the time, > you will still introduce extra shoe shining if your spool file is not > exactly one tape in size. Shoe-shining is something else. Assume youe example, and a LTO8 tape with compression, all working under optimal conditions. Then you can write 900 MB/s to the drive, i. e. writing the 100 GB spool file will take 111 seconds. That means, the tape will write continuously for nearly two minutes, then stop, then continue. This repeats seven times per tape. This is not a problem, and it is not what is called show-shining. Also, disk space is cheap - where is the problem of using a much bigger spool area? I use only LTO4 tapes so far, and I have a 1.5 TB spool area. Where is the problem? Also please note that you are kind of contradicting yourself - if you were uysing ram for buffering data, would you not still have to reserve at least a tape size of memory? Would you be willing to reserve 12 TB of RAM or this? Sorry, to me this makes no sense. > (If your spool file is larger than one tape, then you will fill up one > tape in one continuous operation which is perfect, but then the second > tape will pause once the end of the spool file has been reached which > is not ideal either.) Apparently you have a real angst for a tape stop. Don't! It is a perfectly normal thing to have. > So you can see that using a spool file is typically worse for a tape > drive, as it will almost always introduce additional stop/start cycles > (shoe shining) which would not be there otherwise, unless you have a > very slow client. single stop/start cycles != shoe shining > With my own experience writing data to tape using mbuffer and tar, a > buffer of 4GB was enough to prevent all shoe shining, and it did not > slow down the process at all. However with Bacula, my spool file must > be 800GB to achieve the same result, and even this makes the process > take much longer because the tape is idle while the spool file is > filling up the first time. Normally you have several jobs running in parallel, and while some jobs are writing their data to the spool area, other are writing the spooled data to tape. Don't consider the special case of running a single client. > I don't have 800GB available for the spool file either, which means my > choices are: OK, if this is your problem, then ask yourself how much it would cost to add sufficient storage. Come on, be real! Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de I believe you find life such a problem because
Re: [Bacula-users] Spooling vs buffering (was: Autochanger Configuration Help)
Dear Adam, In message <20190207113145.144af...@teln.shikadi.net> you wrote: > > Spooling can reduce overall throughput because the data is > > sequentially written to disk and then read back. > > This is what got me. I thought it was a buffer to ride out variations > in disk read speed (like the mbuffer program) but it's not. The > purpose is to get data off clients as fast as possible for later > writing to slow tape. I have a different understanding of the function. there is no need to read "data off clients as fast as possible" - if your clients are fast, they have no problems to provide the data at lower rates, too. It's the other way round; if your clients are slow so they cannot feed the data fast enough to keep the tape streaming. This often happens when you run for example incremental backups over a big data set (say, millions of files) with only little changes. In this case the client gets the time it needs to traverse the fole directory tree, and when done, you have all date to be backed up collected in the spool area which is then fast enough to kepp the tape happily streaming. > Consequently spooling works best when the spool file is large enough to > contain one whole tape's worth of data, and you have enough clients > backing up that there is always a complete spool file ready to write > out to tape. This is not necessary. Or only one possible special case. > Anything less than this and spooling will slow things down. This is not correct, if you consider incremental and differential backups. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de If programming was easy, they wouldn't need something as complicated as a human being to do it, now would they? - L. Wall & R. L. Schwartz, _Programming Perl_ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] modifying established jobs
Dear Phil, In message you wrote: > > > You can change the schedules, but don't forget that you have to run > > "reload" in the console so the director reads your new > > configuration. otherwise it would take only effect after restarting > > the director. > > And you should regard 'reload' as a temporary measure and restart the > Director when opportunity permits. What is the rationale for this recommendation? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Man is the best computer we can put aboard a spacecraft ... and the only one that can be mass produced with unskilled labor. - Wernher von Braun ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] modifying established jobs
Dear Sean, In message <2018102610.gw75...@telus.net> you wrote: > > Changes that I want to make aren't very dramatic. Some of the machines > that I assigned a default schedule to won't be up when that job runs. > I want to give them another schedule; during working hours. They each > have their own job. Can I just change the schedule in the job I made, or > do I need to create another, new, job? You can change the schedules, but don't forget that you have to run "reload" in the console so the director reads your new configuration. otherwise it would take only effect after restarting the director. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de I read part of it all the way through. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Relabel tapes without loosing data
Dear Christoph,
In message <1be9171a-8dd0-48f3-aad5-d4ff9a8b7...@uni-koblenz.de> you wrote:
>
> I think I know the answer ("not possible") but maybe someone has an idea:
Right - you cannot (re-) write any data at the start of the tape
without loing all data after it.
> Some years ago I labeled all my LTO-6 tapes with manual printed
> stickers "LTO6-###". As you can see, there are 5 alphanumeric
> characters followed by 3 digits. The barcode standard allows this
> and my LTO devices never had problems with that kind of labels.
> My new tape library (Overland Neo Series T48) does. Sometimes it
> recognises the labels, sometimes not. I think this is because
> LTO-labels should have max. 3 characters followed by max 3 digits
> followed by the LTO series number (LTO###L6).
> I would have no problem in printing new labels, but the tapes have
> to be physically relabelled. Is it possible without loosing the
> tape data? (no).
No, this cannot be done. At best, you can relabel the tapes when
you re-use them, i. e. when you rewrite all of the content anyway.
> Any other ideas how to switch my old tapes to the new label scheme?
Well... who really needs the barcode labels to be exactly the same as
the on-tape and in-database labels? I think this is just for your
own convenience, so you can match the "mtx status" output and bacula
messages against the physical label on the tapes.
But then - in your old labels, the "LTO" part is redundant at least,
and you don't really need it to identify a tape if it's the same on
all tapes. If I were you, I would just print new bracode labels,
and omit the "LT" part. i. e., instead of "LTO6-###" you get
"O6-###L6". Then you can still easily match the "real" label to the
barcode stickers, and don't have to change anything software-wise.
And the "O6-" prefeix could even be explained as "old LTO6 label"
format :-)
[Of course, you should not attempt to use this with a "label ...
barcodes" command and result in the old tape names; but I guess for
new tapes you would switch to a new label scheme anyway.]]
Hope this helps.
Viele Grüße,
Wolfgang Denk
--
DENX Software Engineering GmbH, Managing Director: Wolfgang Denk
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
The ultimate barrier is one's viewpoint.
- Terry Pratchett, _The Dark Side of the Sun_
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape Library Drivers Order Suggestion Device Paths Serial Script
Dear Heitor, I wrote: > Sorry, this doesn't work for me (under Fedora 27): > > Autochanger=0 > Changer Device = /dev/tape/by-id/scsi-1TANDBERGStorageLoader_AA49LA012794 > > Autochanger=1 > Changer Device = 13:43 > > Drive-0 Archive Device = -> > sginfo: invalid option -- '>' Maybe I should add: # ls -la /dev/tape/by-id/* | grep /nst lrwxrwxrwx 1 root root 10 Mar 31 21:41 /dev/tape/by-id/scsi-1TANDBERGTS800_800080800107-nst -> ../../nst2 lrwxrwxrwx 1 root root 10 Apr 1 13:43 /dev/tape/by-id/scsi-3500110a0014d7c1e-nst -> ../../nst1 lrwxrwxrwx 1 root root 10 Mar 31 21:41 /dev/tape/by-id/scsi-3500143802960afce-nst -> ../../nst0 Your first problem is the sed 's/ /,/g' part which will split "Apr 1" in 3 friends due to the 2 space. You probably rather want to use sed 's/ \+/,/g' . But then, the cut -d ',' -f 10,12 gives "->" - I think this should be "-f 11" instead of "-f 10" in both instances. And even with these two changes, you get Drive-1 tapeQUANTUM ULTRIUM 4U61T /dev/st1 /dev/sg7 Archive Device = ../../nst1 sginfo(open): Device or resource busy file=../../nst1, or no corresponding sg device found Is sg driver loaded? for all the tape drives. Either you edit the device names as needed so they canbe found (../../nst1 should be /dev/nst1 instead), or you simply "cd" into the /dev/tape/by-id/ directory in your script before doing anything else. The latter is easier to implement, while the former would result in better readable file names. But all these changes will not fix the problem that devices currently used (for example by a running bacula), will not be accessable, so you get above "Device or resource busy" error... Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de He who hesitates is not only lost, but miles from the next exit. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape Library Drivers Order Suggestion Device Paths Serial Script
Dear Heitor, In message you wrote: > > I was always intrigued by the fact there is no easy way of > determining Linux Tape-Library drives order, as displayed by mtx > status command (Ref: > https://sourceforge.net/p/mtx/mailman/message/6018053/), that says > the only way to really make sure about the drives order is to > insert tapes into each drive. > Also, I've been observing that the output of the ls -la > /dev/tape/by-id/* lately has been very accurate about the > tape-library driver's order matching the alphabetical and TL > physical order. > Because of that, I wrote this script > (https://pastebin.com/857Msd8b) that prints the order and Bacula > configuration directives suggestion for a single installed TL. Sorry, this doesn't work for me (under Fedora 27): Autochanger=0 Changer Device = /dev/tape/by-id/scsi-1TANDBERGStorageLoader_AA49LA012794 Autochanger=1 Changer Device = 13:43 Drive-0 Archive Device = -> sginfo: invalid option -- '>' Error: sginfo: Unknown option Usage: sginfo [-options] [device] [replacement_values] Allowed options are: -6Do 6 byte mode sense and select commands (def: 10 bytes). -aDisplay inquiry info, serial # and all mode pages. -ASimilar to '-a' but displays all subpages as well. ... -RReplace parameters - best used with -X (expert use only) [replacement parameters placed after device on command line] sginfo version: 2.35 [20140403]; See man page for more details. Drive-1 tapeQUANTUM ULTRIUM 4U61T /dev/st1 /dev/sg7 Archive Device = /dev/tape/by-id/scsi-3500110a0014d7c1e-nst sginfo(open): Device or resource busy file=/dev/tape/by-id/scsi-3500110a0014d7c1e-nst, or no corresponding sg device found Is sg driver loaded? Drive-2 Archive Device = -> sginfo: invalid option -- '>' Error: sginfo: Unknown option Usage: sginfo [-options] [device] [replacement_values] Allowed options are: -6Do 6 byte mode sense and select commands (def: 10 bytes). -aDisplay inquiry info, serial # and all mode pages. -ASimilar to '-a' but displays all subpages as well. ... -RReplace parameters - best used with -X (expert use only) [replacement parameters placed after device on command line] sginfo version: 2.35 [20140403]; See man page for more details. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Every time history repeats itself the price goes up. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Having to restart Storage Daemon after unmount/mount
Dear Jim, In message you wrote: > > 1. From bconsole issue an unmount command > 2. Using your tape library, execute a magazine unlock > 3. Using your tape library Remove old tapes, add new tapes > 4. Using your tape library Replace magazine, issue an inventory > 5. From bconsole issue a mount command > 6. Next issue a label barcodes command > 7. Finally verify slots are updated by issuing a status slots command Did you try running an "update slots barcodes" command after step 4 ? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Great teachers have small audiences while they are still alive. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO Cartridge Memory Specification?
Dear Rudolf, I wrote: > OK, so "TAF" means Tape Alert Flag - makes sense. > > Do you also happen to know what these numbers mean? As mentioned, I > have a few tapes which show "3, 4, 6", and one which shows "3, 4, 6, 20". Once I can search for "Tape Alert Flag", I can also find these error codes, for example here [1]. Problem solved, thanks again! [1] https://www-304.ibm.com/support/knowledgecenter/STCMML8/com.ibm.storage.ts3500.doc/opg_3584_xtault.html -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO Cartridge Memory Specification?
Dear Rudolf, In message <20151022092859.ga85...@fit.vutbr.cz> you wrote: > > > My LTO library can read and display this data; most of it is > > self-esplaining, except for a data field "TAF" which probably > > contains error or wear information - for most tapes this is empty, > > but for a few (old, long used) ones I see entries like "3, 4, 6" or > > "3, 4, 6, 20". I would like to understand what these mean? > > > > Can anybody shed any light on this? Thanks in advance. > > I think that it is a number of Tape Alert Flags raised during > tape lifetime. Thanks a lot. OK, so "TAF" means Tape Alert Flag - makes sense. Do you also happen to know what these numbers mean? As mentioned, I have a few tapes which show "3, 4, 6", and one which shows "3, 4, 6, 20". I guess these numbers have some meaning? Of course I can just act on a base "any entrey means tape is bad", but I would feel better if I were able to understand what went wrong. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de God made machine language; all the rest is the work of man. -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] LTO Cartridge Memory Specification?
Hello, I apologize for posting a somewhat Off Topic question, but all attempts to find this information elsewehere failed so far... Is anybody aware of a publicly available document descibing the contents of the LTO Cartridge Memory? My LTO library can read and display this data; most of it is self-esplaining, except for a data field "TAF" which probably contains error or wear information - for most tapes this is empty, but for a few (old, long used) ones I see entries like "3, 4, 6" or "3, 4, 6, 20". I would like to understand what these mean? Can anybody shed any light on this? Thanks in advance. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "Where shall I begin, please your Majesty?" he asked. "Begin at the beginning," the King said, gravely, "and go on till you come to the end: then stop."- Alice's Adventures in Wonderland, Lewis Carroll -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula.org web site non-functional?
Dear Luc Van der Veken, In message you wrote: > > The Blog and Recent Topics sections at the top remain the same everywhere and > take up so much space that I have to page down to see the actual content, > which *is* there. Ah, indeed. Same for me. Well, this is a really unusable web design. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "Pardon me for breathing, which I never do anyway so I don't know why I bother to say it, oh God, I'm so depressed. Here's another of those self-satisfied doors. Life! Don't talk to me about life." - Marvin the Paranoid Android -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula.org web site non-functional?
Dear Kern, In message <53d20c8f.8030...@sibbald.com> you wrote: > > www.bacula.org is perfectly functional. > > What OS and browser are you using. > > Systems known to work, Windows IE, Mac Safari, Linux Firefox, Windows > Chrome, ... This is Linux on x86_64, Fedora 20 with all current updates installed; browser is Firefox 30.0 (firefox-30.0-4.fc20.x86_64). I have the same issue on 3 (more or less identically configured)( systems. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Our management frequently gets lost in thought. That's because it's unfamiliar territory. -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] handling of mixed media types
Hello, I have a tape library with both LTO-3 and LTO-4 tape drives. The individual tape drives and all tapes have been assigned proper media types, "LTO-3" or "LTO-4", respectively. Which media type would I assign to the autoloader resource? I understand I can provide only one type, not a list of types? How can I acchieve that LTO-3 tapes can be loaded in either LTO-3 or LTO-4 drives, while a LTO-4 tape will only be loaded into LTO-4 drives, and never in a LTO-3 drive? Any help welcome... [Yes, I've searched the mailing list and the wiki and (to the extend possible while the web site is non-functional) the manual, but with no working solution yet.] Thanks in advance. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Things are not as simple as they seem at first.- Edward Thorp -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula.org web site non-functional?
Hi, is it only for me that the bacula.org web site is non-functional? I get always only an entry page, and no matter which link I click, the content will not change - exception: the links in the "Downloads" menu still work. Especially, it is impossible to get access to the documentation... Or am I missing something? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Our business is run on trust. We trust you will pay in advance. -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Auto-select for different media types?
Hello, is there a way to configure bacula that it will select the best currently available media type for a job? I have a tape library with both LTO-3 and LTO-4 drives. Assume I add both LTO-3 and LTO-4 tapes to the same pool. I would like to configure bacula such that it will make optimal use of the available tape drives, i. e. it should run jobs referring to this specific pool both on the LTO-3 drive(s) [using LTO-3 media] and on the LTO-4 drive(s) [using LTO-4 media]. Can this be done? Would it be even possible to use the LTO-4 drive with LTO-3 media in the case there are no more LTO-4 media available for the needed pool? Thanks in advance. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de The flow chart is a most thoroughly oversold piece of program docu- mentation. -- Frederick Brooks, "The Mythical Man Month" -- "Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE Instantly run your Selenium tests across 300+ browser/OS combos. Get unparalleled scalability from the best Selenium testing platform available Simple to use. Nothing to install. Get started now for free." http://p.sf.net/sfu/SauceLabs ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] When does bacula use multiple tape drives
Dear Randall,
In message
you wrote:
>
> I am trying to configure a dual drive tape library. My challenge is that
> bacula seems to only use one drive. What determines in bacula when it is
> optimal to use two drives? I am using bacula Version: 5.2.13.
I'm running 5.2.13 under Fedora 20; this is working fine for me.
> Additionally I have set "Maximum Concurrent Jobs = 4" in all the relevant
> places, but all this seems to do is allow multiple concurrent jobs run,
> which I have tested and seems to work, but strangely, I was under the
> impression that one job could write to one tape exclusively. But in this
> case, it seems multiple jobs can write to the same tape concurrently or is
> this not correct? Lastly I have specified spool directory, however it is
> never used. Any ideas here would be appreciated or clarity.
Make sure to set "Maximum Concurrent Jobs" in the storage definition,
too!
> Autochanger {
> Name = Qualstar
> Device = Drive-1
> Device = Drive-2
> Changer Command = "/opt/bacula/etc/mtx-changer %c %o %S %a %d"
> Changer Device = /dev/changer-sg2
> }
Looks OK to me.
> Device {
> Name = Drive-1 #
> Drive Index = 0
> Media Type = LTO6
> Archive Device = /dev/nst1
> AutomaticMount = yes; # when device opened, read it
> AlwaysOpen = yes;
> RemovableMedia = yes;
> RandomAccess = no;
> AutoChanger = yes
> Maximum Spool Size = 100G
> Maximum Block Size = 1032192
> Maximum Network Buffer Size = 65536
> Spool Directory = /var/spool/bacula
...
> }
Try adding
Changer Device = /dev/changer-sg2
to both your Device definitions.
In your bacula-dir.conf, you should have something like this:
# Definition of LTO autoloader
Storage {
Name = LTOLIB
Address = ...
SDPort= 9103
Password = ...
Device= Qualstar
Media Type= LTO6
Autochanger = yes
Maximum Concurrent Jobs = 6
}
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
Beware of the Turing Tar-pit in which everything is possible but
nothing of interest is easy.
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] When does bacula use multiple tape drives
Dear John, In message you wrote: > > > bacula seems to only use one drive. What determines in bacula when it is > > optimal to use two drives? I am using bacula Version: 5.2.13. Additionally > > I have set "Maximum Concurrent Jobs = 4" in all the relevant places, but all > > this seems to do is allow multiple concurrent jobs run, which I have tested > > and seems to work, but strangely, I was under the impression that one job > > could write to one tape exclusively. But in this case, it seems multiple > > jobs can write to the same tape concurrently or is this not correct? Lastly > > I have specified spool directory, however it is never used. Any ideas here > > would be appreciated or clarity. > > Bacula can write to more than 1 drive at a time. However I believe by > default bacula can not load the same pool into more than 1 drive at a > time. Yes, it can. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Two wrongs don't make a right, but three rights make a left. -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fatal error: askdir.c:340 NULL Volume name. This shouldn't happen!!!
Dear Kern Sibbald, In message <5301db23.6010...@sibbald.com> you wrote: > > Were you careful to change the actual volume retention period in > the catalog entry for the volume? That requires a manual step after > changing the conf file. You can check two ways: Yes, I was. "list volumes" shows the new retention period for all volumes. > 1. Look at the full output from all the jobs and see if any > volumes were recycled while the batch of jobs ran. Not in this run, and not in any of the last 15 or so before that. > 2. Do a llist on all the volumes that were used during the > period the problem happened and see if they were freshly > recycled and that the retention period is set to your new > value. retention period is as expected, no recycling happened. > In any case, I will look over your previous emails to see if I see > anything that could point to a problem, and I will look at the bug > report, but without a test case, this is one of those "nightmare" > bugs that take huge resources and time to fix. Hm... I wonder why the DIR allocates for two simultaneous running jobs two pairs of (DRIVE, VOLUME), but not using the volume currently mounted in the respective drive, but in the other one. I would expect, that when a job starts, that either a volume or a drive is selected first: - if the drive is selected first, and it has a tape loaded which is in the right pool, and in status append, then there should be no need to ask for any other tape. - if the volume is allocated first, and it is already loaded in a suitable drive, then that drive should be used, ant not the other one. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "Security is mostly a superstition. It does not exist in nature... Life is either a daring adventure or nothing." - Helen Keller -- Managing the Performance of Cloud-Based Applications Take advantage of what the Cloud has to offer - Avoid Common Pitfalls. Read the Whitepaper. http://pubads.g.doubleclick.net/gampad/clk?id=121054471&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fatal error: askdir.c:340 NULL Volume name. This shouldn't happen!!!
Dear Kern, In message <20140216153143.2d773380...@gemini.denx.de> I wrote: > > > I did find and fix was related to a user setting an expiration time of > > exactly 1 > > or n days, which means at some point when he started a whole batch of > > new backup jobs, a volume that was being used was recycled creating > > the race condition. The solution is perhaps my patch, but it is much easier > > to set the expiration time to be slightly less than a multiple of a day > > (e.g. 23 hours) > > then no volumes should expire while a lot of jobs are starting. > > In my case I had "VolumeRetention = 18d" for all volumes in this pool; > I have changed this now to 455h (= 18d + 23h). Let's see what > happens. > > Thanks for the hint; I will report results in a while (either when it > happens again nevertheless, or in a few weeks when it is sure that > this helped). We didn't have to wait long. The error happened again last night, now with VolumeRetention set to 1,638,000 seconds = 455h = 18d + 23h. Seems this is another problem. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de I believe you find life such a problem because you think there are the good people and the bad people. You're wrong, of course. There are, always and only, the bad people, but some of them are on oppo- site sides. - Terry Pratchett, _Guards! Guards!_ -- Android apps run on BlackBerry 10 Introducing the new BlackBerry 10.2.1 Runtime for Android apps. Now with support for Jelly Bean, Bluetooth, Mapview and more. Get your Android app in front of a whole new audience. Start now. http://pubads.g.doubleclick.net/gampad/clk?id=124407151&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fatal error: askdir.c:340 NULL Volume name. This shouldn't happen!!!
Dear Kern, In message <52fe44c5.8080...@sibbald.com> you wrote: > > If you were not aware, one developer left Bacula. He had previously > be the most active on bugs and responsible for putting patches into > the community version. As you probably also heard as a result of his > departure, I froze the git repository, and development has been continuing > at a very nice pace to the point that we should have a major new > release in late March or April. However, in between time there is no > developer > "devoted" to answering the bugs database, and I haven't found one yet. It > probably would not have helped much while the git repo was frozen anyway. I have to admit that the status of the community version is not exactly inspiring confidence. But thisis another topic... > I am hoping that a number of the existing bugs have been resolved during > the freeze, but have not had the time to look in detail. The particular > case in point > askdir.c:340 from Patti's comments seems to be related to a very complicated > race condition that I have been "chasing" for months and recently found what I see this problem happening quite often. On average it happens about twice per week, with about 30 jobs running per day. I think it is worth noting that it is always exactly 2 jobs out of that batch which fail, when are all started at the same time with the same priority. But I cannot see anything special with these two configurations compared to the rest. > I did find and fix was related to a user setting an expiration time of > exactly 1 > or n days, which means at some point when he started a whole batch of > new backup jobs, a volume that was being used was recycled creating > the race condition. The solution is perhaps my patch, but it is much easier > to set the expiration time to be slightly less than a multiple of a day (e.g. > 23 hours) > then no volumes should expire while a lot of jobs are starting. In my case I had "VolumeRetention = 18d" for all volumes in this pool; I have changed this now to 455h (= 18d + 23h). Let's see what happens. Thanks for the hint; I will report results in a while (either when it happens again nevertheless, or in a few weeks when it is sure that this helped). Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de A failure will not appear until a unit has passed final inspection. -- Android apps run on BlackBerry 10 Introducing the new BlackBerry 10.2.1 Runtime for Android apps. Now with support for Jelly Bean, Bluetooth, Mapview and more. Get your Android app in front of a whole new audience. Start now. http://pubads.g.doubleclick.net/gampad/clk?id=124407151&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fatal error: askdir.c:340 NULL Volume name. This shouldn't happen!!!
In message <2014021328.76b4f380...@gemini.denx.de> I wrote: > > > ... Signing up to make a bug > > report is also broken and has been mentioned on this list. No message is > > sent that allows for verification and setting up an account. > > Confirmed, too. I even mailed Kern about this, but received no > response either. > > Is there still anybody listening to bug reports in the free version of > Bacula, or is this totally unsupported by now? OK, Kern appears to have fixed the registration bug. I have now registered to the bug database and files a bug report: http://bugs.bacula.org/view.php?id=2027 Let's hope this will be fixed soon. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Imagination is more important than knowledge. -- Albert Einstein -- Android apps run on BlackBerry 10 Introducing the new BlackBerry 10.2.1 Runtime for Android apps. Now with support for Jelly Bean, Bluetooth, Mapview and more. Get your Android app in front of a whole new audience. Start now. http://pubads.g.doubleclick.net/gampad/clk?id=124407151&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fatal error: askdir.c:340 NULL Volume name. This shouldn't happen!!!
Dear Patricia, In message you wrote: > > I posted a similar notice 10/31/2013. Beyond the no responses, there is > no bug report which means no fix is pending. ... Thanks for the confirmation. It's somewhat reassuring to know others see this phenomenon, too. > ... Signing up to make a bug > report is also broken and has been mentioned on this list. No message is > sent that allows for verification and setting up an account. Confirmed, too. I even mailed Kern about this, but received no response either. Is there still anybody listening to bug reports in the free version of Bacula, or is this totally unsupported by now? Kern? > I can suggest a work-around that reduces the incidence of tape stealing by > the storage director from one job for another - set their job schedules > with an offset. I have used a 15 minute offset for jobs that had started > at the same time. I still have the "NULL Volume name" happening, but with > less frequency. I just look for it and rerun the affected jobs. My Yes, re-running is what I do so far, too, but it's a pain in the neck when the whole thing is supposed to run basically unmaintained. > current biggest issue is that the storage daemon doesn't see the job > failure and release the tape resource unless I restart the bacula > processes. There appears to be a bug report and a fix pending release for > that issue. Hm... Haven't seen this here yet. Thanks! Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Life is a game. Money is how we keep score. - Ted Turner -- Android apps run on BlackBerry 10 Introducing the new BlackBerry 10.2.1 Runtime for Android apps. Now with support for Jelly Bean, Bluetooth, Mapview and more. Get your Android app in front of a whole new audience. Start now. http://pubads.g.doubleclick.net/gampad/clk?id=124407151&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Fatal error: askdir.c:340 NULL Volume name. This shouldn't happen!!!
To me it appears as if the DIR does not correctly take into account which tape is loaded where. It sees two tape drives, assignes one of them for the first starting job, but then decides not to use the currently mounted tape (which would be perfectly fine from all criteria like Pool, Status, Use Days etc. - actually will later be loaded into the other drive to run more jobs), but to use the one which is currently loaded in the _other_ drive. It starts to unload from the other drive. Now the second job starts running and finds that someone pulled the tape out from under it, and it fails. Does my interpretation make sense? Is this a common problem, or am I doing something wrong? The "interesting" thing is that it's always the same 2 jobs out of my list which are candidates for this error. And it does not always happen - maybe 2 times per week or so... All this is with 5.2.13 on Fedora 20 systems... All help / ideas welcome. Thanks in advance. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de The following statement is not true. The previous statement is true. -- WatchGuard Dimension instantly turns raw network data into actionable security intelligence. It gives you real-time visual feedback on key security issues and trends. Skip the complicated setup - simply import a virtual appliance and go from zero to informed in seconds. http://pubads.g.doubleclick.net/gampad/clk?id=123612991&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] SOLVED: catalog problem: duplicate key value violates unique constraint "fileset_pkey"
Dear Thomas, In message <52d59d74.6000...@mtl.mit.edu> you wrote: > > I can't say exactly why it happened to you but my guess would be that > this problem could hit anyone porting from mysql to postgres. I'm not It seems so. Now that I'm through all this I found a link [1] which desribes exactly this problem. Can't say why my searches didn;tfind that earlier. > familiar with the Bacula procedure for doing that (if you used one) but > any Postgres sequence creations during the Postgres DB setup would more > than likely be created with a default starting value of 1 - but if > you've already got data in your database (migrated over from Mysql) then > all sequences would need to be seeded properly. The bad news for you > may be that almost all of the Bacula tables have sequences to generate > their id fields. > > client > file > filename > path > job > jobmedia > fileset > media > pool There are more: bacula=# SELECT c.relname FROM pg_class c WHERE c.relkind = 'S'; relname --- filename_filenameid_seq job_jobid_seq location_locationid_seq restoreobject_restoreobjectid_seq fileset_filesetid_seq client_clientid_seq media_mediaid_seq jobmedia_jobmediaid_seq mediatype_mediatypeid_seq device_deviceid_seq basefiles_baseid_seq locationlog_loclogid_seq log_logid_seq path_pathid_seq pool_poolid_seq file_fileid_seq storage_storageid_seq (17 rows) > I believe in each case, the 'id' field is the primary key which means it > will be unique - thus any inserts should fail with an error and thus > ensure that your database doesn't get into a strange funky state with > multiple records having the same id. It may also be that you get lucky > and avoid that for tables such as file, job, filename because if your > database had been around awhile, it may be that re-starting those > counters back to 1 may not overlap with any existing/current data (e.g. > if the newest job before migration had an id of 1 and all old jobs > have been purged then restarting at 1 shouldn't cause problems depending > on your configuration of course). With that said, if it was me, I'd > re-seed all the sequences to where the id left off for each of the > tables to avoid possible future insert errors/conflicts. Indeed this appears what needs to be done... > alter sequence fileset_filesetid_seq restart with 76; This is what I did, i. e. for example: ... bacula=# select max(fileid) from file; max 4350001202 (1 row) bacula=# select * from file_fileid_seq; sequence_name | last_value | start_value | increment_by | max_value | min_value | cache_value | log_cnt | is_cycled | is_called -++-+--+-+---+-+-+---+--- file_fileid_seq | 1 | 1 |1 | 9223372036854775807 | 1 | 1 | 0 | f | f (1 row) bacula=# alter sequence file_fileid_seq restart with 4350001203; ALTER SEQUENCE ... Accoding to [1] this could have been simplified, but I didn't know this then yet (and I hope I will never have to do this again). > hope this helps and good luck, It did. Thanks a lot for your help - I highly appreciate it. If we ever should run into each other in real life please remember me that I owe you some beer... [1] http://mtu.net/~jpschewe/blog/2010/06/migrating-bacula-from-mysql-to-postgresql/ Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Don't panic. -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments & Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] catalog problem: duplicate key value violates unique constraint "fileset_pkey"
Dear Thomas, In message <52d6a29a.6010...@mtl.mit.edu> you wrote: > > > I ran this under "bconsole", i. e. as user bacula - is this not the > > right thing to do? ... > As someone I think already pointed out, it sounds like the owner of your > bacula database sequences is another user - more than likely the > Postgres "super user" which is probably named something like 'postgres' > on your system I'm guessing. You will need to connect to the database > as that user in order to have update privileges on the sequences. You were right once more. Running as "postgres" worked fine. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Microsoft Multimedia: You have nice graphics, sound and animations when the system crashes. -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments & Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] catalog problem: duplicate key value violates unique constraint "fileset_pkey"
Dear Dimitri, In message <52d5c764.4050...@bmrb.wisc.edu> you wrote: > > > I didn't use any precanned procedure (is there one? I mean a > > recommended/working one?). Basically whay I did is dumping the DB > > under MySQL=20 > > > and then importing the dump into PostgreSQL. > > That's why the sequences didn't get reinitialized properly. Would there have been a better way to do that? > > Enter SQL query: alter sequence fileset_filesetid_seq restart with = > 76; > > Query failed: ERROR: must be owner of relation fileset_filesetid_s= > eq > > Interesting... "select current_user" will tell you what role name > bconsole is using. It was "postgres". > With psql you can connect as any role: > > psql -U -d Indeed, running as user "postgres" fixed the issue. Thanks a lot! Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de God is real, unless declared integer. -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments & Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] catalog problem: duplicate key value violates unique constraint "fileset_pkey"
Dear Thomas, In message <52d59d74.6000...@mtl.mit.edu> you wrote: > > > Do you have any idea why this would happen? Is this something I can > > influence? > > Are there any other variables that might hit by similar issues? > > I can't say exactly why it happened to you but my guess would be that > this problem could hit anyone porting from mysql to postgres. I'm not > familiar with the Bacula procedure for doing that (if you used one) but I didn't use any precanned procedure (is there one? I mean a recommended/working one?). Basically whay I did is dumping the DB under MySQL: mysqldump -t -n -c \ --compatible=postgresql \ --skip-quote-names --skip-opt --quick \ --disable-keys --lock-tables \ --password=XXX bacula and then importing the dump into PostgreSQL. Hm... Thinking about that.. I did initialize the PostgreSQL DB using the Bacula provided "create_bacula_database", "make_bacula_tables" and "grant_bacula_privileges" scripts. > any Postgres sequence creations during the Postgres DB setup would more > than likely be created with a default starting value of 1 - but if > you've already got data in your database (migrated over from Mysql) then > all sequences would need to be seeded properly. The bad news for you > may be that almost all of the Bacula tables have sequences to generate > their id fields. > > client > file > filename > path > job > jobmedia > fileset > media > pool Ouch... You are right, I see the same with clientid: max=33, but client_clientid_seq last_value=1 :-( > > Sorry, my DB / sql knowledge is somewhat limited (read: non-existient). > > Could you please be so kind and tell me how I could fix that? > > Well, if your DB knowledge is limited then you may want to consult > someone in your location who may be able to assist. Given that, I'll Heh. There is none... That's why I'm asking here... > say the next part with the usual "use at your own risk" disclaimer. To > change the last_value field of a Postgres sequence, you need to use the > Postgres alter sequence command > > e.g. > > alter sequence fileset_filesetid_seq restart with 76; I tried that, but it fails: Enter SQL query: alter sequence fileset_filesetid_seq restart with 76; Query failed: ERROR: must be owner of relation fileset_filesetid_seq I ran this under "bconsole", i. e. as user bacula - is this not the right thing to do? > This may be dependent on your version of Postgres. I am using 9.1.x and > am looking at the following documentation: I'm running postgresql-9.3.2 under Fedora 20 / x86_64. > http://www.postgresql.org/docs/9.1/static/sql-altersequence.html > > I would then redo that above procedure for each of the sequences for > each of the Bacula tables (querying to get the max value currently used > and then resetting the last_value field to + 1). Wii trry that - if I manage ti fiure out how to solve this "must be owner" issue. After reading some docs I tried this: SELECT c.relname,c.relowner FROM pg_class c WHERE c.relkind = 'S'; +---+--+ | relname | relowner | +---+--+ | filename_filenameid_seq | 10 | | job_jobid_seq | 10 | | location_locationid_seq | 10 | | restoreobject_restoreobjectid_seq | 10 | | fileset_filesetid_seq | 10 | | client_clientid_seq | 10 | | media_mediaid_seq | 10 | | jobmedia_jobmediaid_seq | 10 | | mediatype_mediatypeid_seq | 10 | | device_deviceid_seq | 10 | | basefiles_baseid_seq | 10 | | locationlog_loclogid_seq | 10 | | log_logid_seq | 10 | | path_pathid_seq | 10 | | pool_poolid_seq | 10 | | file_fileid_seq | 10 | | storage_storageid_seq | 10 | +---+--+ OK, now I know which sequences I have to check, but I still don't know what owner "10" means... Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Brain: an apparatus with which we think we think.- Ambrose Bierce -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink
Re: [Bacula-users] catalog problem: duplicate key value violates unique constraint "fileset_pkey"
Dear Thomas, In message <52d555c5.9070...@mtl.mit.edu> you wrote: > My guess is that during the migration from MySQL to Postgres, the > sequences in Bacula did not get seeded right and probably are starting > with a seed value of 1. Do you have any idea why this would happen? Is this something I can influence? Are there any other variables that might hit by similar issues? > the filesetid field in the fileset table is automatically populated by > the fileset_filesetid_seq sequence. > > Run the following two queries and see what the results are - in > particular, see what the last_value is for the sequence. This should be > equal to the max value from the fileset table which it is in my Bacula > database. If not, you'll need to manually fix it via a sql update > command to the sequence. > > select max(filesetid) from fileset; > > select * from fileset_filesetid_seq; This is what I get: Enter SQL query: select max(filesetid) from fileset; +--+ | max | +--+ | 75 | +--+ Enter SQL query: select * from fileset_filesetid_seq; +---++-+--+---+---+-+-+---+---+ | sequence_name | last_value | start_value | increment_by | max_value | min_value | cache_value | log_cnt | is_cycled | is_called | +---++-+--+---+---+-+-+---+---+ | fileset_filesetid_seq | 4 | 1 |1 | 9,223,372,036,854,775,807 | 1 | 1 | 32 | f | t | +---++-+--+---+---+-+-+---+---+ Enter SQL query: Sorry, my DB / sql knowledge is somewhat limited (read: non-existient). Could you please be so kind and tell me how I could fix that? Thanks in advance! Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Of course there's no reason for it, it's just our policy. -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments & Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] catalog problem: duplicate key value violates unique constraint "fileset_pkey"
Hello,
I've tried to switch a bacula configuration that has been running for
years using from MySQL to PostgreSQL. Everything worked apparently
fine (I did the same before with two other instalations, where the
very same steps worked, too), but when trying to run jobs in the new
PostgreSQL environment, some jobs fail with errors like this:
13-Jan 22:13 XXX-dir JobId 1: Error: sql_create.c:741 Create DB FileSet record
INSERT INTO FileSet (FileSet,MD5,CreateTime) VALUES ('YYY
root','zD/PtXx6xx/IEHZH8X5OJB','2014-01-13 22:13:59') failed. ERR=ERROR:
duplicate key value violates unique constraint "fileset_pkey"
DETAIL: Key (filesetid)=(1) already exists.
13-Jan 22:13 XXX-dir JobId 1: Error: Could not create FileSet "YYY root"
record. ERR=sql_create.c:741 Create DB FileSet record INSERT INTO FileSet
(FileSet,MD5,CreateTime) VALUES ('YYY
root','zD/PtXx6xx/IEHZH8X5OJB','2014-01-13 22:13:59') failed. ERR=ERROR:
duplicate key value violates unique constraint "fileset_pkey"
DETAIL: Key (filesetid)=(1) already exists.
Not all jobs are faliling like this, only some.
Is there a way to check the DB for consistence (or, even better, to repair it)?
What could cause such issues, and what could be done to fix these?
I don;t know if it's related, but maybe I should note that in the old
setup (with a MySQL DB) I had occasionally jobs failing with errors
like this:
30-Dec 00:05 XXX-dir JobId 70535: Start Backup JobId 70535,
Job=AAA-Root.2013-12-30_00.05.02_02
30-Dec 00:05 XXX-dir JobId 70535: Using Device "LTO3-1" to write.
30-Dec 00:19 ZZZ-sd JobId 70535: Fatal error: askdir.c:340 NULL Volume name.
This shouldn't happen!!!
30-Dec 00:19 ZZZ-sd JobId 70535: Spooling data ...
30-Dec 00:06 AAA-fd JobId 70535: /work is a different filesystem. Will not
descend from / into it.
30-Dec 00:21 ZZZ-sd JobId 70535: Elapsed time=00:01:13, Transfer rate=0
Bytes/second
30-Dec 00:06 AAA-fd JobId 70535: Error: bsock.c:429 Write error sending 8 bytes
to Storage daemon:ZZZ:9103: ERR=Connection reset by peer
30-Dec 00:06 AAA-fd JobId 70535: Fatal error: xattr.c:98 Network send error to
SD. ERR=Connection reset by peer
Out of 30+ jobs running each night, only one would fail about once
per week, and this was one out of 2 candidates - all others never
showed any such problem. I have been wondering if there was some DB
issue for these jobs, which is one of the reasons for switching to
PostgreSQL. But maybe this is totally unrelated...
Any help welcome. Thanks in advance.
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
As long as we're going to reinvent the wheel again, we might as well
try making it round this time.- Mike Dennison
--
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula transfer limited 100Mbit/s
Dear jburkemx, In message <1367616525.m2f.384...@www.backupcentral.com> you wrote: > > I have an TL2000 w/dual LTO5 and when running the btape speed tests I get the > the following results: > > zero data = 146.4 MB/s to 189.4 MB/s > random data = 56.51 MB/s to 116 MB/S > > zero data and bacula block structure = 111 MB/s to 151.5 MB/S > > The slowest tape speed (56.51 MB/s = 452 Mbit/s) is still way faster than the > network transfer speed. This is unusually slow for LTO5; you should see data rates of 200 MB/s and more here. Seems there is at least one other bottleneck in your setup. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Microsoft Multimedia: You have nice graphics, sound and animations when the system crashes. -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with <2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PGSQL: make_catalog_backup.pl dumps everything?
Dear Dan, In message <710e664d50297121bb6c3f866f23d...@mail.unixathome.org> you wrote: > > I take the scripts provided by Bacula as being suggestions. I always > copy > them out of the base installation location, and modify them for my > specific > needs. > > Case in point: mtx-changer. > > I suggest that you do similar. I'm doing that. I just didn't understand what the script was doing. But as it turned out, it was just a RFTDM problem. Now where was my brown paper bag? ;-) Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de If you can't beat it or corrupt it, you pretend it was your idea in the first place. - Terry Pratchett, _Guards! Guards!_ -- Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and much more. Get web development skills now with LearnDevNow - 350+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122812 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PGSQL: make_catalog_backup.pl dumps everything?
Dear Martin, In message <201301101314.r0adeixr002...@higson.cam.lispworks.com> you wrote: > > > I noticed that running "make_catalog_backup.pl" with a PostgreSQL > > database runs "pg_dump -c" (i. e. without specifying a database), > > which results in a full dump of the whole DB server, including far > > more than the Bacula catalog. > > Are you sure that it dumps the whole server? The postgresql.org doc for the > dbname argument to pg_dump says that it only ever dumps one database: > > "Specifies the name of the database to be dumped. If this is not specified, > the environment variable PGDATABASE is used. If that is not set, the user name > specified for the connection is used." > > The make_catalog_backup.pl script sets PGDATABASE. Ah, indeed. I missed the second part of the explanation - I was looking for a command line argument, and saw none. But you are right, indeed it sets the PGDATABASE environment variable. Thanks a lot! Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "IBM uses what I like to call the 'hole-in-the-ground technique' to destroy the competition. IBM digs a big HOLE in the ground and covers it with leaves. It then puts a big POT OF GOLD nearby. Then it gives the call, 'Hey, look at all this gold, get over here fast.' As soon as the competitor approaches the pot, he falls into the pit" - John C. Dvorak -- Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and much more. Get web development skills now with LearnDevNow - 350+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122812 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PGSQL: make_catalog_backup.pl dumps everything?
Dear Andreas, In message <20130110095801.horde.olsom06jtahq7okzvfiu...@webmail.kwsoft.de> you wrote: > > > I noticed that running "make_catalog_backup.pl" with a PostgreSQL > > database runs "pg_dump -c" (i. e. without specifying a database), > > which results in a full dump of the whole DB server, including far > > more than the Bacula catalog. > > > > Is this a bug, or intentional? If the latter, what is the rationale? > > I would say that this is intentional for people just want to use > Bacula and therfore need a database. If you use the Bacula database in > a non standard way eg. for more that just Bacula, you should also be > able to roll out your own backup strategie for the DB. I think you minsunderstand. I am not using the bacula DB in any nonstandard way or for other purposes. The problem I see / the question I have is that the script "make_catalog_backup.pl" as distributed with bacula will not only dump the bacula database, but _all_ databases on the whole PostgreSQL _server_. If I use one machine as a DB server, I might use it to hold other databases (completely unrelated to bacula) as well. I've been using MySQL so far, and here "make_catalog_backup.pl" will dump only the bacula DB (i. e. MyCatalog). When using a PostgreSQL server, the script will not dump only this one DB, but all other, completely unrelated databases as well (plus the DB schema and what else). I think this is not correct - I may end up backing up many, many gigabytes of data which are totally unrelated. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de To program is to be. -- Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and much more. Get web development skills now with LearnDevNow - 350+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122812 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] PGSQL: make_catalog_backup.pl dumps everything?
Hello,
I noticed that running "make_catalog_backup.pl" with a PostgreSQL
database runs "pg_dump -c" (i. e. without specifying a database),
which results in a full dump of the whole DB server, including far
more than the Bacula catalog.
Is this a bug, or intentional? If the latter, what is the rationale?
I'm running Bacula 5.2.12-3 on Fedora 17 systems.
Thanks in advance.
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
If you want strict real-time behavior, run in the real time schedu-
ling class. But there are no seatbelts or airbags; main(){for(;;);}
can hard hang your system. -- Bart Smaalders
--
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122712
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL: import of DB from MySQL fails
Dear Dan, In message <078a8ca8-46cc-46e5-afce-ccfde5644...@langille.org> you wrote: > > > But the instructions at > > http://www.bacula.org/manuals/en/catalog/catalog/Installi_Configur_PostgreS.html > > simply don't work at all (no surprise, as these appear to be more than > > 8 years old and refer to ancient versions. > > > > The description recommended by Marco: > > http://mtu.net/~jpschewe/blog/2010/06/migrating-bacula-from-mysql-to-postgresql/ > > appears to work much better (at least no errors so far), albeit > > _terribly_ slow. I did not expect import times in the order of > > _weeks_. > > I see things in there which I feel are suspect. Eg the dates; they should be > null. Sorry for the delay - I was waiting for the import to complete. It took from Dec 30 15:00 through Jan 06 10:49, i. e. nearly 7 days. I will have to test how long the import of a PostgreSQL dump will take, hopefully it's faster (otherwise recovery after a crash of the DB server will be a real PITA). So the import completet, but it threw some 300+ error messages, apparently for file names which have an apostrophe in their names. For example the SQL statement: INSERT INTO Filename (FilenameId, Name) VALUES (706893,'Multichannel_DMA_API_User\'s_Guide.pdf'); will raise: ERROR: syntax error at or near "s_Guide" LINE 1: ... Name) VALUES (313896,'Multichannel_DMA_API_User\'s_Guide.pd... ^ Can anybody please tell me what this statement should look like so it gets digested by PostgrSQL? Thanks in advance... > > Has anybody else successfully done an update MySQL => PostgrSQL > > recently? > > I would look at non-Bacula resources. What you are doing is > Postgresql-specific. You are definitely right here. But the hints I get there are not really helpful, at least not to me - I ain't no DB expert after all. Thanks. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de What is research but a blind date with knowledge? -- Will Harvey -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnmore_123012 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL: import of DB from MySQL fails
Dear Dan, In message <59739303-6ccd-4198-9f10-135cec184...@langille.org> you wrote: > > Yes. Let the Bacula scripts create the PostgreSQL tables, then export only > data from MySQL. This is what I'm trying to do. But the instructions at http://www.bacula.org/manuals/en/catalog/catalog/Installi_Configur_PostgreS.html simply don't work at all (no surprise, as these appear to be more than 8 years old and refer to ancient versions. The description recommended by Marco: http://mtu.net/~jpschewe/blog/2010/06/migrating-bacula-from-mysql-to-postgresql/ appears to work much better (at least no errors so far), albeit _terribly_ slow. I did not expect import times in the order of _weeks_. Has anybody else successfully done an update MySQL => PostgrS!L recently? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de : ... and it's got weird formatting - Notepad, Write, Works 3 can't : decipher it, and it's too big to go in DOS Edit. Help! Install an operating system. :-) -- Tom Christiansen -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnmore_123012 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL: import of DB from MySQL fails
Dear Andrea, thanks for your help. In message <50deb974.1070...@alyf.net> you wrote: > > Hm... with "--compatible=postgresql" the backtics get changed into '"' > > characters, but the errors essentially remain the same: > > > > ERROR: syntax error at or near ""BaseFiles"" > > LINE 1: LOCK TABLES "BaseFiles" WRITE; > > ^ > > ERROR: syntax error at or near "UNLOCK" > > LINE 1: UNLOCK TABLES; > > Postgres has a different syntax for the LOCK command, and has no UNLOCK. > You can safely remove LOCK/UNLOCK commands as they're not needed in this > scenario. It appears there are more differences... > > ERROR: relation "Client" does not exist > > LINE 1: INSERT INTO "Client" VALUES (1,'diddl-fd','5.2.12 (12Sep12) ... > > You must create the tables before inserting data. You can either tell > mysqldump to also dump the db schema (but you will have to review the > CREATE TABLE statements as there are differences in type names) or > create the schema using the postgres SQL script which comes with bacula. I did create the tables before - I followed the instructions and ran the commands ./drop_bacula_tables ./make_bacula_tables ./grant_bacula_privileges before attempting the DB import. > Depending on your setup, you could also consider creating an empty > database and bscanning all existing volumes into it. This is not really an option for me. I have >700 tapes (including a large number of old, slow SLR100 and DDS-3 tapes) in 2 databases. Scanning these tapes would take ages and cause a significant amount of manual interaction. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "It is better for civilization to be going down the drain than to be coming up it." - Henry Allen -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnmore_123012 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL: import of DB from MySQL fails
Dear Marco van Wieringen, In message you wrote: > > > I have no idea what to try next. Any pointers? All help welcome. > Maybe try the in 2010 working solution available here > > http://mtu.net/~jpschewe/blog/2010/06/migrating-bacula-from-mysql-to-postgresql/ > > which is way more up to date then anything in the current docs which talk > about a 1.x version of 8+ years ago. Indeed - the document says: This process was tested using the following software versions: Linux Mandrake 10/Kernel 2.4.22-10 SMP Mysql Ver 12.21 Distrib 4.0.15, for mandrake-linux-gnu (i586) PostgreSQL 7.3.4 Bacula 1.34.5 No surprise this is breaking down. With your description I get no errors, but I'm still not through. Observations: - With the options used here, mysqldump needs much longer, and it consumes an awful lot of memory - in my case close to 14 GB. I had to add extra swp space because the 4 GB RAM / 4 GB swap I had on my ol d DB server did not work. - The generates SQL dump is about twice as large as the dumps I got before. - The import into PostgreSQL is terribly slow. It spits out a large number of lines "INSERT 0 1" on the terminal (7.7 millions such lines so far, after about 20 hours of run time); but my SQL dump file contains more than 72 millions 'INSERT INTO' lines. Extra- polating from that the import will take at least 190 hours or about 8 days. And this is only the smaller of my bacula databases... Is there something going wrong? I guess there is no way to check before the process completes, right? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "What if" is a trademark of Hewlett Packard, so stop using it in your sentences without permission, or risk being sued. -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnmore_123012 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL: import of DB from MySQL fails
In message <20121228210203.4a8f5200...@gemini.denx.de> I wrote:
>
> There is no Windows system involved anywhere. All are Linux boxen.
> And PostgreSQL appeas to complain about the first backtick in
> statements like
>
> INSERT INTO `File` VALUES (1422233176,1941692,37890,1487195,...
> ^
>
> But I get the same error message when changing the ` into ' like that:
>
> INSERT INTO 'File' VALUES (1422233176,1941692,37890,1487195,...
>
> So there must be some other problem...
>
> Hm google tells me about some "--compatible=postgresql" argument
> to mysqldump ...
>
> Will try that. But then - why isn't this mentioned anywhere in the
> bacula docs?
Hm... with "--compatible=postgresql" the backtics get changed into '"'
characters, but the errors essentially remain the same:
ERROR: syntax error at or near ""BaseFiles""
LINE 1: LOCK TABLES "BaseFiles" WRITE;
^
ERROR: syntax error at or near "UNLOCK"
LINE 1: UNLOCK TABLES;
^
ERROR: syntax error at or near ""CDImages""
LINE 1: LOCK TABLES "CDImages" WRITE;
^
ERROR: syntax error at or near "UNLOCK"
LINE 1: UNLOCK TABLES;
^
ERROR: syntax error at or near ""Client""
LINE 1: LOCK TABLES "Client" WRITE;
^
ERROR: relation "Client" does not exist
LINE 1: INSERT INTO "Client" VALUES (1,'diddl-fd','5.2.12 (12Sep12) ...
^
ERROR: syntax error at or near "UNLOCK"
LINE 1: UNLOCK TABLES;
^
ERROR: syntax error at or near ""Counters""
LINE 1: LOCK TABLES "Counters" WRITE;
^
ERROR: syntax error at or near "UNLOCK"
LINE 1: UNLOCK TABLES;
^
ERROR: syntax error at or near ""Device""
LINE 1: LOCK TABLES "Device" WRITE;
^
ERROR: syntax error at or near "UNLOCK"
LINE 1: UNLOCK TABLES;
^
ERROR: syntax error at or near ""File""
LINE 1: LOCK TABLES "File" WRITE;
^
ERROR: relation "File" does not exist
LINE 1: INSERT INTO "File" VALUES (1422233176,1941692,37890,1487195,...
^
ERROR: relation "File" does not exist
LINE 1: INSERT INTO "File" VALUES (1406866989,2278503,37516,1674162,...
^
ERROR: relation "File" does not exist
LINE 1: INSERT INTO "File" VALUES (1405758742,1170256,37516,907380,2...
^
I have no idea what to try next. Any pointers? All help welcome.
Thanks in advance...
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
If you're not part of the solution, then you're part of the precipi-
tate.
--
Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and
much more. Get web development skills now with LearnDevNow -
350+ hours of step-by-step video tutorials by Microsoft MVPs and experts.
SALE $99.99 this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122812
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL: import of DB from MySQL fails
Dear Bryan, In message <29d76671-f52f-403b-928a-bf6126972...@me.com> you wrote: > Just a long shot, but did you try dos2unix? No, I didn't (but it doesn't help either). There is no Windows system involved anywhere. All are Linux boxen. And PostgreSQL appeas to complain about the first backtick in statements like INSERT INTO `File` VALUES (1422233176,1941692,37890,1487195,... ^ But I get the same error message when changing the ` into ' like that: INSERT INTO 'File' VALUES (1422233176,1941692,37890,1487195,... So there must be some other problem... Hm google tells me about some "--compatible=postgresql" argument to mysqldump ... Will try that. But then - why isn't this mentioned anywhere in the bacula docs? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "When the only tool you have is a hammer, you tend to treat everything as if it were a nail."- Abraham Maslow -- Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and much more. Get web development skills now with LearnDevNow - 350+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122812 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] PostgreSQL: import of DB from MySQL fails
Hi,
now that I got the PostgreSQL setup working, I try to import my data
from the old MySQL configuration. I'm following the instructions at
http://www.bacula.org/manuals/en/catalog/catalog/Installi_Configur_PostgreS.html
especially section "Converting from MySQL to PostgreSQL".
However, when trying to run the commands exported by MySQL, I get a
ton of syntax errors:
ERROR: syntax error at or near "`"
LINE 1: LOCK TABLES `BaseFiles` WRITE;
^
ERROR: syntax error at or near "UNLOCK"
LINE 1: UNLOCK TABLES;
^
ERROR: syntax error at or near "`"
LINE 1: LOCK TABLES `CDImages` WRITE;
^
ERROR: syntax error at or near "UNLOCK"
LINE 1: UNLOCK TABLES;
^
ERROR: syntax error at or near "`"
LINE 1: LOCK TABLES `Client` WRITE;
^
ERROR: syntax error at or near "`"
LINE 1: INSERT INTO `Client` VALUES (1,'diddl-fd','5.2.12 (12Sep12) ...
^
ERROR: syntax error at or near "UNLOCK"
LINE 1: UNLOCK TABLES;
^
ERROR: syntax error at or near "`"
LINE 1: LOCK TABLES `Counters` WRITE;
^
ERROR: syntax error at or near "UNLOCK"
LINE 1: UNLOCK TABLES;
^
ERROR: syntax error at or near "`"
LINE 1: LOCK TABLES `Device` WRITE;
^
ERROR: syntax error at or near "UNLOCK"
LINE 1: UNLOCK TABLES;
^
ERROR: syntax error at or near "`"
LINE 1: LOCK TABLES `File` WRITE;
^
ERROR: syntax error at or near "`"
LINE 1: INSERT INTO `File` VALUES (1422233176,1941692,37890,1487195,...
^
ERROR: syntax error at or near "`"
LINE 1: INSERT INTO `File` VALUES (1406866989,2278503,37516,1674162,...
^
ERROR: syntax error at or near "`"
LINE 1: INSERT INTO `File` VALUES (1405758742,1170256,37516,907380,2...
^
ERROR: syntax error at or near "`"
LINE 1: INSERT INTO `File` VALUES (1405736710,1148224,37516,935293,1...
^
ERROR: syntax error at or near "`"
LINE 1: INSERT INTO `File` VALUES (1405744738,1156252,37516,935661,1...
^
ERROR: syntax error at or near "`"
LINE 1: INSERT INTO `File` VALUES (1414375645,393904,37886,7163,1817...
^
...
It appears that the file formats are not compatible. Is there
anything I'm missing, or some simple fix (like substituting all "`"
charatcers with "'" or so) ?
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
Until you walk a mile in another man's moccasins, you can't imagine
the smell.
--
Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and
much more. Get web development skills now with LearnDevNow -
350+ hours of step-by-step video tutorials by Microsoft MVPs and experts.
SALE $99.99 this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122812
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL - how to exclude bacula database?
Dear Dan, In message you wrote: > > > However, none of the PostgreSQL based examples I have seen so far > > contain similar (at least similar obvious) exclude rules. What am I > > missing here? > > It depends on where your PostgreSQL database is. On FreeBSD, which is = > my preferred > operating system for a server, this is /usr/local/pgsql > > That is the usual location, but it may vary. For the record, under Fedora it's at /var/lib/pgsql/data/ > However, there may be things that you do want to back up. Especially in > /usr/local/pgsql/data: > > at a minimum, I would backup: > > pg_hba.conf > pg_ident.conf > postgresql.conf > > But given you want regex, I'd go with: > > pg_multixactpg_subtrans pg_twophase > pg_stat_tmp pg_tblspc pg_xlog > pg_clog base global postmaster.log Thanks - that was really helpful! > This assumes you are dumping each database, including the globals > database, to disk and backing that up. Understood, doing that. Thanks again. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Give a man a fish, and you feed him for a day. Teach a man to fish, and he'll invite himself over for dinner. - Calvin Keegan -- Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and much more. Get web development skills now with LearnDevNow - 350+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122812 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL - how to exclude bacula database?
Dear Jérôme Blion, In message <57d402d951b7313f52d27fca670c7...@imap.free.fr> you wrote: > > >> Say what? mysqldump doesn't produce a valid backup? ... > http://dba.stackexchange.com/questions/6363/consistent-logical-backup-of-databases-that-use-myisam-and-innodb-engines > http://dev.mysql.com/doc/refman/5.5/en/mysqldump.html#option_mysqldump_single-transaction Well, this states: It's also worth mentioning that the default options will make sure your backup is safe, you don't need to turn any special flag on. > And another reason not to use mysqldump on production systems: the > nightmare begins when you have to restore a huge dump. OK, but poor performance (while still bad) is a completely different thing than inconsistent data. > (that's why I use other tools like mylvmbackup and mydumper when I can > afford to loose some records) I don't understand you. You complain that mysqldump was unreliable (and causing inconsistent backup data), which is apparently not true, and then you recommend some other tools which may "loose some records"? This makes little sense to me. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de In C we had to code our own bugs, in C++ we can inherit them. -- Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and much more. Get web development skills now with LearnDevNow - 350+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122812 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] PostgreSQL - how to exclude bacula database?
Hi again,
here is another PostgreSQL related question: when backing up the
database server, I would like to exclude the bacula database (which
gets backed up separately anyway).
With MySQL, I could do this easily with somthing like this:
Options {
RegexFile = "^/var/lib/mysql/mysql-bin." # exclude MySQL replication
logs and index
RegexFile = "^/var/lib/mysql/bacula/" # exclude bacula DB itself -
backup separately
RegexFile = "^/var/lib/mysql/ib"
Exclude = yes
}
However, none of the PostgreSQL based examples I have seen so far
contain similar (at least similar obvious) exclude rules. What am I
missing here?
Thanks in advance.
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
I will not say that women have no character; rather, they have a new
one every day. -- Heine
--
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122712
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL - Could not open Catalog "MyCatalog", database "bacula"
Dear Dan, In message <74ff5871-d1bc-4ea8-ac5e-f257e1244...@langille.org> you wrote: > > With what you have now, you're connecting to localhost. PostgreSQL > is most likely configured to listen only on localhost. Yes, this was the problem. > listen_addresses = 'localhost, 10.1.1.1' Indeed - fixing listen_addresses solves the issue. > Hope that helps. It does - thanks a lot!! I owe you yet another beer... Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de An age is called Dark not because the light fails to shine, but because people refuse to see it. -- James Michener, "Space" -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnmore_122712 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL - Could not open Catalog "MyCatalog", database "bacula"
Dear Dan Langille,
In message <5a6c0b9b-5b81-4c58-90f5-ca93ba43a...@langille.org> you wrote:
>
> As the PostgreSQL back-end author, I applaud your decision. ;)
I'm aware that I should have dont that a long time ago, but you know
how it is when you have a system that is basically running just fine,
albeit eventually not as performant as possible...
> Please show us your Catalog resource from bacula-dir.conf.
>
> Mine is:
>
> Catalog {
> Name = MyCatalog
> dbname = bacula; dbaddress = localhost; user = bacula; password = ""
> }
I have this:
Catalog {
Name = MyCatalog
dbdriver = "dbi:postgresql"; dbaddress = .denx.de; dbport = 5432
dbname = "bacula"; dbuser = "bacula"; dbpassword = "XX"
}
> Is bacula-dir running on the same host as PostgreSQL?
Yes, both are running on host ""...
Ooops... I was just about to write that I had also tested this with
"dbaddress = localhost" before, and it didn't work either; but that
was probably before some other changes... Fortunately I was wise
enough to retest it before sending this, and indeed this fixes the
problem.
OK, assuming I would like to have the flexibility of running the DB
on another host it seems I need to re-check pg_hba.conf ?
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
"Just Say No." - Nancy Reagan
"No."- Ronald Reagan
--
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122712
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL - Could not open Catalog "MyCatalog", database "bacula"
Dear Simone Caronni, In message you wrote: > > Inside the README.Fedora there is also a brief how to on how to > quickly setup a PostgreSQL based Bacula Director. Thanks again. I followed exactly the steps as described in the README (which are more or less identical http://www.bacula.org/manuals/en/catalog/catalog/Installi_Configur_PostgreS.html). This doesn't help. There must be some other problem. Is there any way to get more debug information from bacula and/or PostgreSQL? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "Unix is simple, but it takes a genius to understand the simplicity." - Dennis Ritchie -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnmore_122712 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL - Could not open Catalog "MyCatalog", database "bacula"
Dear Simone Caronni,
In message
you wrote:
>
> What's missing is only your choice in the alternatives system for the
> database backend:
No, that's not the reason. These are set up correctly, at least I
think so:
# alternatives --display libbaccats.so
libbaccats.so - status is manual.
link currently points to /usr/lib64/libbaccats-postgresql.so
/usr/lib64/libbaccats-mysql.so - priority 50
/usr/lib64/libbaccats-sqlite3.so - priority 40
/usr/lib64/libbaccats-postgresql.so - priority 60
Current `best' version is /usr/lib64/libbaccats-postgresql.so.
I want to use PostgreSQL, so this is OK, I think.
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
If you want strict real-time behavior, run in the real time schedu-
ling class. But there are no seatbelts or airbags; main(){for(;;);}
can hard hang your system. -- Bart Smaalders
--
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122712
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] PostgreSQL - Could not open Catalog "MyCatalog", database "bacula"
Hi,
I would like to apologize in advance for re-asking a FAQ: I am well
aware that here have been a ton of similar reports before, and I did
read these and try out suggested solutions, with no avail.
After running bacula for a long, long time with MySQL, I decided to
try it out with PostgreSQL instead.
This is a from-scratch installation based on Fedora 17 and the Bacula
packages that come with this release, i. e.
bacula-client-5.2.12-3.fc17.x86_64
bacula-common-5.2.12-3.fc17.x86_64
bacula-console-5.2.12-3.fc17.x86_64
bacula-console-bat-5.2.12-3.fc17.x86_64
bacula-director-5.2.12-3.fc17.x86_64
bacula-docs-5.2.12-1.fc17.noarch
bacula-libs-5.2.12-3.fc17.x86_64
bacula-libs-sql-5.2.12-3.fc17.x86_64
bacula-storage-5.2.12-3.fc17.x86_64
The problem: I get (like so many others before) these error messages:
...
bacula-dir: dir_plugins.c:160-0 Load dir plugins
bacula-dir: dir_plugins.c:162-0 No dir plugin dir!
bacula-dir: lockmgr.c:583-0 Exit check_deadlock.
bacula-dir: postgresql.c:1126-0 db_init_database first time
bacula-dir: postgresql.c:241-0 pg_real_connect done
bacula-dir: postgresql.c:243-0 db_user=bacula db_name=bacula db_password=XX
bacula-dir: dird.c:1006 Could not open Catalog "MyCatalog", database "bacula".
bacula-dir: dird.c:1011 postgresql.c:248 Unable to connect to PostgreSQL
server. Databas
Possible causes: SQL server not running; password incorrect; max_connections
exceeded.
27-Dec 15:56 bacula-dir ERROR TERMINATION
Please correct configuration file: /etc/bacula/bacula-dir.conf
...
I used this command to set the db_password :
# su - -s /bin/bash bacula
-bash-4.2$ psql -Ubacula bacula
psql (9.1.7)
Type "help" for help.
bacula=> alter user bacula with password 'XX';
ALTER ROLE
bacula=> \q
-bash-4.2$
I appears this worked fine. I can also access the batabase manually,
like running the commands described in step "13. Resequence your
tables with the following commands" in the "Installing and
Configuring PostgreSQL" section of the manual:
# su - -s /bin/bash bacula
-bash-4.2$ psql -Ubacula bacula
psql (9.1.7)
Type "help" for help.
bacula=> SELECT SETVAL('client_clientid_seq', (SELECT
bacula(> MAX(clientid) FROM client));
setval
(1 row)
bacula=> \q
-bash-4.2$
So it appears that the PostgreSQL server is up and running, the DB is
there and can be accessed.
Note: none of the commands above did request me to enter any
password. [But then, when changing bacula-dir.conf back to the
default setting (empty db_password), I get the same results]
I tried with misc settings of pg_hba.conf as recommended in some of
the previous postings, with no avail either.
Is there any way to debug which actual operation is failing? Or
otherwise find out which exact setting might be wrong?
Thanks in advance...
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
"You're just jealous." "What, of an overgrown puppy with a single-
figure IQ?" - Terry Pratchett, _Moving Pictures_
--
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122712
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to specify drive of Autochanger?
Dear Josh Fisher, In message <50a640aa.2040...@pvct.com> you wrote: > > > Hi, change > > Device = LTO3-0, LTO3-1 > > to > > Device = Autochanger > > What does say status storage=LTOLIB then? > > Nice catch, Cejka. This is almost certainly the problem. That mismatch Yes, it was the problem. > should probably be caught as a config error during startup, since > resource LTOLIB is defined with autochanger=yes in bacula-dir.conf and > the Device= is listing devices that are not defined as autochangers in Indeed - such a consistency check would have saved me (and all that helped me - thanks again for that!) a lot of time. > bacula-sd.conf. However, I don't think that is possible, because > bacula-dir does not know the configuration of bacula-sd, which is why it > must be also defined in bacula-dir to begin with. Eventually such a check could be added? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de The greatest threat towards future is indifference. -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to specify drive of Autochanger?
Dear Radoslaw,
In message
you wrote:
>
> > # Definition of LTO(3) autoloader
> > Storage {
...
> > Device= LTO3-0, LTO3-1
>
> Here should be a Device = Autochanger
Thanks a lot - this indeed fixes it.
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
To understand a program you must become both the machine and the
program.
--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to specify drive of Autochanger?
Dear Cejka, In message <20121116083304.ga1...@fit.vutbr.cz> you wrote: > > Hi, change > Device = LTO3-0, LTO3-1 > to > Device = Autochanger Bingo!! This fixes it - thank a lot!! Now I get what I expected: *mount The defined Storage resources are: 1: File 2: LTOLIB 3: LTO3-0 4: LTO3-1 5: ltos_temp 6: SLR100-0 7: SLR100-1 8: SLR100-2 9: DDS-3 Select Storage resource (1-9): 2 Connecting to Storage daemon LTOLIB at ltos.denx.de:9103 ... Enter autochanger drive[0]: 1 Enter autochanger slot: 13 3307 Issuing autochanger "unload slot 25, drive 1" command. 3304 Issuing autochanger "load slot 13, drive 1" command. 3305 Autochanger "load slot 13, drive 1", status is OK. 3001 Mounted Volume: DIF000L3 3001 Device ""LTO3-1" (/dev/tape/by-id/scsi-35000e11802947004-nst)" is already mounted with Volume "DIF000L3" Thanks again! Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de This all sounds complicated, but it mostly does excatly what you ex- pect. It's just difficult for us to explain what you expect... - L. Wall & R. L. Schwartz, _Programming Perl_ -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to specify drive of Autochanger?
Dear Cejka, In message <20121116083507.gb1...@fit.vutbr.cz> you wrote: > John Drescher wrote (2012/11/15): > > > However, no matter what I enter at the prompt "Enter autochanger > > > drive[0]:", the director will always send a command to access drive > > > index 0. > > > > Where do you get this prompt? I have never ever been asked this and I > > have had an autochanger at work since 2006 and I used it with bacula > > from the start since I was already using bacula for years before I got > > the changer.. > > And do you have two or more drives? The autoloader has two drives. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de HR Manager to job candidate "I see you've had no computer training. Although that qualifies you for upper management, it means you're under-qualified for our entry level positions." -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to specify drive of Autochanger?
Dear Geert, In message <20121116074956.gb29...@pcgeerts.capdata.vanadcc.nl> you wrote: > > > *mount > > The defined Storage resources are: ... > > Select Storage resource (1-9): 2 > > Connecting to Storage daemon LTOLIB at ltos.denx.de:9103 ... > > Enter autochanger drive[0]: 1 > > Why '1'? With what does it match? With what _should_ it match? My idea was to load this tape into the second drive; based on the definition "Device = LTO3-0, LTO3-1" that would have been "LTO3-1". > Below is told what is _wanted_ c.q. what is _desired_. Sorry - what does "c.q." mean? > I assume it is allready wrong before the 'Enter autochanger drive[0]:' prompt > that John Drescher is warning about. Probably. Still trying to understand why and where. > I do read it as "Confirm autochanger drive[0]:" prompt. That would be a bit strange. The format of this message is generally used to allow input of a user chosen value, showing the default value in brackets - i. e. when I press enter it uses drive # 0, but I can overwrite this by entering another value, like 1 in my case. AM I wrong here? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Marriage is the triumph of imagination over intelligence. Second marriage is the triumph of hope over experience. -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to specify drive of Autochanger?
Dear John Drescher, In message you wrote: > > > Where do you get this prompt? I have never ever been asked this and I > > have had an autochanger at work since 2006 and I used it with bacula > > from the start since I was already using bacula for years before I got > > the changer.. > > Although this could be because I use the autochanger in an unsupported > way. What I mean is in my bacula-dir.conf I have a device for the > autochanger and devices for each drive instead of just the autochanger > device. I did the same (to test the drives individualy, to make sure these are actually available and working); see the full configuration I posted before here: http://article.gmane.org/gmane.comp.sysutils.backup.bacula.general/72107 BTW - I'm running on Fedora 17, i. e. version 5.2.11 : bacula-common-5.2.11-3.fc17.x86_64 bacula-console-5.2.11-3.fc17.x86_64 bacula-console-bat-5.2.11-3.fc17.x86_64 bacula-director-5.2.11-3.fc17.x86_64 bacula-docs-5.2.11-1.fc17.noarch bacula-libs-5.2.11-3.fc17.x86_64 bacula-libs-sql-5.2.11-3.fc17.x86_64 bacula-storage-5.2.11-3.fc17.x86_64 Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Never underestimate the bandwidth of a station wagon full of tapes. -- Dr. Warren Jackson, Director, UTCS -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to specify drive of Autochanger?
Dear John Drescher, In message you wrote: > > > However, no matter what I enter at the prompt "Enter autochanger > > drive[0]:", the director will always send a command to access drive > > index 0. > > Where do you get this prompt? I have never ever been asked this and I > have had an autochanger at work since 2006 and I used it with bacula > from the start since I was already using bacula for years before I got > the changer.. It's when running a mount command on bconsole: This is the full output: *mount The defined Storage resources are: 1: File 2: LTOLIB 3: LTO3-0 4: LTO3-1 5: ltos_temp 6: SLR100-0 7: SLR100-1 8: SLR100-2 9: DDS-3 Select Storage resource (1-9): 2 Connecting to Storage daemon LTOLIB at ltos.denx.de:9103 ... Enter autochanger drive[0]: 1 Enter autochanger slot: 25 3304 Issuing autochanger "load slot 25, drive 0" command. 3305 Autochanger "load slot 25, drive 0", status is OK. 3001 Mounted Volume: INC000L3 3001 Device ""LTO3-0" (/dev/tape/by-id/scsi-35000e11802947001-nst)" is mounted with Volume "INC000L3" Note that already the "3304 Issuing autochanger "load slot 25, drive 0" command." is incorrect, it should have "drive 1" instead. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de An expert is a person who avoids the small errors while sweeping on to the grand fallacy. -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to specify drive of Autochanger?
Dear Josh,
In message <50a550fc.30...@pvct.com> you wrote:
>
> > Storage server xxx - bacula-sd.conf:
> >
> > Autochanger {
> >Name = Autochanger
> >Device = LTO3-0
> >Device = LTO3-1
> >Changer Command = "/usr/libexec/bacula/mtx-changer %c %o %S %a %d"
> >Changer Device = /dev/tape/by-id/scsi-1BDT_FlexStor_II_00DE64100465_LL0
> > }
>
> Try replacing the two Device= lines with one line:
> Device = LT03-0,LT02-1
Thanks for the idea - done, but unfortunately this does not change the
behaviour in any way.
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
Every little picofarad has a nanohenry all its own. - Don Vonada
--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Copy + Migrate to different ppols - was: Tape-to-tape copy job?
Dear Adrian, In message <2012165221.ga25...@r2d2.s.lihas.de> you wrote: > > On Sun, Nov 11, 2012 at 03:05:12PM +0100, Wolfgang Denk wrote: > > OK, the task is: > > 1) Backup some jobs to pool DISK > > 2) Copy these jobs from pool DISK to pool ARCHIVE > > 3) Migrate the same jobs from pool DISK to pool TAPE > > I have the very same setup. > My solution had been to write a job that replaces the NextPool > statement and reloads bacula. I can give you the script. Thnaks, but this appears to be quite fragile - it will break as soon as two such jobs which need different settings happen to run simultaneously for one reason or another. > However, there seems to be a better solution, someone posted it on > this list a few months ago: > Use a dummy-Pool with the correct NextPool statement, select the jobs to > be copied by e.g. jobid (I use an sql select there) and they will still > be copied, even if they are in some other pool. The original post is at > http://thread.gmane.org/gmane.comp.sysutils.backup.bacula.devel/14084 Thanks. This is the way to go, then. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de panic: kernel trap (ignored) -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to specify drive of Autochanger?
Dear Dan,
In message you wrote:
>
> > I must be missing something very basic. I can address both drives in
> > my autoloader directly. But when using the autoloader device, it
> > always grabs device 0 only, like this:
> >
> > Storage server xxx - bacula-sd.conf:
> >
> > Autochanger {
> > Name = Autochanger
> > Device = LTO3-0
> > Device = LTO3-1
> > Changer Command = "/usr/libexec/bacula/mtx-changer %c %o %S %a %d"
>
> I would start by debugging this script: /usr/libexec/bacula/mtx-changer
>
> Make sure it is passing the correct values to the robot.
This works like a charm. When I use the single drives directly (i. e.
through the names "LTO3-0" resp. "LTO3-1", I can see that the last
argument (%d) receives the correct drive index, and this does exactly
what it is supposed to do.
However, no matter what I enter at the prompt "Enter autochanger
drive[0]:", the director will always send a command to access drive
index 0.
> FYI here is what I wrote up about debugging mtx-changer.
Thanks, but this is not a mtx-changer problem - that part works.
It's some problem with the director (or more likely with it's
configuration) that causes it to always use drive index 0 only.
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
GUIs are virtually useless. Learn tools. They're configurable,
scriptable, automatable, cron-able, interoperable, etc. We don't need
no brain-dead winslurping monolithic claptrap.
-- Tom Christiansen in 371140df@csnews
--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to specify drive of Autochanger?
Dear John,
In message
you wrote:
>
> Yes. The robot works on all 3 devices.
I must be missing something very basic. I can address both drives in
my autoloader directly. But when using the autoloader device, it
always grabs device 0 only, like this:
*mount
The defined Storage resources are:
1: File
2: LTOLIB
3: LTO3-0
4: LTO3-1
5: ltos_temp
6: SLR100-0
7: SLR100-1
8: SLR100-2
9: DDS-3
Select Storage resource (1-9): 2
Connecting to Storage daemon LTOLIB at ltos.denx.de:9103 ...
Enter autochanger drive[0]: 1
Enter autochanger slot: 25
3304 Issuing autochanger "load slot 25, drive 0" command.
3305 Autochanger "load slot 25, drive 0", status is OK.
3001 Mounted Volume: INC000L3
3001 Device ""LTO3-0" (/dev/tape/by-id/scsi-35000e11802947001-nst)" is mounted
with Volume "INC000L3"
I select drive 1, but the mount command operates on drive 0 instead.
director - bacula-dir.conf :
# Definition of LTO(3) autoloader
Storage {
Name = LTOLIB
Address = xxx
SDPort= 9103
Password = yyy
Device= LTO3-0, LTO3-1
Media Type= LTO-3
Autochanger = yes
Maximum Concurrent Jobs = 6
}
# Definition of LTO(3) drive #0 in the autoloader
Storage {
Name = LTO3-0
Address = xxx
SDPort= 9103
Password = yyy
Device= LTO3-0
Media Type= LTO-3
Maximum Concurrent Jobs = 6
}
# Definition of LTO(3) drive #1 in the autoloader
Storage {
Name = LTO3-1
Address = xxx
SDPort= 9103
Password = yyy
Device= LTO3-1
Media Type= LTO-3
Maximum Concurrent Jobs = 6
}
Storage server xxx - bacula-sd.conf:
Autochanger {
Name = Autochanger
Device = LTO3-0
Device = LTO3-1
Changer Command = "/usr/libexec/bacula/mtx-changer %c %o %S %a %d"
Changer Device = /dev/tape/by-id/scsi-1BDT_FlexStor_II_00DE64100465_LL0
}
Device {
Name = LTO3-0
Media Type = LTO-3
Drive Index = 0
Archive Device = /dev/tape/by-id/scsi-35000e11802947001-nst
AutomaticMount = yes;
AlwaysOpen = yes;
RemovableMedia = yes;
RandomAccess = no;
Maximum File Size = 5GB
Maximum Block Size = 512K
Changer Command = "/usr/libexec/bacula/mtx-changer %c %o %S %a %d"
Changer Device = /dev/tape/by-id/scsi-1BDT_FlexStor_II_00DE64100465_LL0
AutoChanger = yes
# Enable the Alert command only if you have the mtx package loaded
Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
# If you have smartctl, enable this, it has more info than tapeinfo
# Alert Command = "sh -c 'smartctl -H -l error %c'"
# Spool Data to disk before writing to tape
Spool Directory = /backup/spool
Maximum Spool Size = 5120GB
Maximum Job Spool Size = 5120GB
}
Device {
Name = LTO3-1
Media Type = LTO-3
Drive Index = 1
Archive Device = /dev/tape/by-id/scsi-35000e11802947004-nst
AutomaticMount = yes;
AlwaysOpen = yes;
RemovableMedia = yes;
RandomAccess = no;
Maximum File Size = 5GB
Maximum Block Size = 512K
Changer Command = "/usr/libexec/bacula/mtx-changer %c %o %S %a %d"
Changer Device = /dev/tape/by-id/scsi-1BDT_FlexStor_II_00DE64100465_LL0
AutoChanger = yes
# Enable the Alert command only if you have the mtx package loaded
# Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
# If you have smartctl, enable this, it has more info than tapeinfo
Alert Command = "sh -c 'smartctl -H -l error %c'"
# Spool Data to disk before writing to tape
Spool Directory = /backup/spool
Maximum Spool Size = 5120GB
Maximum Job Spool Size = 5120GB
}
Any attempt to access storage "LTOLIB" will always go to drive 0 (aka
"LTO3-0" = /dev/tape/by-id/scsi-35000e11802947001-nst) only.
What am I missing?
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
As a general rule, the freedom of any people can be judged by the
volume of their laughter.
--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Copy + Migrate to different ppols - was: Tape-to-tape copy job?
Dear Dan, In message you wrote: > > NOTE: this is not the tape-to-tape copy mentioned in the subject. True. Changed Subject: . > Well, first, don't try to figure HOW to do it quite yet. > > Figure out what you want to have happen. Don't express it in terms of > the three steps above. But in terms of what copies your want where > > So.. given backup job X on disk, n days later, I want a copy of that > job X > in Pool B. Y days alter, I want Job X in Pool C. > > Ignore that one is disk, one is tape. Then it should be easier. OK, the task is: 1) Backup some jobs to pool DISK 2) Copy these jobs from pool DISK to pool ARCHIVE 3) Migrate the same jobs from pool DISK to pool TAPE My current problem is that I think pool DISK would need two different "next pool" entries, one for ARCHIVE and one for TAPE, and I don;t know how to switch these on a per-job base. You wrote in your other message: > > Can I overwrite thissetting, for example in the Job definition? > > I think not, reading > http://www.bacula.org/5.2.x-manuals/en/main/main/Configuring_Director.html#SECTION00223 Indeed - trying to use "next pool" in the Job description I get a Config error: Keyword "NextPool" not permitted in this resource. Ditto for the "run" command; using a "NextPool=..." on the command line, I get an error Invalid keyword: NextPool However, Section "11.7 Virtual Backup (Vbackup)" in the manual says "...writes it to the Next Pool specified in the Job resource" but this appears to be misleading. But if "next pool" can really be used only within a pool definition, then it is never possible to copy (or copy & migrate) from one pool to two or more other pools. Or am I missing something? Is there any deeper technical reason for such a limitation [except that nobody needed this before, so it was just never anticipated] ? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "I can call spirits from the vasty deep." "Why so can I, or so can any man; but will they come when you do call for them?" - Shakespeare, 1 King Henry IV, Act III, Scene I. -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape-to-tape copy job?
Dear Dan, thanks a lot for your reply. In message you wrote: > > I can show you what I did with backup to disk, then copy to tape. > > Copy from tape to tape is just repeating again. > > http://www.freebsddiary.org/bacula-disk-to-tape.php > http://www.freebsddiary.org/bacula-disk-to-tape-via-sql.php Thanks, that was really helpful. > > - Pool / Next Pool settings: I can define a "TEMP" pool for the > > temporary disk copies, but I'd like to have both the old, original > > backups and their copies on the new media in the same (archive) > > pool. How would I use this with "Next Pool"? > > Next Pool indicates the pool that the jobs should be copied to. The > originals remain. Can I overwrite thissetting, for example in the Job definition? The setup I'm targeting for now is this: 1) Backup to disk 2) in somewhat larger intervals, copy the jobs to tape (for off-site archival) 3) in somewhat shorter intervals, migrate the jobs to tape (for regular storage) For this to work, the pool for the jobs on disk would need two separate "next pool" seetings - one for the regular migration to tape, and another for for copying to the archive tapes. Can this be done? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Systems programmers are the high priests of a low cult. -- R.S. Barton -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] wanted on DEVICE-0, is in use by device DEVICE-1
Dear Stephen Thompson,
In message <50982f94.10...@seismo.berkeley.edu> you wrote:
> On 11/05/2012 01:17 PM, Josh Fisher wrote:
> >
> > On 11/5/2012 11:03 AM, Stephen Thompson wrote:
...
> > When you start the jobs manually, I assume you are starting them at
> > different times. This works, because the first job is up and running
> > with the volume loaded before the second job begins its selection
> > process. One way to handle this issue is to have a different Schedule
> > for each job and start the jobs at different times with one second
> > spacing. Jobs will still run concurrently, they just won't start up
> > concurrently.
>
> I suspected something like that, but would ask out loud "if bacula runs
> into a contention like that and there are other available volumes in the
> requested pool, why doesn't it decide to use another volume instead of
> blocking?"
I'm not sure about this. I see very similar problems when trying to
use the second drive for other purposes, like labelling new tapes,
while a job is running on the first one, like this:
*label dummy pool=ARCH storage=LTOLIB drive=1 slots=25 barcodes
Connecting to Storage daemon LTOLIB at ltos.denx.de:9103 ...
3306 Issuing autochanger "slots" command.
Device "LTO3-0" has 48 slots.
Connecting to Storage daemon LTOLIB at ltos.denx.de:9103 ...
3306 Issuing autochanger "list" command.
The following Volumes will be labeled:
Slot Volume
==
25 SAV000L3
Do you want to label these Volumes? (yes|no): yes
Connecting to Storage daemon LTOLIB at ltos.denx.de:9103 ...
Sending label command for Volume "SAV000L3" Slot 25 ...
3937 Device ""LTO3-0" (/dev/tape/by-id/scsi-35000e11802947001-nst)" is busy
with writers=1 reserved=0.
Label command failed for Volume SAV000L3.
with:
Device {
Name = LTO3-0
Media Type = LTO-3
Archive Device = /dev/tape/by-id/scsi-35000e11802947001-nst
AutomaticMount = yes; # when device opened, read it
AlwaysOpen = yes;
RemovableMedia = yes;
RandomAccess = no;
Maximum File Size = 5GB
Maximum Block Size = 512K
Changer Command = "/usr/libexec/bacula/mtx-changer %c %o %S %a %d"
Changer Device = /dev/tape/by-id/scsi-1BDT_FlexStor_II_00DE64100465_LL0
AutoChanger = yes
# Enable the Alert command only if you have the mtx package loaded
Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
# If you have smartctl, enable this, it has more info than tapeinfo
# Alert Command = "sh -c 'smartctl -H -l error %c'"
# Spool Data to disk before writing to tape
Spool Directory = /backup/spool
Maximum Spool Size = 5120GB
Maximum Job Spool Size = 5120GB
}
Device {
Name = LTO3-1
Media Type = LTO-3
Archive Device = /dev/tape/by-id/scsi-35000e11802947004-nst
AutomaticMount = yes; # when device opened, read it
AlwaysOpen = yes;
RemovableMedia = yes;
RandomAccess = no;
Maximum File Size = 5GB
Maximum Block Size = 512K
Changer Command = "/usr/libexec/bacula/mtx-changer %c %o %S %a %d"
Changer Device = /dev/tape/by-id/scsi-1BDT_FlexStor_II_00DE64100465_LL0
AutoChanger = yes
# Enable the Alert command only if you have the mtx package loaded
# Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
# If you have smartctl, enable this, it has more info than tapeinfo
Alert Command = "sh -c 'smartctl -H -l error %c'"
# Spool Data to disk before writing to tape
Spool Directory = /backup/spool
Maximum Spool Size = 5120GB
Maximum Job Spool Size = 5120GB
}
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
Drawing on my fine command of language, I said nothing.
--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_nov
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Tape-to-tape copy job?
Hello, I'm in the process of migrating to a more recent tape storage technology. In the end, I would like to dump all the old tapes and drives, but there are a number of backups that have to be kept. My idea was to define a pair of copy & migrate jobs - first a copy job to read the backups from the old tapes to disk, followed by a migrate job to move them to the new tapes. Does such a procedure make sense, or are there more straightforward ways for such re-shuffling from one set of storage media to another one? Are there any example setups doing similar things? I have to admit that I have hard times coming up with a configuration to do what I have in mind - there are a number of areas where I don't really know what to do: - Pool / Next Pool settings: I can define a "TEMP" pool for the temporary disk copies, but I'd like to have both the old, original backups and their copies on the new media in the same (archive) pool. How would I use this with "Next Pool"? - Selection Type: This appears to be especially hard. Actually I don't want to define a real schedule for this stuff, but rather run this interactively on the console. Ideally selection would be done by a list of JobIDs; alternatively by a list of volume names (meaning to copy all jobs stored on these volumes), or so. I see the "Volume" and "Job" Selection Types in the documentation, which appear to be just what I'm looking for, but how can I set this up to provide such information interactively on the console command line? Any help welcome, thanks in advance. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Microsoft Compatibility: your old Windows 3.11 application crash exactly as the new ones. -- LogMeIn Central: Instant, anywhere, Remote PC access and management. Stay in control, update software, and manage PCs from one command center Diagnose problems and improve visibility into emerging IT issues Automate, monitor and manage. Do more in less time with Central http://p.sf.net/sfu/logmein12331_d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Summary - Tweak SCSI negotiation settings
In message <20121018190231.ebda7204...@gemini.denx.de> I wrote: > > I see very poor performance with HP Ultrium LTO3 drive, which is > attached over SCSI to a Linux box (using a Adaptec 2940 Ultra SCSI > adapter). It seems I cannot get more than about 8.8 MBytes/s for > either writing to or reading from the drive. The comments I received supported my suspicon that the limiting actor might be the old SCSI adapter. I switched to a LSI Logic / Symbios Logic 53c1010 66MHz Ultra3 SCSI Adapter on the hardware side, and experimented a bit with the block size, confirming earlier postings here that this should be chosenin the 1024 ... 2048 KiB range. With this setup I get now sustained data rates of 55...59 MiB/sec for uncompressible data, and data rates varying between 80...140 MiB/sec for compressible data. Thanks! Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de When some people discover the truth, they just can't understand why everybody isn't eager to hear it. -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tweak SCSI negotiation settings
Dear Carsten, In message <508056a2.3020...@tomse.dk> you wrote: > an Adaptec 2940 is usually only a SCSI-II device with 10MB/Sec > > the 2940UW performs 40MB/sec > these are maximum bus transfers It's the 2940UW... > pressing CTRL-A when the SCSI bios tells you to, you should be able to > set transferspeeds to 40MB/sec in one of the menues. > though performance will still be bad. As mentioned before, I did that. The SCSI BIOS is set to 40MB/sec, but the Linux driver appears to see different results: ... > > Target 5 Negotiation Settings > > User: 40.000MB/s transfers (20.000MHz, offset 127, 16bit) > > Goal: 10.000MB/s transfers (10.000MHz, offset 15) > > Curr: 10.000MB/s transfers (10.000MHz, offset 15) > replacing the SCSI host adapter to the Adaptec Ultra 160 or 320 models > will give a much better performance, the 2940 is from last millenia Agreed. Thanks for confirming my suspicion that I should start by replacing the SCSI adapter. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de As far as the laws of mathematics refer to reality, they are not cer- tain, and as far as they are certain, they do not refer to reality. -- Albert Einstein -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Tweak SCSI negotiation settings
Hello, apologies in advance - this may be a bit off topic, but I guess I find most experts for such a problem on this list... I see very poor performance with HP Ultrium LTO3 drive, which is attached over SCSI to a Linux box (using a Adaptec 2940 Ultra SCSI adapter). It seems I cannot get more than about 8.8 MBytes/s for either writing to or reading from the drive. Looking around, I see this information in /proc/scsi/aic7xxx/3 : ... Target 5 Negotiation Settings User: 40.000MB/s transfers (20.000MHz, offset 127, 16bit) Goal: 10.000MB/s transfers (10.000MHz, offset 15) Curr: 10.000MB/s transfers (10.000MHz, offset 15) Channel A Target 5 Lun 0 Settings Commands Queued 20 Commands Active 0 Command Openings 1 Max Tagged Openings 4 Device Queue Frozen Count 0 ... Am I understanding this correctly that the SCSI adapter is set to 10 MB/s transfers only? That would certainly expolain the transfer rates I'm observing... Is there any way to tweak these settings in Linux? I alreay checked in the SCSI adapter's BIOS settings, but there are no indications for auch a limitation. [Yes, I am aware that the Adaptec 2940 is not exactly new. But I should get more than 8.8 MB/s out of it, should I not?] Any help welcome. Thanks in advance. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de If the odds are a million to one against something occuring, chances are 50-50 it will. -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] parallelizing jobs
Dear Mark, In message <3158.1333653400@localhost> you wrote: > > => I wonder why I see situations that a client is waiting for another job > => to complete, that is only despooling, i. e. that does not block any > => resources on the client: > > This has been discussed several times. Check the list archives for "concurrent > spooling": > > https://www.google.com/search?q=bacula+mailing+list+concurrent+spooling I'm not sure if this is the same problem. In my case, there is actualy no concurrency. The job on the client has terminated, the client says it is running no jobs at this time. Only SD and DIR are still processing this job. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "An open mind has but one disadvantage: it collects dirt." - a saying at RPI -- For Developers, A Lot Can Happen In A Second. Boundary is the first to Know...and Tell You. Monitor Your Applications in Ultra-Fine Resolution. Try it FREE! http://p.sf.net/sfu/Boundary-d2dvs2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] parallelizing jobs
Dear John Drescher, In message you wrote: > > >> Do you have any restrictions on how many jobs go per volume? > > > > No. > > Is the same volume used by both clients? I mean you are not using a > different pool per client or something like that? All these jobs use the same pool, so both jobs and thus both clients will use the same volume. There are other jobs running in parallel, too (but not as many as to run into the max job limit). Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de The only perfect science is hind-sight. -- For Developers, A Lot Can Happen In A Second. Boundary is the first to Know...and Tell You. Monitor Your Applications in Ultra-Fine Resolution. Try it FREE! http://p.sf.net/sfu/Boundary-d2dvs2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] parallelizing jobs
Dear John Drescher, In message you wrote: > > Do you have any restrictions on how many jobs go per volume? No. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de What is research but a blind date with knowledge? -- Will Harvey -- Better than sec? Nothing is better than sec when it comes to monitoring Big Data applications. Try Boundary one-second resolution app monitoring today. Free. http://p.sf.net/sfu/Boundary-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] parallelizing jobs
Hi, I wonder why I see situations that a client is waiting for another job to complete, that is only despooling, i. e. that does not block any resources on the client: 53100 Increme SD despooling Data 53101 Increme is waiting on max Client jobs This is with bacula 5.0.3 as distributed with Fedora 15. Settings: - in FD and SD: Maximum Concurrent Jobs = 20 - in Job: Maximum Concurrent Jobs = 6 - in Client:Maximum Concurrent Jobs = 1 I am aware that I'm limiting the number of jobs on the client to 1, and this is intentional. But the "SD despooling Data" is something that involves the DIR and the SD only, so it should not block the client from starting the next backup job. Seems I'm missing something here. Any ideas are highly welcome. Thanks in advance. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Severe culture shock results when experts from another protocol suite [...] try to read OSI documents. The term "osified" is used to refer to such documents. [...] Any relationship to the word "ossified" is purely intentional.- Marshall T. Rose -- Better than sec? Nothing is better than sec when it comes to monitoring Big Data applications. Try Boundary one-second resolution app monitoring today. Free. http://p.sf.net/sfu/Boundary-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems with Jumbo packets?
Dear Bill, In message <4f0728e7.7050...@revpol.com> you wrote: > > A quick (non-bacula) way to test is to ssh from one machine to the other and > run a find / command or something that will generate similar amount of output. > If jumbo frames are not enabled on the whole path, then this output will > appear to "just hang" and you will no longer have connectivity to the system. > > It is also possible that some of the NICs in your servers are not properly > supporting the higher MTU that you are setting. Indeed it appears I have to look deeper into the NIC / driver side of things. Thanks for all the advice. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de An expert is a person who avoids the small errors while sweeping on to the grand fallacy. -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems with Jumbo packets?
Dear Frank Sweetser, In message <4f0722a4.5090...@wpi.edu> you wrote: > > Are all of the machines on the same subnet? If not, you'll also have to check > the MTU on all of your local router interfaces. Yes, they are all in the same net, and all on the same switch. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Quote from the Boss after overriding the decision of a task force he created to find a solution: "I'm sorry if I ever gave you the impression your input would have any effect on my decision for the outcome of this project!" -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems with Jumbo packets?
Dear Alexandre, In message <4f072790.9060...@horoa.net> you wrote: > > Some Network card are supposed to "support" Jumbo frames but not as high > value as 9000 octets. > I remember I had issues with some broadcom NIC that couldn't go further > than 7200. > Maybe you could take a look at the NIC on the impacted hosts Yes, I do have some of these, too. But these are easy to spot as they don't accept larger MTU's: # ifconfig eth0 mtu 9000 SIOCSIFMTU: Invalid argument # ifconfig eth0 mtu 7200 # Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Applying computer technology is simply finding the right wrench to pound in the correct screw. -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Problems with Jumbo packets?
Hello, I know that this is not exactly related to Bacula, but maybe some other user has seen similar behaviour. I have problems when trying to enable support for jumbo frames on the network. All NICs and switches are supposed to support that, however on some systems the communication of the FD to the SD stops as soon as I change on the FD the MTU from the default of 1500 to a higher value (9000). The MTU on the DIR and SD can be set to 9000 without visible impact on bacula. Funny thing is that this happens not on all systems. Does this ring a bell somewhere? Thanks in advance. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de This restaurant was advertising breakfast any time. So I ordered french toast in the renaissance.- Steven Wright, comedian -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Linux: backup and restore of file capabilities ?
Dear Marco, In message <4f030530.7050...@planets.elm.net> you wrote: > > But I think I have found the problem. > > First of all we have a snarfu due to fixing bug #1610 see > > http://bugs.bacula.org/view.php?id=1806 ... > http://bugs.bacula.org/view.php?id=1807 > > I need to think how we are going to solve that. I understand the problem is located, and no further testing on my side is needed? Thanks. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "...one of the main causes of the fall of the Roman Empire was that, lacking zero, they had no way to indicate successful termination of their C programs." - Robert Firth -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Linux: backup and restore of file capabilities ?
Dear Marco, I wrote: > > So I would say give the xattr=yes a go on your install and see > > if it works for these attributes. You could create a test fileset > > with a known file with a posix file capability and run the bacula-fd > > with a debug level of 100 and watch for xattr save messages. > > Done that, but I could not see any. The log file is available here: ftp://ftp.denx.de/pub/tmp/log.gz Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "They that can give up essential liberty to obtain a little temporary saftey deserve neither liberty not saftey." - Benjamin Franklin, 1759 -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Linux: backup and restore of file capabilities ?
Dear Marco,
In message you wrote:
>
> > It appears that bacula does not save, and thus cannot restore, such
> > file capabilities.
> >
> Thats not really true. I did some searching on google to find out
> how these so called POSIX file capabilities are implemented.
> Its also quite new code it went into Linux 2.6.24 in may last year or so.
Hm... v2.6.24 is four years old... Maybe you mean v2.6.34,
and May 2010?
> Yup add acl = yes and xattr = yes to your fileset and you should
> be set to backup most of the future options. Bacula is one of
Hm... I have these settings in the FileSet definition:
Include {
Options {
signature = MD5
xattrsupport = yes
aclsupport = yes
}
File = /usr/bin
}
When restoring, the file attributes were lost anyway.
Is there any other place I need to give extra options? When
restoring?
> the few Open Source backup products (probably the only)
> which has very broad support for all these kind of exotic
> acl's, extended attributes and extensible attributes. I had to
> write everything from scratch as no other projects address all
> know interfaces. So we are quite good in doing the exotic stuff.
Guess why I've been using bacula for so long...
And btw: thanks :-)
> We already found out that Novell uses extended attributes for
> storing additional access control lists on there NSS filesystem.
> And those also backup and restore fine with the generic xattr code.
I'm just a user of bacula, no developer of it, so I don't care much
about the implementation or the interface. As long as the
functionality is present and working I'm fine with it.
> > Note that this is probably a bigger problem - it appears that
> > neither cpio nor tar nor rsync etc. can deal with file capabilities.
> > At the moment I don't know how to create a 100% correct backup of a
> > plain vanilla Linux root filesystem...
> >
> If you look at the linked webpage you will see that rsync and cpio
> have support for extended attributes and that is used to copy these
> posix file capabilities.
In the linked PDF file I cannot find a reference to cpio or rsync.
But rsync does indeed work as needed when using -X. Sorry, I missed that.
The cpio in Fedora 16 does not appear to support this.
> So I would say give the xattr=yes a go on your install and see
> if it works for these attributes. You could create a test fileset
> with a known file with a posix file capability and run the bacula-fd
> with a debug level of 100 and watch for xattr save messages.
Done that, but I could not see any.
This is with bacula as distributed with Fedora 16, most recent
updates installed:
bacula-client-5.0.3-13.fc16.x86_64
bacula-common-5.0.3-13.fc16.x86_64
bacula-console-5.0.3-13.fc16.x86_64
bacula-console-bat-5.0.3-13.fc16.x86_64
bacula-director-common-5.0.3-13.fc16.x86_64
bacula-director-mysql-5.0.3-13.fc16.x86_64
bacula-docs-5.0.3-13.fc16.x86_64
bacula-storage-common-5.0.3-13.fc16.x86_64
bacula-storage-mysql-5.0.3-13.fc16.x86_64
Anything ales I could look for?
Thanks in advance.
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
Punishment becomes ineffective after a certain point. Men become in-
sensitive.
-- Eneg, "Patterns of Force", stardate 2534.7
--
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Linux: backup and restore of file capabilities ?
A number of tools in recent Linux distributions (say, Fedora 16) rely on file capabilities for correct operation. For example, "rlogin" willonly work for regular uses when the "cap_net_bind_service" capability is set: -> getcap -v /usr/bin/rlogin /usr/bin/rlogin = cap_net_bind_service+ep Without this capability, non-root users will only get: -> rlogin rcmd: socket: Permission denied It appears that bacula does not save, and thus cannot restore, such file capabilities. The result is that any restore of a root file system will have a (usually unknown) number of files that don't work correctly any more. I searched the mailing list archives and the documentation, but could not find any reference to dealing with file capabilities. Am I missing something? Is there a way to perform "correct" backups under Linux, i. e. to backup and be able to restore things like ACLs and especially file capabilities? If not, are there any plans to add such a feature? Note that this is probably a bigger problem - it appears that neither cpio nor tar nor rsync etc. can deal with file capabilities. At the moment I don't know how to create a 100% correct backup of a plain vanilla Linux root filesystem... :-( Happy new year, btw... Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "I can call spirits from the vasty deep." "Why so can I, or so can any man; but will they come when you do call for them?" - Shakespeare, 1 King Henry IV, Act III, Scene I. -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] st: from_buffer offset overflow. - I/O Error
Dear Tobias Dinse, In message <4df88a7d.1020...@stegbauer.info> you wrote: > > still the same Kernel and I/O Error: > > > Jun 14 14:26:10 xx kernel: [451873.506638] st0: Can't allocate > 199 byte tape buffer. Why are you trying to allocate a 2 MB buffer for your tape driver? Bacula will write in 63 KiB blocks, so you should never need that much. What does your /etc/stinit.def look like? [Or where else do you configure your tape driver to use such buffers?] Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "Deliver yesterday, code today, think tomorrow." -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Cancel Multiple Jobs
Dear "Rodrigo Ferraz",
In message <002001cc2ac7$bc860520$35920f60$@gmail.com> you wrote:
>
> Is there a way to cancel multiple running Jobs with bconsole?
Use the shell...
> Select Job:
> 1: JobId=1271 Job=Backup-fs01.2011-06-14_15.54.55_04
> 2: JobId=1272 Job=Backup-mx01.2011-06-14_15.54.58_05
> 3: JobId=1273 Job=Backup-db01.2011-06-14_15.55.00_06
> 4: JobId=1274 Job=Backup-srv02.2011-06-14_15.55.03_07
> 5: JobId=1275 Job=BackupCatalog.2011-06-14_15.55.07_08
>
> Choose Job to cancel (1-5): *
for i in 127{1..5} ; do echo cancel JobId=$i ; done | bconsole
Best regards,
Wolfgang Denk
--
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
Emotions are alien to me. I'm a scientist.
-- Spock, "This Side of Paradise", stardate 3417.3
--
EditLive Enterprise is the world's most technically advanced content
authoring tool. Experience the power of Track Changes, Inline Image
Editing and ensure content is compliant with Accessibility Checking.
http://p.sf.net/sfu/ephox-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula stalls after 2.5 TB
Dear John Acar, In message <9f3ac5511e192548bc1d06fd1bc1ef8306f5453...@gsoc-bb01.treas.local> you wrote: > I have a job running right now. It seems to be in the "stalled" state. Then don't stop it. Analyze what's going on. > status client > > Shows no data counter changes. > >Backup Job started: 02-Dec-10 09:32 > Files=1,215 Bytes=1,040,342,163,456 Bytes/sec=39,869,018 Errors> =0 > Files Examined=1,215 > Processing file: /firewall/mysql/archive/sdw_sw/sw_20090916.tar > SDReadSeqNo=5 fd=5 > > Though bytes/s is going down > > The file does not seem to be open so I am at a loss of what is going on with > some of these files. Why do you think the file seems not to be open? What sort of system is the client? If it's Linux or similar, you can probably get a lot information by - checking the /proc/*/fd entries for the file daemon - attaching with strace to the file deamon to see what it's doing - attaching with a debugger to see what it's doing etc. Even a simple test like running a "ps" to show which processes are actually running (and eventually consuming CPU) is helpful. Also check if you have software compression enabled in your setup. My speculation is still that this might be a sparse file (eventually unintentionally, like after disk errors) and you consume the time compressing a zillion of null bytes or similar. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de Of course there's no reason for it, it's just our policy. -- Oracle to DB2 Conversion Guide: New IBM DB2 features make compatibility easy. Learn about native support for PL/SQL, new data types, scalar functions, improved concurrency, built-in packages, OCI, SQL*Plus, data movement tools, best practices and more - all designed to run applications on both DB2 and Oracle platforms. http://p.sf.net/sfu/oracle-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula stalls after 2.5 TB
Dear John Acar, In message <9f3ac5511e192548bc1d06fd1bc1ef8306f5453...@gsoc-bb01.treas.local> you wrote: > > I am running Bacula 3.0.2 (Mysql) on Centos 4.8. I have a Spectra T380 > changer with 50 tape slots. I need to archive about 7 TB of data. The first > time I attempted to back it up, the job stalled on 2.559TB and errored out. > I figured it might be the > drive i used since I have had trouble with that drive so I used drive-2. The > job stopped at precisely the same spot but I did not get any errors. Bacula > still thinks the job is running. Are you sure it really stops? How long did you wait? > Running Jobs: > JobId 440 Job TNET.2010-11-30_09.39.39_08 is running. > Backup Job started: 30-Nov-10 09:39 > Files=1,229 Bytes=2,559,801,067,520 Bytes/sec=24,701,351 Errors=0 > Files Examined=1,229 > Processing file: /firewall/mysql/archive/sdw_netflow/netflow_20100430.tar > SDReadSeqNo=5 fd=5 > Director connected at: 01-Dec-10 14:26 repeat the "status dir" command a fw times. Are any of the counters (Files, Bytes, Files Examined) and the file name changing? What does "status storage" report? Can you see or hear if the tape drive is active? What does a "ls -l /firewall/mysql/archive/sdw_netflow/netflow_20100430.tar" on that system show? Is there any chance that this is a sparse file with (big) holes (eventually even unintentionally, like after some error in a RAID)? Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de "One planet is all you get." -- Increase Visibility of Your 3D Game App & Earn a Chance To Win $500! Tap into the largest installed PC base & get more eyes on your game by optimizing for Intel(R) Graphics Technology. Get started today with the Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs. http://p.sf.net/sfu/intelisp-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] change tape status while backups are running
Dear Phil Stracchino, In message <4c06c4c7.3030...@metrocast.net> you wrote: > On 06/02/10 16:28, Jesse Angell wrote: > > Is there some way I can force it to move onto the next tape mid-backup? > > Why would you want to do that? Frankly, I'm having trouble imagining a > scenario in which you'd need to do this that cannot be handled better > by fixing the Pool settings. Here is one example: Assume I have a big backup job running on Friday afternoon, and I realize it's writing on the last tape in the library; it may take hours to fill that tape, and I don't want to wait that long. On the other hand, I don't want to job to stall until Monday when the tape finally fills up. If it was possible to signal a "tape full" condition, I could enforce the insertion of a new magazine. Best regards, Wolfgang Denk -- DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de If something is different, it's either better or worse, and usually both.- Larry Wall -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
