Re: [Bacula-users] critical error -- tape labels get corrupted, previous backups unreadable
In the message dated: Tue, 24 Jan 2012 14:30:44 PST, The pithy ruminations from Steve Ellis on were: => On 1/24/12 2:22 PM, mark.berg...@uphs.upenn.edu wrote: => > In the message dated: Tue, 24 Jan 2012 19:09:15 GMT, => > The pithy ruminations from Martin Simmons on => > => > => > Thanks for replying. => > => > => > > ps unreadable> were: => > => > On Mon, 23 Jan 2012 18:47:31 -0500, mark bergman said: => > => > => > => > I'm experiencing a critical problem where tape labels on volumes with data => > => > get corrupted, leaving all data on the tape inaccessible to bacula. => > => > => > => > I'm running bacula 5.2.2 built from source, under Linux (CentOS 5.7 => > => > x86_64). => > => > => > => > This problem has happened with approximately 15 tapes over approximately 6 => > => > months, mostly new LTO-4 media, but some LTO-3 media that's being reused. => > => > The problem is sporadic, appearing in approximately 1 out of 60 tapes => > => > per week. => > => > => > => > I do not think the issue is related to the physical media or the tape => > => > drives. One tape was last written successfully when in drive 0, then appears => > => > corrupt when a later job tries to use is in drive 1. Another tape was last => > => > written successfully when in drive 1, then appears corrupt when a later job => > => > tries to use it in drive 0. => > => => > => Why do think it isn't a hardware problem? => > => => > => > I don't think it's a hardware problem because: => > => >the vast majority of tape access (read or write) doesn't result => >in corrupted labels => > => >there aren't SCSI, tape, or bacula errors reported during backups => >(within Bacula, the OS, or the tape library console) => > => >the tapes are readable--though the data is not usable by bacula => > => >the problem occurs on tapes that have been written and read in => >both drives (this doesn't rule out some common element in the => >tape library) => > => Perhaps someone else already suggested this and I missed it--this looks => like somehow the tapes were rewound behind bacula's back--could that => explain the behavior you are seeing? Thanks for suggesting this. I appreciate the feedback. Yeah, it would explain the symptom, but if I understand it correctly, this would require: bacula loads a tape with a valid label writes N backup jobs to the tape "something" rewinds the tape bacula writes to the beginning of the tape, corrupting the label (but believing the job to be successful) bacula unloads the tape at some later point, bacula loads the tape for another job and cannot read the label It is difficult to think of a scenario where "something rewinds" but does not unload the tape. We don't have any software other than bacula that reads/writes from tape. Attempts to access the tape drives (not the autochanger) manually with 'mt' while bacula-sd is running are blocked as bacula-sd has a lock on the tape devices. It is possible to use "mtx" to unload tapes from the drives while bacula is running, and I believe that unloading an LTO tape implies that it is rewound. However, I can't think of any scenario where a tape is unloaded without updating the "in changer" flag in the database, and where "update slots" is not called after the tape is unloaded, and where bacula tries to append to the same tape, and where the tape is loaded without triggering an attempt to read the label, and the 'append' therefore overwrites the beginning of the tape...but maybe that's possible. I may just change the bacula-dir and bacula-sd init scripts to call mtx-changer and unload all drives before starting either daemon. This would help ensure consistency, regardless of which daemon starts first or is later restarted. Thanks, Mark => -se => -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] SCSI Errors
On Mon, Jan 23, 2012 at 6:17 PM John Drescher wrote: > Bad tape? Drive need cleaned? I completed btape fill and unfill without errors. I cleaned the drive and will see whether that resolves the issue. Any other ideas? Nikola Lazic -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] critical error -- tape labels get corrupted, previous backups unreadable
On 1/24/12 2:22 PM, mark.berg...@uphs.upenn.edu wrote: > In the message dated: Tue, 24 Jan 2012 19:09:15 GMT, > The pithy ruminations from Martin Simmons on > > > Thanks for replying. > > > backu > ps unreadable> were: > => > On Mon, 23 Jan 2012 18:47:31 -0500, mark bergman said: > => > > => > I'm experiencing a critical problem where tape labels on volumes with > data > => > get corrupted, leaving all data on the tape inaccessible to bacula. > => > > => > I'm running bacula 5.2.2 built from source, under Linux (CentOS 5.7 > => > x86_64). > => > > => > This problem has happened with approximately 15 tapes over > approximately 6 > => > months, mostly new LTO-4 media, but some LTO-3 media that's being > reused. > => > The problem is sporadic, appearing in approximately 1 out of 60 tapes > => > per week. > => > > => > I do not think the issue is related to the physical media or the tape > => > drives. One tape was last written successfully when in drive 0, then > appears > => > corrupt when a later job tries to use is in drive 1. Another tape was > last > => > written successfully when in drive 1, then appears corrupt when a > later job > => > tries to use it in drive 0. > => > => Why do think it isn't a hardware problem? > => > > I don't think it's a hardware problem because: > > the vast majority of tape access (read or write) doesn't result > in corrupted labels > > there aren't SCSI, tape, or bacula errors reported during backups > (within Bacula, the OS, or the tape library console) > > the tapes are readable--though the data is not usable by bacula > > the problem occurs on tapes that have been written and read in > both drives (this doesn't rule out some common element in the > tape library) > Perhaps someone else already suggested this and I missed it--this looks like somehow the tapes were rewound behind bacula's back--could that explain the behavior you are seeing? -se -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] critical error -- tape labels get corrupted, previous backups unreadable
In the message dated: Tue, 24 Jan 2012 19:09:15 GMT,
The pithy ruminations from Martin Simmons on
Thanks for replying.
were:
=> > On Mon, 23 Jan 2012 18:47:31 -0500, mark bergman said:
=> >
=> > I'm experiencing a critical problem where tape labels on volumes with data
=> > get corrupted, leaving all data on the tape inaccessible to bacula.
=> >
=> > I'm running bacula 5.2.2 built from source, under Linux (CentOS 5.7
=> > x86_64).
=> >
=> > This problem has happened with approximately 15 tapes over approximately 6
=> > months, mostly new LTO-4 media, but some LTO-3 media that's being reused.
=> > The problem is sporadic, appearing in approximately 1 out of 60 tapes
=> > per week.
=> >
=> > I do not think the issue is related to the physical media or the tape
=> > drives. One tape was last written successfully when in drive 0, then
appears
=> > corrupt when a later job tries to use is in drive 1. Another tape was last
=> > written successfully when in drive 1, then appears corrupt when a later job
=> > tries to use it in drive 0.
=>
=> Why do think it isn't a hardware problem?
=>
I don't think it's a hardware problem because:
the vast majority of tape access (read or write) doesn't result
in corrupted labels
there aren't SCSI, tape, or bacula errors reported during backups
(within Bacula, the OS, or the tape library console)
the tapes are readable--though the data is not usable by bacula
the problem occurs on tapes that have been written and read in
both drives (this doesn't rule out some common element in the
tape library)
=> Bacula only looks at the label when a volume is mounted, so it could be
=> written unsuccessfully but you wouldn't know that until later.
Interesting... thanks for bringing this up...I'm checking the logs
(which only go back to early Dec) to see if any of the corrupted tapes
got unloaded, reloaded and then written to successfully
[pause]
Some of the tapes that are not corrupt have gone through multiple
load/unload cycles for different jobsso the act of reloading a tape in
order to append new jobs does not always cause corruption in the label.
The initial label (via "label barcodes", assigning the tape to the
Scratch pool) must be valid, or bacula would detect the corruption
when it later loads the tape and uses is for its first job.
Does bacula actually relabel a tape with a working pool (Full,
Incremental, or Archive), or will it continue to have the pool name
(Scratch) that was assigned during "label barcodes"?
I'm also going to load all the other tapes in the changer and
check their labels with btape and dump.
[pause]
Done. I loaded, dumped the first ~640MB from the tape, and used 'btape' to
read the label from each tape in the changer (35). There were no I/O errors,
all tapes were 'readable', though 4 have corrupt labels.
=>
=>
=> > Here are the log records for a particular volume. It was labeled about
=> > Dec 22, 2011. First used on Jan 4 2012. Used successfully for 10 jobs
=> > (350.49GB), then the label was corrupted.
=> >
=> > --
=> > 04-Jan 06:24 sbia-infr-vbacula JobId 42676: Using Volume "004090" from
'Scratch' pool.
=> > 04-Jan 06:25 sbia-infr-vbacula JobId 42676: Wrote label to prelabeled
Volume "004090" on devic
What does "Wrote label to prelabeled Volume" mean, exactly? Should the label
be changed from when it was first written with "label barcodes"?
The labels on new tapes that have been used but are not corrupted show a pool
of "Scratch". However, the database shows that those tapes have been used for
jobs in the working pools (Full, Incremental, Archive). For example, the
database shows that volume 004056 is 'full', has ~1513GB of data from 4
backups, and
is in the "Full" pool, but the label shows the pool as "Scratch".
It appears that:
label barcodes successfully labels a tape and puts it into the Scratch
pool
when the tape is first used, bacula logs the message "Wrote
label to prelabed Volume", but the label is not updated ('btape
readlabel' reports Scratch), and jobs can be written to the tape
at some time the label on some tapes gets corrupted
when the tape is reloaded, bacula detects the corruption
=> e "ml6000-drv1" (/dev/tape1-ml6000)
=> > 04-Jan 06:25 sbia-infr-vbacula JobId 42676: New volume "004090" mounted on
device "ml6000-drv1
=> " (/dev/tape1-ml6000) at 04-Jan-2012 06:25.
=>
=> Is /dev/tape1-ml6000 a non-rewinding device (like /dev/nst0)?
Yes, so successive writes to the same tape without unloading should
append.
The tape hardware consists of 2x LTO-4 drives in a 40 slot Dell ML6000
(rebranded Adic) changer.
=>
=>
=> > At this point, the volume 004090 is unusable. Running 'btape' on that
volume reports
=> >
=> > [root@sbia-infr1 working]# ../bin/btape -v ml6000-drv0
=> > Tape block granularity is 1024 bytes.
=>
Re: [Bacula-users] critical error -- tape labels get corrupted, previous backups unreadable
> On Mon, 23 Jan 2012 18:47:31 -0500, mark bergman said: > > I'm experiencing a critical problem where tape labels on volumes with data > get corrupted, leaving all data on the tape inaccessible to bacula. > > I'm running bacula 5.2.2 built from source, under Linux (CentOS 5.7 > x86_64). > > This problem has happened with approximately 15 tapes over approximately 6 > months, mostly new LTO-4 media, but some LTO-3 media that's being reused. > The problem is sporadic, appearing in approximately 1 out of 60 tapes > per week. > > I do not think the issue is related to the physical media or the tape > drives. One tape was last written successfully when in drive 0, then appears > corrupt when a later job tries to use is in drive 1. Another tape was last > written successfully when in drive 1, then appears corrupt when a later job > tries to use it in drive 0. Why do think it isn't a hardware problem? Bacula only looks at the label when a volume is mounted, so it could be written unsuccessfully but you wouldn't know that until later. > Here are the log records for a particular volume. It was labeled about > Dec 22, 2011. First used on Jan 4 2012. Used successfully for 10 jobs > (350.49GB), then the label was corrupted. > > -- > 04-Jan 06:24 sbia-infr-vbacula JobId 42676: Using Volume "004090" from > 'Scratch' pool. > 04-Jan 06:25 sbia-infr-vbacula JobId 42676: Wrote label to prelabeled Volume > "004090" on device "ml6000-drv1" (/dev/tape1-ml6000) > 04-Jan 06:25 sbia-infr-vbacula JobId 42676: New volume "004090" mounted on > device "ml6000-drv1" (/dev/tape1-ml6000) at 04-Jan-2012 06:25. Is /dev/tape1-ml6000 a non-rewinding device (like /dev/nst0)? > At this point, the volume 004090 is unusable. Running 'btape' on that volume > reports > > [root@sbia-infr1 working]# ../bin/btape -v ml6000-drv0 > Tape block granularity is 1024 bytes. > btape: butil.c:290 Using device: "ml6000-drv0" for writing. > 23-Jan 18:14 btape JobId 0: 3301 Issuing autochanger "loaded? drive 0" > command. > 23-Jan 18:14 btape JobId 0: 3302 Autochanger "loaded? drive 0", result is Slot > 9. > btape: btape.c:477 open device "ml6000-drv0" (/dev/tape0-ml6000): OK > *readlabel > btape: btape.c:526 Volume has no label. > > Volume Label: > Id: **error**VerNo : 0 > VolName : > PrevVolName : > VolFile : 0 > LabelType : Unknown 0 > LabelSize : 0 > PoolName : > MediaType : > PoolType : > HostName : > Date label written: -4712-01-01 at 00:00 > > > > > > However, there _is_ data on the tape. I'm able to read the tape via dd > (ibs=64k). The ASCII data at the beginning of the tape shows fragments of the > Bacula label and data that corresponds to some of the backups: The output of od -tx1 /tmp/vol4090.header | head -n 40 might be useful, to see why Bacula rejects it. __Martin -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Director and FD versions question
> > I have a director still at 5.0.3, and a few new clients coming up. > > Should I use the current version (5.2.4) on these FDs, or should I > > keep them on 5.0.3 until the director has been upgraded? > > > > Vennlige hilsener / Best regards > > > > It's always recommended that the director version = SD version and > both of these are greater than or equal to the FD versions. Thanks a bunch - guess I'll keep to 5.0.3 until the director and SDs are upgraded, then... Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Have we reached bacula's limits?
On 24/01/12 17:08, John Drescher wrote: > I believe it meant that with bacula prior to 5.2.X you had to compile > in your db choice (sqlite, postgresql,mysql) and could not change that > choice at runtime. Now with 5.2 You can mix and match and have more > than 1 catalog. 1: You can only define one database server in bacula-dir 2: You can have as many catalogs on that server as you want. 3: No matter which database engine you choose, as the table sizes increase it will perform badly unless tuned properly. Different engines suit different loads but until the size and load factor of bacula's requirements gets _large_ the differences are largely academic, so people should go with what they're comfortable with. 4: Changing between mysql/postgres is irritating but as long as dumps are done in proper compatibility mode, relatively painless (I have around 350 million files in my databases. Tuned Postgres vs tuned Mysql has measurable performance/memory differences. With only 20 million files onboard the differences are negligable) There are advantages and disadvantages to a monolithic catalog. This is a matter of personal taste. 5: Splitting up a monolithic catalog set takes a fair amount of patience. FWIW I have multiple catalog sets: a: Servers and support gear (daily machine backups) b: Fileserver cluster1 backups (100Tb or so) c: Fileserver 2 backups (~200Tb) d: Desktop hardware This is mainly done for political and dump/restore size reasons. There's very little performance/memory difference between running them all monolithically or separate.) 6: Poolsets are per-catalog. 1 pool cannot service multiple catalogs. (the data about what's on which tape is per-catalog) 7: Bacula scales to limits which would blow most people's minds - well beyond most COTS (commercial off the shelf) software and past every other OSS package I'm aware of. -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Have we reached bacula's limits?
On Tue, Jan 24, 2012 at 12:00 PM, Marcello Romani wrote: > Il 24/01/2012 17:43, Xabier Elkano ha scritto: >> El 24/01/12 17:02, Marcello Romani escribió: >>> Il 24/01/2012 12:21, Xabier Elkano ha scritto: >>> >>> [snip] >>> > I'm just thinking out loud, but I don't see how having a catalog for > each client can help you scale, since you can't put them on different db > servers. You'd probably have a higher ROI by upgrading the DBMS hardware > and/or migrating to postgres and/or throwing some (consultancy) money at > tuning. > > Just my 2 cents. Why not? If I want I can put each catalog on different db servers, each catalog has its own db config. But this is not the idea, I want to put all catalogs on the same db server but trying to keep tables as small as possible to reduce IOs on db server, because is the server bottleneck now. I can upgrade my server hardware, putting more memory or cpu, but my problem is on disks handling these table sizes. >> May be, I've not explained it very well :-) >> >> Now, I can't grow my bacula installation without installing another >> director to distribute the clients, because using only one catalog, its >> database is too big and restores are becoming impossibles to do. >> >> So, I am currently testing two catalogs (with two databases) in same >> director and it is working fine (but, yes implies more stuff to do). >>> For the record: >>> >>> "Currently, Bacula can only handle a single database server" >> >> I think that this sentence is only explaining that if you have compiled >> bacula to use mysql, you can only use mysql as db server (and not >> postgresql), but you can use as many mysql servers as you want to >> storage your catalogs. >> > > So what is the correct meaning of that sentence ? Only tests will tell :-) > I believe it meant that with bacula prior to 5.2.X you had to compile in your db choice (sqlite, postgresql,mysql) and could not change that choice at runtime. Now with 5.2 You can mix and match and have more than 1 catalog. John -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Have we reached bacula's limits?
Il 24/01/2012 17:43, Xabier Elkano ha scritto: > El 24/01/12 17:02, Marcello Romani escribió: >> Il 24/01/2012 12:21, Xabier Elkano ha scritto: >> >> [snip] >> I'm just thinking out loud, but I don't see how having a catalog for each client can help you scale, since you can't put them on different db servers. You'd probably have a higher ROI by upgrading the DBMS hardware and/or migrating to postgres and/or throwing some (consultancy) money at tuning. Just my 2 cents. >>> Why not? If I want I can put each catalog on different db servers, each >>> catalog has its own db config. But this is not the idea, I want to put >>> all catalogs on the same db server but trying to keep tables as small as >>> possible to reduce IOs on db server, because is the server bottleneck >>> now. I can upgrade my server hardware, putting more memory or cpu, but >>> my problem is on disks handling these table sizes. >>> > May be, I've not explained it very well :-) > > Now, I can't grow my bacula installation without installing another > director to distribute the clients, because using only one catalog, its > database is too big and restores are becoming impossibles to do. > > So, I am currently testing two catalogs (with two databases) in same > director and it is working fine (but, yes implies more stuff to do). >> For the record: >> >> "Currently, Bacula can only handle a single database server" > > I think that this sentence is only explaining that if you have compiled > bacula to use mysql, you can only use mysql as db server (and not > postgresql), but you can use as many mysql servers as you want to > storage your catalogs. > So what is the correct meaning of that sentence ? Only tests will tell :-) -- Marcello Romani -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Have we reached bacula's limits?
El 24/01/12 17:02, Marcello Romani escribió: > Il 24/01/2012 12:21, Xabier Elkano ha scritto: > > [snip] > >>> I'm just thinking out loud, but I don't see how having a catalog for >>> each client can help you scale, since you can't put them on different db >>> servers. You'd probably have a higher ROI by upgrading the DBMS hardware >>> and/or migrating to postgres and/or throwing some (consultancy) money at >>> tuning. >>> >>> Just my 2 cents. >> Why not? If I want I can put each catalog on different db servers, each >> catalog has its own db config. But this is not the idea, I want to put >> all catalogs on the same db server but trying to keep tables as small as >> possible to reduce IOs on db server, because is the server bottleneck >> now. I can upgrade my server hardware, putting more memory or cpu, but >> my problem is on disks handling these table sizes. >> May be, I've not explained it very well :-) Now, I can't grow my bacula installation without installing another director to distribute the clients, because using only one catalog, its database is too big and restores are becoming impossibles to do. So, I am currently testing two catalogs (with two databases) in same director and it is working fine (but, yes implies more stuff to do). > For the record: > > "Currently, Bacula can only handle a single database server" I think that this sentence is only explaining that if you have compiled bacula to use mysql, you can only use mysql as db server (and not postgresql), but you can use as many mysql servers as you want to storage your catalogs. > > therefore you can't put different catalogs on different db servers. > > Also: > > "In the current implementation, there is only a single Director > resource, but the final design will contain multiple Directors to > maintain index and media database redundancy." > > so now bacula is limited to a single director which connects to a single > database server. > > So it seems the only way to spread the load of a huge db onto multiple > servers is to exploit the load balancing and replication feature of the > db server. > > These 2 cents of mine are based on my understanding of the docs :-) > -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Have we reached bacula's limits?
Il 24/01/2012 12:21, Xabier Elkano ha scritto: [snip] >> I'm just thinking out loud, but I don't see how having a catalog for >> each client can help you scale, since you can't put them on different db >> servers. You'd probably have a higher ROI by upgrading the DBMS hardware >> and/or migrating to postgres and/or throwing some (consultancy) money at >> tuning. >> >> Just my 2 cents. > > Why not? If I want I can put each catalog on different db servers, each > catalog has its own db config. But this is not the idea, I want to put > all catalogs on the same db server but trying to keep tables as small as > possible to reduce IOs on db server, because is the server bottleneck > now. I can upgrade my server hardware, putting more memory or cpu, but > my problem is on disks handling these table sizes. > For the record: "Currently, Bacula can only handle a single database server" therefore you can't put different catalogs on different db servers. Also: "In the current implementation, there is only a single Director resource, but the final design will contain multiple Directors to maintain index and media database redundancy." so now bacula is limited to a single director which connects to a single database server. So it seems the only way to spread the load of a huge db onto multiple servers is to exploit the load balancing and replication feature of the db server. These 2 cents of mine are based on my understanding of the docs :-) -- Marcello Romani -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Have we reached bacula's limits?
Hi folks, thanks to your hints and ideas the restore times have been reduced from 3-4 hours to about five minutes (building the directory tree, that is). Lesson learnt: Before complaining loudly to the list, make sure your db is in good health by administering a generous dosage of "repair table" statements in mysql even if the database itself reports that all is just fine and dandy. Turned out the File table had some errors which seem to have gone undetected. 8-P I also used the opportunity to kick out mysql for good and replace it with MariaDB 5.2 which helped improve dir build times even further, even without having to tweak any special my.cnf settings or exporting / importing to InnoDB or some other storage backen. I had wanted to do this ever since listening to the recent interview with Monty Widenius on "FLOSS Weekly". All the best & thanks again for your help, Uwe -- NIONEX --- Ein Unternehmen der Bertelsmann AG -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Will Bacula be faster with Two Tape Devices?
Thanks for the reply, John. I'll give it a go. The spooling will be on RAID 10, so I won't get the performance of RAID 0, but we will see how it goes. Cheers, Bryan On Mon, 2012-01-23 at 17:59 -0500, John Drescher wrote: > > But will this speed up my backups? Generally speaking, should Bacula be > > able to write two the two tapes devices more quickly than it can write > > to one? The unit in question is a Tandberg Data StorageLibrary T24 LTO > > with two serial attached scsi LTO4 tape devices, attached to a server > > running Centos 6.2. > > It will not speed up a single job since 1 job can not use more than 1 > drive however if you have concurrent jobs with spooling and you can > provide enough bandwidth to keep up with the drives it can speed up > multiple jobs. Remember that at 2:1 compression these LTO4 drives > write at 120MB /s each so you will need to have a raid array (raid 0 > maybe) or fast SSD for your spool location and this raid probably > should not be on the same drives as your source data. > > John -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Have we reached bacula's limits?
On 01/24/2012 06:21 AM, Xabier Elkano wrote: > El 24/01/12 11:47, Marcello Romani escribió: >> I'm just thinking out loud, but I don't see how having a catalog for >> each client can help you scale, since you can't put them on different db >> servers. You'd probably have a higher ROI by upgrading the DBMS hardware >> and/or migrating to postgres and/or throwing some (consultancy) money at >> tuning. >> >> Just my 2 cents. > Why not? If I want I can put each catalog on different db servers, each > catalog has its own db config. But this is not the idea, I want to put > all catalogs on the same db server but trying to keep tables as small as > possible to reduce IOs on db server, because is the server bottleneck > now. I can upgrade my server hardware, putting more memory or cpu, but > my problem is on disks handling these table sizes. What my company does is run multiple Directors each with its own catalog DB. The catalog DBs share the same DB server though (running PostgreSQL). -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater It's not the years, it's the mileage. -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Director and FD versions question
On Tue, Jan 24, 2012 at 4:40 AM, Roy Sigurd Karlsbakk wrote: > Hi all > > I have a director still at 5.0.3, and a few new clients coming up. Should I > use the current version (5.2.4) on these FDs, or should I keep them on 5.0.3 > until the director has been upgraded? > > Vennlige hilsener / Best regards > It's always recommended that the director version = SD version and both of these are greater than or equal to the FD versions. John -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Director and FD versions question
Excerpts from Roy Sigurd Karlsbakk's message of Tue Jan 24 04:40:45 -0500 2012: Hi Roy, > I have a director still at 5.0.3, and a few new clients coming > up. Should I use the current version (5.2.4) on these FDs, or should > I keep them on 5.0.3 until the director has been upgraded? I asked this late last year and Dan Langille suggested[1] that the following should hold true: 1. dir version == sd version 2. fd version <= dir version HTH Thanks -Ben [1] http://sourceforge.net/mailarchive/message.php?msg_id=28531626 -- Ben Walton Systems Programmer - CHASS University of Toronto C:416.407.5610 | W:416.978.4302 -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] SQL Query: Total size of last success full backups
Hi Folks, I need to know how much disk space my full backups are in use for the last backup run. Thanks in advance, -- Isamar Maia Cel. VIVO SSA: (55) 71-9146-8575 Cel. TIM SSA: (55) 71-9185-5264 Fixo: (55) 71-4062-8688 日本: +81-(0)3-4550-1212 Skype ID: isamar.maia -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Have we reached bacula's limits?
El 24/01/12 11:47, Marcello Romani escribió: > Il 24/01/2012 11:18, Xabier Elkano ha scritto: >> El 24/01/12 10:49, Marcello Romani escribió: >>> Il 24/01/2012 10:05, Xabier Elkano ha scritto: El 23/01/12 16:28, Uwe Schuerkamp escribió: > DB Size: > Total clients:107 Total bytes stored: 34.41 TB > Total files: 47495362 Database size:31.64 GB Hi Uwe, I am having the same problem, backups are fast, but restores takes too long creating directory tree with bat. I have a lot of files to backup per client. I am using mysql with innodb engine, my File table is about 17GB on disk. My numbers: BytesPerJobAvg: 6539156346 ClientCount: 31 FileCount: 113286836 FileRetentionAvg: FilenameCount: 29713190 FilesPerJobAvg: 184213 JobRetentionAvg: PathCount: 6671143 TotalBytes: 1588763249151 TotalFiles: 44919364 First, I considered to create more bacula servers to separate clients on diferent databases, but now I am testing a configuration with one catalog per client. With this config, each client goes in separate db, It's more difficult to administer and setup it but I guess is the best way to scale the platform. Has anyone tried this config? Sorry for my bad english. Xabier -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users >>> You mean 31 catalogs ?! >>> >> Yes, now, I am only testing with two catalogs and it's working Ok, what >> are the downsides using this config? >> According to the documentation bacula supports it: >> >> " The Catalog Resource defines what catalog to use for the current job. >> Currently, Bacula can only handle a single database server (SQLite, >> MySQL, PostgreSQL) that is defined when configuring*Bacula*. However, >> there may be as many Catalogs (databases) defined as you wish. For >> example, you may want each Client to have its own Catalog database, or >> you may want backup jobs to use one database and verify or restore jobs >> to use another database." >> >> >> >> -- >> Keep Your Developer Skills Current with LearnDevNow! >> The most comprehensive online learning library for Microsoft developers >> is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, >> Metro Style Apps, more. Free future releases when you subscribe now! >> http://p.sf.net/sfu/learndevnow-d2d >> ___ >> Bacula-users mailing list >> Bacula-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/bacula-users > I'm just thinking out loud, but I don't see how having a catalog for > each client can help you scale, since you can't put them on different db > servers. You'd probably have a higher ROI by upgrading the DBMS hardware > and/or migrating to postgres and/or throwing some (consultancy) money at > tuning. > > Just my 2 cents. Why not? If I want I can put each catalog on different db servers, each catalog has its own db config. But this is not the idea, I want to put all catalogs on the same db server but trying to keep tables as small as possible to reduce IOs on db server, because is the server bottleneck now. I can upgrade my server hardware, putting more memory or cpu, but my problem is on disks handling these table sizes. -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Have we reached bacula's limits?
On Tue, 24 Jan 2012 11:47:51 +0100 Marcello Romani wrote: [...] > >> You mean 31 catalogs ?! > > Yes, now, I am only testing with two catalogs and it's working Ok, > > what are the downsides using this config? > > According to the documentation bacula supports it: > > > > " The Catalog Resource defines what catalog to use for the current > > job. Currently, Bacula can only handle a single database server > > (SQLite, MySQL, PostgreSQL) that is defined when > > configuring*Bacula*. However, there may be as many Catalogs > > (databases) defined as you wish. For example, you may want each > > Client to have its own Catalog database, or you may want backup > > jobs to use one database and verify or restore jobs to use another > > database." [...] > I'm just thinking out loud, but I don't see how having a catalog for > each client can help you scale, since you can't put them on different > db servers. You'd probably have a higher ROI by upgrading the DBMS > hardware and/or migrating to postgres and/or throwing some > (consultancy) money at tuning. > > Just my 2 cents. More catalogs also means more stuff to back up and keep track of. -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Have we reached bacula's limits?
Il 24/01/2012 11:18, Xabier Elkano ha scritto: > El 24/01/12 10:49, Marcello Romani escribió: >> Il 24/01/2012 10:05, Xabier Elkano ha scritto: >>> El 23/01/12 16:28, Uwe Schuerkamp escribió: DB Size: Total clients: 107 Total bytes stored: 34.41 TB Total files: 47495362 Database size:31.64 GB >>> Hi Uwe, >>> >>> I am having the same problem, backups are fast, but restores takes too >>> long creating directory tree with bat. I have a lot of files to backup >>> per client. I am using mysql with innodb engine, my File table is about >>> 17GB on disk. >>> >>> My numbers: >>> >>> BytesPerJobAvg: 6539156346 >>> ClientCount: 31 >>> FileCount: 113286836 >>> FileRetentionAvg: >>> FilenameCount: 29713190 >>> FilesPerJobAvg: 184213 >>> JobRetentionAvg: >>> PathCount: 6671143 >>> TotalBytes: 1588763249151 >>> TotalFiles: 44919364 >>> >>> First, I considered to create more bacula servers to separate clients on >>> diferent databases, but now I am testing a configuration with one >>> catalog per client. With this config, each client goes in separate db, >>> It's more difficult to administer and setup it but I guess is the best >>> way to scale the platform. Has anyone tried this config? >>> >>> Sorry for my bad english. >>> >>> Xabier >>> >>> >>> -- >>> Keep Your Developer Skills Current with LearnDevNow! >>> The most comprehensive online learning library for Microsoft developers >>> is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, >>> Metro Style Apps, more. Free future releases when you subscribe now! >>> http://p.sf.net/sfu/learndevnow-d2d >>> ___ >>> Bacula-users mailing list >>> Bacula-users@lists.sourceforge.net >>> https://lists.sourceforge.net/lists/listinfo/bacula-users >> You mean 31 catalogs ?! >> > > Yes, now, I am only testing with two catalogs and it's working Ok, what > are the downsides using this config? > According to the documentation bacula supports it: > > " The Catalog Resource defines what catalog to use for the current job. > Currently, Bacula can only handle a single database server (SQLite, > MySQL, PostgreSQL) that is defined when configuring*Bacula*. However, > there may be as many Catalogs (databases) defined as you wish. For > example, you may want each Client to have its own Catalog database, or > you may want backup jobs to use one database and verify or restore jobs > to use another database." > > > > -- > Keep Your Developer Skills Current with LearnDevNow! > The most comprehensive online learning library for Microsoft developers > is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, > Metro Style Apps, more. Free future releases when you subscribe now! > http://p.sf.net/sfu/learndevnow-d2d > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users I'm just thinking out loud, but I don't see how having a catalog for each client can help you scale, since you can't put them on different db servers. You'd probably have a higher ROI by upgrading the DBMS hardware and/or migrating to postgres and/or throwing some (consultancy) money at tuning. Just my 2 cents. -- Marcello Romani -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Have we reached bacula's limits?
El 24/01/12 10:49, Marcello Romani escribió: > Il 24/01/2012 10:05, Xabier Elkano ha scritto: >> El 23/01/12 16:28, Uwe Schuerkamp escribió: >>> DB Size: >>> Total clients: 107 Total bytes stored: 34.41 TB >>> Total files:47495362 Database size:31.64 GB >> Hi Uwe, >> >> I am having the same problem, backups are fast, but restores takes too >> long creating directory tree with bat. I have a lot of files to backup >> per client. I am using mysql with innodb engine, my File table is about >> 17GB on disk. >> >> My numbers: >> >> BytesPerJobAvg: 6539156346 >> ClientCount: 31 >> FileCount: 113286836 >> FileRetentionAvg: >> FilenameCount: 29713190 >> FilesPerJobAvg: 184213 >> JobRetentionAvg: >> PathCount: 6671143 >> TotalBytes: 1588763249151 >> TotalFiles: 44919364 >> >> First, I considered to create more bacula servers to separate clients on >> diferent databases, but now I am testing a configuration with one >> catalog per client. With this config, each client goes in separate db, >> It's more difficult to administer and setup it but I guess is the best >> way to scale the platform. Has anyone tried this config? >> >> Sorry for my bad english. >> >> Xabier >> >> >> -- >> Keep Your Developer Skills Current with LearnDevNow! >> The most comprehensive online learning library for Microsoft developers >> is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, >> Metro Style Apps, more. Free future releases when you subscribe now! >> http://p.sf.net/sfu/learndevnow-d2d >> ___ >> Bacula-users mailing list >> Bacula-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/bacula-users > You mean 31 catalogs ?! > Yes, now, I am only testing with two catalogs and it's working Ok, what are the downsides using this config? According to the documentation bacula supports it: " The Catalog Resource defines what catalog to use for the current job. Currently, Bacula can only handle a single database server (SQLite, MySQL, PostgreSQL) that is defined when configuring*Bacula*. However, there may be as many Catalogs (databases) defined as you wish. For example, you may want each Client to have its own Catalog database, or you may want backup jobs to use one database and verify or restore jobs to use another database." -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Have we reached bacula's limits?
Il 24/01/2012 10:05, Xabier Elkano ha scritto: > El 23/01/12 16:28, Uwe Schuerkamp escribió: >> DB Size: >> Total clients: 107 Total bytes stored: 34.41 TB >> Total files: 47495362 Database size:31.64 GB > Hi Uwe, > > I am having the same problem, backups are fast, but restores takes too > long creating directory tree with bat. I have a lot of files to backup > per client. I am using mysql with innodb engine, my File table is about > 17GB on disk. > > My numbers: > > BytesPerJobAvg: 6539156346 > ClientCount: 31 > FileCount: 113286836 > FileRetentionAvg: > FilenameCount: 29713190 > FilesPerJobAvg: 184213 > JobRetentionAvg: > PathCount: 6671143 > TotalBytes: 1588763249151 > TotalFiles: 44919364 > > First, I considered to create more bacula servers to separate clients on > diferent databases, but now I am testing a configuration with one > catalog per client. With this config, each client goes in separate db, > It's more difficult to administer and setup it but I guess is the best > way to scale the platform. Has anyone tried this config? > > Sorry for my bad english. > > Xabier > > > -- > Keep Your Developer Skills Current with LearnDevNow! > The most comprehensive online learning library for Microsoft developers > is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, > Metro Style Apps, more. Free future releases when you subscribe now! > http://p.sf.net/sfu/learndevnow-d2d > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users You mean 31 catalogs ?! -- Marcello Romani -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Director and FD versions question
Hi all I have a director still at 5.0.3, and a few new clients coming up. Should I use the current version (5.2.4) on these FDs, or should I keep them on 5.0.3 until the director has been upgraded? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Have we reached bacula's limits?
El 23/01/12 16:28, Uwe Schuerkamp escribió: > DB Size: > Total clients:107 Total bytes stored: 34.41 TB > Total files: 47495362 Database size:31.64 GB Hi Uwe, I am having the same problem, backups are fast, but restores takes too long creating directory tree with bat. I have a lot of files to backup per client. I am using mysql with innodb engine, my File table is about 17GB on disk. My numbers: BytesPerJobAvg: 6539156346 ClientCount: 31 FileCount: 113286836 FileRetentionAvg: FilenameCount: 29713190 FilesPerJobAvg: 184213 JobRetentionAvg: PathCount: 6671143 TotalBytes: 1588763249151 TotalFiles: 44919364 First, I considered to create more bacula servers to separate clients on diferent databases, but now I am testing a configuration with one catalog per client. With this config, each client goes in separate db, It's more difficult to administer and setup it but I guess is the best way to scale the platform. Has anyone tried this config? Sorry for my bad english. Xabier -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Have we reached bacula's limits?
On Mon, Jan 23, 2012 at 11:13:30AM -0500, Phil Stracchino wrote: > > If max_heap_table_size is 16M, then in-memory temporary tables are > limited to 16M too. Maximum in-memory temporary table size is the > smaller of tmp_table-size and max_heap_table_size. You only ever have a > single DB connection; why are you allowing 151 connections? > > Cut max_connections to 10, increase tmp_table_size and > max_heap_table_size to 64M or even 128M, increase table_cache to 64, > disable the query cache because you're going to have few if any > frequently-repeated queries, update to MySQL 5.5, and seriously, > seriously consider converting to InnoDB. It is a MUCH higher > performance storage engine than MyISAM. Remember that MyISAM was > designed to yield *acceptable* performance in shared installations on > machines with less than 32MB of RAM. > Hi Phil, thanks much for your tuning hints, I'll give them a go and will report back on how things work out. Cheers, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX --- Ein Unternehmen der Bertelsmann AG -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
