Re: [Bacula-devel] Unneeded database index

2013-08-16 Thread Kern Sibbald
On 08/16/2013 08:40 PM, Jason A. Kates wrote: > I love Bacula and we run it using mysql. We have noticed some real > jumps in speed moving to a more current release of mysql. That is nice to hear. I guess that Oracle may be pushing a little bit of their high end technology back to MySQL, which

Re: [Bacula-devel] Unneeded database index

2013-08-16 Thread Jason A. Kates
I love Bacula and we run it using mysql. We have noticed some real jumps in speed moving to a more current release of mysql. (You may have some dependency issues as bacula-enterprise doesn't like the mysql with the caps in the RPM name) but it's worth it in terms of the speed. It looks like

Re: [Bacula-devel] Unneeded database index

2013-08-16 Thread azurIt
>What modification did you do at your my.conf ? key_buffer_size = 16M max_allowed_packet = 1M thread_stack= 256K thread_cache_size = 8 innodb_buffer_pool_size = 512M table_open_cache= 1 open-files-limit= 5 query_cache_limit = 1M query_c

Re: [Bacula-devel] Unneeded database index

2013-08-16 Thread Kern Sibbald
My own database is 2G. But in testing Bacula I tested backups of 10 Million files, which is a relatively large number for a single backup, but really big backups range from 20 Million to 40 Million files. My personal database was MySQL for something like 12 years, but for the last couple I have

Re: [Bacula-devel] Unneeded database index

2013-08-16 Thread stefano scotti
That is a really large database :) What modification did you do at your my.conf ? The performance issues are only during inserting or even during selecting? Have you got concurrent jobs? What's your hardware configuration? I'm particularly interested in hard drives bus, rpm and raid settings.

Re: [Bacula-devel] Unneeded database index

2013-08-16 Thread Kern Sibbald
Oh, I must have missed the part about 7 million files. In that case, you will need a well tuned DB, and personally, I would use Postgres. 5 hours seems to me much too long for the insert. I am sure that DB tuning will make a big difference -- maybe as much as a factor of 10. Kern On 08/16/2013

Re: [Bacula-devel] Unneeded database index

2013-08-16 Thread azurIt
Hi, i'm not using unmodified MySQL configuration. My Bacula database has about 21 GB and i'm mainly having problems with inserting into File table after the virtual full backup of our e-mail server. Job has more then 7 000 000 of files and insert takes about 5 hours. Just to explain why i'm sea

Re: [Bacula-devel] Unneeded database index

2013-08-16 Thread Kern Sibbald
Hello, Thanks for your question. I have asked my database expert who says the same as I do but more in detail. I will include his response below. Bottom line: we have spent a long time determining the best indexes for Bacula, which are the ones we release in the code, so we do not recommend mak

[Bacula-devel] Unneeded database index

2013-08-16 Thread azurIt
Hi, i'm having some MySQL performance difficulties so i started to search what can i do better. My table 'File' had these indexes created: CREATE INDEX file_jobid_idx on File (JobId); CREATE INDEX file_jpf_idx on File (JobId, PathId, FilenameId); Which looks correct according to documentation: h