Re: [Bacula-users] Windows Bat Version Browser problems
> Time to test the rc1 which can be found here > > http://sourceforge.net/projects/bacula/files/Win32_64/5.2.0rc1/ > Is that compatible with a 5.0.X director? John -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows Bat Version Browser problems
On 10/13/2011 05:32 PM, John Drescher wrote: > On Thu, Oct 13, 2011 at 11:31 AM, John Drescher wrote: >>> I've seen that there was a reported problem regarding version browser in >>> Windows version of Bat. Is there a way, with the latest version, to >>> browse the files correctly with Windows so that the users who have to >>> navigate through the file listing in order to do a restore? What is the >>> latest release of bat for Windows, anyway? >> >> 5.0.3. And its over a year old. >> > > Unless you crosscompile a development build on linux with mingw > > John > Time to test the rc1 which can be found here http://sourceforge.net/projects/bacula/files/Win32_64/5.2.0rc1/ -- Bruno Friedmann Ioda-Net Sàrl www.ioda-net.ch openSUSE Member & Ambassador GPG KEY : D5C9B751C4653227 irc: tigerfoot -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] seeking advice re. splitting up large backups -- dynamic filesets to prevent duplicate jobs and reduce backup time
> On Wed, 12 Oct 2011 21:58:28 -0400, mark bergman said: > > => If you limited the maximum jobs on the FD it would only run one at once, > > That doesn't work, as we backup ~20 small machines in addition to the large (4 > to 8TB) filesystems. Assuming you mean ~20 separate client machines (File Daemons), then you can set Maximum Concurrent Jobs in the director's config for the large client. In fact, the default is 1, so it is surprising that you get concurrency unless you've already increased it. __Martin -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows Bat Version Browser problems
> I've seen that there was a reported problem regarding version browser in > Windows version of Bat. Is there a way, with the latest version, to > browse the files correctly with Windows so that the users who have to > navigate through the file listing in order to do a restore? What is the > latest release of bat for Windows, anyway? 5.0.3. And its over a year old. John -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] seeking advice re. splitting up large backups -- dynamic filesets to prevent duplicate jobs and reduce backup time
> In an effort to work around the fact that bacula kills long-running > jobs, I'm about to partition my backups into smaller sets. For example, > instead of backing up: Since we may end up having jobs that run for more than 6 days, I was pretty curious to see where in the code (release 5.0.3) this insanity check was happening. Looking at your previous thread's error message, I was able to track down these checks to the jcr_timeout_check routine in jcr.c. But after a brief look at the code it looks to me like this only occurs if the socket connection is essentially stuck and no read/writes are occurring over it (thus the reason Kern probably labeled it an insanity check). This explains why other folks have said that they do have jobs that have run > 6 days. Are you actually seeing an active job (i.e. it's in the middle of writing data from the client when it's killed)? Could it be that it is in the middle of de-spooling a very large job (and/or waiting for operator intervention) and that is when this occurs? I could see that happening since no traffic is flowing over the connection to the client but the job is still active thus the client connection probably is as well. In any event, if you have access to the source code (5.0.3 - which is what I'm looking at) and are comfortable making changes to it then I believe all you need to do is change line 75 in lib/bsock.c and line 687 in lib/bnet.c to something longer than 6 days. This may be simpler than re-working your entire backup scheme to avoid the issue. --tom -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows Bat Version Browser problems
On Thu, Oct 13, 2011 at 11:31 AM, John Drescher wrote: >> I've seen that there was a reported problem regarding version browser in >> Windows version of Bat. Is there a way, with the latest version, to >> browse the files correctly with Windows so that the users who have to >> navigate through the file listing in order to do a restore? What is the >> latest release of bat for Windows, anyway? > > 5.0.3. And its over a year old. > Unless you crosscompile a development build on linux with mingw John -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] multiple spool files per job
Il 13/10/2011 15:16, Alan Brown ha scritto: > Marcello Romani wrote: > >> Hmmm... sounds like the perfect candidate for a paid enterprise >> feature request. I belive the creators of Bacula would be happy to >> hear from you. > > I looked into this earlier this year. > > Bacula Enterprise subscriptions are several _thousand_ euro per year, > which is simply too much for us (and I daresay most academic sites). > > I'm not sure why Kern has priced this out of the reach of most > organisations who'd be willing to pay 500-900 euro/year. > > > I've never looked closely at their pricing, since we're a small shop and are doing reasonably well on our own so far, but if the prices are all-or-nothing in the range of thousands of dollars per year, as you write, then yes, I agree with you there's a gap in their support offering. Or maybe there are other companies offering bacula support / consulting which are able to fill this gap (as I'd expect with an opensource enterprise-grade software)... (ok I'll stop here since I've got nothing more to add than my own speculations :-) -- Marcello Romani -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Windows Bat Version Browser problems
Hi, I have version bat 5.0.3 for Windows installed, and I can't show all of the directories that are backed up. However, I can see them all in the Linux version. I've seen that there was a reported problem regarding version browser in Windows version of Bat. Is there a way, with the latest version, to browse the files correctly with Windows so that the users who have to navigate through the file listing in order to do a restore? What is the latest release of bat for Windows, anyway? A very good backup program without a good restore tool (in Windows, I know, but hey, the dark side exists) is a little less useful. Thanks, -- Christian Tardif -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Filling Database Table - very slow
Thanks for the info guys. I decided to start over from scratch with the server (running Suse Server 11 BTW). Batch insert was NOT on before (it is now) and I used the InnoDB specs below. The restore process is 1000 times faster now. THANK YOU! Version browser is still a bit slow if picking an entire directory, but I can't really see using that to restore an entire structure anyway. Just a few files. So again, thanks for your help! :) >>> Brian Debelius 10/11/2011 11:09 AM >>> Hi, I have a 5GB database. The server has 6GB RAM. These are the settings I am using right now. default-storage-engine=innodb default-table-type=innodb query_cache_limit=16M query_cache_size=256M innodb_log_file_size=384M innodb_buffer_pool_size=3G innodb_log_buffer_size=2M innodb_flush_log_at_trx_commit=2 Your mileage may vary, Brian- On 10/11/2011 8:04 AM, Jarrod Holder wrote: Bacula version 5.0.3 In BAT, when trying to restore a directory (roughly 31,000 files in 560 sub folders) The "Filling Database Table" takes an extremely long time to complete (about an hour or so). I've been looking around for a way to speed this up. Found a post on here that referred to an article that basically said PostgreSQL was the way to go as far as speed (http://wiki.bacula.org/doku.php?id=faq#restore_takes_a_long_time_to_retrieve_sql_results_from_mysql_catalog). So I converted from MySQL to PostgreSQL using the conversion procedure in the Bacula documentation. We are now on PostgreSQL, but the speed seems just as slow (if not slower). Is there anything else that can be done to speed this process up? I've also tried the running the DB under MySQL with MyISAM and InnoDB tables. Both had the same slow performance here. With MySQL, I also tried using the my-large.cnf and my-huge.cnf files. Neither helped. Server load is very low during this process (0.06). BAT process is at about 3% cpu and 1.6% memory. Postgres service is about 1%cpu, 0.6% memory. Drive array is pretty quiet also. Any help would be greatly appreciated. If any extra info is needed, I will gladly provide it. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense.http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing listBacula-users@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/bacula-users -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] multiple spool files per job
Marcello Romani wrote: > Hmmm... sounds like the perfect candidate for a paid enterprise feature > request. I belive the creators of Bacula would be happy to hear from you. I looked into this earlier this year. Bacula Enterprise subscriptions are several _thousand_ euro per year, which is simply too much for us (and I daresay most academic sites). I'm not sure why Kern has priced this out of the reach of most organisations who'd be willing to pay 500-900 euro/year. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] multiple spool files per job
Il 13/10/2011 11:51, Stefan Lubitz ha scritto: > Hi, > > this feature would be really great. We have three Backup serves which all > have single Jobs to backup (each job app. 13TB). > The Time to despool is absolutely waste of time and could be used more > efficient. This feature request is more than 4 Years old and still not > implemented. > Maybe I am wrong and I am sorry to say this, but as the data volume is > growing all the time and this feature is still missing, I've got a notion > that Bacula is not anymore "up to date" or state of the art. > > Regards, > Stefan > Hmmm... sounds like the perfect candidate for a paid enterprise feature request. I belive the creators of Bacula would be happy to hear from you. Just a hint... -- Marcello Romani -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] batch script in Windows causes job to fail
No batching experts? :) Should the script do something else than "exit 0"? -- Silver On 12.10.2011 11:05, Silver Salonen wrote: > Hi. > > A job of Windows-client is set to execute a .bat file after the job. The > .bat script is smth like: > del /Q /F C:\Accounting\Backup\*.TXT > del /Q /F C:\Accounting2\Backup\*.TXT > exit 0 > > For every day there is 1 .TXT file in both folders and the files are > about 150 MB in total. > But this script causes the job to fail (only sometimes, in half cases, > I'd say) with error: > > 05-Oct 01:02 mybacula-dir JobId 45922: Fatal error: Network error with FD > during Backup: ERR=Connection reset by peer > 05-Oct 01:02 mybacula-dir JobId 45922: Fatal error: No Job status returned > from FD. > > After I disabled execution of the script, the job has not failed. > > Any ideas, why is that? -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] multiple spool files per job
On 13.10.2011 11:51, Stefan Lubitz wrote: > Hi, > > this feature would be really great. We have three Backup serves which all > have single Jobs to backup (each job app. 13TB). > The Time to despool is absolutely waste of time and could be used more > efficient. This feature request is more than 4 Years old and still not > implemented. > Maybe I am wrong and I am sorry to say this, but as the data volume is > growing all the time and this feature is still missing, I've got a notion > that Bacula is not anymore "up to date" or state of the art. as with any opensource tool you are free to send in code which enables the feature. or hire somebody to write it for you and the community. or buy the bacula enterprise version and tell them you really need the concurrent spooling/despooling feature. - Thomas > James Harper wrote: >> Is there a way to make bacula write multiple spool files per job? Two >> would do. What I'm seeing is that 4 jobs start, all hit their spool >> limit around the same time, then all wait in a queue until the file is >> despooled. The despool happens fairly quickly (much quicker than the >> spooling due to network and server fd throughput) so it isn't a huge >> problem, but it would be better if the sd could just switch over to >> another spool file when despooling starts so that the backup can >> continue uninterrupted. > > I believe this is in the todo list, but it will happen faster if someone > submits already-written code. > -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] multiple spool files per job
Hi, this feature would be really great. We have three Backup serves which all have single Jobs to backup (each job app. 13TB). The Time to despool is absolutely waste of time and could be used more efficient. This feature request is more than 4 Years old and still not implemented. Maybe I am wrong and I am sorry to say this, but as the data volume is growing all the time and this feature is still missing, I've got a notion that Bacula is not anymore "up to date" or state of the art. Regards, Stefan -Ursprüngliche Nachricht- Von: Alan Brown [mailto:a...@mssl.ucl.ac.uk] Gesendet: Montag, 10. Oktober 2011 13:00 An: James Harper Cc: bacula-users@lists.sourceforge.net Betreff: Re: [Bacula-users] multiple spool files per job James Harper wrote: > Is there a way to make bacula write multiple spool files per job? Two > would do. What I'm seeing is that 4 jobs start, all hit their spool > limit around the same time, then all wait in a queue until the file is > despooled. The despool happens fairly quickly (much quicker than the > spooling due to network and server fd throughput) so it isn't a huge > problem, but it would be better if the sd could just switch over to > another spool file when despooling starts so that the backup can > continue uninterrupted. I believe this is in the todo list, but it will happen faster if someone submits already-written code. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] seeking advice re. splitting up large backups --dynamic filesets to prevent duplicate jobs and reduce backup time
From: James Harper [mailto:james.har...@bendigoit.com.au] > > In an effort to work around the fact that bacula kills long-running jobs, I'm > about to partition my backups into smaller sets. For example, instead of > backing up: > > /home > > I would like to backup the content of /home as separate jobs. For example: > Have you thought of a script that creates links to a backup directory split into the groups you want? Run the linking script to link /home/[0-9]* to /backup/0-9/, /home/[A-G]* to /backup/A-G, etc. > /home/[0-9]* > /home/[A-G]* > /home/[H-M]* > /home/[N-Q]* > /home/[R-U]* > /home/[V-Z]* > /home/[a-g]* > /home/[h-m]* > /home/[n-q]* > /home/[r-u]* > /home/[v-z]* > > I'm looking for advice for how prevent multiple jobs of different names, that > access the same client, from running simultaneously. For example, to > prevent an incremental of job "home0-9" running at the same time as a full > of job "homeA-G". > > The only method I can think of is to use a dynamic fileset in the director to > generate the different filesets, so that there's only a single named job that > backs up a different set of files on each full backup. This way the "Allow > Duplicate Jobs" setting can be effective. > Does Bacula really kill long running jobs? Or are you seeing the effect of something at layer 3 or below (eg TCP connections timing out in firewalls)? I think your dynamic fileset idea would break Bacula's 'Accurate Backup' code. If you are not using Accurate then it might work but it still seems like a lot of trouble to go to to solve this problem. If you limited the maximum jobs on the FD it would only run one at once, but if the link was broken it might fail all the jobs. Another option would be a "Run After" to start the next job. Only the first job would be scheduled, and it would run the next job in turn. Then they would all just run in series. You could even take it a step further and have the "Run After" script to retry the same job if it failed due to a connection problem, and to give up after so many retries. Maybe it could even start pinging the FD to see if it was reachable (if backing up over an unreliable link is the problem you are trying to solve). James -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct http://www.lifestylegroup.co.uk/ http://www.linkedin.com/company/39206 This e-mail is confidential and only intended for the named recipient. If you are not the intended recipient please notify the sender immediately by phone or email. Please then delete it from your system. Any opinions are those of the author and do not necessarily represent those of Lifestyle Services Group Ltd. Please note that this e-mail and any attachments have not been encrypted. They may therefore be liable to be compromised. We do not accept any liability for any virus infection, external compromise of security or confidentiality in relation to e-mails. Lifestyle Services Group Limited (LSG) is a company registered in England and Wales No. 5114385 and is authorised and regulated by the Financial Services Authority in respect of insurance mediation activities. Registered Office: Osprey House, Ore Close, Lymedale Business Park, Newcastle-under-Lyme, Staffordshire ST5 9QD. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
