Re: [Bacula-users] File level deduplication

2015-04-27 Thread Kern Sibbald
Hello,

Actually, the Bacula Enterprise version has two different types of
deduplication.

1. Aligned Volumes -- special patented volume format that optimizes
deduplication that is done by the underlying deduplicating FS (e.g. ZFS,
Btrfs, ...).

2. Global End Point Deduplication -- build-in Bacula deduplication in
the SD as well as in the FD (configurable).

It is possible that the Aligned Volume plugin binary will be available
to the community later this year for free.

Best regards,
Kern

On 27.04.2015 09:01, Silver Salonen wrote:
 On 04/25/2015 11:09 PM, Alex Domoradov wrote:
 Hello

 Is there any chance to implement file level deduplication in bacula?
 Maybe some undocumented way/tricks. I know about base job, but it's
 not what I need. I have a lot of Wordpress instances (~2000) on my
 server and all these instances have 95% of same base files. The file
 level deduplication would be a great way to save space in the pool.

 Thanks in advance.
 Hi.

 It's not there for open-source edition of Bacula. Enterprise version has
 proper data de-duplication that's done even on client-side and
 everything. Haven't been hands-on with it though...

 --
 Silver

 --
 One dashboard for servers and applications across Physical-Virtual-Cloud 
 Widest out-of-the-box monitoring support with 50+ applications
 Performance metrics, stats and reports that give you Actionable Insights
 Deep dive visibility with transaction tracing using APM Insight.
 http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] using different fileset for Base job

2015-04-27 Thread Silver Salonen
On 04/24/2015 04:51 PM, Silver Salonen wrote:
 On 04/24/2015 04:43 PM, Eric Bollengier wrote:
 Hello,

 On 24/04/2015 15:23, Silver Salonen wrote:
 On 04/24/2015 01:13 PM, Eric Bollengier wrote:
 On 24/04/2015 11:43, Silver Salonen wrote:
 I did test it with 7.0.5 at latest. This restriction is actually that
 the restore does not include the files from Base job although it should.
 It also seems that somewhere the information is there because otherwise
 it wouldn't even try to restore those files.
 Can you be more specific? With a good catalog when you restore a job,
 files from a BaseJob are not restored? Or when you select the Base job
 with the restore menu you can't restore files?

 In my case the files were removed from catalog first (because of the low
 File Retention period) and then I restored them by bscanning both Full
 and Base backups.
 OK, so like I said, the current code doesn't support such scenario, with
 a recent version, you should be able to combine both jobs in a single
 restore session, choose your files and restore them, you will have all
 files, but you might restore too much files from the BaseJob.

 I will add a note in the manual on Base jobs and bscan.

 Best Regards,
 Eric
 I still wonder where does the current restore take its list of files
 though, ie. why does it try to even restore files from Base job if it
 doesn't use the Base job (by ID at least) for restoring.

 Shall I create a bug report for this or is this already a planned
 improvement of eg. bscan?

 --
 Silver

One more interesting finding...

I tried a new restore with the most recent backup. The restore
successfully used a Base job that was done on 22.Mar.2015 - the weird
bit here is that I had File Retention = 14 days before, so I actually
expected the restore to miss the Base job files again.

It seems that job's files are checked for pruning within the same job at
the same level?

--
Silver

--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] File level deduplication

2015-04-27 Thread Alex Domoradov
Ukraine

On Mon, Apr 27, 2015 at 9:32 PM, Kern Sibbald k...@sibbald.com wrote:

  Hello,

 Were are you and your company located?

 Best regards,
 Kern


 On 27.04.2015 16:52, Alex Domoradov wrote:

 Could anyone point me how much would be cost subscription for 30 servers?
 I can't find out any prices on the off site

 On Mon, Apr 27, 2015 at 2:24 PM, Raymond Burns Jr. rbur...@gmail.com
 wrote:

 I CAN'T WAIT UNTIL THAT IS AVAILABLE!  I'm so excited just thinking about
 it

 On Mon, Apr 27, 2015, 5:27 AM Kern Sibbald k...@sibbald.com wrote:

 Hello,

 Actually, the Bacula Enterprise version has two different types of
 deduplication.

 1. Aligned Volumes -- special patented volume format that optimizes
 deduplication that is done by the underlying deduplicating FS (e.g. ZFS,
 Btrfs, ...).

 2. Global End Point Deduplication -- build-in Bacula deduplication in
 the SD as well as in the FD (configurable).

 It is possible that the Aligned Volume plugin binary will be available
 to the community later this year for free.

 Best regards,
 Kern

 On 27.04.2015 09:01, Silver Salonen wrote:
  On 04/25/2015 11:09 PM, Alex Domoradov wrote:
  Hello
 
  Is there any chance to implement file level deduplication in bacula?
  Maybe some undocumented way/tricks. I know about base job, but it's
  not what I need. I have a lot of Wordpress instances (~2000) on my
  server and all these instances have 95% of same base files. The file
  level deduplication would be a great way to save space in the pool.
 
  Thanks in advance.
  Hi.
 
  It's not there for open-source edition of Bacula. Enterprise version
 has
  proper data de-duplication that's done even on client-side and
  everything. Haven't been hands-on with it though...
 
  --
  Silver
 
 
 --
  One dashboard for servers and applications across
 Physical-Virtual-Cloud
  Widest out-of-the-box monitoring support with 50+ applications
  Performance metrics, stats and reports that give you Actionable
 Insights
  Deep dive visibility with transaction tracing using APM Insight.
  http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
  ___
  Bacula-users mailing list
  Bacula-users@lists.sourceforge.net
  https://lists.sourceforge.net/lists/listinfo/bacula-users
 



 --
 One dashboard for servers and applications across Physical-Virtual-Cloud
 Widest out-of-the-box monitoring support with 50+ applications
 Performance metrics, stats and reports that give you Actionable Insights
 Deep dive visibility with transaction tracing using APM Insight.
 http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



 --
 One dashboard for servers and applications across Physical-Virtual-Cloud
 Widest out-of-the-box monitoring support with 50+ applications
 Performance metrics, stats and reports that give you Actionable Insights
 Deep dive visibility with transaction tracing using APM Insight.
 http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users




--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] my very first Windows client

2015-04-27 Thread Robert A Threet
Oh my gosh!  That worked.  Not sure why that wasn't intuiitive to me.  
Thanks!!  I feel better!  (I *do* have backups afterall!)

On Mon, 27 Apr 2015 15:33:18 -0300
Ana Emília M. Arruda emiliaarr...@gmail.com wrote:

 Hello Robert,
 
 Try this:
 
 $ ls
 C:/
 $ cd C:/
 cwd is: C:/
 
 
 Best regards,
 Ana
 
 On Mon, Apr 27, 2015 at 2:52 PM, Robert A Threet rober...@netzero.net
 wrote:
 
  I backed up a Windows client but the navigation in restore doesn't seem to
  work.
  Am I just doing it wrong or what?  It *says* it had data.
 
  Select the Client (1-11): 5
  Automatically selected FileSet: Windows 2000
 
  +---+---+--++-++
  | jobid | level | jobfiles | jobbytes   | starttime   |
  volumename |
 
  +---+---+--++-++
  |   285 | F |  181,979 | 22,097,177,794 | 2015-04-08 16:19:09 |
  23L6   |
  |   511 | D |3,175 |  4,784,492,699 | 2015-04-26 23:05:00 |
  39L6   |
 
  +---+---+--++-++
  You have selected the following JobIds: 285,511
 
  Building directory tree for JobId(s) 285,511 ...
  ++
  152,928 files inserted into the tree.
 
  You are now entering file selection mode where you add (mark) and
  remove (unmark) files to be restored. No files are initially added, unless
  you used the all keyword on the command line.
  Enter done to leave this mode.
 
  cwd is: /
  $ ls
  C:/
  $ cd Windows
  Invalid path given.
  cwd is: /
  $ cd System32
  Invalid path given.
  cwd is: /
  $ ls
  C:/
  $
 
  Terminated Jobs:
   JobId  LevelFiles  Bytes   Status   FinishedName
  ===
 389  Incr  1,1824.049 G  OK   17-Apr-15 23:13 GPS
 402  Incr2103.210 G  OK   18-Apr-15 23:11 GPS
 415  Diff  2,3345.083 G  OK   19-Apr-15 23:15 GPS
 428  Incr  1,1133.511 G  OK   20-Apr-15 23:12 GPS
 441  Incr2313.385 G  OK   21-Apr-15 23:12 GPS
 454  Incr1973.209 G  OK   22-Apr-15 23:11 GPS
 471  Incr1993.210 G  OK   23-Apr-15 23:12 GPS
 485  Incr1883.206 G  OK   24-Apr-15 23:13 GPS
 498  Incr1863.205 G  OK   25-Apr-15 23:12 GPS
 511  Diff  3,1754.784 G  OK   26-Apr-15 23:14 GPS
 
  bacula1-dir Version: 6.6.11 (11 August 2014)
  x86_64-redhat-linux-gnu-bacula-enterprise redhat Enterprise release
 
 
  --
  Robert A Threet rober...@netzero.net
  
  Protect what matters
  Floods can happen anywhere. Learn your risk and find an agent today.
  http://thirdpartyoffers.netzero.net/TGL3231/553e77737792877723dd5st04vuc
 
 
  --
  One dashboard for servers and applications across Physical-Virtual-Cloud
  Widest out-of-the-box monitoring support with 50+ applications
  Performance metrics, stats and reports that give you Actionable Insights
  Deep dive visibility with transaction tracing using APM Insight.
  http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
  ___
  Bacula-users mailing list
  Bacula-users@lists.sourceforge.net
  https://lists.sourceforge.net/lists/listinfo/bacula-users
 


-- 
Robert A Threet rober...@netzero.net

Old School Yearbook Pics
View Class Yearbooks Online Free. Search by School  Year. Look Now!
http://thirdpartyoffers.netzero.net/TGL3231/553e90e6b601f10e5652dst02vuc
--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] File level deduplication

2015-04-27 Thread Silver Salonen
On 04/25/2015 11:09 PM, Alex Domoradov wrote:
 Hello

 Is there any chance to implement file level deduplication in bacula?
 Maybe some undocumented way/tricks. I know about base job, but it's
 not what I need. I have a lot of Wordpress instances (~2000) on my
 server and all these instances have 95% of same base files. The file
 level deduplication would be a great way to save space in the pool.

 Thanks in advance.

Hi.

It's not there for open-source edition of Bacula. Enterprise version has
proper data de-duplication that's done even on client-side and
everything. Haven't been hands-on with it though...

--
Silver

--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Device is BLOCKED - renamed Bugged or not?

2015-04-27 Thread Kern Sibbald

  
  
Hello Ana,
  
  One of the big race conditions that is not yet solved, because it
  takes a major rewrite, that is waiting on me having some free time
  is the case where two jobs attempt to use the same drive at the
  same time for different Volumes.  This leads to a BLOCKED
  condition on one of the jobs until the other job finishes.
  
  The workaround for that problem is for jobs that can contend for
  the same drive but use different Volumes (pools), ensure that they
  do not all start at the same time.  That is if you start 50-100
  jobs at the same time, and there are 20 that run concurrently in
  the SD, then you increase the changes of a initial drive
  assignment conflict.
  
  If instead you start those jobs with 1-2 minute intervals, you
  will not have that particular issue.  Generally, it just requires
  slightly different schedules.
  
  Best regards,
  Kern
  
  On 27.04.2015 03:04, Ana Emília M. Arruda wrote:


  



  ​I'm glad to read so
good news. Thank you Kern.​




  ​I have been ​trying
to understand this issue that a Bacula user has been facing.
As Kern said, it is really difficult to replicate it. We
noticed that his backups worked fine for days and suddenly a
"DEVICE is blocked" appeared. Some details about his
configuration:



1)
  3 pools being used by 20 or more concurrent jobs;
2)
  an autochanger with 10 drives (to avoid interleaving, each
  device was configured with maximum concurrent jobs = 1)
3)
  jobs with different priorities and various scheduled times.
4)
  groups of jobs using different pools


He
  noticed that he was having issues with slot mess. That is,
  before his backups started, he had the output from mtx-changer
  listall showing the media/slots information as it was in
  Bacula's Catalog. Then, after a day of backup jobs run he
  noticed that mtx-changer listall show different information
  from the Catalog. 


The
  issue here seemed to be the autochanger timeout configuration.
  He had an autochanger with a 900 seconds timeout. So we
  configured the maximum changer/rewind/open wait directives
  configured for 900 seconds and the mtx-changer script. It
  seems that this solved the problem with the slot mess.


We
  thought that this was causing the issue with DEVICE is
  blocked. But we cannot confirme that by now.



Also
  he did some schedules and pools modifications. Now all the
  jobs have the same priority, same time schedule and will use
  just one pool in a specific day.


We
  are going to monitor this new configuration and maybe we can
  post here the results.


Best
  regards,
Ana
  
  
On Sat, Apr 25, 2015 at 2:50 AM, Kern
  Sibbald k...@sibbald.com
  wrote:
  In my last
email, I did forget to mention that as you point out, the
problem can also result from a design issue.  And the
resolution of
those problems from design issues fall into my point 2.  If
we have a
good test case that shows the problem, even if it results
from a design
decision, most of the time we can find a solution -- in some
cases, we
have added new directives, but in most cases, a bit more
programming/logic can fix the problem.

One of the biggest issues that I have with the current SD
algorithm is
that during the drive(s) reservation process (prior to
starting the SD
job) once a write drive is assigned, it cannot be changed. 
Changing a
drive when multiple simultaneous jobs are writing is a
non-trivial
problem.  There are solutions, but they require rather
profound changes
to the SD, which I have been planning for at least 5 years
-- all the
underlying code and algorithms now exist so it is a matter
of time.

Best regards,
Kern

  
On 24.04.2015 22:07, Josh Fisher
wrote:
 I guess it is semantics, but I was just pointing
out that it was not a
 coding issue, but rather a design issue/choice.

 You can divide 

Re: [Bacula-users] File level deduplication

2015-04-27 Thread Raymond Burns Jr.
I CAN'T WAIT UNTIL THAT IS AVAILABLE!  I'm so excited just thinking about
it

On Mon, Apr 27, 2015, 5:27 AM Kern Sibbald k...@sibbald.com wrote:

 Hello,

 Actually, the Bacula Enterprise version has two different types of
 deduplication.

 1. Aligned Volumes -- special patented volume format that optimizes
 deduplication that is done by the underlying deduplicating FS (e.g. ZFS,
 Btrfs, ...).

 2. Global End Point Deduplication -- build-in Bacula deduplication in
 the SD as well as in the FD (configurable).

 It is possible that the Aligned Volume plugin binary will be available
 to the community later this year for free.

 Best regards,
 Kern

 On 27.04.2015 09:01, Silver Salonen wrote:
  On 04/25/2015 11:09 PM, Alex Domoradov wrote:
  Hello
 
  Is there any chance to implement file level deduplication in bacula?
  Maybe some undocumented way/tricks. I know about base job, but it's
  not what I need. I have a lot of Wordpress instances (~2000) on my
  server and all these instances have 95% of same base files. The file
  level deduplication would be a great way to save space in the pool.
 
  Thanks in advance.
  Hi.
 
  It's not there for open-source edition of Bacula. Enterprise version has
  proper data de-duplication that's done even on client-side and
  everything. Haven't been hands-on with it though...
 
  --
  Silver
 
 
 --
  One dashboard for servers and applications across Physical-Virtual-Cloud
  Widest out-of-the-box monitoring support with 50+ applications
  Performance metrics, stats and reports that give you Actionable Insights
  Deep dive visibility with transaction tracing using APM Insight.
  http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
  ___
  Bacula-users mailing list
  Bacula-users@lists.sourceforge.net
  https://lists.sourceforge.net/lists/listinfo/bacula-users
 



 --
 One dashboard for servers and applications across Physical-Virtual-Cloud
 Widest out-of-the-box monitoring support with 50+ applications
 Performance metrics, stats and reports that give you Actionable Insights
 Deep dive visibility with transaction tracing using APM Insight.
 http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Device is BLOCKED - renamed Bugged or not?

2015-04-27 Thread Josh Fisher

On 4/25/2015 1:50 AM, Kern Sibbald wrote:
 In my last email, I did forget to mention that as you point out, the
 problem can also result from a design issue.  And the resolution of
 those problems from design issues fall into my point 2.  If we have a
 good test case that shows the problem, even if it results from a design
 decision, most of the time we can find a solution -- in some cases, we
 have added new directives, but in most cases, a bit more
 programming/logic can fix the problem.

 One of the biggest issues that I have with the current SD algorithm is
 that during the drive(s) reservation process (prior to starting the SD
 job) once a write drive is assigned, it cannot be changed.  Changing a
 drive when multiple simultaneous jobs are writing is a non-trivial
 problem.  There are solutions, but they require rather profound changes
 to the SD, which I have been planning for at least 5 years -- all the
 underlying code and algorithms now exist so it is a matter of time.

Thank you Kern. That is good news!

Have you considered using a single device-volume pair assignment, rather 
than both a device assignment and a separate volume assignment? I have 
found that the easiest way to avoid thread-related issues is to minimize 
the number of things that must be serialized. Since a job, at any given 
instant, will always require both a device and a volume, it might make 
sense to assign both at the same time as a single atomic operation. The 
device-volume pair assignment code can be serialized by a single mutex, 
and I believe that would greatly simplify the device and volume 
assignment code, as well as allow for changing a job's device in a safe 
manner.  Any time that a job requires a volume to write on, whether at 
job start up or end of previous volume, it requests a device-volume pair 
to continue writing on. Since only one job at a time can enter the 
assignment code, both device and volume state are guaranteed to be 
static while checking device and volume criteria and making a 
device-volume pair selection and unloading / loading the device as 
needed. In turn, a successful request guarantees that the device-volume 
pair returned is valid for the job, and an unsuccessful request 
guarantees that the job needs to wait for an appendable volume. I 
believe that treating device and volume as a single unit would greatly 
simplify the assignment code. A single mutex for device-volume pairing 
should eliminate any chance of a race condition.



--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Problem with a volume: unable to solve

2015-04-27 Thread Simone Martina
Good evening,
I got a problem with an old Bacula 5.2.5 (26 January 2012)
i686-pc-linux-gnu redhat.
Sometimes, during week-end differential backups I got a fail with mysql
dump job:

25-Apr 05:10 backup.lan-sd JobId 22026: Error: block.c:577 Write error
at 0:0 on device Drive-1 (/dev/st1). ERR=Bad file descriptor.
25-Apr 05:10 backup.lan-sd JobId 22026: Error: Error writing final EOF
to tape. This Volume may not be readable.
dev.c:1551 ioctl MTWEOF error on Drive-1 (/dev/st1). ERR=Bad file
descriptor.
25-Apr 05:10 backup.lan-dir JobId 22026: Fatal error: Volume Files at 88
being set to 0 for Volume GJ8634L5. This is incorrect.
25-Apr 05:10 backup.lan-sd JobId 22026: Fatal error: Error getting
Volume info: 1992 Update Media error. VolFiles=0, CatFiles=88

With the same mysql backup we run succesfully other jobs saving simple
files without beforescripts. These jobs terminated correctly using the
same GJ8634L5 LTO-5 tape, so I believe is not a problem with the tape.

Have you ever seen a similar prbolem?

Thanks in adavance for attention and sorry for my poor english.

Simone Martina
-- 
01010011 01011001 01010011
Skylogic a EutelSat Company
--

This message contains confidential information and is intended only for the 
individual named. If you are not the named addressee you should not 
disseminate, distribute or copy this e-mail. Please notify the sender 
immediately by e-mail if you have received this e-mail by mistake and delete 
this e-mail from your system. E-mail transmission cannot be guaranteed to be 
secure or error-free as information could be intercepted, corrupted, lost, 
destroyed, arrive late or incomplete, or contain viruses. The sender therefore 
does not accept liability for any errors or omissions in the contents of this 
message, which arise as a result of e-mail transmission. If verification is 
required please request a hard-copy version. Please note that any views or 
opinions presented in this email are solely those of the author and do not 
necessarily represent those of the Company.

No employee or agent is authorized to conclude any binding agreement on behalf 
of this Company nor, through this latter, any of the Eutelsat Communication 
group with another party by email without express written confirmation by a 
duly authorized officer of the Company. The list of duly authorized officers 
and the scope of their powers is published on the Trade Register according to 
the national law of each affiliate.


--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] File level deduplication

2015-04-27 Thread Alex Domoradov
Could anyone point me how much would be cost subscription for 30 servers? I
can't find out any prices on the off site

On Mon, Apr 27, 2015 at 2:24 PM, Raymond Burns Jr. rbur...@gmail.com
wrote:

 I CAN'T WAIT UNTIL THAT IS AVAILABLE!  I'm so excited just thinking about
 it

 On Mon, Apr 27, 2015, 5:27 AM Kern Sibbald k...@sibbald.com wrote:

 Hello,

 Actually, the Bacula Enterprise version has two different types of
 deduplication.

 1. Aligned Volumes -- special patented volume format that optimizes
 deduplication that is done by the underlying deduplicating FS (e.g. ZFS,
 Btrfs, ...).

 2. Global End Point Deduplication -- build-in Bacula deduplication in
 the SD as well as in the FD (configurable).

 It is possible that the Aligned Volume plugin binary will be available
 to the community later this year for free.

 Best regards,
 Kern

 On 27.04.2015 09:01, Silver Salonen wrote:
  On 04/25/2015 11:09 PM, Alex Domoradov wrote:
  Hello
 
  Is there any chance to implement file level deduplication in bacula?
  Maybe some undocumented way/tricks. I know about base job, but it's
  not what I need. I have a lot of Wordpress instances (~2000) on my
  server and all these instances have 95% of same base files. The file
  level deduplication would be a great way to save space in the pool.
 
  Thanks in advance.
  Hi.
 
  It's not there for open-source edition of Bacula. Enterprise version has
  proper data de-duplication that's done even on client-side and
  everything. Haven't been hands-on with it though...
 
  --
  Silver
 
 
 --
  One dashboard for servers and applications across Physical-Virtual-Cloud
  Widest out-of-the-box monitoring support with 50+ applications
  Performance metrics, stats and reports that give you Actionable Insights
  Deep dive visibility with transaction tracing using APM Insight.
  http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
  ___
  Bacula-users mailing list
  Bacula-users@lists.sourceforge.net
  https://lists.sourceforge.net/lists/listinfo/bacula-users
 



 --
 One dashboard for servers and applications across Physical-Virtual-Cloud
 Widest out-of-the-box monitoring support with 50+ applications
 Performance metrics, stats and reports that give you Actionable Insights
 Deep dive visibility with transaction tracing using APM Insight.
 http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



 --
 One dashboard for servers and applications across Physical-Virtual-Cloud
 Widest out-of-the-box monitoring support with 50+ applications
 Performance metrics, stats and reports that give you Actionable Insights
 Deep dive visibility with transaction tracing using APM Insight.
 http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] SQLite

2015-04-27 Thread Matt Ivie
I saw a note in the Bacula documentation stating that some users were
reporting database corruption problems when using SQLite. I also saw a
thread on the mailing list from a couple of years ago where one user
wanted to know if he would be better off using Postgresql

One user stated he had great luck using SQLite and another simply said
he recommended Postgres. I don't want to run a full blown database if I
don't need to as my backup needs are not really complicated. I would
like to use SQLite but if stability is a problem I'll have to rethink
the situation and go with MySQL or Postgres.

Does anyone here have experience with using SQLite?




--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] my very first Windows client

2015-04-27 Thread Robert A Threet
I backed up a Windows client but the navigation in restore doesn't seem to 
work.  
Am I just doing it wrong or what?  It *says* it had data.

Select the Client (1-11): 5
Automatically selected FileSet: Windows 2000
+---+---+--++-++
| jobid | level | jobfiles | jobbytes   | starttime   | volumename |
+---+---+--++-++
|   285 | F |  181,979 | 22,097,177,794 | 2015-04-08 16:19:09 | 23L6   |
|   511 | D |3,175 |  4,784,492,699 | 2015-04-26 23:05:00 | 39L6   |
+---+---+--++-++
You have selected the following JobIds: 285,511

Building directory tree for JobId(s) 285,511 ...  
++
152,928 files inserted into the tree.

You are now entering file selection mode where you add (mark) and
remove (unmark) files to be restored. No files are initially added, unless
you used the all keyword on the command line.
Enter done to leave this mode.

cwd is: /
$ ls
C:/
$ cd Windows
Invalid path given.
cwd is: /
$ cd System32
Invalid path given.
cwd is: /
$ ls
C:/
$ 
 
Terminated Jobs:
 JobId  LevelFiles  Bytes   Status   FinishedName
===
   389  Incr  1,1824.049 G  OK   17-Apr-15 23:13 GPS
   402  Incr2103.210 G  OK   18-Apr-15 23:11 GPS
   415  Diff  2,3345.083 G  OK   19-Apr-15 23:15 GPS
   428  Incr  1,1133.511 G  OK   20-Apr-15 23:12 GPS
   441  Incr2313.385 G  OK   21-Apr-15 23:12 GPS
   454  Incr1973.209 G  OK   22-Apr-15 23:11 GPS
   471  Incr1993.210 G  OK   23-Apr-15 23:12 GPS
   485  Incr1883.206 G  OK   24-Apr-15 23:13 GPS
   498  Incr1863.205 G  OK   25-Apr-15 23:12 GPS
   511  Diff  3,1754.784 G  OK   26-Apr-15 23:14 GPS

bacula1-dir Version: 6.6.11 (11 August 2014) 
x86_64-redhat-linux-gnu-bacula-enterprise redhat Enterprise release 


-- 
Robert A Threet rober...@netzero.net

Protect what matters
Floods can happen anywhere. Learn your risk and find an agent today.
http://thirdpartyoffers.netzero.net/TGL3231/553e77737792877723dd5st04vuc

--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] my very first Windows client

2015-04-27 Thread John Drescher
On Mon, Apr 27, 2015 at 1:52 PM, Robert A Threet rober...@netzero.net wrote:
 I backed up a Windows client but the navigation in restore doesn't seem to 
 work.
 Am I just doing it wrong or what?  It *says* it had data.

 Select the Client (1-11): 5
 Automatically selected FileSet: Windows 2000
 +---+---+--++-++
 | jobid | level | jobfiles | jobbytes   | starttime   | 
 volumename |
 +---+---+--++-++
 |   285 | F |  181,979 | 22,097,177,794 | 2015-04-08 16:19:09 | 23L6  
  |
 |   511 | D |3,175 |  4,784,492,699 | 2015-04-26 23:05:00 | 39L6  
  |
 +---+---+--++-++
 You have selected the following JobIds: 285,511

 Building directory tree for JobId(s) 285,511 ...  
 ++
 152,928 files inserted into the tree.

 You are now entering file selection mode where you add (mark) and
 remove (unmark) files to be restored. No files are initially added, unless
 you used the all keyword on the command line.
 Enter done to leave this mode.

 cwd is: /
 $ ls
 C:/
 $ cd Windows
 Invalid path given.
 cwd is: /
 $ cd System32
 Invalid path given.
 cwd is: /
 $ ls
 C:/
 $

I think you need to cd C:/

before cd Windows

John

--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] File level deduplication

2015-04-27 Thread Kern Sibbald

  
  
Hello,
  
  Were are you and your company located?
  
  Best regards,
  Kern
  
  On 27.04.2015 16:52, Alex Domoradov wrote:


  Could anyone point me how much would be cost
subscription for 30 servers? I can't find out any prices on the
off site
  
  
On Mon, Apr 27, 2015 at 2:24 PM,
  Raymond Burns Jr. rbur...@gmail.com wrote:
  
I CAN'T WAIT UNTIL THAT IS AVAILABLE!  I'm so
  excited just thinking about it 

  

On Mon, Apr 27, 2015, 5:27
  AM Kern Sibbald k...@sibbald.com
  wrote:
  Hello,

Actually, the Bacula Enterprise version has two
different types of
deduplication.

1. Aligned Volumes -- special patented volume format
that optimizes
deduplication that is done by the underlying
deduplicating FS (e.g. ZFS,
Btrfs, ...).

2. Global End Point Deduplication -- build-in Bacula
deduplication in
the SD as well as in the FD (configurable).

It is possible that the Aligned Volume plugin binary
will be available
to the community later this year for free.

Best regards,
Kern

On 27.04.2015 09:01, Silver Salonen wrote:
 On 04/25/2015 11:09 PM, Alex Domoradov wrote:
 Hello

 Is there any chance to implement file level
deduplication in bacula?
 Maybe some undocumented way/tricks. I know
about base job, but it's
 not what I need. I have a lot of Wordpress
instances (~2000) on my
 server and all these instances have 95% of
same base files. The file
 level deduplication would be a great way to
save space in the pool.

 Thanks in advance.
 Hi.

 It's not there for open-source edition of
Bacula. Enterprise version has
 proper data de-duplication that's done even on
client-side and
 everything. Haven't been hands-on with it
though...

 --
 Silver


--
 One dashboard for servers and applications
across Physical-Virtual-Cloud
 Widest out-of-the-box monitoring support with
50+ applications
 Performance metrics, stats and reports that
give you Actionable Insights
 Deep dive visibility with transaction tracing
using APM Insight.
 http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
One dashboard for servers and applications across
Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+
applications
Performance metrics, stats and reports that give you
Actionable Insights
Deep dive visibility with transaction tracing using
APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
  

  


--
One dashboard for servers and applications across
Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+
applications
   

Re: [Bacula-users] my very first Windows client

2015-04-27 Thread Ana Emília M . Arruda
Hello Robert,

Try this:

$ ls
C:/
$ cd C:/
cwd is: C:/


Best regards,
Ana

On Mon, Apr 27, 2015 at 2:52 PM, Robert A Threet rober...@netzero.net
wrote:

 I backed up a Windows client but the navigation in restore doesn't seem to
 work.
 Am I just doing it wrong or what?  It *says* it had data.

 Select the Client (1-11): 5
 Automatically selected FileSet: Windows 2000

 +---+---+--++-++
 | jobid | level | jobfiles | jobbytes   | starttime   |
 volumename |

 +---+---+--++-++
 |   285 | F |  181,979 | 22,097,177,794 | 2015-04-08 16:19:09 |
 23L6   |
 |   511 | D |3,175 |  4,784,492,699 | 2015-04-26 23:05:00 |
 39L6   |

 +---+---+--++-++
 You have selected the following JobIds: 285,511

 Building directory tree for JobId(s) 285,511 ...
 ++
 152,928 files inserted into the tree.

 You are now entering file selection mode where you add (mark) and
 remove (unmark) files to be restored. No files are initially added, unless
 you used the all keyword on the command line.
 Enter done to leave this mode.

 cwd is: /
 $ ls
 C:/
 $ cd Windows
 Invalid path given.
 cwd is: /
 $ cd System32
 Invalid path given.
 cwd is: /
 $ ls
 C:/
 $

 Terminated Jobs:
  JobId  LevelFiles  Bytes   Status   FinishedName
 ===
389  Incr  1,1824.049 G  OK   17-Apr-15 23:13 GPS
402  Incr2103.210 G  OK   18-Apr-15 23:11 GPS
415  Diff  2,3345.083 G  OK   19-Apr-15 23:15 GPS
428  Incr  1,1133.511 G  OK   20-Apr-15 23:12 GPS
441  Incr2313.385 G  OK   21-Apr-15 23:12 GPS
454  Incr1973.209 G  OK   22-Apr-15 23:11 GPS
471  Incr1993.210 G  OK   23-Apr-15 23:12 GPS
485  Incr1883.206 G  OK   24-Apr-15 23:13 GPS
498  Incr1863.205 G  OK   25-Apr-15 23:12 GPS
511  Diff  3,1754.784 G  OK   26-Apr-15 23:14 GPS

 bacula1-dir Version: 6.6.11 (11 August 2014)
 x86_64-redhat-linux-gnu-bacula-enterprise redhat Enterprise release


 --
 Robert A Threet rober...@netzero.net
 
 Protect what matters
 Floods can happen anywhere. Learn your risk and find an agent today.
 http://thirdpartyoffers.netzero.net/TGL3231/553e77737792877723dd5st04vuc


 --
 One dashboard for servers and applications across Physical-Virtual-Cloud
 Widest out-of-the-box monitoring support with 50+ applications
 Performance metrics, stats and reports that give you Actionable Insights
 Deep dive visibility with transaction tracing using APM Insight.
 http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users