Re: [Bacula-users] label command frequently fails

2018-09-25 Thread Gary Dale

On 2018-09-20 06:09 AM, Kern Sibbald wrote:

Hello,

The output produced by Bacula seems unusually short.  Normally Bacula 
displays a reason for the failure.


I recommend trying your label command again, but turn on debug with 
something link


setdebug level=150 Storage

prior to doing the label command.  It should give you a more detailed 
reason for

the failure.


It gives me the exact same output. It took the setdebug command but 
continues to complain when I try to label a new volume. After a reboot I 
was able to label a volume however. After a while I lose that ability 
once more.


Meanwhile I am currently getting messages every minute to the effect:
25-Sep 23:36 bacula-dir JobId 3284: Pruning oldest volume 
"weekly-backup-pool-03"
25-Sep 23:36 bacula-dir JobId 3284: Found no Job associated with the 
Volume "weekly-backup-pool-03" to  prune

(repeated at 23:37, 23:38, etc.)

This is possibly unrelated but I don't think it should be happening either.


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] deleting specific folders from backups

2018-09-25 Thread Tilman Schmidt
Am 25.09.2018 um 23:05 schrieb Elma:
> I wonder if there is a way  to remove some folder/files from all the
> bacula backups?

AFAIK there is no way to modify Bacula backups after they have been
created. The only way to remove a file from all backups is to erase all
the volumes it may have ended on, thereby destroying all the backups
which contained it, and an indefinite number of other backups along with it.



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] deleting specific folders from backups

2018-09-25 Thread Elma
Hi,

I wonder if there is a way  to remove some folder/files from all the bacula
backups?

Thanks in advance for your help!

Regards,
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] FileSet estimate listing sorting

2018-09-25 Thread George Anchev via Bacula-users
On Tue, 25 Sep 2018 14:38:27 +0200 Radosław
Korzeniewski wrote:

> Possibilities are endless and limited by your
> imagination.

Actually by my lack of knowledge (otherwise I wouldn't
really ask). I know how to filter things a little bit
with sed + regex but I am not sure for example how to
sort by full path name preserving all the other
columns displayed by `estimate listing`. I suppose
that is out of the scope of the current mailing list.

--
George


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] CFLAGS optimizations and building for another architecture

2018-09-25 Thread George Anchev via Bacula-users
Hi Josh,

You seem to be replying to an earlier message (about
CFLAGS optimizations) quoting the latest one (which
is about building for another architecture), so at
first that got me confused. FWIW: I don't use software
compression (the storage has hardware compression).

--
George


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] FileSet estimate listing sorting

2018-09-25 Thread Radosław Korzeniewski
Hello,

wt., 25 wrz 2018 o 10:54 George Anchev via Bacula-users <
bacula-users@lists.sourceforge.net> napisał(a):

> On Mon, 24 Sep 2018 19:19:42 -0400 Dan Langille wrote:
>
> > What use cases exist for sorting the estimate?
>
> I don't know. Personally I would like to be able to
> sort by general file system attributes:
>
> - file name
> - full path name
> - date (ctime, mtime, maybe also "last backed up")
> - (perhaps also): permissions/acl, xattr
>
>
It is extremely simpler to make a sort outside then inside Bacula. Sorting
inside Bacula would consume resources which is not what you want.
External sorting require some additional scripting which you can do in a
few minutes then you can add some filtering if you wish. You can even load
all estimation data to database and do sorting, filtering, aggregation, etc.
Possibilities are endless and limited by your imagination.

Developing this kind of functionality inside Bacula require a lot of effort
and time. If you want to contribute a such functionality, you are welcome.

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] CFLAGS optimizations and building for another architecture

2018-09-25 Thread Josh Fisher



On 9/25/2018 5:18 AM, George Anchev via Bacula-users wrote:

...

Also: I would like to use a faster machine to
create builds for other slower machines (one of
them even 32-bit). Do I need anything more than
just finding the proper "-march" setting for the
target CPU?

I'm not sure you need to do even that. The default
should be to produce code that will run on all
supported CPUs (of the same instruction set
architecture). Unless you need to cross-compile, or
to target a CPU so old that it is no longer
supported by default (e.g., a 80x86 with x<6), you
probably don't need to do anything special. Creating
a 32-bit build on a 64-bit system may require you to
use -m32 (or whatever the exact syntax is) or (my
preferred approach) to build in a 32-bit environment
(chroot, container or virtual machine).

I am particularly interested in building FDs for two
types of CPUs. I am attaching the /proc/cpuinfo for
both. Could you advise on specifics?


I'm not sure whether compiler optimizations will make a huge difference. 
The FD is quite i/o bound, in general. However, there are exceptions. On 
clients with weak CPUs, enabling compression and/or encryption will very 
much affect performance. If software compression is required, then try 
to use LZO. Weak clients will usually perform better with compression 
disabled, in spite of the increased network traffic.




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] CFLAGS optimizations and building for another architecture

2018-09-25 Thread George Anchev via Bacula-users
Hi Sergio,

I suppose you replied personally to me instead of to
the list by mistake. I will provide my answer here,
quoting yours:

On Tue, 25 Sep 2018 08:56:30 +0200 Sergio Gelato wrote:

> I think you're asking the wrong question. The
> question I would ask is: is the performance of
> Bacula limited by the CPU or by other factors
> (especially I/O and system calls)? If Bacula isn't
> CPU-bound, the difference between -O2 and -O3 isn't
> going to be worth worrying about.

I understand what you are saying but still I was
interested to know.

> I haven't looked at the Bacula code base in enough
> detail to be sure, but I'd expect its loops to be
> linked-list traversals rather than iterations over
> large arrays. Vectorization isn't going to help much
> in that case.

Hopefully someone who has more in-depth look at the
code could provide more clarity.

> Ultimately, the best way to answer such questions is
> by direct benchmarking: build it both ways, and see
> if you can measure a difference.

I don't know how to create a benchmark comparison
scenario, otherwise I wouldn't mind doing it.

> I just wouldn't bother to do it with Bacula since
> its main job is I/O, not computation.

Aren't DB operations, sorting, (maybe something else)
affected by certain optimizations?

> (Some things in Bacula are memory-bound. For
> example, doing an accurate backup of a filesystem
> with lots of inodes is going to require lots of RAM;
> if you're short of memory the page swapping activity
> will kill performance. None of this is going to be
> affected by -O2 vs. -O3, and I don't think even -Os
> is going to help much; what's needed is an algorithm
> that makes smarter use of the available memory. Most
> people just buy more RAM instead.)

Algorithm efficiency is surely essential, I am not
even questioning that. But since I am unaware of what
algorithms are used and which of them may benefit or
suffer from -O3, I decided to ask.

> > Also: I would like to use a faster machine to
> > create builds for other slower machines (one of
> > them even 32-bit). Do I need anything more than
> > just finding the proper "-march" setting for the
> > target CPU?  
> 
> I'm not sure you need to do even that. The default
> should be to produce code that will run on all
> supported CPUs (of the same instruction set
> architecture). Unless you need to cross-compile, or
> to target a CPU so old that it is no longer
> supported by default (e.g., a 80x86 with x<6), you
> probably don't need to do anything special. Creating
> a 32-bit build on a 64-bit system may require you to
> use -m32 (or whatever the exact syntax is) or (my
> preferred approach) to build in a 32-bit environment
> (chroot, container or virtual machine).

I am particularly interested in building FDs for two
types of CPUs. I am attaching the /proc/cpuinfo for
both. Could you advise on specifics?

--
George
# cat /proc/cpuinfo
processor   : 0
vendor_id   : GenuineIntel
cpu family  : 6
model   : 13
model name  : Intel(R) Celeron(R) M processor 1.50GHz
stepping: 8
microcode   : 0x20
cpu MHz : 1496.392
cache size  : 1024 KB
physical id : 0
siblings: 1
core id : 0
cpu cores   : 1
apicid  : 0
initial apicid  : 0
fdiv_bug: no
f00f_bug: no
coma_bug: no
fpu : yes
fpu_exception   : yes
cpuid level : 2
wp  : yes
flags   : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov 
clflush dts acpi mmx fxsr sse sse2 ss tm pbe bts cpuid
bugs: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf
bogomips: 2992.78
clflush size: 64
cache_alignment : 64
address sizes   : 32 bits physical, 32 bits virtual
power management:# cat /proc/cpuinfo
processor   : 0
vendor_id   : GenuineIntel
cpu family  : 15
model   : 3
model name  : Intel(R) Xeon(TM) CPU 2.80GHz
stepping: 4
microcode   : 0x17
cpu MHz : 2799.886
cache size  : 1024 KB
physical id : 0
siblings: 2
core id : 0
cpu cores   : 1
apicid  : 0
initial apicid  : 0
fpu : yes
fpu_exception   : yes
cpuid level : 5
wp  : yes
flags   : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov 
pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall lm 
constant_tsc pebs bts nopl cpuid pni dtes64 monitor ds_cpl cid xtpr pti
bugs: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf
bogomips: 5599.77
clflush size: 64
cache_alignment : 128
address sizes   : 36 bits physical, 48 bits virtual
power management:

processor   : 1
vendor_id   : GenuineIntel
cpu family  : 15
model   : 3
model name  : Intel(R) Xeon(TM) CPU 2.80GHz
stepping: 4
microcode   : 0x17
cpu MHz : 2799.886
cache size  : 1024 KB
physical id : 3
siblings: 2
core id : 0
cpu cores   : 1

Re: [Bacula-users] FileSet estimate listing sorting

2018-09-25 Thread George Anchev via Bacula-users
On Mon, 24 Sep 2018 19:19:42 -0400 Dan Langille wrote:

> What use cases exist for sorting the estimate?

I don't know. Personally I would like to be able to
sort by general file system attributes:

- file name
- full path name
- date (ctime, mtime, maybe also "last backed up")
- (perhaps also): permissions/acl, xattr

--
George


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users