Re: [BackupPC-users] BackupPC 4.2.1 released

[Ghislain Adnet]

This release allows the new backup delete CGI feature to be disabled for users 
and/or admins, plus a couple of minor bug fixes:




very cool, thanks !

this delete feature perhaps is cool for some but i really dislike that user can screw the production AND the backup. 
This way i can prevent them to do it, i use backupPC also because users can never delete their backup contrary to other 
tools :)


When you encounter a disgrunted employee that erase all servers AND the backups once, you never want anyone to be able 
to do that again.



Ghislain.

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] no errors but no file backuped in some directory not others

[Ghislain Adnet]

hi,

 I am testing backuppc4 after quite some time using backuppc3. It is quite a pain as there is no packages. I used the 
commands from the source and (debian buster) :



cpan install SCGI
apt-get install  libcgi-pm-perl apache2-utils


configure.pl\
--batch \
--cgi-dir /usr/lib/backuppc/cgi-bin \
--data-dir /var/lib/backuppc\
--hostname $(hostname -f)   \
--html-dir /usr/share/backuppc/image\
--html-dir-url  /backuppc   \
--run-dir /var/run/backuppc \
--log-dir /var/log/backuppc \
--config-dir /etc/backuppc  \
--scgi-port 3000\
--install-dir /usr/share/backuppc;


 to try to mimick the debian package of the 3.x, i use nginx with the exemple 
config to connect to the admin interface.

 Using the same configuration than the 3.x version i have backups that just miss files, entire directory are skipped 
and i dont see why.


 So i removed my cold onfiguration completly and put

BackupFilesOnly  to /var/backups/mysql
and removed all exclusions

inside this directory /var/backups/mysql is just some gz of mysql dumps files.

 The backups end well and tell me i have 0 files backuped.

 If i add /etc to the BackupFilesOnly list then /etc is perfectly backuped but 
still no  /var/backups/mysql :(

 So i am quite at a loss here, any idea of what could be going on ? This configuration works like a charm on backuppc3, 
the client machine has only one partition.


regards,
Ghislain.





___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] no errors but no file backuped in some directory not others

[Ghislain Adnet]

On 4/18/20 6:49 AM, Craig Barratt via BackupPC-users wrote:
Are you using rsync?  The default in 4.x is --one-file-system.  You can edit the config file to remove that if you 
prefer. I do realize you said "the client machine has only one partition", so that might not be the issue.




oh sorry, yes i use rsync via ssh.

I think i found the issue, i used to store the backuped file  those file a "container" like system. So backuppc connnect 
to the host and then backcup the guest:



http://backuppc.sourceforge.net/faq/BackupPC.html#_conf_rsyncclientcmd_

# rsync client commands
$Conf{RsyncClientCmd}   = '$sshPath  -T -q -x -l aqbackup $host sudo vnamespace -e "'.$nomduvserveur.'" 
/usr/sbin/chroot "/vservers/'.$nomduvserveur.'" $rsyncPath $argList+';
$Conf{RsyncClientRestoreCmd}= '$sshPath  -T -q -x -l aqbackup $host sudo vnamespace -e "'.$nomduvserveur.'" 
/usr/sbin/chroot "/vservers/'.$nomduvserveur.'" $rsyncPath $argList+';



it seems this part is not working as it was and it is tryng to backup the host 
instead  of the guest.

I dont find those in 4.0, have they disapeared ?

regards,
Ghislain.




___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] no errors but no file backuped in some directory not others

[Ghislain Adnet]

On 4/19/20 8:45 AM, Craig Barratt via BackupPC-users wrote:
Yes, the rsync settings have changed in 4.x.  You'll need to set $Conf{RsyncSshArgs} and $Conf{RsyncClientPath}.  You 
should be able to put the chroot into $Conf{RsyncClientPath}.


Craig


ok so i guess

#$Conf{RsyncClientCmd}=
'$sshPath  -T -q -x -l aqbackup $host
sudo vnamespace -e "'.$nomduvserveur.'" /usr/sbin/chroot 
"/vservers/'.$nomduvserveur.'" $rsyncPath $argList+';

convert to

$Conf{RsyncClientPath}  =
'sudo vnamespace -e "'.$nomduvserveur.'" /usr/sbin/chroot 
"/vservers/'.$nomduvserveur.'" /usr/bin/rsync ';

$Conf{RsyncSshArgs} = [
'-e', '$sshPath  -T -q -x -l aqbackup',
];


seems to work, is it still necessary to have things like

  '--block-size=2048',
  '--checksum-seed=32761',

to help the backups ?

Regards,
Ghislain.


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] no errors but no file backuped in some directory not others

[Ghislain Adnet]

thanks a lot for your help on this one Craig !

Ghislain.



___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] compiling backuppc4.4, error starting the daemon

[Ghislain Adnet]

Hi,

 i try to compile the backuppc4.4 as there is no package to migrate from 
backuppc of the debian.

 I compiled and installed successfully XS, rsync on my ubuntu 20.04 but the 
backuppc part fail when i try to start the service:

[backuppc:~]$ /usr/share/backuppc/bin/BackupPC
No language setting
BackupPC::Lib->new failed

i reinstalled all the 3 at zero but still cannot make it work. Any idea on how 
to debug this issue ?

I used the debian configure:

perl ./configure.pl --batch --no-fhs --hostname $HOSTNAME --uid-ignore \
--install-dir /usr/share/backuppc \
--run-dir /var/run/backuppc \
--log-dir /var/log/backuppc \
--data-dir /var/lib/backuppc --cgi-dir /usr/share/backuppc/cgi-bin \
--html-dir /usr/share/backuppc/image --html-dir-url /backuppc/image \
--bin-path perl=/usr/bin/perl --bin-path tar=/bin/tar \
--bin-path smbclient=/usr/bin/smbclient \
--bin-path nmblookup=/usr/bin/nmblookup \
--bin-path rsync=/usr/bin/rsync --bin-path ping=/bin/ping \
--bin-path df=/bin/df --bin-path ssh=/usr/bin/ssh \
--bin-path sendmail=/usr/sbin/sendmail \
--bin-path hostname=/bin/hostname --bin-path split=/usr/bin/split \
--bin-path par2=/usr/bin/par2 --bin-path cat=/bin/cat \
--bin-path gzip=/bin/gzip --bin-path bzip2=/bin/bzip2 --scgi-port 3000;



 Any idea on how to debug the issue ?

regards


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] compiling backuppc4.4, error starting the daemon

[Ghislain Adnet]

i added to the ./configure

--config-dir /etc/backuppc \

to

perl ./configure.pl --batch --no-fhs --hostname $HOSTNAME --uid-ignore \
--install-dir /usr/share/backuppc \
--run-dir /var/run/backuppc --config-dir /etc/backuppc \
--log-dir /var/log/backuppc \
--data-dir /var/lib/backuppc --cgi-dir /usr/share/backuppc/cgi-bin \
--html-dir /usr/share/backuppc/image --html-dir-url /backuppc/image \
--bin-path perl=/usr/bin/perl --bin-path tar=/bin/tar \
--bin-path smbclient=/usr/bin/smbclient \
--bin-path nmblookup=/usr/bin/nmblookup \
--bin-path rsync=/usr/bin/rsync --bin-path ping=/bin/ping \
--bin-path df=/bin/df --bin-path ssh=/usr/bin/ssh \
--bin-path sendmail=/usr/sbin/sendmail \
--bin-path hostname=/bin/hostname --bin-path split=/usr/bin/split \
--bin-path par2=/usr/bin/par2 --bin-path cat=/bin/cat \
--bin-path gzip=/bin/gzip --bin-path bzip2=/bin/bzip2 --scgi-port 3000;

got

Created /var/lib/backuppc
Created /var/lib/backuppc/pool
Created /var/lib/backuppc/cpool
Created /var/lib/backuppc/pc
Created /etc/backuppc
Created /var/log/backuppc
Created /var/run/backuppc
Installing binaries in /usr/share/backuppc/bin
Installing library in /usr/share/backuppc/lib
Installing images in /usr/share/backuppc/image
Making systemd and init.d scripts
Making Apache configuration file for suid-perl
Installing docs in /usr/share/backuppc/share/doc/BackupPC
Installing config.pl and hosts in /etc/backuppc


but even with that i see that backuppc search the config.pl in 
/var/lib/backuppc/conf/
I had to link it to /etc/baclkuppc and now it start.

hope it helps some people here. If you know why it ignore  --config-dir 
/etc/backuppc or what i do wrong :)

regards,
Ghislain.


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

[BackupPC-users] Wrong info in bpc->BackupInfoRead ?

[Ghislain Adnet]

hi,

  I hope all the community is well :)

  I got a little issue and as the docs and my try do not seems to find the 
solution i am asking here :)

  After a backup i use to report on the backup and do a perl script that do 
reporting to my zabbix server, the start is

my($dateactuelle) = int(time);

my @backups = $bpc->BackupInfoRead($host) ;
# take the last one
my  $lastbackupID = @backups-1;



  # 86400 + delais de backup = 24h + 10h
  if( ( $dateactuelle - int($backups[$lastbackupID]{endTime}) ) 
> 122400 ){
print  STDERR "$host - impossible we just did it !\n";
next;
  }

 but it seems that the very same backup that called the script 
$Conf{DumpPostUserCmd} is not recognised by the api as the @backups-1 .

 I do not see in the doc when exactly the xxxCmd are called, seems the name 
suggest this is done after the backup but it seems not and be called a little 
before it.


  With backuppc3 i do it and it seems to work but not anymore in 4+, i use the 
postusercmd to repport things like this:

print ZABBIX "$host filebackup_type 
".$backups[$lastbackupID]{type}."\n";
print ZABBIX "$host filebackup_start 
".$backups[$lastbackupID]{startTime}."\n";
print ZABBIX "$host filebackup_end 
".$backups[$lastbackupID]{endTime}."\n";

print ZABBIX "$host filebackup_serveur <%= @fqdn %>\n";

print ZABBIX "$host 
filebackup_size_newfichier_".$backups[$lastbackupID]{type}." 
".$backups[$lastbackupID]{sizeNew}."\n";
print ZABBIX "$host 
filebackup_size_fichier_".$backups[$lastbackupID]{type}." 
".$backups[$lastbackupID]{size}."\n";
print ZABBIX "$host 
filebackup_nb_newfichier_".$backups[$lastbackupID]{type}." 
".$backups[$lastbackupID]{nFilesNew}."\n";
print ZABBIX "$host 
filebackup_nb_fichier_".$backups[$lastbackupID]{type}." 
".$backups[$lastbackupID]{nFiles}."\n";
print ZABBIX "$host filebackup_duree_".$backups[$lastbackupID]{type}." 
".int($backups[$lastbackupID]{endTime}-$backups[$lastbackupID]{startTime})."\n";

  How can i call a script when the backup is completed to send information 
about it to a monitoring system ?

--
cordialement,
Ghislain ADNET.
AQUEOS.


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] Wrong info in bpc->BackupInfoRead ?

[Ghislain Adnet]

Le 27/10/2020 à 01:36, Craig Barratt via BackupPC-users a écrit :

Ghislain,

This looks like a bug.  It seems that $Conf{DumpPostUserCmd} is run before the 
backups file is re-written with the new backup information. Before that there 
is just a placeholder for the new backup.

You could see if you can fix it by moving the $Conf{UserCmdCheckStatus} run in bin/BackupPC_dump 
(here <https://github.com/backuppc/backuppc/blob/master/bin/BackupPC_dump#L1295>) to after 
the BackupSave() (here 
<https://github.com/backuppc/backuppc/blob/master/bin/BackupPC_dump#L1348>).  You'll also 
need to repeat that code inside the if statement for the case the backup fails (here 
<https://github.com/backuppc/backuppc/blob/master/bin/BackupPC_dump#L1308>).

Craig

Thanks Craig, i 'all have to play with that and retest. Thanks for the heads up 
! :)

--
cordialement,
Ghislain ADNET.
AQUEOS.


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

[BackupPC-users] ZFS very slow with BackupPC_refCountUpdate

[Ghislain Adnet]

hi,

  I have an incredibly slow result using ZFS with backuppc4.

I use for ZFS a zraid1

lxdpool/containers/backup  compression   off
   inherited 
from lxdpool
lxdpool/containers/backup  atime off
   inherited 
from lxdpool
lxdpool/containers/backup  sync  disabled   
   inherited 
from lxdpool
lxdpool/containers/backup  encryptionoff
   default
lxdpool/containers/backup  dedup off
   default


but when refcountupdate run the machine is incredibly slow with cpu in WA for 
40+%

TID  PRIO  USER DISK READ  DISK WRITE  SWAPIN IO>COMMAND
3174083 be/6 1000112 2.81 M/s0.00 B/s  0.00 % 99.99 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 169-171
3174071 be/6 1000112 2.08 M/s0.00 B/s  0.00 % 97.33 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 160-162
3174105 be/6 1000112 2.12 M/s0.00 B/s  0.00 % 96.15 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 163-165
3174069 be/6 1000112  1353.41 K/s0.00 B/s  0.00 % 96.00 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 166-168
3174080 be/6 1000112 9.01 M/s0.00 B/s  0.00 % 93.42 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 172-175
2940817 be/4 100  1759.34 K/s  285.89 K/s  0.00 % 43.55 % systemd-journald


  I have similar setup in ext4 and btrfs who run really fine but on ZFS it 
crawl like crazy. Is the anything i missed ?


--
cordialement,
Ghislain ADNET.
AQUEOS.


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] btrfs questions

[Ghislain Adnet]

Le 06/03/2021 à 15:24, Paul Leyland a écrit :

I've seen bit-rot on a few disks out of hundreds used over the last
35-ish years.

I am now storing /var/lib/backuppc on a ZFS RAID since the last
catastophic disk failure. Sure enough one of those disks started writing
garbage and then was taken off-line through infant mortality. The pool
kept going. A year or so later a different disk went off-line, with a
dying SATA cable this time. The pool kept going. In both cases
rebuilding the array ("re-silvering") happened automagically.

Very happy with ZFS myself. YMMV.


Curious i have ZFS on my backuppc4 machines and i got horrible performances.

/usr/share/backuppc/bin/BackupPC_refCountUpdate

is completly killing the machine for hours while on btrfs and ext4 it does not 
cause any issue.

i am planning to move out of ZFS as soon as i can because notaime, nosync and 
all optimisation like l2arc on ssd have not helped the problem :(

--
cordialement,
Ghislain



___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] ZFS very slow with BackupPC_refCountUpdate

[Ghislain Adnet]

Le 25/04/2021 à 21:08, Paul Leyland a écrit :

I really don't understand this. My backuppc system is a very elderly Q6600 
2.4GHz with 8GB RAM. System disks are ext4; /var/lib/backuppc is a 3x4TB in a 
ZFS RAID configuration. Works like a dream.

We could try to swap information if you wish but I am not entirely sure the 
list wants to see the gory details.


yes sure, we can share the result with the list if we find something :)


--
cordialement,
Ghislain ADNET.
AQUEOS.


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] ZFS very slow with BackupPC_refCountUpdate

[Ghislain Adnet]

Le 25/04/2021 à 15:57, Robert Trevellyan a écrit :

Have you maxed out the RAM? ZFS needs lots of RAM for best performance.


i have to check tomorow while the refcount is made but it seems the 16Go are 
full, but aain linux is allways full with memory with the cache so i need to 
grab /proc/meminfo when  it happens.


--
cordialement,
Ghislain ADNET.
AQUEOS.


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] ZFS very slow with BackupPC_refCountUpdate

[Ghislain Adnet]

Le 25/04/2021 à 15:57, Robert Trevellyan a écrit :

Have you maxed out the RAM? ZFS needs lots of RAM for best performance.




seems the ram is

  totalusedfree  shared  buff/cache   available
Mem:   15Gi14Gi   164Mi   2.0Mi   1.3Gi   1.2Gi


MemTotal:   16290736 kB
MemFree: 1314804 kB
MemAvailable:2502204 kB

Buffers:   69072 kB
Cached:   716212 kB
SwapCached:14976 kB
Active:   634184 kB
Inactive: 485584 kB
Active(anon): 222572 kB
Inactive(anon):   122732 kB
Active(file): 411612 kB
Inactive(file):   362852 kB
Unevictable:   19008 kB
Mlocked:   19008 kB
SwapTotal:523260 kB
SwapFree: 291260 kB
Dirty:   204 kB
Writeback: 0 kB
AnonPages:341624 kB
Mapped:   114900 kB
Shmem:  2608 kB
KReclaimable: 755220 kB
Slab:   11797212 kB
SReclaimable: 755220 kB
SUnreclaim: 11041992 kB
KernelStack:6624 kB
PageTables: 7240 kB
NFS_Unstable:  0 kB
Bounce:0 kB
WritebackTmp:  0 kB
CommitLimit: 8668628 kB
Committed_AS:1794232 kB
VmallocTotal:   34359738367 kB
VmallocUsed:  826024 kB
VmallocChunk:  0 kB
Percpu:12480 kB
HardwareCorrupted: 0 kB
AnonHugePages: 0 kB
ShmemHugePages:0 kB
ShmemPmdMapped:0 kB
FileHugePages: 0 kB
FilePmdMapped: 0 kB
HugePages_Total:   0
HugePages_Free:0
HugePages_Rsvd:0
HugePages_Surp:0
Hugepagesize:   2048 kB
Hugetlb:   0 kB
DirectMap4k:13276068 kB
DirectMap2M: 3395584 kB
DirectMap1G: 2097152 kB


mostly used by arc.

Total DISK READ:12.39 M/s | Total DISK WRITE: 0.00 B/s
Current DISK READ:   6.39 M/s | Current DISK WRITE:   0.00 B/s
TID  PRIO  USER DISK READ  DISK WRITE  SWAPIN IO>COMMAND
4180940 be/6 1000112   295.24 K/s0.00 B/s  0.00 % 99.99 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 10-15
4180868 be/6 1000112 2.56 M/s0.00 B/s  0.00 % 99.99 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 5-9
4180931 be/6 1000112 4.21 M/s0.00 B/s  0.00 % 99.99 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 26-31
4180961 be/6 1000112  1058.09 K/s0.00 B/s  0.00 % 99.99 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 16-20
4180966 be/6 1000112  1239.63 K/s0.00 B/s  0.00 % 99.99 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 0-4
4180937 be/6 1000112 2.64 M/s0.00 B/s  0.00 % 99.99 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 21-25
884 be/0 root   40.34 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]
885 be/0 root   33.01 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]
886 be/0 root   89.86 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]
887 be/0 root   90.77 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]
888 be/0 root   85.27 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]
889 be/0 root   50.43 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]
890 be/0 root   27.51 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]
891 be/0 root   45.84 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]


%Cpu(s):  0.1 us,  0.7 sy,  0.2 ni, 56.1 id, 43.0 wa,  0.0 hi,  0.0 si,  0.0 st

4180961 1000112   30  10   47704  35532   4036 D   1.3   0.2   0:02.73 
/usr/bin/perl /usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 
16-20
4180940 1000112   30  10   47744  35496   3968 D   1.0   0.2   0:03.24 
/usr/bin/perl /usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 
10-15
884 root   0 -20   0  0  0 S   0.7   0.0 203:37.50 
[z_rd_int]
886 root   0 -20   0  0  0 S   0.7   0.0 203:44.14 
[z_rd_int]
887 root   0 -20   0  0  0 S   0.7   0.0 203:42.38 
[z_rd_int]
889 root   0 -20   0  0  0 S   0.7   0.0 203:39.86 
[z_rd_int]
891 root   0 -20   0  0  0 S   0.7   0.0 203:41.30 
[z_rd_int]
885 root   0 -20   0  0  0 S   0.3   0.0 203:41.32 
[z_rd_int]
888 root   0 -20   0  0  0 S   0.3   0.0 203:46.68 
[z_rd_int]
890 root   0 -20   0  0  0 S   0.3   0.0 203:41.32 
[z_rd_int]


so we have lots of z_rd_int but its 
/usr/share/backuppc/bin/BackupPC_refCountUpdate that do all the io.

--
cordialement,
Ghislain



___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] ZFS very slow with BackupPC_refCountUpdate

[Ghislain Adnet]

Le 27/04/2021 à 11:14, Alexander Moisseev via BackupPC-users a écrit :

On 27.04.2021 11:31, Ghislain Adnet wrote:


so we have lots of z_rd_int but its 
/usr/share/backuppc/bin/BackupPC_refCountUpdate that do all the io.



Do you still have BackupPC v3 pool? It may relate to hardlinks.


no those are fresh backuppc4 install compiled from the git repo, perhaps my 
setting on


$Conf{BackupPCNightlyPeriod} = 8;
$Conf{PoolSizeNightlyUpdatePeriod} = 16;
$Conf{PoolNightlyDigestCheckPercent} = 10;
$Conf{RefCntFsck} = 1;

perhaps this is $Conf{PoolNightlyDigestCheckPercent} = 10;,
i revert to 1 and see if it is the thing that is the problem, anyway this does 
not have any effect off this sort on ext4 or btrfs.


--
cordialement,
Ghislain


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

[BackupPC-users] Conf{PoolNightlyDigestCheckPercent} on btrfs and zfs

[Ghislain Adnet]

hi,

  Should this setting put to 0 on ZFS or BTRFS as the filesystem allready do 
checksumming and will detect issues ?

  Or is it something différent ?

$Conf{PoolNightlyDigestCheckPercent} = 1;

Integrity check the pool files by confirming the md5 digest of the contents 
matches their file name. Because the pool is very large, only check a small 
random percentage of the pool files each night.

This is check if there has been any server file system corruption.

The default value of 1% means approximately 30% of the pool files will be 
checked each month, although the actual number will be a bit less since some 
files might be checked more than once in that time. If BackupPC_nightly takes 
too long, you could reduce this value.

--
cordialement,
Ghislain



___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] Conf{PoolNightlyDigestCheckPercent} on btrfs and zfs

[Ghislain Adnet]

No, because that's like turning off the airbags on your car because you already 
have seatbelts.


thanks for your answer, i am trying to understand more about this.

If this check is to prevent bitrot or disk corruption of an existing file, and 
if rsync is sure the file is ok, and then that ZFS keep the checksum
and guarantee that the file did not change (assuming raidz1 at least of course) 
then, at the end what could be the case where this check help find issue ?

--
cordialement,
Ghislain
--
cordialement,
Ghislain ADNET.
AQUEOS.


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

[BackupPC-users] compilation error on VXS FYI

[Ghislain Adnet]

hello,

 just FYI i got error when i compile VXS if it helps anyone:




bpc_attrib.c:1249:50: warning: ‘%d’ directive output may be truncated writing 
between 1 and 11 bytes into a region of size between 0 and 8191 
[-Wformat-truncation=]
 1249 | snprintf(attribPathTemp, BPC_MAXPATHLEN, "%s.%d", attribPath, 
getpid());
  |  ^~
In file included from /usr/include/stdio.h:867,
 from ./rsync.h:38,
 from backuppc.h:24,
 from bpc_attrib.c:20:
/usr/include/x86_64-linux-gnu/bits/stdio2.h:67:10: note: 
‘__builtin___snprintf_chk’ output between 3 and 8204 bytes into a destination 
of size 8192
   67 |   return __builtin___snprintf_chk (__s, __n, __USE_FORTIFY_LEVEL - 1,
  |  ^~~~
   68 |__bos (__s), __fmt, __va_arg_pack ());
  |~
bpc_attrib.c:1352:62: warning: ‘%s’ directive output may be truncated writing 
up to 255 bytes into a region of size between 0 and 8191 [-Wformat-truncation=]
 1352 | snprintf(deletePath, sizeof(deletePath), "%s/%s", 
attribPath, dp->d_name);
  |  ^~
In file included from /usr/include/stdio.h:867,
 from ./rsync.h:38,
 from backuppc.h:24,
 from bpc_attrib.c:20:
/usr/include/x86_64-linux-gnu/bits/stdio2.h:67:10: note: 
‘__builtin___snprintf_chk’ output between 2 and 8448 bytes into a destination 
of size 8192
   67 |   return __builtin___snprintf_chk (__s, __n, __USE_FORTIFY_LEVEL - 1,
  |  ^~~~
   68 |__bos (__s), __fmt, __va_arg_pack ());
  |~
bpc_attrib.c:1146:50: warning: ‘%d’ directive output may be truncated writing 
between 1 and 11 bytes into a region of size between 0 and 8191 
[-Wformat-truncation=]
 1146 | snprintf(attribPathTemp, BPC_MAXPATHLEN, "%s.%d", attribPath, 
getpid());
  |  ^~
In file included from /usr/include/stdio.h:867,
 from ./rsync.h:38,
 from backuppc.h:24,
 from bpc_attrib.c:20:
/usr/include/x86_64-linux-gnu/bits/stdio2.h:67:10: note: 
‘__builtin___snprintf_chk’ output between 3 and 8204 bytes into a destination 
of size 8192
   67 |   return __builtin___snprintf_chk (__s, __n, __USE_FORTIFY_LEVEL - 1,
  |  ^~~~
   68 |__bos (__s), __fmt, __va_arg_pack ());
  |~
x86_64-linux-gnu-gcc -c  -I. -D_REENTRANT -D_GNU_SOURCE -DDEBIAN -fwrapv -fno-strict-aliasing -pipe 
-I/usr/local/include -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -O2 -g   -DVERSION=\"0.62\" 
-DXS_VERSION=\"0.62\" -fPIC "-I/usr/lib/x86_64-linux-gnu/perl/5.30/CORE"   
bpc_attribCache.c
bpc_attribCache.c: In function ‘bpc_attribCache_loadPath’:
bpc_attribCache.c:234:66: warning: ‘%s’ directive output may be truncated 
writing up to 8191 bytes into a region of size between 0 and 16383 
[-Wformat-truncation=]
  234 | snprintf(fullAttribPath, sizeof(fullAttribPath), "%s/%s", 
topDir, attribPath);
  |  ^~ 
  ~~
In file included from /usr/include/stdio.h:867,
 from ./rsync.h:38,
 from backuppc.h:24,
 from bpc_attribCache.c:20:
/usr/include/x86_64-linux-gnu/bits/stdio2.h:67:10: note: 
‘__builtin___snprintf_chk’ output between 2 and 24576 bytes into a destination 
of size 16384
   67 |   return __builtin___snprintf_chk (__s, __n, __USE_FORTIFY_LEVEL - 1,
  |  ^~~~
   68 |__bos (__s), __fmt, __va_arg_pack ());
  |~
bpc_attribCache.c: In function ‘bpc_attribCache_loadInode’:
bpc_attribCache.c:366:63: warning: ‘%s’ directive output may be truncated 
writing up to 8191 bytes into a region of size between 8186 and 16377 
[-Wformat-truncation=]
  366 | snprintf(inodeDir, sizeof(inodeDir), "%s/pc/%s/%d/%s", 
BPC_TopDir, ac->hostName, ac->bkupMergeList[i].num, attribDir);
  |   ^~
   ~
In file included from /usr/include/stdio.h:867,
 from ./rsync.h:38,
 from backuppc.h:24,
 from bpc_attribCache.c:20:
/usr/include/x86_64-linux-gnu/bits/stdio2.h:67:10: note: 
‘__builtin___snprintf_chk’ output 8 or more bytes (assuming 16390) into a 
destination of size 16384
   67 |   return __builtin___snprintf_chk (__s, __n, __USE_FORTIFY_LEVEL - 1,
  |  ^~~~

[BackupPC-users] compilation error in rsyncbpc Fyi

[Ghislain Adnet]

hi,

 just forwarding some warning i got in compiling backuppc rsync if it helps to 
have the info:


socket.c: In function ‘open_socket_out’:
socket.c:76:59: warning: ‘%s’ directive output may be truncated writing up to 
1023 bytes into a region of size between 976 and 1005 [-Wformat-truncation=]
   76 |  snprintf(buffer, sizeof buffer, "CONNECT %s:%d HTTP/1.0%s%s\r\n\r\n",
  |   ^~
   77 |host, port, authhdr, authbuf);
  | ~~~
In file included from /usr/include/stdio.h:867,
 from rsync.h:318,
 from socket.c:27:
/usr/include/x86_64-linux-gnu/bits/stdio2.h:67:10: note: 
‘__builtin___snprintf_chk’ output 24 or more bytes (assuming 1076) into a 
destination of size 1024
   67 |   return __builtin___snprintf_chk (__s, __n, __USE_FORTIFY_LEVEL - 1,
  |  ^~~~
   68 |__bos (__s), __fmt, __va_arg_pack ());
  |~

gcc -I. -I. -I./zlib -I./popt -g -O2 -DHAVE_CONFIG_H -Wall -W  -c popt/popt.c 
-o popt/popt.o
In file included from /usr/include/string.h:495,
 from popt/system.h:40,
 from popt/popt.c:11:
In function ‘strncpy’,
inlined from ‘expandNextArg’ at popt/popt.c:629:6:
/usr/include/x86_64-linux-gnu/bits/string_fortified.h:106:10: warning: 
‘__builtin_strncpy’ output truncated before terminating nul copying as many 
bytes from a string as its length [-Wstringop-truncation]
  106 |   return __builtin___strncpy_chk (__dest, __src, __len, __bos (__dest));
  |  ^~
popt/popt.c: In function ‘expandNextArg’:
popt/popt.c:624:13: note: length computed here
  624 |  alen = strlen(a);
  | ^

VRSYNC="3.1.3.0"


--
cordialement,
Ghislain



___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] maintaining exclusion templates

[Ghislain Adnet]

Le 20/05/2021 à 21:18, Mike Hughes a écrit :

Hi BackupPC users,

I'd like to maintain several templates for exclusion lists to be available 
across all clients. For example, the LINUX_WWW template might exclude these 
directories:
/proc
/sys
/home/this_user
/mnt/this_network_share
/tmp






hi,

 i use things like this that i include in each host file:



while ( my ($key,$value) = each(%{$Conf{BackupFilesExclude}}) ) {
push (@{$value}, '**/lost+found/**' );
push (@{$value}, '**/.svn/**' );

#SPAMASSASSIN
push (@{$value}, '**/.spamassassin/bayes*' );
push (@{$value}, '**/.spamassassin/auto*' );
# symfony 3
push (@{$value}, '**/app/cache/**' );
push (@{$value}, '**/app/logs/**' );
# symfony 4
push (@{$value}, '**/var/cache/**' );
push (@{$value}, '**/var/logs/**' );

# cms mystere, on a retrouve ceci utilise
push (@{$value}, '**/www/cache/**' );

if ( "$key" eq "/etc" ){
push (@{$value}, '/etc/webmin/mailboxes' );
}

}


i include it in my server file with



do "/etc/backuppc/include/baseexclude.pl";

--
cordialement,
Ghislain


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

[BackupPC-users] restore a backup from command line

[Ghislain Adnet]

hi,

 i was wondering if there was any way to restore from the command line. I need 
to restore all /home/ daily to another server


 I was trying to use


/usr/share/backuppc/bin/BackupPC_restore


 but there is no docs and it fails for me as i try various things like

[~]: sudo -u backuppc /usr/share/backuppc/bin/BackupPC_restore 127.0.0.1 
myclientserver.com  /etc/vim/vimrc
/usr/share/backuppc/bin/BackupPC_restore: bad reqFileName (arg #3): 
/etc/vim/vimrc

usage: /usr/share/backuppc/bin/BackupPC_restore [-p] [-v] [-m]   



any idea if this is possible ?

--
cordialement,
Ghislain ADNET.
AQUEOS.
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] restore a backup from command line

[Ghislain Adnet]

Evidently "BackupPC_restore" is to be used only through the CGI. Follow the link to 
documentation from within the CGI and once there look for the title "Command-line restore 
options" where you will find the recommended commands and a some examples usages.


thanks,

  Well i saw the exemples but they seems to create tar on the backup server 
then moving the tar then untar it.

  unfortunatly I do not have the disk space for that nor on the backup server 
nor on the destination server :(

 I would like to do a restore the same way i do it in the web interface to 
automate this but seems there is not a tool for it.

--
cordialement,
Ghislain ADNET.
AQUEOS.
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

[BackupPC-users] Backup corrupted, impossible to corect it

[Ghislain Adnet]

hi,

 I need your help on a corrupt pool issue. i have a backup server that has 
corrupt pool:

bpc_path_refCountAll: can't read attrib file 
/var/lib/backuppc/pc/my.server.com/745/f%2f/fvar/flib/fvim/attrib_ed3203cd9ac62bd456a37700c2051357
bpc_attrib_dirRead: can't open 
/var/lib/backuppc/cpool/18/04/18049d6c5bf4339c16a4850421ebf020
bpc_path_refCountAll: can't read attrib file 
/var/lib/backuppc/pc/my.server.com/745/f%2f/fvar/flog/attrib_18049d6c5bf4339c16a4850421ebf020
bpc_attrib_dirRead: can't open 
/var/lib/backuppc/cpool/70/18/701886a56156e44efd43bd7ba0dde4e9
bpc_path_refCountAll: can't read attrib file 
/var/lib/backuppc/pc/my.server.com/745/f%2f/fvar/fspool/attrib_701886a56156e44efd43bd7ba0dde4e9
bpc_attrib_dirRead: can't open 
/var/lib/backuppc/cpool/d4/a2/d4a30c60507b799b3e67fab9902136f6
bpc_path_refCountAll: can't read attrib file 
/var/lib/backuppc/pc/my.server.com/745/f%2f/fvar/fspool/fcron/attrib_d4a30c60507b799b3e67fab9902136f6
bpc_attrib_dirRead: can't open 
/var/lib/backuppc/cpool/ea/86/eb864e3cc6744041fa3f107e2cf6d2fc
bpc_path_refCountAll: can't read attrib file 
/var/lib/backuppc/pc/my.server.com/745/f%2f/fvar/fwww/attrib_eb864e3cc6744041fa3f107e2cf6d2fc
bpc_attrib_dirRead: can't open 
/var/lib/backuppc/cpool/a6/04/a604a101e6952191d40a4b2b4be31c26


and i can't correct this.

I runned

/usr/bin/perl /usr/share/backuppc/bin/BackupPC_fsck -f -s


it just show the error but correct nothing and the corruption prevent any 
restore of the files of course. New backup do nothing to correct it and  the 
daily refcount do nothing.


Any pointer to correct this ?

--
cordialement,
Ghislain ADNET.
AQUEOS.
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] Backup corrupted, impossible to corect it

[Ghislain Adnet]

Le 13/08/2024 à 00:09, Alexander Kobel a écrit :

Hi,

well, your message means that some attrib files are unaccessible. Likely 
destroyed, but you should confirm that e.g. with checking the access rights of 
those mentioned files in /var/lib/backuppc/cpool/??/??/
BackupPC_zcat 
/var/lib/backuppc/cpool/18/04/18049d6c5bf4339c16a4850421ebf020 | md5sum -
which should print the name of the file as its hash.



Thanks a lot for your response.

i will test this, the issue is that the fsck take nearly 24h to do so not easy 
to do it a lot :)


this is scary because backuppc do not seem to see this and we have data loss 
and subsequent backups do not correct the issue.

The internal backuppc system does not seems capable to detect and correct it so 
perhaps i have some security settings that are not googd or too low.

$Conf{PoolNightlyDigestCheckPercent}    = 1;
$Conf{PoolSizeNightlyUpdatePeriod}  = 16;
$Conf{RefCntFsck}   = 1;

is the default i wonder if cranking it up would helpl and if backuppc will then 
recover and start to backup those files again.


--
cordialement,
Ghislain ADNET.
AQUEOS.
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] Backup corrupted, impossible to corect it

[Ghislain Adnet]

Le 13/08/2024 à 11:33, Alexander Kobel a écrit :

Hi,

you can always force a full recheck on the nightly by increasing the 
PoolNightlyDigestCheckPercent config entry to 100 (% = full pool).

But: this will detect issues, but not correct them. The warnings you see are an 
indicator of data loss on your server instance, and BackupPC can't magically 
restore lost data. (It can backup again what still exists on your hosts, of 
course, but that's about it.)


well if the file is lost it is a problem, but, if the next backup save the file 
at least we will have it again.
I have here a file that is not here and new backups do not save it either.

--
cordialement,
Ghislain ADNET.
AQUEOS.
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] Backup corrupted, impossible to corect it

[Ghislain Adnet]

so what i get from this is that when there a corruption for a random reason 
backuppc will see it but will not do anything to correct it or backup it ever 
again even if it exist on the source client.

This sound really bad to me beceause if this is true then we have no way of 
recovering from this it seems.

So we can all have thousands of files not backuped on our servers without any 
way to correct this apart reinstalling a fresh backuppc system and pray it does 
not do it again :(


--
cordialement,
Ghislain ADNET.
AQUEOS.
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] Backup corrupted, impossible to corect it

[Ghislain Adnet]

That's all fine and true. But Ghislain is touching a very valid point here.
He actually *did* test (or looked at BackupPC's fsck performing a partial 
test), found out that there is some issue, and now wants to take steps to 
resolve it.

If I understand correctly, the situation here is:

1) Backups have been executed in the past and been working fine.
2) Some corruption on the server happened; e.g., one or several pool files 
experienced bit rot.
3) BackupPC_fsck detects the issue and reports a file as broken.
4) ... but there is no means for BackupPC itself to *react* on the issue; it 
simply warns, but there is no recovery.



yes thanks this exactly this. As stated in the Subject of the thread.

 I can have issue but then i need to be able to

- spot them
- correct them

in a programatic way (humans are unreliable).

Also

Backuppc_fsck
takes more than 24h on the backuppc server so cannot be used "regulary" without 
preventing backuppc normal operations.

For PoolNightlyDigestCheckPercent
did it correct the issue of just put it in the logs ?
It seems it just do 1/ but not 2/ ;p


@Guillermo Rozas    => thanks i think i will look at your 
tool :)


anyway the issue is here to spot and correct problems. If there is a way, be it 
 in the rsync options or backuppc system i would gladly hear it as perhaps i 
missed something somewhere :)



--
cordialement,
Ghislain ADNET.
AQUEOS.
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] Backup corrupted, impossible to corect it

[Ghislain Adnet]

hi Ged,


That's like saying your car shouldn't stop when all the coolant leaks
out of the radiator.  You had a temperature gauge.  You were supposed
to keep an eye on it.  You failed to do that.  Now, instead of a can
of Radweld, you need a new engine.  It's entirely your own fault.


so to be clear i use :

- a filesystem with cow and checksuming
- a maintenance tool that check the FS on a regular basis that scrub the 
complete fs in 6 weeks time max. ( a % each week )
- thats the case on the source and on the destination most of the time (some 
sources are in ext4 but less and less)
- i monitor any errors to a zabbix server that alert me if there is any alerts 
on the FS side and not any alerts show up.

I have seen some rsync crash mainly in OOM situations and network can fail too.



You seem to be asking BackupPC to be a filesystem repair tool. That's
a completely different animal, way beyond the scope of a comparatively
simple scheme for copying files, and unless the latest Pacific Bubble
'AI'[*] turns out to be more than a bubble there never will be any way
in general, to repair a broken filesystem reliably and automatically.


not really.

i dont ask anything special, i ask the community if there is a way, if we 
detect an issue, to tell backuppc to correct it :)

--
cordialement,
Ghislain ADNET.
AQUEOS.
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] Backup corrupted, impossible to corect it

[Ghislain Adnet]

thanks Les,

 i must say that i never changed the rsync options so i will have a deep look 
at it, the recommanded settings for v4 and what i use that is quite old i 
admint.

'--super',
'--recursive',
'--protect-args',
'--numeric-ids',
'--perms',
'--owner',
'--group',
'-D',
'--times',
'--links',
'--hard-links',
'--delete',
'--delete-excluded',
'--partial',
'--log-format=log: %o %i %B %8U,%8G %9l %f%L',
'--stats',
#
# Add additional arguments here, for example --acls or --xattrs
# if all the clients support them.
#
'--acls',
'--xattrs',
'--temp-dir=/var/tmp',

the one inhttps://github.com/backuppc/backuppc/blob/master/conf/config.pl

'--super',
'--recursive',
'--protect-args',
'--numeric-ids',
'--perms',
'--owner',
'--group',
'-D',
'--times',
'--links',
'--hard-links',
'--delete',
'--delete-excluded',
'--one-file-system',
'--partial',
'--log-format=log: %o %i %B %8U,%8G %9l %f%L',
'--stats',


they seems quite similar to me but i will look.

$Conf{RsyncFullArgsExtra} is not set on my configuration so i will add it with 
--ignore-times :)

--
cordialement,
Ghislain ADNET.
AQUEOS.
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

[BackupPC-users] RGDP, is backuppc still usable for non hobby backups after may 25

[Ghislain Adnet]

Hi there,

 The RDGP or GDRP is a new law in Europe :

https://en.wikipedia.org/wiki/General_Data_Protection_Regulation

 it state that; data MUST be protected from top to bottom, this include of course backup. In May 2018 all company in EU 
or using data about EU citizen will be subject to this law. From where i see it the GDPR force people to use encryption 
on all the data chain including the backup one.


 Also it add the right to 'forget' and some seems to include here that customer data should be removed from all the 
systems if required and that include backup. Of course for database i dont see how a backup system could erase line 
inside its dump files but for simple files we cannot say that. In backuppc i can manualy go erase a directory/file from 
all the backups so i should be covered here.


  The problem lies more with encryption as backuppc, from what i know, cannot encrypt data it store, it only can secure 
the transmit phase.


  Rsync or tar have no encryption sytem built so i wanted to know what the other users have in mind to survive the GDPR 
laws for their backups ?



best regards,
Ghislain.



A report[27] by the European Union Agency for Network and Information Security elaborates on what needs to be done to 
achieve privacy and data protection by default. It specifies that encryption and decryption operations must be carried 
out locally, not by remote service, because both keys and data must remain in the power of the data owner if any privacy 
is to be achieved. The report specifies that outsourced data storage on remote clouds is practical and relatively safe 
if only the data owner, not the cloud service, holds the decryption keys.


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] BackupPC 4.2.0 released

[Ghislain Adnet]

Le 15/04/2018 à 01:10, Craig Barratt via BackupPC-users a écrit :

BackupPC 4.2.0  has 
been released on Github.

The changes since4.1.5 are listed below.  The biggest change is 
a new feature in the web interface written by @moisseev that allows prior backups to be deleted.




ohhh this is a very bad idea... Having a way to remove backup in the web interface  sounds cool but when a bad apple 
employee comes and destroy all the backups because he is angry this is a real issue. Same if account is comprimised


With the agentless thing the fact that nobody could destroy a backup was a 
major features that was making us use backuppc.

Command line tools are fine but webgui tools to do that seems scuicidal to me where availability of backups is more 
important to anything else. When you have a problem you want the backups to be there and not learn that a compromised PC 
led to wiping of its data AND of the backups alltogether :)


is there a way to remove the feature so its not even loaded in the code (not 
just limited by the login/pass used) ?

Regards,
Ghislain.

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] best ssh settings for backup PC performances

[Ghislain ADNET]

Hi,

  I tried to play a little with SSH settings for backups with backup PC
and rsync.

 I ended with compression level to 5 and blowfish as a cipher but this
was a very quick test on my side. Is there anyone who have done some
more testing on this ?  For exemple is -z of rsync  better idea than ssh
compression ?

   Protocol 2
   Cipher blowfish
   Ciphers blowfish-cbc
   CompressionLevel 5

  How does this impact the performance of a backupPC machine ?  The
question is open, let us share our experiences on this ! :)

-- 
Cordialement,
Ghislain ADNET.


smime.p7s
Description: S/MIME Cryptographic Signature
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/