Re: [BackupPC-users] BackupPC, incremetal doesn't work

2017-05-18 Thread Craig Barratt 
Lano,

This does look like what Dieter and I have been trying to debug on his
setup. For some reasons we don't yet understand, it is looking in pool
(uncompressed pool) instead of cpool (compressed pool).

Let me respond off-list with some questions about your setup and some
things to try.

Craig

On Thu, May 18, 2017 at 2:38 AM, Dieter Fauth  wrote:

> Hi Bartosz,
> looks similar to what I see on my system.
> In my case the file exist in cpool, but it is searched in pool.
>
> Current assumption is that some corrupted files do cause this.
>
>
> --
> Many regards, Dieter Fauth :-)
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Sending output of DumpPreUserCmd by email

2017-05-18 Thread Craig Barratt 
You need DumpPreUserCmd to run to completion before continuing with the
backup.  Using systemd will run the command in the background (I believe
even for oneshot), which is almost certainly not what you want to do.

An easier solution is to write a cover script (pick you favorite scripting
language - bash, python, perl etc) that runs mysqldump, emails whatever you
want etc, and then point DumpPreUserCmd at your script.

Craig

On Thu, May 18, 2017 at 8:30 AM, Richard Shaw  wrote:

> On Thu, May 18, 2017 at 9:49 AM, Vladislav Kurz <
> vladislav.k...@webstep.net> wrote:
>
>> Hello all,
>>
>> First of all big thanks to all developers of BackupPC, it is really a
>> very nice and useful backup tool.
>>
>> I use DumpPreUserCmd (and similar options) to run mysqldump, or make
>> snapshots of filesystems before backup. I would like to have the output
>> of these mailed to me instead of being just logged.
>
>
> Probably not the direction you were thinking but why not create a systemd
> service file for DumpPreUserCmd to start?
>
> I'm assuming you're using a system which uses systemd...
>
> If you prepend the command in the service file with a hyphen the unit will
> exit cleanly even if the command failed...
>
> ExecStart=-/command/to/run
>
> Then you would set your DumpPreUserCmd to "/usr/bin/systemctl start
> "
>
> You would want to set the unit type to "oneshot" so it doesn't return
> until the command is finished.
>
> Just a thought.
>
> Thanks,
> Richard
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Sending output of DumpPreUserCmd by email

2017-05-18 Thread Richard Shaw 
On Thu, May 18, 2017 at 9:49 AM, Vladislav Kurz 
wrote:

> Hello all,
>
> First of all big thanks to all developers of BackupPC, it is really a
> very nice and useful backup tool.
>
> I use DumpPreUserCmd (and similar options) to run mysqldump, or make
> snapshots of filesystems before backup. I would like to have the output
> of these mailed to me instead of being just logged.


Probably not the direction you were thinking but why not create a systemd
service file for DumpPreUserCmd to start?

I'm assuming you're using a system which uses systemd...

If you prepend the command in the service file with a hyphen the unit will
exit cleanly even if the command failed...

ExecStart=-/command/to/run

Then you would set your DumpPreUserCmd to "/usr/bin/systemctl start "

You would want to set the unit type to "oneshot" so it doesn't return until
the command is finished.

Just a thought.

Thanks,
Richard
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] Sending output of DumpPreUserCmd by email

2017-05-18 Thread Vladislav Kurz 
Hello all,

First of all big thanks to all developers of BackupPC, it is really a
very nice and useful backup tool.

I use DumpPreUserCmd (and similar options) to run mysqldump, or make
snapshots of filesystems before backup. I would like to have the output
of these mailed to me instead of being just logged.

I know that there is UserCmdCheckStatus, but that only makes the whole
backup fail, which is not always what I want. If mysql dump fails, I
want the backup to run anyway, and backup at least the rest of the
filesystem, but I want to be notified that something went wrong.

I think of the same behavior as with cron: send mail if there is any
output (stdout or stderr), or if the command fails (exit code != 0).

Is that possible now? If not could this be impemented in future versions?

-- 
Best Regards
Vladislav Kurz


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] BackupPC, incremetal doesn't work

2017-05-18 Thread Dieter Fauth 
Hi Bartosz,
looks similar to what I see on my system.
In my case the file exist in cpool, but it is searched in pool.

Current assumption is that some corrupted files do cause this.


-- 
Many regards, Dieter Fauth :-)

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] BackupPC, incremetal doesn't work

2017-05-18 Thread lano 
Hi guys!

Im using BackupPC 4.1.2 on Debian 7 (3.2.0-4-amd64 #1 SMP Debian
3.2.68-1+deb7u3).

My backup dir is 192.168.0.49:/backup on /var/lib/backuppc type cifs
(rw,relatime,sec=ntlm,unc=\\192.168.0.49\backup,username=backuppc,uid=113,forceuid,gid=118,forcegid,addr=192.168.0.49,file_mode=0755,dir_mode=0755,nounix,rsize=61440,wsize=65536,actimeo=1)

I mounted it this way:
mount -t cifs 192.168.0.49:/backup /var/lib/backuppc -o
rw,username=nnn,pass=nnn,uid=113,gid=118,iocharset=utf8

My xfer method is tar with cmd: /usr/bin/sudo $tarPath -c -v -f - -C
$shareName --totals
I set ClientCharset and ClientCharsetLegacy to iso-8859-2 (Im from Poland)


In /var/lib/backuppc/log/LOG I have multiple errors like this:

2017-05-18 01:00:01 Running 2 BackupPC_nightly jobs from 0..15 (out of 0..15)
2017-05-18 01:00:01 Running BackupPC_nightly -m -P 5 0 127 (pid=6846)
2017-05-18 01:00:01 Running BackupPC_nightly -P 5 128 255 (pid=6847)
2017-05-18 01:00:01 Next wakeup is 2017-05-18 02:00:00
2017-05-18 01:00:01 BackupPC_nightly now running
BackupPC_refCountUpdate -m -s -c -P 5 -r 0-127
2017-05-18 01:00:01  admin : __bpc_pidStart__ 6850
2017-05-18 01:00:01 BackupPC_nightly now running
BackupPC_refCountUpdate -m -s -c -P 5 -r 128-255
2017-05-18 01:00:01  admin1 : __bpc_pidStart__ 6851
2017-05-18 01:02:52  admin : BackupPC_refCountUpdate: missing pool
file 01716d1b6cb036b4eecd70894f770505 count 1
2017-05-18 01:02:52  admin : BackupPC_refCountUpdate: missing pool
file 00cb3be0f4f031dd98e5ba9fe491d3d6 count 1
2017-05-18 01:02:55  admin1 : BackupPC_refCountUpdate: missing pool
file 81805f0ffe1ae38eef6682865a7cd5c5 count 1
2017-05-18 01:05:36  admin : BackupPC_refCountUpdate: missing pool
file 02bd7fe6d0beeaef522d2f2e41b5a0d9 count 1
2017-05-18 01:05:36  admin : BackupPC_refCountUpdate: missing pool
file 03f69274b4d47598b6e90a3b3e518348 count 1
2017-05-18 01:05:36  admin : BackupPC_refCountUpdate: missing pool
file 031f961fa4691e270120e476855e526c count 1
2017-05-18 01:16:28  admin1 : BackupPC_refCountUpdate: missing pool
file 8b43ff9070f311cf0c9bfc8f692bc10e count 1
(...)
2017-05-18 03:55:23  admin : BackupPC_refCountUpdate: missing pool
file 7683d6e9ba7f76f6e549feff28612c8f count 1
2017-05-18 03:58:05  admin : BackupPC_refCountUpdate: missing pool
file 7bc60d113bafd3c8887b023494f181eb count 1
2017-05-18 03:58:05  admin : BackupPC_refCountUpdate: missing pool
file 7acf41f8bd71a87aa836fe867472301d count 1
2017-05-18 03:59:26  admin : BackupPC_refCountUpdate: missing pool
file 7d55e0c7eddfad20fac4698e011f6ec3 count 1
2017-05-18 04:00:05 Next wakeup is 2017-05-18 05:00:00
2017-05-18 04:00:59  admin : BackupPC_refCountUpdate total errors: 67
2017-05-18 04:00:59  admin : __bpc_pidEnd__ 6850
2017-05-18 04:00:59 BackupPC_nightly now running BackupPC_sendEmail
2017-05-18 04:01:15 Finished  admin  (BackupPC_nightly -m -P 5 0 127)
2017-05-18 04:01:15 Pool nightly clean removed 0 files of size 0.00GB
2017-05-18 04:01:15 Pool is 0.00GB, 0 files (0 repeated, 0 max chain,
0 max links), 0 directories
2017-05-18 04:01:15 Cpool nightly clean removed 0 files of size 0.00GB
2017-05-18 04:01:15 Cpool is 0.00GB, 0 files (0 repeated, 0 max chain,
0 max links), 0 directories
2017-05-18 04:01:15 Pool4 nightly clean removed 115 files of size 0.00GB
2017-05-18 04:01:15 Pool4 is 649.76GB, 1347589 files (0 repeated, 0
max chain, 4616 max links), 16512 directories
2017-05-18 04:01:15 Cpool4 nightly clean removed 0 files of size 0.00GB
2017-05-18 04:01:15 Cpool4 is 0.00GB, 0 files (0 repeated, 0 max
chain, 0 max links), 0 directories
2017-05-18 04:01:15 Running BackupPC_rrdUpdate (pid=11240)
2017-05-18 04:01:15  admin-1 : 2017-05-18 04:01:15 RRD updated: date
1495152000; cpoolKb 0.00; total 1629336066.456055; poolKb
0.00; pool4Kb 665353636.00; cpool4Kb 0.00
2017-05-18 04:01:16 Finished  admin-1  (BackupPC_rrdUpdate)
2017-05-18 05:00:00 Next wakeup is 2017-05-18 06:00:00



In /var/lib/backuppc/pc/localhost/LOG.052017 I have these errors:

2017-05-17 21:00:00 incr backup started back to 2017-05-16 20:00:01
(backup #18) for directory /boot
2017-05-17 21:00:01 incr backup started back to 2017-05-16 20:00:01
(backup #18) for directory /bin
2017-05-17 21:00:01 incr backup started back to 2017-05-16 20:00:01
(backup #18) for directory /etc
2017-05-17 21:00:11 incr backup started back to 2017-05-16 20:00:01
(backup #18) for directory /root
2017-05-17 21:00:42 incr backup started back to 2017-05-16 20:00:01
(backup #18) for directory /home
2017-05-17 21:05:41 incr backup started back to 2017-05-16 20:00:01
(backup #18) for directory /var/local
2017-05-17 21:22:33 incr backup 19 complete, 210849 files, 0 bytes, 0
xferErrs (0 bad files, 0 bad shares, 0 other)
2017-05-17 21:22:33 Removing unfilled backup 10
2017-05-17 21:22:34 BackupPC_backupDelete: removing #10
2017-05-17 21:22:34 BackupPC_backupDelete: No prior backup for merge
2017-05-17 21:22:41 BackupPC_refCountUpdate: host localhost #11:
gotFsck = , gotDelta = , gotPoolCnt = 1, gotNoPoolCntOk =