Re: [BackupPC-users] Late to the Game: Upgrading from Version 3.x on Fedora 25

[Tim Evans]

On 05/29/2017 09:24 PM, Tim Evans wrote:

Today's update:  The full backup ran for just a few minutes over 24 
hours and was killed by BackupPC; log says:


2017-05-29 15:34:24 Backup failed on pelican (BackupPC_tarExtract exited 
with fail status 256)

2017-05-29 15:34:27 Started full backup on pelican (pid=15026, share=C$)

As you can see, a new full backup was kicked off almost immediately.

I've googled the "BackupPC_tarExtract exited with fail status 256" 
message and found many hits, going back to version 3 of BackupPC.  Seems 
to be a problem with Linux 'tar' extracting the incoming data.


There was a thread just a month ago (late April/early May) on this 
mailing list entitled "Multiple issues on newly installed 4.1.0" which 
discussed the apparent same issue of failing backups due to a problem in 
'tar.' In this thread, Craig Barratt wrote that he had pushed a fix to 
git for this issue. I'm guessing this hasn't yet made it into the 4.1.2 
version in the Hobbes Fedora 25 repo?


Any other info would be appreciated.  Thanks.


Just wanted to update this thread.  Release 4.1.3 
(BackupPC-4.1.3-1.fc25.x86_64) has come down via the Hobbes repo since I 
last posted.


Still, I'm seeing the same "BackupPC_tarExtract exited with fail status 
256" error from time to time.  Some backups (full and incremental) 
complete successfully, but others hang and are killed/restarted with the 
same error. The restarted backups always complete without error.

--
Tim Evans   |5 Chestnut Court
443-394-3864|Owings Mills, MD 21117

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Late to the Game: Upgrading from Version 3.x on Fedora 25

[Tim Evans]

On 05/28/2017 05:18 PM, Tim Evans wrote:

The UID thing took me off in the wrong direction.  The BackupPC service 
was failing to start, so, of course, the web interface wouldn't show 
anything!


Poking around in the journalctl output, I find:

May 28 13:08:56 osprey BackupPC[3990]: 2017-05-28 13:08:56 PoolV3Enabled 
is set, and can't create a test hardlink between a file in 
/raptor/pc-backups//pc and /raptor/pc-backups//cpool.  Either these are 
different file systems, or this file system doesn't support hardlinks, 
or these directories don't exist, or there is a permissions problem, or 
the file system is out of inodes or full.  Use df, df -i, and ls -ld to 
check each of these possibilities. Quitting...


Well, I'd removed the entire filetree that contained the version 3 pool 
in cleaning things up, but forgot to turn the upgrade option off in 
config.pl. (This maybe shouldn't be a fatal error?)


So, config.pl now fixed and the service is now running, as is a full 
backup of the Win 7 PC. Will report back when/if it finishes.


Thanks, again.


Today's update:  The full backup ran for just a few minutes over 24 
hours and was killed by BackupPC; log says:


2017-05-29 15:34:24 Backup failed on pelican (BackupPC_tarExtract exited 
with fail status 256)

2017-05-29 15:34:27 Started full backup on pelican (pid=15026, share=C$)

As you can see, a new full backup was kicked off almost immediately.

I've googled the "BackupPC_tarExtract exited with fail status 256" 
message and found many hits, going back to version 3 of BackupPC.  Seems 
to be a problem with Linux 'tar' extracting the incoming data.


There was a thread just a month ago (late April/early May) on this 
mailing list entitled "Multiple issues on newly installed 4.1.0" which 
discussed the apparent same issue of failing backups due to a problem in 
'tar.' In this thread, Craig Barratt wrote that he had pushed a fix to 
git for this issue. I'm guessing this hasn't yet made it into the 4.1.2 
version in the Hobbes Fedora 25 repo?


Any other info would be appreciated.  Thanks.
--
Tim Evans   |   5 Chestnut Court
|   Owings Mills, MD 21117
|   443-394-3864

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Late to the Game: Upgrading from Version 3.x on Fedora 25

[Tim Evans]

On 05/28/2017 03:17 PM, Richard Shaw wrote:
I didn't have to modify the user BackupPC or apache runs as but I did 
change the group on config.pl  from backuppc to apache 
and that seems to work for me...


# ll /etc/BackupPC/
total 96
-rw-r-. 1 backuppc backuppc46 Jan 20  2013 apache.users
-rw-r-. 1 backuppc apache   82263 May 11 19:45 config.pl 


-rw-r-. 1 backuppc apache2293 Mar 26 13:29 hosts
-rw-r-. 1 backuppc apache   0 May 28 14:00 LOCK
drwxr-x---. 2 backuppc apache4096 Apr 29 07:31 pc


The UID thing took me off in the wrong direction.  The BackupPC service 
was failing to start, so, of course, the web interface wouldn't show 
anything!


Poking around in the journalctl output, I find:

May 28 13:08:56 osprey BackupPC[3990]: 2017-05-28 13:08:56 PoolV3Enabled 
is set, and can't create a test hardlink between a file in 
/raptor/pc-backups//pc and /raptor/pc-backups//cpool.  Either these are 
different file systems, or this file system doesn't support hardlinks, 
or these directories don't exist, or there is a permissions problem, or 
the file system is out of inodes or full.  Use df, df -i, and ls -ld to 
check each of these possibilities. Quitting...


Well, I'd removed the entire filetree that contained the version 3 pool 
in cleaning things up, but forgot to turn the upgrade option off in 
config.pl. (This maybe shouldn't be a fatal error?)


So, config.pl now fixed and the service is now running, as is a full 
backup of the Win 7 PC. Will report back when/if it finishes.


Thanks, again.
--
Tim Evans   |   5 Chestnut Court
|   Owings Mills, MD 21117
|   443-394-3864

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Late to the Game: Upgrading from Version 3.x on Fedora 25

[Richard Shaw]

I didn't have to modify the user BackupPC or apache runs as but I did
change the group on config.pl from backuppc to apache and that seems to
work for me...

# ll /etc/BackupPC/
total 96
-rw-r-. 1 backuppc backuppc46 Jan 20  2013 apache.users
-rw-r-. 1 backuppc apache   82263 May 11 19:45 config.pl
-rw-r-. 1 backuppc apache2293 Mar 26 13:29 hosts
-rw-r-. 1 backuppc apache   0 May 28 14:00 LOCK
drwxr-x---. 2 backuppc apache4096 Apr 29 07:31 pc

Thanks,
Richard
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Late to the Game: Upgrading from Version 3.x on Fedora 25

[Tim Evans]

On 05/25/2017 10:53 AM, Richard Shaw wrote:

As far as I can tell from experience with my upgrade on my CentOS 7 box, 
yes, that's all that should be required. I did update some of the 
SELinux contexts for 4.x and other tweaks so it would be good to hear 
how smoothly things go as I haven't gotten any feedback yet from people 
upgrading from 3.x to 4.x.




OK, this started out like it was going to be a trivial update.

Dnf'd the update, checked out config.pl and made needed changes there 
and my hosts file, and fired off a full, SMB-based backup of a Windows 7 PC.


Version 4.x dutifully converted the backup pool.  The backup ran for 24 
hours and never completed, then it was killed and restarted.  *This was 
the very problem that led to my abandoning version 3.x 18 months ago.*


So, I assumed something, somewhere is corrupted, and dnf removed 
BackupPC and the very old pool, and re-installed.  Again, restored 
changes to config.pl and hosts file.


Now BackupPC won't start.  Web page says:

"Error: Wrong user: my userid is 48, instead of 987(backuppc)

This script needs to run as the user specified in $Conf{BackupPCUser}, 
which is set to backuppc.


This is an installation problem. If you are using mod_perl then it 
appears that Apache is not running as user backuppc. If you are not 
using mod_perl, then most like setuid is not working properly on 
BackupPC_Admin. Check the permissions on 
/usr/libexec/BackupPC/BackupPC_Admin and look at the documentation."


UID 48 is, of course, apache.

Permissions on /usr/libexec/BackupPC/BackupPC_Admin appear to be 
correct, based on comparison from a dump-based backup.


Googling this message brings up lots of hits, mostly suggestions to run 
either BackupPC as the apache user, or to run Apache as the backuppc 
user.  Neither works in this case.


Other ideas welcome.  Thanks.



--
Tim Evans   |5 Chestnut Court
443-394-3864|Owings Mills, MD 21117

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Late to the Game: Upgrading from Version 3.x on Fedora 25

[Richard Shaw]

On Thu, May 25, 2017 at 9:26 AM, Tim Evans  wrote:

> On 05/24/2017 12:57 PM, Richard Shaw wrote:
>
> The main thing is to merge config.pl . Your old one
>> should not be overwritten and the new one from the 4.x package should be
>> renamed to config.pl.rpmnew.
>>
>
> Thank you, Richard.  I'll be sure to follow these instructions.
>
> My questions are more fundamental, however:
>
> o   Do I need to remove Version 3.x first?
>

No, it works like any other package upgrade.



> o   If not, does the version 4.x from the referenced repo replace the
> existing Version 3.x install, with just the fixes to config.pl needed?


As far as I can tell from experience with my upgrade on my CentOS 7 box,
yes, that's all that should be required. I did update some of the SELinux
contexts for 4.x and other tweaks so it would be good to hear how smoothly
things go as I haven't gotten any feedback yet from people upgrading from
3.x to 4.x.

Thanks,
Richard
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Late to the Game: Upgrading from Version 3.x on Fedora 25

[Adam Goryachev]

On 25/05/17 02:57, Richard Shaw wrote:
On Wed, May 24, 2017 at 10:53 AM, Tim Evans > wrote:


I have BackupPC-3.3.1-7.fc25.x86_64 installed on Fedora 25. Stopped
using it a good while back when the Samba changes screwed things up.
Could never get the patches to 3.x to work for me.  My backup pool is
now more than a year out of date.

(I have been running an alternative backup mechanism (NetGear ReadyNAS
built-in backups), with a separate destination, so the old pool isn't
important.)

I'd like to install version 4.x, but must've missed any step-by-steps
that have been published. I've found the Hobbes repo, but there's
nothing there in the way of docs.


The main thing is to merge config.pl . Your old one 
should not be overwritten and the new one from the 4.x package should 
be renamed to config.pl.rpmnew.


You can diff the two and merge what you need from the old one into the 
new one. The main difference being (IIRC) that the rsync path and 
rsync arguments being split into two different variables.


Something like:
# cd /etc/BackupPC
# mv config.pl  config.pl.old
# mv config.pl.rpmnew config.pl 
# diff -Nau config.pl.old config.pl  > changes.diff

Then review changes.diff and merge what you need over to the new 
config.pl 


It is a bit time consuming because the supplied default config.pl 
 and the changes made the first time you click save 
from the CGI interface create a lot of false positives in the diff.


Thanks,
Richard
In relation to this, it would be great if the original shipped config.pl 
was never modified, but there was a line at the bottom to either include 
a config_local.pl or all files contained in a directory named config.d
This would make upgrades *much* easier, since all your local edits are 
contained safely in a different file, so all you need to do is 
rename/adjust your custom settings if the variable name has changed/etc.


PS, this is already easy to do, as long as you never modify settings 
from the web, but it shouldn't be difficult to add this for the web 
editor to support the same concept.


I'm not sure what other distros do, but it appears this is being done 
for a lot of debian/ubuntu packages.


Regards,
Adam
--
Adam Goryachev Website Managers www.websitemanagers.com.au
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Late to the Game: Upgrading from Version 3.x on Fedora 25

[Richard Shaw]

On Wed, May 24, 2017 at 10:53 AM, Tim Evans  wrote:

> I have BackupPC-3.3.1-7.fc25.x86_64 installed on Fedora 25.  Stopped
> using it a good while back when the Samba changes screwed things up.
> Could never get the patches to 3.x to work for me.  My backup pool is
> now more than a year out of date.
>
> (I have been running an alternative backup mechanism (NetGear ReadyNAS
> built-in backups), with a separate destination, so the old pool isn't
> important.)
>
> I'd like to install version 4.x, but must've missed any step-by-steps
> that have been published. I've found the Hobbes repo, but there's
> nothing there in the way of docs.


The main thing is to merge config.pl. Your old one should not be
overwritten and the new one from the 4.x package should be renamed to
config.pl.rpmnew.

You can diff the two and merge what you need from the old one into the new
one. The main difference being (IIRC) that the rsync path and rsync
arguments being split into two different variables.

Something like:
# cd /etc/BackupPC
# mv config.pl config.pl.old
# mv config.pl.rpmnew config.pl
# diff -Nau config.pl.old config.pl > changes.diff

Then review changes.diff and merge what you need over to the new config.pl

It is a bit time consuming because the supplied default config.pl and the
changes made the first time you click save from the CGI interface create a
lot of false positives in the diff.

Thanks,
Richard
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] Late to the Game: Upgrading from Version 3.x on Fedora 25

[Tim Evans]

I have BackupPC-3.3.1-7.fc25.x86_64 installed on Fedora 25.  Stopped 
using it a good while back when the Samba changes screwed things up. 
Could never get the patches to 3.x to work for me.  My backup pool is 
now more than a year out of date.

(I have been running an alternative backup mechanism (NetGear ReadyNAS 
built-in backups), with a separate destination, so the old pool isn't 
important.)

I'd like to install version 4.x, but must've missed any step-by-steps 
that have been published. I've found the Hobbes repo, but there's 
nothing there in the way of docs.

As noted, the backup pool is quite old and I don't really care about it, 
but I do want to keep the existing config.

Can someone point me to an upgrade recipe?  Thanks.
-- 
Tim Evans   |5 Chestnut Court
443-394-3864|Owings Mills, MD 21117

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/