Re: [BackupPC-users] Issue with remote backup of server(s) over VPN after failover

[Scott Saunders]

Thanks for sharing Stefan.

Unfortunately, I don't think either of those is causing an issue here. 
Both the remote and local sites have T1 connections each with a static 
IP. I recently did an fsck of the backup client's filesystem in question 
(I did it on the master client - any fsck changes would be replicated to 
the slave client via drbd - only one client node, the master in the 
pacemaker cluster, is allowed to have the filesystem mounted at a time) 
- should I also do an fsck of the backup server?

The odd thing here is 5-10 other clients continue to backup without 
errors while this one in particular exhibits what I have previously 
described. It never finishes the first (first here can mean the very 
first or original backup after the server was installed OR the first 
backup taken after backups haven't been taken for a week or two but are 
then resumed) remote backup, and it isn't even stopped by the 
clientTimeout. However, if I physically move the remote backup server 
local and take a full backup of the client in question, subsequent 
remote backups will succeed after moving the remote backup server back 
to the remote location.

Please share any thoughts you might have on what could be done to 
determine the cause here to find a solution. TIA

Scott

On 2/11/2011 1:15 AM, Stefan Peter wrote:
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA1
>
> Hi Scott
>
> Am 11.02.2011 01:29, schrieb Scott Saunders:
>> I let the most recent backup 'finish' on its own. It becomes a partial
>> backup in the host backup summary page with the following error:
>>
>> Read EOF:
>> Tried again: got 0 bytes
>> finish: removing in-process file path/to/filename.ext
>> Can't write 4 bytes to socket
>> Child is aborting
>> Done: 229002 files, 82767774899 bytes
>> Got fatal error during xfer (aborted by signal=PIPE)
>> Backup aborted by user signal
>>
> I had this problem in several times yet. In one case, it was caused by
> the remote ADSL line changing the TCP/IP address during the backup.
> Switching this line to a fixed IP fixed this for me. In all other cases,
> a fsck of the file system in question fixed the issue.
>
> Regards
>
> Stefan Peter
>
> - -- 
> In theory there is no difference between theory and practice. In
> practice there is.
> -BEGIN PGP SIGNATURE-
> Version: GnuPG v1.4.10 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iQEcBAEBAgAGBQJNVPoJEBgqi52L7+L/7zwIAJXhvFoN50SUDvNRcMZ2Q7bH
> JHledI1cFIghcqHmN0HHNeTTzbmyIN9dCpG8piieDSnvYRkJotCWJWFP7e7n38sC
> SF1RhOTDorsO63AISE8pNwNhXscHB7I4PE/zCPsrixW/DiLVl8EptkyYX8UHzANZ
> vua2wz2s7BqwJDGFzLc09KoejVU/NYDI3DLkgcYblLAhM1FpKs9dGTicXErjPF0X
> oDijBaa7iXjt5Uf2xjGVJDpS0dJ/SwBElPPn/S5n6HYjwgXDVGfVu4D7l6re7aD6
> hrPJ8qA+JQd6GyqXoFZJdbBR9S0mJHDH+TG3HMeS2OjS6XD+/3+Hxd4GRJVPSGU=
> =NRxB
> -END PGP SIGNATURE-
>
> --
> The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE:
> Pinpoint memory and threading errors before they happen.
> Find and fix more than 250 security defects in the development cycle.
> Locate bottlenecks in serial and parallel code that limit performance.
> http://p.sf.net/sfu/intel-dev2devfeb
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>

--
The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE:
Pinpoint memory and threading errors before they happen.
Find and fix more than 250 security defects in the development cycle.
Locate bottlenecks in serial and parallel code that limit performance.
http://p.sf.net/sfu/intel-dev2devfeb
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Issue with remote backup of server(s) over VPN after failover

[Scott Saunders]

I let the most recent backup 'finish' on its own. It becomes a partial 
backup in the host backup summary page with the following error:


Read EOF:
Tried again: got 0 bytes
finish: removing in-process file path/to/filename.ext
Can't write 4 bytes to socket
Child is aborting
Done: 229002 files, 82767774899 bytes
Got fatal error during xfer (aborted by signal=PIPE)
Backup aborted by user signal

Note, this is well after the default clientTimeout of 72000(secs) and 
the in-process file it specified to be removing is only 114MB so I don't 
think it was due to hanging on a large file.


TypeFilled  Level   Start Date  Duration/mins   Age/days
...





fullyes 0   12/22 20:00 205.4   49.9
fullyes 0   12/29 21:00 136.2   42.8
fullyes 0   1/5 21:00   336.4   35.8
incrno  1   1/10 21:00  0.1 30.8
incrno  1   1/11 22:01  0.1 29.8
partial yes 0   1/28 02:00  17136.1 13.6


Looking a little further in the past, the results of the other node's 
partial backup are a little bit different:


Remote[1]: rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at 
rsync.c(543) [sender=3.0.7]
Can't write 32780 bytes to socket
Read EOF: Connection reset by peer
Tried again: got 0 bytes
finish: removing in-process file path/to/filename.ext
Child is aborting
Done: 32547 files, 30060082211 bytes
Got fatal error during xfer (aborted by signal=PIPE)
Backup aborted by user signal

The file it choked on was only 25MB.

Has nobody else had issues with one of their server's remote backups 
never finishing? The odd thing to me is that if I bring the remote 
backup server local to take a full backup of the server, subsequent 
remote backups of that server succeed (Note, other servers run remote 
backups without these issues). Any help here is appreciated. Maybe I'm 
just overlooking something simple, but I haven't made any progress on 
this issue for some time and I've searched the mailing list for help 
without finding a solution.


Could this possibly be an issue with an older version (we're running 
BackupPC version 3.0.0)? Could this possibly be related to tcp 
segmentation offload (set to 'on' for both backup client and backup 
server)? Could it be compatibility issues between rsync versions? The 
backup servers are running 2.6.9 protocol version 29 and both of the 
clients are running 3.0.7 protocol version 30. AFAIK the newer version 
would be backwards compatible, no? Is this setup confusing -- have I 
explained the issue well enough?


Scott

On 2/7/2011 2:46 PM, Scott Saunders wrote:

I've got a couple of servers running in a 2 node master/slave cluster
using pacemaker(corosync)/drbd. Like other servers, I've got them
configured to backup to a local BackupPC server as well as a remote (VPN
over T1) BackupPC server (rsync over ssh for both). However, with the
cluster, only the master node has the partition mounted that is to be
backed up, so the backups for the slave node will always fail. This is
ok, but maybe there is a better way to do this? Anyway, to get the
backups started I brought the remote backup server local to take a full
backup (because ~300GB). After a fail over of the master node to the
slave node the slave becomes the new master, gets the partition mounted
and thus has something to backup. The local backups work without a
problem on the new master. The remote backups act like they are working
on the new master, but never actually finish. I've let them go more than
a week, which is well past the default client timeout which has actually
never taken effect with these two boxes. This erroneous behavior
persists when failing back over to the original master. The only way I
get the remote backups going again is to bring the remote server local
for a full backup. Any subsequent remote backups work after this until a
fail over of the cluster occurs. Remote backups for other servers in the
past have been performed without these issues. Any ideas as to why there
are issues with the remote backup in this setup? And what I might try to
get the backups running again on the master node after a fail over
without having to bring the remote server local every time?

--
The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE:
Pinpoint memory and threading errors before they happen.
Find and fix more than 250 security defects in the development cycle.
Locate bottlenecks in serial and parallel code that limit performance.
http://p.sf.net/sfu/intel-dev2devfeb
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: 

[BackupPC-users] Issue with remote backup of server(s) over VPN after failover

[Scott Saunders]

I've got a couple of servers running in a 2 node master/slave cluster 
using pacemaker(corosync)/drbd. Like other servers, I've got them 
configured to backup to a local BackupPC server as well as a remote (VPN 
over T1) BackupPC server (rsync over ssh for both). However, with the 
cluster, only the master node has the partition mounted that is to be 
backed up, so the backups for the slave node will always fail. This is 
ok, but maybe there is a better way to do this? Anyway, to get the 
backups started I brought the remote backup server local to take a full 
backup (because ~300GB). After a fail over of the master node to the 
slave node the slave becomes the new master, gets the partition mounted 
and thus has something to backup. The local backups work without a 
problem on the new master. The remote backups act like they are working 
on the new master, but never actually finish. I've let them go more than 
a week, which is well past the default client timeout which has actually 
never taken effect with these two boxes. This erroneous behavior 
persists when failing back over to the original master. The only way I 
get the remote backups going again is to bring the remote server local 
for a full backup. Any subsequent remote backups work after this until a 
fail over of the cluster occurs. Remote backups for other servers in the 
past have been performed without these issues. Any ideas as to why there 
are issues with the remote backup in this setup? And what I might try to 
get the backups running again on the master node after a fail over 
without having to bring the remote server local every time?

--
The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE:
Pinpoint memory and threading errors before they happen.
Find and fix more than 250 security defects in the development cycle.
Locate bottlenecks in serial and parallel code that limit performance.
http://p.sf.net/sfu/intel-dev2devfeb
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] converting a backup from inc to full

[Scott Saunders]

dan wrote:
> yes, its that incrementals dont last, either that or i have to keep an 
> insane number of them.
>  i dont want my month end backups being deleted and having only 
> backups for random days throughout the year
>
> On Feb 1, 2008 3:40 PM, Les Mikesell <[EMAIL PROTECTED] 
> > wrote:
>
> Timothy J. Massey wrote:
>
> >  > I would like to be able to convert a backup from an
> incremental to a
> >  > full.  Im not sure if just changing the entry in the backups file
> >  > from inc to full will work or not but i would like to suggest a
> >  > method of doing this from the CGI.
> >  >
> >  > anyone know if it will work just changing the type in the
> backups file?
> >
> > What possible legitimate purpose are you trying to serve here?
>
> I think he mentioned the real objective in an earlier email as being
> able to save end-of-month backup runs for a much longer time than any
> others.
>
> --
>   Les Mikesell
> [EMAIL PROTECTED] 
>
>
> 
>
> -
> This SF.net email is sponsored by: Microsoft
> Defy all challenges. Microsoft(R) Visual Studio 2008.
> http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/
> 
>
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>   
If I understand correctly I have the same concerns.  Even though I have 
set up some configurations to save a trailing full backup every four 
weeks or so for about a year, I won't get the exact day for end of month 
backups - they could end up happening a couple of days before the month 
is over or perhaps even at the beginning of the next month depending on 
the values used.  For some this may not be an ideal setup.  I don't 
think this is possible through backuppc.  The only way I can think of 
how this would work would be to setup cron jobs to schedule each hosts 
backups to one's liking which would be a little bit more complicated 
than setting up the host configuration files when it comes to choosing a 
transport, tweaking the flags and deciding on what to include or exclude...

-Scott

-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] scheduling full backups to take place on a weekend

[Scott Saunders]

I've noticed with the default scheduling for a backup a full week of a 
host is backed up consisting of 1 full and 6 incrementals.  Using the 
default scheduling as an example, the full could happen any day of the 
week or the scheduling would even be reset if the backuppc daemon is 
restarted.  Please correct me if my understanding of this is wrong.  
What I want to be able to do in this case is have the incrementals take 
place on weekdays and the full happen on a Saturday or Sunday.  Is there 
a consistent way to control this behavior using as many of the program 
defaults as possible (i understand that scheduling things this way could 
be completely controlled using cron jobs but I'd rather not have to do 
that for every host I want to backup)?

-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] scheduling backups

[Scott Saunders]

Rich Rauenzahn wrote:
>
>> Multiple profiles?  I'm not sure I understand.  Would this consist of 
>> creating multiple per-host configurations for the same host? If so,   
> Yes...
>
>> would there be a specific naming convention?  Is there a way to have   
>
> No...
>> backuppc still automatically back them up - aren't these 
>> configurations to be named after the host thus allowing only one file 
>> per host?
>>
>>   
> See "$Conf{ClientNameAlias}" -- set it to the real hostname that the 
> config file pertains to.  So you could have several config files.. 
> such as..
>
> hostA_share1.pl
> hostA_share2.pl
> hostA_share3.pl
>
> And have all three of those names in the /etc/BackupPC/hosts file 
> (without the .pl), but each one would override the hostname by having 
> the ClientNameAlias set within it to 'hostA'
>
> Rich
>
This seems to make sense, however when I set it up at first the host(s) 
could not be backed up because of "host not found" error. Placing 
hostA_share1 and hostA_share2 and so on  in the /etc/backuppc/hosts file 
seemed to cause this as they are not real host names and fail an 
nmblookup query.  Should these names be able to pass an nmblookup 
query?  Also, pings to the host seemed to fail until I created new dns 
entries for each hostA_share# on the dns server.  After doing so I was 
able to do a successful backup.  Is this absolutely necessary or should 
a local update of the /etc/hosts file suffice? 
ip   fqdn   hostA_share#


-
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] scheduling backups

[Scott Saunders]

> On 01/09 09:19 , Scott Saunders wrote:
>> > I know it's possible to set specific schedules for backups per host 
>> > using $Conf{FullPeriod}, $Conf{IncPeriod}, and $Conf{FullKeepCnt}among 
>> > others, but I was wondering if there is a way to do scheduling specific 
>> > to a smaller subset of that - being per shares on the same host.  Any 
>> > ideas/solutions?
>> 
>
> set up multiple profiles for the same host; each of which backs up a
> particular area. Then schedule them individually; or with a script run from
> cron which does them serially.
>
> -- Carl Soderstrom Systems Administrator Real-Time Enterprises 
> www.real-time.com
Multiple profiles?  I'm not sure I understand.  Would this consist of 
creating multiple per-host configurations for the same host? If so, 
would there be a specific naming convention?  Is there a way to have 
backuppc still automatically back them up - aren't these configurations 
to be named after the host thus allowing only one file per host?

-Scott

-
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] scheduling backups

[Scott Saunders]

I know it's possible to set specific schedules for backups per host 
using $Conf{FullPeriod}, $Conf{IncPeriod}, and $Conf{FullKeepCnt}among 
others, but I was wondering if there is a way to do scheduling specific 
to a smaller subset of that - being per shares on the same host.  Any 
ideas/solutions?

-Scott

-
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/