Re: [BackupPC-users] Unable to read 2757426 bytes from /home/backuppc/pc/mail/new

2006-09-18 Thread David Koski
On Wednesday 06 September 2006 10:19, Les Mikesell wrote:
 On Wed, 2006-09-06 at 10:01 -0700, David Koski wrote:
  Last nights backup looks about the same with same errors. There are about
  64 of these:
 
  Unable to read 2757426 bytes from /home/backuppc/pc/mail/new//f%2f/RStmp
  got=2287922, seekPosn=78452430 (4608,339,10001,80740352,81347343)

The errors have returned. I am getting about 20 exactly like this:

Unable to read 7389184 bytes from /home/backuppc/pc/mail/new//f%2f/RStmp 
got=6832128, seekPosn=364363776 (6656,451,22691,371195904,371762304)

..and about 80 with other numeric parameters. Any idea what might cause this?

 I still don't understand those, but maybe they are a symptom of:
  There are about 225 of these:
 
  Remote[2]: file has vanished: /var/CommuniGate/Queue/27732874.msg

 These are normal when backing up active file systems.  It just means
 that the file went away between reading the directory to get the
 name and opening the file.   I'm not sure what backuppc does with
 growing/shrinking files - tar takes only the length known when
 the header is written and pads with nulls if the file has shrunk.

I have excluded the Queue directory to eliminate these.

David Koski
[EMAIL PROTECTED]

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/


Re: [BackupPC-users] Unable to read 2757426 bytes from /home/backuppc/pc/mail/new

2006-09-18 Thread Les Mikesell
On Mon, 2006-09-18 at 09:10 -0700, David Koski wrote:
  On Wed, 2006-09-06 at 10:01 -0700, David Koski wrote:
   Last nights backup looks about the same with same errors. There are about
   64 of these:
  
   Unable to read 2757426 bytes from /home/backuppc/pc/mail/new//f%2f/RStmp
   got=2287922, seekPosn=78452430 (4608,339,10001,80740352,81347343)
 
 The errors have returned. I am getting about 20 exactly like this:
 
 Unable to read 7389184 bytes from /home/backuppc/pc/mail/new//f%2f/RStmp 
 got=6832128, seekPosn=364363776 (6656,451,22691,371195904,371762304)
 
 ..and about 80 with other numeric parameters. Any idea what might cause this?
 
  I still don't understand those, but maybe they are a symptom of:
   There are about 225 of these:
  
   Remote[2]: file has vanished: /var/CommuniGate/Queue/27732874.msg
 
  These are normal when backing up active file systems.  It just means
  that the file went away between reading the directory to get the
  name and opening the file.   I'm not sure what backuppc does with
  growing/shrinking files - tar takes only the length known when
  the header is written and pads with nulls if the file has shrunk.
 
 I have excluded the Queue directory to eliminate these.

Same problem, different place. The files are disappearing between
the time the directory is read to find the name and opening the
file for copying.  That looks like a maildir directory where
frequent changes would be expected.

-- 
  Les Mikesell
[EMAIL PROTECTED]



-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/


Re: [BackupPC-users] Unable to read 2757426 bytes from /home/backuppc/pc/mail/new

2006-09-18 Thread David Koski
On Monday 18 September 2006 09:18, Les Mikesell wrote:
 On Mon, 2006-09-18 at 09:10 -0700, David Koski wrote:
   On Wed, 2006-09-06 at 10:01 -0700, David Koski wrote:
Last nights backup looks about the same with same errors. There are
about 64 of these:
   
Unable to read 2757426 bytes from
/home/backuppc/pc/mail/new//f%2f/RStmp got=2287922, seekPosn=78452430
(4608,339,10001,80740352,81347343)
 
  The errors have returned. I am getting about 20 exactly like this:
 
  Unable to read 7389184 bytes from /home/backuppc/pc/mail/new//f%2f/RStmp
  got=6832128, seekPosn=364363776 (6656,451,22691,371195904,371762304)
 
  ..and about 80 with other numeric parameters. Any idea what might cause
  this?
 
   I still don't understand those, but maybe they are a symptom of:
There are about 225 of these:
   
Remote[2]: file has vanished: /var/CommuniGate/Queue/27732874.msg
  
   These are normal when backing up active file systems.  It just means
   that the file went away between reading the directory to get the
   name and opening the file.   I'm not sure what backuppc does with
   growing/shrinking files - tar takes only the length known when
   the header is written and pads with nulls if the file has shrunk.
 
  I have excluded the Queue directory to eliminate these.

Just to clarify, I am not getting file has vanished errors since I excluded 
the Queue directory from backup.

 Same problem, different place. The files are disappearing between
 the time the directory is read to find the name and opening the
 file for copying.  That looks like a maildir directory where
 frequent changes would be expected.

The Unable to read problem indicates the same seekPosn and other 
parameters every day for the past several days. Do you still think it is a 
transient file issue?

Regards,
David

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/


Re: [BackupPC-users] Unable to read 2757426 bytes from /home/backuppc/pc/mail/new

2006-09-18 Thread David Koski
On Monday 18 September 2006 09:48, Les Mikesell wrote:
 On Mon, 2006-09-18 at 09:27 -0700, David Koski wrote:
  Just to clarify, I am not getting file has vanished errors since I
  excluded the Queue directory from backup.
 
   Same problem, different place. The files are disappearing between
   the time the directory is read to find the name and opening the
   file for copying.  That looks like a maildir directory where
   frequent changes would be expected.
 
  The Unable to read problem indicates the same seekPosn and other
  parameters every day for the past several days. Do you still think it is
  a transient file issue?

 That's 'not supposed' to happen on filesystems with unix semantics.
 That is, if a process gets a file open, it is supposed to continue
 to have access to it's data even if some other process removes
 or renames it.  It could happen if another process truncates
 it - which doesn't seem likely for programs using maildir format.
 It also might happen over an NFS mount, although NFS goes through
 some contortions to avoid it.  In any case, it is somehow related
 to filesystem activity and probably doesn't hurt much as long
 as you can restore the other files.

But this error occurs in the same position day after day, increasing in number 
of times it is found in the log.

Now for a dumb question: Does that error indicate a problem on the backuppc 
server or the server being backed up? I have been assuming the whole time it 
was the backuppc server.

Thanks,
David

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/


Re: [BackupPC-users] Unable to read 2757426 bytes from /home/backuppc/pc/mail/new

2006-09-18 Thread Les Mikesell
On Mon, 2006-09-18 at 09:59 -0700, David Koski wrote:

 But this error occurs in the same position day after day, increasing in 
 number 
 of times it is found in the log.
 
 Now for a dumb question: Does that error indicate a problem on the backuppc 
 server or the server being backed up? I have been assuming the whole time it 
 was the backuppc server.

It's being reported on the backuppc copy.  I was assuming it got that
way because it encountered the error when reading the remote file
after starting the copy but I could easily be wrong.

-- 
  Les Mikesell
   [EMAIL PROTECTED]



-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys -- and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/


Re: [BackupPC-users] Unable to read 2757426 byte s from /home/backuppc/pc/mail/new

2006-09-18 Thread David Koski
On Monday 18 September 2006 11:19, Les Mikesell wrote:
 On Mon, 2006-09-18 at 09:59 -0700, David Koski wrote:
  But this error occurs in the same position day after day, increasing in
  number of times it is found in the log.
 
  Now for a dumb question: Does that error indicate a problem on the
  backuppc server or the server being backed up? I have been assuming the
  whole time it was the backuppc server.

 It's being reported on the backuppc copy.  I was assuming it got that
 way because it encountered the error when reading the remote file
 after starting the copy but I could easily be wrong.

Thank you.  I have removed a drive from the mirror of the backuppc host, 
zeroed the superblock and readded it to get a fresh resynchronization. I'll 
see what happens tonight with the next backup.

Regards,
David Koski
[EMAIL PROTECTED]

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys -- and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/


Re: [BackupPC-users] Backuppc and incremental backup question

2006-09-18 Thread Philip Gleghorn
Les Mikesell wrote:
 Has anyone looked at using the bacula client as another
 transfer method?  I'm not sure how it handles incrementals
 but using the native backup api on windows clients might
 have some advantages.
 
The bacula client also has the same problem of not being able to 
intelligently detect moved files/directories. Rsync looks to be the best 
solution.


-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys -- and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/


Re: [BackupPC-users] Client Push revisited

2006-09-18 Thread Ski Kacoroski
John,

I have used two approaches to this problem.

1. Change to rdiff-backup for the mobile clients.  It does not have the 
GUI, but it does have a nice command line for dealing incrementals, 
expiring incrementals, etc.  I use it on my laptop.

2. The second option is more time consuming to set up, but I am using it 
for a system that backups 1400+ workstations.  On each workstation I run 
a small script that updates Openldap with the workstation IP and Mac 
address.  Then I have a script that creates a DHCP hosts file and 
restarts the DHCP server.  This along with Dynamic DNS means that each 
laptop ends up with a single network name no matter which physical 
network it is on so BackupPC can get to the laptop to back it up.

This should be easier if you are running Active Directory as Microsoft 
workstations add entries to AD when they get an IP.

cheers,

ski

John Locke wrote:
 Hi,
 
 I've gone through the archives, and found messages from 2003 about
 client push (backups initiated from client machines to the backup
 server) being on the long range plans. Has any work progressed on this
 front?
 
 I've got a couple networks I'm managing that have roaming Windows
 laptops. They already run Rsync via Cygwin to do essentially a straight
 copy to the server, not using BackupPC at all. The backup server already
 provides rotating backups, using hard links to make copies of the
 existing backups but only use disk space when a file changes.
 
 It would be great to have access to these backups via the CGI script.
 Alternatively, it would be fantastic if backuppc acted like an Rsync
 server, accepting client connections from a remote Rsync sender, and
 adding these files according to the BackupPC storage system.
 
 Are there any current plans for implementing either system?
 
 I don't currently have bandwidth for working on this, but if there's a
 relatively straightforward place to start developing this sort of
 functionality, I may be able to free up some developer time to work on
 this sort of thing...
 
 Cheers,
 

-- 
When we try to pick out anything by itself, we find it
  connected to the entire universeJohn Muir

Chris Ski Kacoroski, [EMAIL PROTECTED], 206-501-9803

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys -- and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/


Re: [BackupPC-users] Client Push revisited

2006-09-18 Thread John Locke
Hi, Ski,

Thanks for your reply, but I don't think it addresses my need...

Ski Kacoroski wrote:
 John,

 I have used two approaches to this problem.

 1. Change to rdiff-backup for the mobile clients.  It does not have
 the GUI, but it does have a nice command line for dealing
 incrementals, expiring incrementals, etc.  I use it on my laptop.
I'll have to check this out--can it be used in conjunction with BackupPC?

 2. The second option is more time consuming to set up, but I am using
 it for a system that backups 1400+ workstations.  On each workstation
 I run a small script that updates Openldap with the workstation IP and
 Mac address.  Then I have a script that creates a DHCP hosts file and
 restarts the DHCP server.  This along with Dynamic DNS means that each
 laptop ends up with a single network name no matter which physical
 network it is on so BackupPC can get to the laptop to back it up.

 This should be easier if you are running Active Directory as Microsoft
 workstations add entries to AD when they get an IP.
This isn't the issue--I've already got DHCP updating DNS with client
hostnames. BackupPC can find the hosts, no problem. The issue is that I
would rather keep server software (rsyncd, ssh, Windows
Networking/Samba) off my mobile clients, and initiate backups from them
so they don't have to enable/disable firewalls, etc. when connecting to
untrusted networks.

Any other ideas?

Thanks again,

-- 
John Locke
Open Source Solutions for Small Business Problems
published by Charles River Media, June 2004
http://www.freelock.com


-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys -- and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/