Re: [BackupPC-users] Unable to read 2757426 bytes from /home/backuppc/pc/mail/new
On Wednesday 06 September 2006 10:19, Les Mikesell wrote: On Wed, 2006-09-06 at 10:01 -0700, David Koski wrote: Last nights backup looks about the same with same errors. There are about 64 of these: Unable to read 2757426 bytes from /home/backuppc/pc/mail/new//f%2f/RStmp got=2287922, seekPosn=78452430 (4608,339,10001,80740352,81347343) The errors have returned. I am getting about 20 exactly like this: Unable to read 7389184 bytes from /home/backuppc/pc/mail/new//f%2f/RStmp got=6832128, seekPosn=364363776 (6656,451,22691,371195904,371762304) ..and about 80 with other numeric parameters. Any idea what might cause this? I still don't understand those, but maybe they are a symptom of: There are about 225 of these: Remote[2]: file has vanished: /var/CommuniGate/Queue/27732874.msg These are normal when backing up active file systems. It just means that the file went away between reading the directory to get the name and opening the file. I'm not sure what backuppc does with growing/shrinking files - tar takes only the length known when the header is written and pads with nulls if the file has shrunk. I have excluded the Queue directory to eliminate these. David Koski [EMAIL PROTECTED] - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Unable to read 2757426 bytes from /home/backuppc/pc/mail/new
On Mon, 2006-09-18 at 09:10 -0700, David Koski wrote: On Wed, 2006-09-06 at 10:01 -0700, David Koski wrote: Last nights backup looks about the same with same errors. There are about 64 of these: Unable to read 2757426 bytes from /home/backuppc/pc/mail/new//f%2f/RStmp got=2287922, seekPosn=78452430 (4608,339,10001,80740352,81347343) The errors have returned. I am getting about 20 exactly like this: Unable to read 7389184 bytes from /home/backuppc/pc/mail/new//f%2f/RStmp got=6832128, seekPosn=364363776 (6656,451,22691,371195904,371762304) ..and about 80 with other numeric parameters. Any idea what might cause this? I still don't understand those, but maybe they are a symptom of: There are about 225 of these: Remote[2]: file has vanished: /var/CommuniGate/Queue/27732874.msg These are normal when backing up active file systems. It just means that the file went away between reading the directory to get the name and opening the file. I'm not sure what backuppc does with growing/shrinking files - tar takes only the length known when the header is written and pads with nulls if the file has shrunk. I have excluded the Queue directory to eliminate these. Same problem, different place. The files are disappearing between the time the directory is read to find the name and opening the file for copying. That looks like a maildir directory where frequent changes would be expected. -- Les Mikesell [EMAIL PROTECTED] - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Unable to read 2757426 bytes from /home/backuppc/pc/mail/new
On Monday 18 September 2006 09:18, Les Mikesell wrote: On Mon, 2006-09-18 at 09:10 -0700, David Koski wrote: On Wed, 2006-09-06 at 10:01 -0700, David Koski wrote: Last nights backup looks about the same with same errors. There are about 64 of these: Unable to read 2757426 bytes from /home/backuppc/pc/mail/new//f%2f/RStmp got=2287922, seekPosn=78452430 (4608,339,10001,80740352,81347343) The errors have returned. I am getting about 20 exactly like this: Unable to read 7389184 bytes from /home/backuppc/pc/mail/new//f%2f/RStmp got=6832128, seekPosn=364363776 (6656,451,22691,371195904,371762304) ..and about 80 with other numeric parameters. Any idea what might cause this? I still don't understand those, but maybe they are a symptom of: There are about 225 of these: Remote[2]: file has vanished: /var/CommuniGate/Queue/27732874.msg These are normal when backing up active file systems. It just means that the file went away between reading the directory to get the name and opening the file. I'm not sure what backuppc does with growing/shrinking files - tar takes only the length known when the header is written and pads with nulls if the file has shrunk. I have excluded the Queue directory to eliminate these. Just to clarify, I am not getting file has vanished errors since I excluded the Queue directory from backup. Same problem, different place. The files are disappearing between the time the directory is read to find the name and opening the file for copying. That looks like a maildir directory where frequent changes would be expected. The Unable to read problem indicates the same seekPosn and other parameters every day for the past several days. Do you still think it is a transient file issue? Regards, David - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Unable to read 2757426 bytes from /home/backuppc/pc/mail/new
On Monday 18 September 2006 09:48, Les Mikesell wrote: On Mon, 2006-09-18 at 09:27 -0700, David Koski wrote: Just to clarify, I am not getting file has vanished errors since I excluded the Queue directory from backup. Same problem, different place. The files are disappearing between the time the directory is read to find the name and opening the file for copying. That looks like a maildir directory where frequent changes would be expected. The Unable to read problem indicates the same seekPosn and other parameters every day for the past several days. Do you still think it is a transient file issue? That's 'not supposed' to happen on filesystems with unix semantics. That is, if a process gets a file open, it is supposed to continue to have access to it's data even if some other process removes or renames it. It could happen if another process truncates it - which doesn't seem likely for programs using maildir format. It also might happen over an NFS mount, although NFS goes through some contortions to avoid it. In any case, it is somehow related to filesystem activity and probably doesn't hurt much as long as you can restore the other files. But this error occurs in the same position day after day, increasing in number of times it is found in the log. Now for a dumb question: Does that error indicate a problem on the backuppc server or the server being backed up? I have been assuming the whole time it was the backuppc server. Thanks, David - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Unable to read 2757426 bytes from /home/backuppc/pc/mail/new
On Mon, 2006-09-18 at 09:59 -0700, David Koski wrote: But this error occurs in the same position day after day, increasing in number of times it is found in the log. Now for a dumb question: Does that error indicate a problem on the backuppc server or the server being backed up? I have been assuming the whole time it was the backuppc server. It's being reported on the backuppc copy. I was assuming it got that way because it encountered the error when reading the remote file after starting the copy but I could easily be wrong. -- Les Mikesell [EMAIL PROTECTED] - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Unable to read 2757426 byte s from /home/backuppc/pc/mail/new
On Monday 18 September 2006 11:19, Les Mikesell wrote: On Mon, 2006-09-18 at 09:59 -0700, David Koski wrote: But this error occurs in the same position day after day, increasing in number of times it is found in the log. Now for a dumb question: Does that error indicate a problem on the backuppc server or the server being backed up? I have been assuming the whole time it was the backuppc server. It's being reported on the backuppc copy. I was assuming it got that way because it encountered the error when reading the remote file after starting the copy but I could easily be wrong. Thank you. I have removed a drive from the mirror of the backuppc host, zeroed the superblock and readded it to get a fresh resynchronization. I'll see what happens tonight with the next backup. Regards, David Koski [EMAIL PROTECTED] - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backuppc and incremental backup question
Les Mikesell wrote: Has anyone looked at using the bacula client as another transfer method? I'm not sure how it handles incrementals but using the native backup api on windows clients might have some advantages. The bacula client also has the same problem of not being able to intelligently detect moved files/directories. Rsync looks to be the best solution. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Client Push revisited
John, I have used two approaches to this problem. 1. Change to rdiff-backup for the mobile clients. It does not have the GUI, but it does have a nice command line for dealing incrementals, expiring incrementals, etc. I use it on my laptop. 2. The second option is more time consuming to set up, but I am using it for a system that backups 1400+ workstations. On each workstation I run a small script that updates Openldap with the workstation IP and Mac address. Then I have a script that creates a DHCP hosts file and restarts the DHCP server. This along with Dynamic DNS means that each laptop ends up with a single network name no matter which physical network it is on so BackupPC can get to the laptop to back it up. This should be easier if you are running Active Directory as Microsoft workstations add entries to AD when they get an IP. cheers, ski John Locke wrote: Hi, I've gone through the archives, and found messages from 2003 about client push (backups initiated from client machines to the backup server) being on the long range plans. Has any work progressed on this front? I've got a couple networks I'm managing that have roaming Windows laptops. They already run Rsync via Cygwin to do essentially a straight copy to the server, not using BackupPC at all. The backup server already provides rotating backups, using hard links to make copies of the existing backups but only use disk space when a file changes. It would be great to have access to these backups via the CGI script. Alternatively, it would be fantastic if backuppc acted like an Rsync server, accepting client connections from a remote Rsync sender, and adding these files according to the BackupPC storage system. Are there any current plans for implementing either system? I don't currently have bandwidth for working on this, but if there's a relatively straightforward place to start developing this sort of functionality, I may be able to free up some developer time to work on this sort of thing... Cheers, -- When we try to pick out anything by itself, we find it connected to the entire universeJohn Muir Chris Ski Kacoroski, [EMAIL PROTECTED], 206-501-9803 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Client Push revisited
Hi, Ski, Thanks for your reply, but I don't think it addresses my need... Ski Kacoroski wrote: John, I have used two approaches to this problem. 1. Change to rdiff-backup for the mobile clients. It does not have the GUI, but it does have a nice command line for dealing incrementals, expiring incrementals, etc. I use it on my laptop. I'll have to check this out--can it be used in conjunction with BackupPC? 2. The second option is more time consuming to set up, but I am using it for a system that backups 1400+ workstations. On each workstation I run a small script that updates Openldap with the workstation IP and Mac address. Then I have a script that creates a DHCP hosts file and restarts the DHCP server. This along with Dynamic DNS means that each laptop ends up with a single network name no matter which physical network it is on so BackupPC can get to the laptop to back it up. This should be easier if you are running Active Directory as Microsoft workstations add entries to AD when they get an IP. This isn't the issue--I've already got DHCP updating DNS with client hostnames. BackupPC can find the hosts, no problem. The issue is that I would rather keep server software (rsyncd, ssh, Windows Networking/Samba) off my mobile clients, and initiate backups from them so they don't have to enable/disable firewalls, etc. when connecting to untrusted networks. Any other ideas? Thanks again, -- John Locke Open Source Solutions for Small Business Problems published by Charles River Media, June 2004 http://www.freelock.com - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/