Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-18 Thread Adam Goryachev
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Holger Parplies wrote:
 Hi,
 
 Adam Goryachev wrote on 2009-08-13 15:42:26 +1000 [Re: [BackupPC-users] 
 100,000+ errors in last nights backup]:
 [...]
 I've frequently managed to cause two backuppc_dump's to run in parallel
 where one was scheduled by backuppc and one was run manually by me from
 the command line. It would be nice if backuppc_dump could do a simple
 check to see if the new directory already exists, and if so, simple exit
 (or error and exit).
 
 while a check would be possible, it's not quite as simple as that. What
 happens when the machine crashes during running backups? The new/ directory
 won't disappear by itself (well, BackupPC could move all new/ directories to
 trash on startup, but, according to your logic, you might just be running
 BackupPC_dump manually ...). File locking? Put up a big sign don't run
 BackupPC_dump manually unless you know what you are doing? ;-)

Of course, but programs shouldn't really be designed around what happens
when a system crashes (though they should try and handle it well).

A simple failure message if the new directory exists telling the admin
to rm -rf backuppc/pc/host/new or something to that effect would be
sufficient

 Mainly I run backups manually so I can see exactly what is happening
 during the backup and where/why it is failing or taking so long.
 
 Maybe there should/could be a way to serverMesg BackupPC to do a backup for a
 specific host with a -v switch and verbose logging directed to a specific file
 (i.e. make BackupPC_dump -v take a file name argument and pass that over via
 the BackupPC daemon). Please remind me in about two weeks ;-).

Well, I think there is already the ability to increase the log level,
and hence see more information in the log, but this has two issues:
1) I don't really want to modify the config to increase the log level, I
only want it to apply for the current run.
2) The existing logs are not flushed per line, they are only flushed
after a certain amount of bytes (probably per buffsize or whatever it is).

So, perhaps this could be achieved by fiddling the loglevel value with a
parameter, which could also force the log files to flush after each
line. I am pretty sure perl has a method to set this (per line flush or
buffer size flush) which can be set after the file open() and applies
until the file close()

PS, I know it hasn't been two weeks, but thought the above would be
easier to implement...

Regards,
Adam

- --
Adam Goryachev
Website Managers
www.websitemanagers.com.au
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAkqLeWAACgkQGyoxogrTyiVJHwCdEOgs6aT/Wopku3NLN+ErFsNa
6EIAn2qoMeEzF6BwrNLuhkaZ7OZN8ByD
=k+qX
-END PGP SIGNATURE-

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-17 Thread Holger Parplies
Hi,

Adam Goryachev wrote on 2009-08-13 15:42:26 +1000 [Re: [BackupPC-users] 
100,000+ errors in last nights backup]:
 [...]
 I've frequently managed to cause two backuppc_dump's to run in parallel
 where one was scheduled by backuppc and one was run manually by me from
 the command line. It would be nice if backuppc_dump could do a simple
 check to see if the new directory already exists, and if so, simple exit
 (or error and exit).

while a check would be possible, it's not quite as simple as that. What
happens when the machine crashes during running backups? The new/ directory
won't disappear by itself (well, BackupPC could move all new/ directories to
trash on startup, but, according to your logic, you might just be running
BackupPC_dump manually ...). File locking? Put up a big sign don't run
BackupPC_dump manually unless you know what you are doing? ;-)

 Mainly I run backups manually so I can see exactly what is happening
 during the backup and where/why it is failing or taking so long.

Maybe there should/could be a way to serverMesg BackupPC to do a backup for a
specific host with a -v switch and verbose logging directed to a specific file
(i.e. make BackupPC_dump -v take a file name argument and pass that over via
the BackupPC daemon). Please remind me in about two weeks ;-).

Regards,
Holger

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-17 Thread Holger Parplies
Hi,

Steve Blackwell wrote on 2009-08-13 00:26:20 -0400 [Re: [BackupPC-users] 
100,000+ errors in last nights backup]:
 I started to reply to your e-mail but my system crashed. The messages
 log suggests that backuppc may have been the culprit. See below.

hmm. See below.

 On Thu, 13 Aug 2009 02:19:25 +0200 Holger Parplies wb...@parplies.de
 wrote:
 
  [...] I can't imagine why
  two backups of the same host would be scheduled simultaneously, and I
  don't think it's a good idea to do so :-). BackupPC doesn't usually
  do this. Have you changed the code in any way? Have you seen such a
  thing happen before?
 
 Could I have started the backuppc service twice somehow?

I don't think so. BackupPC opens a UNIX domain socket on startup (and failing
to do that is a fatal error). This should make a second instance fail to start
up.

  So, I believe we're back to the issue of what you did wrong when
  moving $TopDir. I don't remember reading which version of BackupPC
 
 When moving $TopDir? I haven't moved it. It's always been /media/disk
 ever since I installed backuppc.

Meaning you installed from the SF tarball and set TopDir to /media/disk when
running the configure script?

  Below /media/disk/cpool? BackupPC_nightly reports files there, but
 
 # ls -l /media/disk
 total 48
 drwxr-x--- 18 backuppc root  4096 2009-08-12 20:00 cpool
 drwx--  2 root root 16384 2008-07-16 23:54 lost+found
 drwxr-x---  4 backuppc root  4096 2009-08-09 23:06 pc
 drwxr-x---  2 backuppc root  4096 2008-07-26 18:53 pool
 drwxr-x---  2 backuppc root  4096 2009-08-11 01:25 trash

Shouldn't there be a log directory there? Hmm. You might simply have put it
elsewhere (probably under /var/log). But I find it confusing that ...

 So cpool has today's date

... but ...

 ]# ls -l /media/disk/cpool
 [...]
 Nothing since 6/28.

Why is ctime on cpool/ updated when all subdirectories already exist? Hmm,
probably the hardlink test (which does *not* necessarily mean this is the
cpool BackupPC uses - again: which version are you running?).
In any case, pool files would be created three directory levels below.

 This is where I got to when the machine crashed. Looking
 at /var/log/messages I see this:
 
 [...]
 Aug 12 20:00:12 steve kernel: Pid: 17353, comm: BackupPC_tarExt

Yes, BackupPC_tarExtract was running ... not unusual during a backup. But user
space processes can't cause kernel panics (they can maybe trigger them, but
never *cause* them). I'm no expert on kernel stack traces, so I won't guess
about the cause. If I were you, I'd check the BackupPC pool file system (and
maybe system memory).

 This is repeated for the 2nd CPU. Does this have anything to do with
 that link we created?

No.

 As I said in an earlier e-mail, the disk I backup to is an external 1TB
 USB drive. My computer is old enough that the BIOS locks up when
 booting with this disk connected so I have to unplug it to boot.

Old enough as in USB1?

What kernel version are you running? Ah, yes. 2.6.27. I've had more problems
with older kernels and USB2 than I could have wished for, but newer kernels
seem to behave much better. Still, I'd try to avoid USB for such heavy use
as a BackupPC pool tends to be. Is that at all possible? eSATA? Does it *need*
to be an external disk?

 Backuppc fails during the boot process because it can't make the
 required links. 

Ok. That's good.

 After the machine has booted, I plug in the USB drive and it gets
 automatically mounted as disk on the mount point /media.

I take it you mean it is mounted on /media/disk ...

 Then I have to restart the backuppc service.

Can you umount it manually and run an fsck?

Regards,
Holger

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-13 Thread Steve Blackwell
Holger,

I started to reply to your e-mail but my system crashed. The messages
log suggests that backuppc may have been the culprit. See below.

On Thu, 13 Aug 2009 02:19:25 +0200 Holger Parplies wb...@parplies.de
wrote:

 Hi,
 
 Jeffrey J. Kosowsky wrote on 2009-08-12 18:12:09 -0400 [Re:
 [BackupPC-users] 100,000+ errors in last nights backup]:
  Steve Blackwell wrote at about 14:33:54 -0400 on Wednesday, August
  12, 2009:
Steve Blackwell wrote at about 11:18:36 -0400 on
Wednesday, August 12, 2009:
  On Wed, 12 Aug 2009 10:06:37 -0400 Jeffrey J.
  Kosowsky backu...@kosowsky.org wrote:
   Try manually doing something like the following from
   the command line: link
   b32585c3cc30b7ebb556d335a08554e3 
  /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
  
  Where do I need to be to run this? 
 
 you need to be in $TopDir/cpool/b/3/2 ... or rather, it should be
 
   sudo -u backuppc ln
 $TopDir/cpool/b/3/2/b32585c3cc30b7ebb556d335a08554e3 
 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml

my $TopDir is /media/disk. I ran the command above and it appeared to
work OK. I don't have the exact result anymore because of the crash.

 (or use 'link' if you prefer). You need to get $TopDir right though.
 See below.
 
# sudo -u backuppc link
b32585c3cc30b7ebb556d335a08554e3 
  /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
link: cannot create link

  `/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml'
to `b32585c3cc30b7ebb556d335a08554e3': No such file or directory
 
 Yes, most directories won't contain a file with that name ;-).
 
Jeffrey, I'm now thinking that two backups have somehow been
scheduled at the same. See the Les Miskell thread.
 
 I agree with that except for the name. But I don't think it's the
 problem, at least not the one you're looking for. I can't imagine why
 two backups of the same host would be scheduled simultaneously, and I
 don't think it's a good idea to do so :-). BackupPC doesn't usually
 do this. Have you changed the code in any way? Have you seen such a
 thing happen before?

Could I have started the backuppc service twice somehow? I certainly
haven't changed any of the code. I haven't written any perl since perl
4 circa 1995.


8 [snip]

 So, I believe we're back to the issue of what you did wrong when
 moving $TopDir. I don't remember reading which version of BackupPC

When moving $TopDir? I haven't moved it. It's always been /media/disk
ever since I installed backuppc.

 you are using. What did you do to move $TopDir? Have a look at the
 old location, wherever that was. Are there files with recent
 modification times below the cpool/ directory?
 Below /media/disk/cpool? BackupPC_nightly reports files there, but

# ls -l /media/disk
total 48
drwxr-x--- 18 backuppc root  4096 2009-08-12 20:00 cpool
drwx--  2 root root 16384 2008-07-16 23:54 lost+found
drwxr-x---  4 backuppc root  4096 2009-08-09 23:06 pc
drwxr-x---  2 backuppc root  4096 2008-07-26 18:53 pool
drwxr-x---  2 backuppc root  4096 2009-08-11 01:25 trash

So cpool has today's date

]# ls -l /media/disk/cpool
total 128
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 0
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 1
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 2
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 3
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 4
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 5
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 6
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 7
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 8
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 9
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 a
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 b
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 c
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 d
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 e
drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 f

Nothing since 6/28.

This is where I got to when the machine crashed. Looking
at /var/log/messages I see this:

Aug 12 20:00:12 steve kernel: [ cut here ]
Aug 12 20:00:12 steve kernel: WARNING: at lib/list_debug.c:51
list_del+0x41/0x60() 
Aug 12 20:00:12 steve kernel: Hardware name: To Be Filled By O.E.M. 
Aug 12 20:00:12 steve kernel: list_del corruption. next-prev should be
c14c2838, but was c14c2878 
Aug 12 20:00:12 steve kernel: Modules linked in: snd_seq_midi vfat fat
autofs4 w83627ehf hwmon_vid hwmon nf_conntrack_netbios_ns
nf_conntrack_ipv6 ip6t_ipv6header ip6t_REJECT ip6table_filter
ip6_tables ipv6 p4_clockmod fuse dm_multipath uinput snd_usb_audio
snd_usb_lib snd_emu10k1_synth

Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-13 Thread Les Mikesell
Steve Blackwell wrote:
 
 So, I believe we're back to the issue of what you did wrong when
 moving $TopDir. I don't remember reading which version of BackupPC
 
 When moving $TopDir? I haven't moved it. It's always been /media/disk
 ever since I installed backuppc.

If you installed from the sourceforge tarball you can set the location anywhere 
you want.  However it is a very common problem with packaged (rpm/deb) 
installations that people try to move the storage location after installation 
and it doesn't work to simply change $TopDir once it is set.  But, I didn't 
think that was your problem since you were at backup 150 before seeing a 
problem.   There is still the possibility of a physical disk error.  External 
drives aren't all that reliable - but that should be reported in 'dmesg'.

-- 
   Les Mikesell
lesmikes...@gmail.com


--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-13 Thread Steve Blackwell
Last night's backup, after the restart due to the crash appears to have
worked OK. Here is the server log file:

2009-08-13 01:00:00 Running 2 BackupPC_nightly jobs from 0..15 (out of
0..15) 
2009-08-13 01:00:00 Running BackupPC_nightly -m 0 127 (pid=5801) 
2009-08-13 01:00:00 Running BackupPC_nightly 128 255 (pid=5802) 
2009-08-13 01:00:00 Next wakeup is 2009-08-13 02:00:00 
2009-08-13 01:00:02 Started incr backup on steve (pid=5803, share=/) 
2009-08-13 01:06:37 Finished  admin1 (BackupPC_nightly 128 255) 
2009-08-13 01:06:37 BackupPC_nightly now running BackupPC_sendEmail 
2009-08-13 01:06:47 Finished  admin (BackupPC_nightly -m 0 127) 
2009-08-13 01:06:47 Pool nightly clean removed 0 files of size 0.00GB 
2009-08-13 01:06:47 Pool is 0.00GB, 0 files (0 repeated, 0 max chain, 0
max links), 1 directories 
2009-08-13 01:06:47 Cpool nightly clean removed 1 files of size 0.00GB 
2009-08-13 01:06:47 Cpool is 15.90GB, 397513 files (48553 repeated, 11
max chain, 794 max links), 4369 directories 
2009-08-13 01:29:59 Finished incr backup on steve 
2009-08-13 01:29:59 Running BackupPC_link steve (pid=5977) 
2009-08-13 01:30:21 Finished steve (BackupPC_link steve)

and the corresponding log file from steve:

2009-08-13 01:00:02 incr backup started back to 2009-08-12 00:00:06
(backup #151) for directory / 
2009-08-13 01:29:59 incr backup 152 complete, 41555 files, 0 bytes, 0
xferErrs (0 bad files, 0 bad shares, 0 other)

I didn't change any settings. I think it's worse when things magically
start to work than when they continue to fail. [:-P

Steve

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-13 Thread Steve Blackwell
On Thu, 13 Aug 2009 10:18:20 -0500
Les Mikesell lesmikes...@gmail.com wrote:

 Steve Blackwell wrote:
  
  I didn't change any settings. I think it's worse when things
  magically start to work than when they continue to fail. [:-P
 
 Running Fedora or some other close-to-beta OS?
 
F10. I use the oldest supported version in an attempt to step away from
the bleeding edge. That strategy has worked up until this version.

Steve.

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


[BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Steve Blackwell
Backuppc has been behaving strangely lately. This is another instance.

This is part of the log file for host steve:

2009-08-12 01:00:06 full backup started for directory /
2009-08-12 01:00:06 full backup started for directory /
2009-08-12 05:00:06 Rename /media/disk/pc/steve/new
- /media/disk/pc/steve/151 failed 
2009-08-12 05:00:06 full backup complete, 388335 files, 0 bytes, 2
xferErrs (0 bad files, 0 bad shares, 2 other) 
2009-08-12 05:00:06 full backup 151 complete, 388335 files, 0 bytes, 2
xferErrs (0 bad files, 0 bad shares, 2 other)

Apart from the fact that the backup seems to have started twice (Maybe
just logged twice?) everything looks OK but then

In the server log file I get this:

2009-08-12 01:00:06 Started full backup on steve (pid=2644, share=/)
2009-08-12 01:06:15 BackupPC_nightly now running BackupPC_sendEmail
2009-08-12 01:06:16 Finished  admin1  (BackupPC_nightly 128 255)
2009-08-12 01:06:36 Finished  admin  (BackupPC_nightly -m 0 127)
2009-08-12 01:06:36 Pool nightly clean removed 0 files of size 0.00GB
2009-08-12 01:06:36 Pool is 0.00GB, 0 files (0 repeated, 0 max chain, 0
max links), 1 directories 
2009-08-12 01:06:36 Cpool nightly clean removed 0 files of size 0.00GB
2009-08-12 01:06:36 Cpool is 111.15GB, 364467 files (21648 repeated, 10
max chain, 793 max links), 4369 directories 
2009-08-12 02:00:00 Next wakeup is 2009-08-12 03:00:00 
2009-08-12 03:00:01 Next wakeup is 2009-08-12 04:00:00 
2009-08-12 04:00:00 Next wakeup is 2009-08-12 05:00:00 
2009-08-12 05:00:01 Next wakeup is 2009-08-12 06:00:00 
2009-08-12 05:00:06 Finished full backup on steve 2009-08-12 05:00:06
Running BackupPC_link steve (pid=8901) 
2009-08-12 05:00:08 BackupPC_link got error -3 when calling
MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml,
b32585c3cc30b7ebb556d335a08554e3, 1)

followed by 100,000+ of the same error on different files

What is going on here?

Thanks,
Steve

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Jeffrey J. Kosowsky
Steve Blackwell wrote at about 08:49:23 -0400 on Wednesday, August 12, 2009:
  Backuppc has been behaving strangely lately. This is another instance.
  
  This is part of the log file for host steve:
  
  2009-08-12 01:00:06 full backup started for directory /
  2009-08-12 01:00:06 full backup started for directory /
  2009-08-12 05:00:06 Rename /media/disk/pc/steve/new
  - /media/disk/pc/steve/151 failed 
  2009-08-12 05:00:06 full backup complete, 388335 files, 0 bytes, 2
  xferErrs (0 bad files, 0 bad shares, 2 other) 
  2009-08-12 05:00:06 full backup 151 complete, 388335 files, 0 bytes, 2
  xferErrs (0 bad files, 0 bad shares, 2 other)
  
  Apart from the fact that the backup seems to have started twice (Maybe
  just logged twice?) everything looks OK but then
  
  In the server log file I get this:
  
  2009-08-12 01:00:06 Started full backup on steve (pid=2644, share=/)
  2009-08-12 01:06:15 BackupPC_nightly now running BackupPC_sendEmail
  2009-08-12 01:06:16 Finished  admin1  (BackupPC_nightly 128 255)
  2009-08-12 01:06:36 Finished  admin  (BackupPC_nightly -m 0 127)
  2009-08-12 01:06:36 Pool nightly clean removed 0 files of size 0.00GB
  2009-08-12 01:06:36 Pool is 0.00GB, 0 files (0 repeated, 0 max chain, 0
  max links), 1 directories 
  2009-08-12 01:06:36 Cpool nightly clean removed 0 files of size 0.00GB
  2009-08-12 01:06:36 Cpool is 111.15GB, 364467 files (21648 repeated, 10
  max chain, 793 max links), 4369 directories 
  2009-08-12 02:00:00 Next wakeup is 2009-08-12 03:00:00 
  2009-08-12 03:00:01 Next wakeup is 2009-08-12 04:00:00 
  2009-08-12 04:00:00 Next wakeup is 2009-08-12 05:00:00 
  2009-08-12 05:00:01 Next wakeup is 2009-08-12 06:00:00 
  2009-08-12 05:00:06 Finished full backup on steve 2009-08-12 05:00:06
  Running BackupPC_link steve (pid=8901) 
  2009-08-12 05:00:08 BackupPC_link got error -3 when calling
  MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml,
  b32585c3cc30b7ebb556d335a08554e3, 1)
  
  followed by 100,000+ of the same error on different files
  
  What is going on here?
  

Error -3 means that calling the perl function link (between a file in
the pool and a name in the pc tree) failed.

Try manually doing something like the following from the command line:
link b32585c3cc30b7ebb556d335a08554e3 
/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml


Potential reasons:
- Files are on different filesystems
- File system you are using doesn't allow hard links (what filesystem
  are you using)
- Pool file somehow got erased before MakeFileLink was called or pc
  tree got erased
- File system full (?)

I guess I would ask what have you changed lately either for BackupPC
specifically or on your setup in general?

  Thanks,
  Steve
  
  --
  Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
  trial. Simplify your report design, integration and deployment - and focus 
  on 
  what you do best, core application coding. Discover what's new with 
  Crystal Reports now.  http://p.sf.net/sfu/bobj-july
  ___
  BackupPC-users mailing list
  BackupPC-users@lists.sourceforge.net
  List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
  Wiki:http://backuppc.wiki.sourceforge.net
  Project: http://backuppc.sourceforge.net/
  

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Steve Blackwell
On Wed, 12 Aug 2009 10:06:37 -0400
Jeffrey J. Kosowsky backu...@kosowsky.org wrote:

 Steve Blackwell wrote at about 08:49:23 -0400 on Wednesday, August
 12, 2009:
   Backuppc has been behaving strangely lately. This is another
   instance.

...
   05:00:06 Running BackupPC_link steve (pid=8901) 
   2009-08-12 05:00:08 BackupPC_link got error -3 when calling
   
 MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml,
   b32585c3cc30b7ebb556d335a08554e3, 1)
   
   followed by 100,000+ of the same error on different files
   
   What is going on here?
   
 
 Error -3 means that calling the perl function link (between a file in
 the pool and a name in the pc tree) failed.
 
 Try manually doing something like the following from the command line:
 link
 b32585c3cc30b7ebb556d335a08554e3 
 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml

Where do I need to be to run this? 

 
 Potential reasons:
 - Files are on different filesystems
 - File system you are using doesn't allow hard links (what filesystem
   are you using)

# mount
...
/dev/sdd2 on /media/disk type ext3 (rw,nosuid,nodev,uhelper=hal)
...

 - Pool file somehow got erased before MakeFileLink was called or pc
   tree got erased
 - File system full (?)

From logwatch:
 - Disk Space Begin  

 FilesystemSize  Used Avail Use% Mounted on
 /dev/mapper/VolGroup00-LogVol00
   143G   57G   78G  43% /
 /dev/sdb1 190M   21M  160M  12% /boot
 /dev/sda1 112G   69G   44G  61% /mnt/c_drive
 /dev/sdc1 7.6G  783M  6.9G  11% /media/UDISK
 /dev/sdd1 466G   80M  466G   1% /media/WINDOWS_BACUP
 /dev/sdd2 459G   30G  406G   7% /media/disk
 
 
 -- Disk Space End - 
so plenty of space!
 
 I guess I would ask what have you changed lately either for BackupPC
 specifically or on your setup in general?

The backup drive is a 1TB external USB and my computer is getting a
little long in the tooth and the BIOS won't boot if I power on with it
connected. So I get lazy and don't always plug it in and restart the
backuppc service. What has changed is that I'm being more diligent in
making my backups and perhaps more significantly, I have recently
upgraded from F9 to F10.

Thanks,
Steve

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Steve Blackwell
On Wed, 12 Aug 2009 10:19:47 -0500
Les Mikesell lesmikes...@gmail.com wrote:

 Steve Blackwell wrote:
  Backuppc has been behaving strangely lately. This is another
  instance.
  
  This is part of the log file for host steve:
  
  2009-08-12 01:00:06 full backup started for directory /
  2009-08-12 01:00:06 full backup started for directory /
  2009-08-12 05:00:06 Rename /media/disk/pc/steve/new
  - /media/disk/pc/steve/151 failed 
 
 Out of inodes?  Check with 'df -i'.

# df -i
FilesystemInodes   IUsed   IFree IUse% Mounted on
/dev/mapper/VolGroup00-LogVol00
   38502400  300300 382021001% /
/dev/sdb150200  40   501601% /boot
tmpfs   129178   2  1291761% /dev/shm
/dev/sda1  45944516   79740 458647761% /mnt/c_drive
/dev/sdc10   0   0-  /media/UDISK
/dev/sdd1  488231440  23 488231417 1% /media/WINDOWS_BACUP 
/dev/sdd2  61063168  790151 602730172% /media/disk

No problems there but thanks for the suggestion.

Steve.

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Les Mikesell
Steve Blackwell wrote:
 On Wed, 12 Aug 2009 10:19:47 -0500
 Les Mikesell lesmikes...@gmail.com wrote:
 
 Steve Blackwell wrote:
 Backuppc has been behaving strangely lately. This is another
 instance.

 This is part of the log file for host steve:

 2009-08-12 01:00:06 full backup started for directory /
 2009-08-12 01:00:06 full backup started for directory /
 2009-08-12 05:00:06 Rename /media/disk/pc/steve/new
 - /media/disk/pc/steve/151 failed 
 Out of inodes?  Check with 'df -i'.
 
 # df -i
 FilesystemInodes   IUsed   IFree IUse% Mounted on
 /dev/mapper/VolGroup00-LogVol00
38502400  300300 382021001% /
 /dev/sdb150200  40   501601% /boot
 tmpfs   129178   2  1291761% /dev/shm
 /dev/sda1  45944516   79740 458647761% /mnt/c_drive
 /dev/sdc10   0   0-  /media/UDISK
 /dev/sdd1  488231440  23 488231417 1% /media/WINDOWS_BACUP 
 /dev/sdd2  61063168  790151 602730172% /media/disk
 
 No problems there but thanks for the suggestion.

Can you 'mv /media/disk/pc/steve/new  /media/disk/pc/steve/151' as the 
backuppc user?  Also, look at the output of 'dmesg' - you might have 
physical disk errors.   If this is a packaged (rpm) install, did you 
follow the wiki instructions for moving the storage location?

-- 
Les Mikesell
 lesmikes...@gmail.com




--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Jeffrey J. Kosowsky
Les Mikesell wrote at about 10:19:47 -0500 on Wednesday, August 12, 2009:
  Steve Blackwell wrote:
   Backuppc has been behaving strangely lately. This is another instance.
   
   This is part of the log file for host steve:
   
   2009-08-12 01:00:06 full backup started for directory /
   2009-08-12 01:00:06 full backup started for directory /
   2009-08-12 05:00:06 Rename /media/disk/pc/steve/new
   - /media/disk/pc/steve/151 failed 
  
  Out of inodes?  Check with 'df -i'.

Don't hard links re-use the same inode?
(remember it fails on the 'link' command)
  -- 
 Les Mikesell
  lesmikes...@gmail.com
  
  
  
  
  
  --
  Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
  trial. Simplify your report design, integration and deployment - and focus 
  on 
  what you do best, core application coding. Discover what's new with 
  Crystal Reports now.  http://p.sf.net/sfu/bobj-july
  ___
  BackupPC-users mailing list
  BackupPC-users@lists.sourceforge.net
  List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
  Wiki:http://backuppc.wiki.sourceforge.net
  Project: http://backuppc.sourceforge.net/
  

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Jeffrey J. Kosowsky
Steve Blackwell wrote at about 11:18:36 -0400 on Wednesday, August 12, 2009:
  On Wed, 12 Aug 2009 10:06:37 -0400
  Jeffrey J. Kosowsky backu...@kosowsky.org wrote:
  
   Steve Blackwell wrote at about 08:49:23 -0400 on Wednesday, August
   12, 2009:
 Backuppc has been behaving strangely lately. This is another
 instance.
  
  ...
 05:00:06 Running BackupPC_link steve (pid=8901) 
 2009-08-12 05:00:08 BackupPC_link got error -3 when calling
 
   MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml,
 b32585c3cc30b7ebb556d335a08554e3, 1)
 
 followed by 100,000+ of the same error on different files
 
 What is going on here?
 
   
   Error -3 means that calling the perl function link (between a file in
   the pool and a name in the pc tree) failed.
   
   Try manually doing something like the following from the command line:
   link
   b32585c3cc30b7ebb556d335a08554e3 
   /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
  
  Where do I need to be to run this? 

From the command line anywhere. Just type the command as-is.
Actually type it as:
su -u backuppc link ...

so that it runs as user 'backuppc'
If it works, you can undo it by typing:
rm 
/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
(assuming the file didn't exist previously)

  
   
   Potential reasons:
   - Files are on different filesystems
   - File system you are using doesn't allow hard links (what filesystem
 are you using)
  
  # mount
  ...
  /dev/sdd2 on /media/disk type ext3 (rw,nosuid,nodev,uhelper=hal)
  ...
  
   - Pool file somehow got erased before MakeFileLink was called or pc
 tree got erased
   - File system full (?)
  
  From logwatch:
   - Disk Space Begin  
  
   FilesystemSize  Used Avail Use% Mounted on
   /dev/mapper/VolGroup00-LogVol00
 143G   57G   78G  43% /
   /dev/sdb1 190M   21M  160M  12% /boot
   /dev/sda1 112G   69G   44G  61% /mnt/c_drive
   /dev/sdc1 7.6G  783M  6.9G  11% /media/UDISK
   /dev/sdd1 466G   80M  466G   1% /media/WINDOWS_BACUP
   /dev/sdd2 459G   30G  406G   7% /media/disk
   
   
   -- Disk Space End - 
  so plenty of space!
   
   I guess I would ask what have you changed lately either for BackupPC
   specifically or on your setup in general?
  
  The backup drive is a 1TB external USB and my computer is getting a
  little long in the tooth and the BIOS won't boot if I power on with it
  connected. So I get lazy and don't always plug it in and restart the
  backuppc service. What has changed is that I'm being more diligent in
  making my backups and perhaps more significantly, I have recently
  upgraded from F9 to F10.
  
  Thanks,
  Steve
  
  --
  Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
  trial. Simplify your report design, integration and deployment - and focus 
  on 
  what you do best, core application coding. Discover what's new with 
  Crystal Reports now.  http://p.sf.net/sfu/bobj-july
  ___
  BackupPC-users mailing list
  BackupPC-users@lists.sourceforge.net
  List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
  Wiki:http://backuppc.wiki.sourceforge.net
  Project: http://backuppc.sourceforge.net/
  

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Steve Blackwell
On Wed, 12 Aug 2009 12:24:04 -0400
Jeffrey J. Kosowsky backu...@kosowsky.org wrote:

 Steve Blackwell wrote at about 11:18:36 -0400 on Wednesday, August
 12, 2009:
   On Wed, 12 Aug 2009 10:06:37 -0400
   Jeffrey J. Kosowsky backu...@kosowsky.org wrote:
   
Steve Blackwell wrote at about 08:49:23 -0400 on Wednesday,
August 12, 2009:
  Backuppc has been behaving strangely lately. This is another
  instance.
   
   ...
  05:00:06 Running BackupPC_link steve (pid=8901) 
  2009-08-12 05:00:08 BackupPC_link got error -3 when calling
  
 MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml,
  b32585c3cc30b7ebb556d335a08554e3, 1)
  
  followed by 100,000+ of the same error on different files
  
  What is going on here?
  

Error -3 means that calling the perl function link (between a
file in the pool and a name in the pc tree) failed.

Try manually doing something like the following from the command
line: link
b32585c3cc30b7ebb556d335a08554e3 
 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
   
   Where do I need to be to run this? 
 
 From the command line anywhere. Just type the command as-is.
 Actually type it as:
 su -u backuppc link ...
 
 so that it runs as user 'backuppc'
 If it works, you can undo it by typing:
 rm 
 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
 (assuming the file didn't exist previously)

su doesn't have a -u option.

# su --help
Usage: su [OPTION]... [-] [USER [ARG]...]
Change the effective user id and group id to that of USER.

  -, -l, --login   make the shell a login shell
  -c, --command=COMMANDpass a single COMMAND to the shell with
  -c
  --session-command=COMMANDpass a single COMMAND to the shell with
  -c
   and do not create a new session
  -f, --fast   pass -f to the shell (for csh or tcsh)
  -m, --preserve-environment   do not reset environment variables
  -p   same as -m
  -s, --shell=SHELLrun SHELL if /etc/shells allows it
  --help display this help and exit
  --version  output version information and exit

A mere - implies -l.   If USER not given, assume root.

Report bugs to bug-coreut...@gnu.org.


# su backuppc link
b32585c3cc30b7ebb556d335a08554e3 
/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
This account is currently not available.

# link
b32585c3cc30b7ebb556d335a08554e3 
/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
link: cannot create link
`/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml'
to `b32585c3cc30b7ebb556d335a08554e3': No such file or directory

Steve

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Steve Blackwell
On Wed, 12 Aug 2009 11:00:19 -0500
Les Mikesell lesmikes...@gmail.com wrote:

 Steve Blackwell wrote:
  On Wed, 12 Aug 2009 10:19:47 -0500
  Les Mikesell lesmikes...@gmail.com wrote:
  
  Steve Blackwell wrote:
  Backuppc has been behaving strangely lately. This is another
  instance.
 
  This is part of the log file for host steve:
 
  2009-08-12 01:00:06 full backup started for directory /
  2009-08-12 01:00:06 full backup started for directory /
  2009-08-12 05:00:06 Rename /media/disk/pc/steve/new
  - /media/disk/pc/steve/151 failed 
  Out of inodes?  Check with 'df -i'.
  
  # df -i
  FilesystemInodes   IUsed   IFree IUse% Mounted on
  /dev/mapper/VolGroup00-LogVol00
 38502400  300300 382021001% /
  /dev/sdb150200  40   501601% /boot
  tmpfs   129178   2  1291761% /dev/shm
  /dev/sda1  45944516   79740 458647761% /mnt/c_drive
  /dev/sdc10   0   0-  /media/UDISK
  /dev/sdd1  488231440  23 488231417
  1% /media/WINDOWS_BACUP /dev/sdd2  61063168  790151
  602730172% /media/disk
  
  No problems there but thanks for the suggestion.
 
 Can you 'mv   /media/disk/pc/steve/151' as
 the backuppc user?  Also, look at the output of 'dmesg' - you might
 have physical disk errors.   If this is a packaged (rpm) install, did
 you follow the wiki instructions for moving the storage location?
 

There is no file /media/disk/pc/steve/new.

# ls -l /media/disk/pc/steve
total 15388
drwxr-x--- 3 backuppc backuppc4096 2009-08-04 17:03 146
drwxr-x--- 3 backuppc backuppc4096 2009-08-05 20:18 147
drwxr-x--- 3 backuppc backuppc4096 2009-08-08 18:31 148
drwxr-x--- 3 backuppc backuppc4096 2009-08-11 02:10 150
drwxr-x--- 3 backuppc backuppc4096 2009-08-12 05:13 151
-rw-r- 1 backuppc backuppc 802 2009-08-12 05:21 backups
-rw-r- 1 backuppc backuppc 799 2009-08-12 05:21 backups.old
-rw-r- 1 backuppc backuppc   0 2008-07-26 19:00 LOCK
-rw-r- 1 backuppc backuppc 585 2009-01-31 20:09 LOG.012009.z
-rw-r- 1 backuppc backuppc 963 2009-02-28 20:40 LOG.022009.z
-rw-r- 1 backuppc backuppc 412 2009-03-23 20:14 LOG.032009.z
-rw-r- 1 backuppc backuppc 797 2009-04-26 20:09 LOG.042009.z
-rw-r- 1 backuppc backuppc 172 2009-06-28 15:30 LOG.062009.z
-rw-r- 1 backuppc backuppc 959 2008-08-31 20:05 LOG.082008.z
-rw-r- 1 backuppc backuppc2308 2009-08-12 05:00 LOG.082009
-rw-r- 1 backuppc backuppc 748 2008-09-22 20:07 LOG.092008.z
-rw-r- 1 backuppc backuppc 662 2008-10-31 20:11 LOG.102008.z
-rw-r- 1 backuppc backuppc 625 2008-11-30 05:27 LOG.112008.z
-rw-r- 1 backuppc backuppc 143 2008-12-09 05:05 LOG.122008.z
-rw-r- 1 backuppc apache   290 2008-07-30 20:48 RestoreInfo.0
-rw-r- 1 backuppc backuppc 200 2008-07-30 20:48 RestoreLOG.0.z
-rw-r- 1 backuppc backuppc  36 2008-07-30 20:48 restores
-rw-r- 1 backuppc backuppc 4373346 2009-08-04 17:03 XferLOG.146.z
-rw-r- 1 backuppc backuppc  439712 2009-08-05 20:18 XferLOG.147.z
-rw-r- 1 backuppc backuppc  619036 2009-08-08 18:31 XferLOG.148.z
-rw-r- 1 backuppc backuppc 1064831 2009-08-10 02:31 XferLOG.149.z
-rw-r- 1 backuppc backuppc  848135 2009-08-11 02:10 XferLOG.150.z
-rw-r- 1 backuppc backuppc 8149788 2009-08-12 05:00 XferLOG.151.z
-rw-r- 1 backuppc backuppc 264 2008-07-29 12:25
XferLOG.bad.z.old

Steve

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Les Mikesell
Steve Blackwell wrote:
 On Wed, 12 Aug 2009 11:00:19 -0500
 Les Mikesell lesmikes...@gmail.com wrote:
 
 Steve Blackwell wrote:
 On Wed, 12 Aug 2009 10:19:47 -0500
 Les Mikesell lesmikes...@gmail.com wrote:

 Steve Blackwell wrote:
 Backuppc has been behaving strangely lately. This is another
 instance.

 This is part of the log file for host steve:

 2009-08-12 01:00:06 full backup started for directory /
 2009-08-12 01:00:06 full backup started for directory /
 2009-08-12 05:00:06 Rename /media/disk/pc/steve/new
 - /media/disk/pc/steve/151 failed 


 Out of inodes?  Check with 'df -i'.
 # df -i
 FilesystemInodes   IUsed   IFree IUse% Mounted on
 /dev/mapper/VolGroup00-LogVol00
38502400  300300 382021001% /
 /dev/sdb150200  40   501601% /boot
 tmpfs   129178   2  1291761% /dev/shm
 /dev/sda1  45944516   79740 458647761% /mnt/c_drive
 /dev/sdc10   0   0-  /media/UDISK
 /dev/sdd1  488231440  23 488231417
 1% /media/WINDOWS_BACUP /dev/sdd2  61063168  790151
 602730172% /media/disk

 No problems there but thanks for the suggestion.
 Can you 'mv /media//disk/pc/steve/new  /media/disk/pc/steve/151' as
 the backuppc user?  Also, look at the output of 'dmesg' - you might
 have physical disk errors.   If this is a packaged (rpm) install, did
 you follow the wiki instructions for moving the storage location?

 
 There is no file /media/disk/pc/steve/new.
 
 # ls -l /media/disk/pc/steve
 total 15388
 drwxr-x--- 3 backuppc backuppc4096 2009-08-04 17:03 146
 drwxr-x--- 3 backuppc backuppc4096 2009-08-05 20:18 147
 drwxr-x--- 3 backuppc backuppc4096 2009-08-08 18:31 148
 drwxr-x--- 3 backuppc backuppc4096 2009-08-11 02:10 150
 drwxr-x--- 3 backuppc backuppc4096 2009-08-12 05:13 151
 -rw-r- 1 backuppc backuppc 802 2009-08-12 05:21 backups
 -rw-r- 1 backuppc backuppc 799 2009-08-12 05:21 backups.old
 -rw-r- 1 backuppc backuppc   0 2008-07-26 19:00 LOCK
 -rw-r- 1 backuppc backuppc 585 2009-01-31 20:09 LOG.012009.z
 -rw-r- 1 backuppc backuppc 963 2009-02-28 20:40 LOG.022009.z
 -rw-r- 1 backuppc backuppc 412 2009-03-23 20:14 LOG.032009.z
 -rw-r- 1 backuppc backuppc 797 2009-04-26 20:09 LOG.042009.z
 -rw-r- 1 backuppc backuppc 172 2009-06-28 15:30 LOG.062009.z
 -rw-r- 1 backuppc backuppc 959 2008-08-31 20:05 LOG.082008.z
 -rw-r- 1 backuppc backuppc2308 2009-08-12 05:00 LOG.082009
 -rw-r- 1 backuppc backuppc 748 2008-09-22 20:07 LOG.092008.z
 -rw-r- 1 backuppc backuppc 662 2008-10-31 20:11 LOG.102008.z
 -rw-r- 1 backuppc backuppc 625 2008-11-30 05:27 LOG.112008.z
 -rw-r- 1 backuppc backuppc 143 2008-12-09 05:05 LOG.122008.z
 -rw-r- 1 backuppc apache   290 2008-07-30 20:48 RestoreInfo.0
 -rw-r- 1 backuppc backuppc 200 2008-07-30 20:48 RestoreLOG.0.z
 -rw-r- 1 backuppc backuppc  36 2008-07-30 20:48 restores
 -rw-r- 1 backuppc backuppc 4373346 2009-08-04 17:03 XferLOG.146.z
 -rw-r- 1 backuppc backuppc  439712 2009-08-05 20:18 XferLOG.147.z
 -rw-r- 1 backuppc backuppc  619036 2009-08-08 18:31 XferLOG.148.z
 -rw-r- 1 backuppc backuppc 1064831 2009-08-10 02:31 XferLOG.149.z
 -rw-r- 1 backuppc backuppc  848135 2009-08-11 02:10 XferLOG.150.z
 -rw-r- 1 backuppc backuppc 8149788 2009-08-12 05:00 XferLOG.151.z
 -rw-r- 1 backuppc backuppc 264 2008-07-29 12:25
 XferLOG.bad.z.old
 

So a subsequent backup has completed?  Or was the 151 directory there 
before?  If it wasn't there and that rename failed, there would be an 
obvious reason for the subsequent link failures involving things under 
the 151 directory.
-- 
   Les Mikesell


--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Jeffrey J. Kosowsky
Steve Blackwell wrote at about 13:27:17 -0400 on Wednesday, August 12, 2009:
  On Wed, 12 Aug 2009 12:24:04 -0400
  Jeffrey J. Kosowsky backu...@kosowsky.org wrote:
  
   Steve Blackwell wrote at about 11:18:36 -0400 on Wednesday, August
   12, 2009:
 On Wed, 12 Aug 2009 10:06:37 -0400
 Jeffrey J. Kosowsky backu...@kosowsky.org wrote:
 
  Steve Blackwell wrote at about 08:49:23 -0400 on Wednesday,
  August 12, 2009:
Backuppc has been behaving strangely lately. This is another
instance.
 
 ...
05:00:06 Running BackupPC_link steve (pid=8901) 
2009-08-12 05:00:08 BackupPC_link got error -3 when calling

   MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml,
b32585c3cc30b7ebb556d335a08554e3, 1)

followed by 100,000+ of the same error on different files

What is going on here?

  
  Error -3 means that calling the perl function link (between a
  file in the pool and a name in the pc tree) failed.
  
  Try manually doing something like the following from the command
  line: link
  b32585c3cc30b7ebb556d335a08554e3 
   /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
 
 Where do I need to be to run this? 
   
   From the command line anywhere. Just type the command as-is.
   Actually type it as:
   su -u backuppc link ...
   
   so that it runs as user 'backuppc'
   If it works, you can undo it by typing:
   rm 
   /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
   (assuming the file didn't exist previously)
  
  su doesn't have a -u option.
  

run: sudo -u backuppc
or su backuppc -c link...

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Steve Blackwell
On Wed, 12 Aug 2009 12:54:05 -0500
Les Mikesell lesmikes...@gmail.com wrote:

 Steve Blackwell wrote:
  On Wed, 12 Aug 2009 11:00:19 -0500
  Les Mikesell lesmikes...@gmail.com wrote:
  
  Steve Blackwell wrote:
  On Wed, 12 Aug 2009 10:19:47 -0500
  Les Mikesell lesmikes...@gmail.com wrote:
 
  Steve Blackwell wrote:
  Backuppc has been behaving strangely lately. This is another
  instance.
 
  This is part of the log file for host steve:
 
  2009-08-12 01:00:06 full backup started for directory /
  2009-08-12 01:00:06 full backup started for directory /
  2009-08-12 05:00:06 Rename /media/disk/pc/steve/new
  - /media/disk/pc/steve/151 failed 
 
 
  Out of inodes?  Check with 'df -i'.
  # df -i
  FilesystemInodes   IUsed   IFree IUse% Mounted on
  /dev/mapper/VolGroup00-LogVol00
 38502400  300300 382021001% /
  /dev/sdb150200  40   501601% /boot
  tmpfs   129178   2  1291761% /dev/shm
  /dev/sda1  45944516   79740 458647761% /mnt/c_drive
  /dev/sdc10   0   0-  /media/UDISK
  /dev/sdd1  488231440  23 488231417
  1% /media/WINDOWS_BACUP /dev/sdd2  61063168  790151
  602730172% /media/disk
 
  No problems there but thanks for the suggestion.
  Can you 'mv /media//disk/pc/steve/new  /media/disk/pc/steve/151' as
  the backuppc user?  Also, look at the output of 'dmesg' - you might
  have physical disk errors.   If this is a packaged (rpm) install,
  did you follow the wiki instructions for moving the storage
  location?
 
  
  There is no file /media/disk/pc/steve/new.
  
  # ls -l /media/disk/pc/steve
  total 15388
  drwxr-x--- 3 backuppc backuppc4096 2009-08-04 17:03 146
  drwxr-x--- 3 backuppc backuppc4096 2009-08-05 20:18 147
  drwxr-x--- 3 backuppc backuppc4096 2009-08-08 18:31 148
  drwxr-x--- 3 backuppc backuppc4096 2009-08-11 02:10 150
  drwxr-x--- 3 backuppc backuppc4096 2009-08-12 05:13 151
  -rw-r- 1 backuppc backuppc 802 2009-08-12 05:21 backups
  -rw-r- 1 backuppc backuppc 799 2009-08-12 05:21 backups.old
  -rw-r- 1 backuppc backuppc   0 2008-07-26 19:00 LOCK
  -rw-r- 1 backuppc backuppc 585 2009-01-31 20:09 LOG.012009.z
  -rw-r- 1 backuppc backuppc 963 2009-02-28 20:40 LOG.022009.z
  -rw-r- 1 backuppc backuppc 412 2009-03-23 20:14 LOG.032009.z
  -rw-r- 1 backuppc backuppc 797 2009-04-26 20:09 LOG.042009.z
  -rw-r- 1 backuppc backuppc 172 2009-06-28 15:30 LOG.062009.z
  -rw-r- 1 backuppc backuppc 959 2008-08-31 20:05 LOG.082008.z
  -rw-r- 1 backuppc backuppc2308 2009-08-12 05:00 LOG.082009
  -rw-r- 1 backuppc backuppc 748 2008-09-22 20:07 LOG.092008.z
  -rw-r- 1 backuppc backuppc 662 2008-10-31 20:11 LOG.102008.z
  -rw-r- 1 backuppc backuppc 625 2008-11-30 05:27 LOG.112008.z
  -rw-r- 1 backuppc backuppc 143 2008-12-09 05:05 LOG.122008.z
  -rw-r- 1 backuppc apache   290 2008-07-30 20:48
  Restoreinfo.0 -rw-r- 1 backuppc backuppc 200 2008-07-30
  20:48 RestoreLOG.0.z -rw-r- 1 backuppc backuppc  36
  2008-07-30 20:48 restores -rw-r- 1 backuppc backuppc 4373346
  2009-08-04 17:03 XferLOG.146.z -rw-r- 1 backuppc backuppc
  439712 2009-08-05 20:18 XferLOG.147.z -rw-r- 1 backuppc
  backuppc  619036 2009-08-08 18:31 XferLOG.148.z -rw-r- 1
  backuppc backuppc 1064831 2009-08-10 02:31 XferLOG.149.z -rw-r-
  1 backuppc backuppc  848135 2009-08-11 02:10 XferLOG.150.z
  -rw-r- 1 backuppc backuppc 8149788 2009-08-12 05:00
  XferLOG.151.z -rw-r- 1 backuppc backuppc 264 2008-07-29
  12:25 XferLOG.bad.z.old
  
 
 So a subsequent backup has completed?  Or was the 151 directory there 
 before?  If it wasn't there and that rename failed, there would be an 
 obvious reason for the subsequent link failures involving things
 under the 151 directory.

As I said in my original e-mail:

 2009-08-12 01:00:06 full backup started for directory /
 2009-08-12 01:00:06 full backup started for directory /
 2009-08-12 05:00:06 Rename /media/disk/pc/steve/new
- /media/disk/pc/steve/151 failed   
 2009-08-12 05:00:06 full backup complete, 388335 files, 0 bytes, 2
xferErrs (0 bad files, 0 bad shares, 2 other) 
 2009-08-12 05:00:06 full backup 151 complete, 388335 files, 0 bytes, 2
xferErrs (0 bad files, 0 bad shares, 2 other)

 Apart from the fact that the backup seems to have started twice (Maybe
 just logged twice?)...

So perhaps backuppc is somehow scheduling the backup to run twice at
the same time but then if the rename of 'new' to '151' is failing, what
is creating '151'? Does the first backup do the rename so that 'new'
does not exist for the 2nd backup? That might explain things but then
how is the backup scheduled twice?

Confused
Steve

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. 

Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Steve Blackwell
On Wed, 12 Aug 2009 14:18:04 -0400
Jeffrey J. Kosowsky backu...@kosowsky.org wrote:

 Steve Blackwell wrote at about 13:27:17 -0400 on Wednesday, August
 12, 2009:
   On Wed, 12 Aug 2009 12:24:04 -0400
   Jeffrey J. Kosowsky backu...@kosowsky.org wrote:
   
Steve Blackwell wrote at about 11:18:36 -0400 on Wednesday,
August 12, 2009:
  On Wed, 12 Aug 2009 10:06:37 -0400
  Jeffrey J. Kosowsky backu...@kosowsky.org wrote:
  
   Steve Blackwell wrote at about 08:49:23 -0400 on Wednesday,
   August 12, 2009:
 Backuppc has been behaving strangely lately. This is
 another instance.
  
  ...
 05:00:06 Running BackupPC_link steve (pid=8901) 
 2009-08-12 05:00:08 BackupPC_link got error -3 when
 calling
 
 MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml,
 b32585c3cc30b7ebb556d335a08554e3, 1)
 
 followed by 100,000+ of the same error on different files
 
 What is going on here?
 
   
   Error -3 means that calling the perl function link (between
   a file in the pool and a name in the pc tree) failed.
   
   Try manually doing something like the following from the
   command line: link
   b32585c3cc30b7ebb556d335a08554e3 
 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
  
  Where do I need to be to run this? 

From the command line anywhere. Just type the command as-is.
Actually type it as:
su -u backuppc link ...

so that it runs as user 'backuppc'
If it works, you can undo it by typing:
rm 
 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
(assuming the file didn't exist previously)
   
   su doesn't have a -u option.
   
 
 run: sudo -u backuppc
 or su backuppc -c link...

# sudo -u backuppc link
b32585c3cc30b7ebb556d335a08554e3 
/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
link: cannot create link
`/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml'
to `b32585c3cc30b7ebb556d335a08554e3': No such file or directory


Jeffrey, I'm now thinking that two backups have somehow been scheduled
at the same. See the Les Miskell thread.

Steve

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Filipe Brandenburger
Hi,

On Wed, Aug 12, 2009 at 08:49, Steve Blackwellzep...@cfl.rr.com wrote:
 2009-08-12 05:00:08 BackupPC_link got error -3 when calling
 MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml,
 b32585c3cc30b7ebb556d335a08554e3, 1)

 followed by 100,000+ of the same error on different files

 What is going on here?

I used to have exactly this problem.

I guess you changed TopDir in your config.pl file, right?

Well, BackupPC 3.1.0 has a bug in that TopDir change will not affect
the pool and cpool directories, so it will try to create a
hardlink in /var/lib/BackupPC for a file in /media/disk, which are in
different filesystems, so it fails.

See this post for a patch that can be used to fix this issue:
http://sourceforge.net/mailarchive/message.php?msg_name=20080808032558.GG13869%40gratch.parplies.de

Alternatively, you may remove the /var/lib/BackupPC directory and
create a symbolic link to /media/disk in its place.

You can also upgrade your setup to 3.2.0 beta, which has this bug already fixed.

HTH,
Filipe

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Jeffrey J. Kosowsky
Steve Blackwell wrote at about 14:33:54 -0400 on Wednesday, August 12, 2009:
  On Wed, 12 Aug 2009 14:18:04 -0400
  Jeffrey J. Kosowsky backu...@kosowsky.org wrote:
  
   Steve Blackwell wrote at about 13:27:17 -0400 on Wednesday, August
   12, 2009:
 On Wed, 12 Aug 2009 12:24:04 -0400
 Jeffrey J. Kosowsky backu...@kosowsky.org wrote:
 
  Steve Blackwell wrote at about 11:18:36 -0400 on Wednesday,
  August 12, 2009:
On Wed, 12 Aug 2009 10:06:37 -0400
Jeffrey J. Kosowsky backu...@kosowsky.org wrote:

 Steve Blackwell wrote at about 08:49:23 -0400 on Wednesday,
 August 12, 2009:
   Backuppc has been behaving strangely lately. This is
   another instance.

...
   05:00:06 Running BackupPC_link steve (pid=8901) 
   2009-08-12 05:00:08 BackupPC_link got error -3 when
   calling
   
   MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml,
   b32585c3cc30b7ebb556d335a08554e3, 1)
   
   followed by 100,000+ of the same error on different files
   
   What is going on here?
   
 
 Error -3 means that calling the perl function link (between
 a file in the pool and a name in the pc tree) failed.
 
 Try manually doing something like the following from the
 command line: link
 b32585c3cc30b7ebb556d335a08554e3 
   /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml

Where do I need to be to run this? 
  
  From the command line anywhere. Just type the command as-is.
  Actually type it as:
  su -u backuppc link ...
  
  so that it runs as user 'backuppc'
  If it works, you can undo it by typing:
  rm 
   /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
  (assuming the file didn't exist previously)
 
 su doesn't have a -u option.
 
   
   run: sudo -u backuppc
   or su backuppc -c link...
  
  # sudo -u backuppc link
  b32585c3cc30b7ebb556d335a08554e3 
  /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
  link: cannot create link
  `/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml'
  to `b32585c3cc30b7ebb556d335a08554e3': No such file or directory
  
  
  Jeffrey, I'm now thinking that two backups have somehow been scheduled
  at the same. See the Les Miskell thread.
  
  Steve
  

I don't know. I am perplexed since the code that is creating the error
code '3' is as follows (from MakeFileLink in Lib.pm):

return -1 if ( !-f $name );
for ( $i = -1 ; ; $i++ ) {
return -2 if ( !defined($rawFile = $bpc-MD52Path($d,
$compress)) );
$rawFile .= _$i if ( $i = 0 );
if ( -f $rawFile ) {
if ( (stat(_))[3]  $bpc-{Conf}{HardLinkMax}
 !compare($name, $rawFile) ) {
unlink($name);
return -3 if ( !link($rawFile, $name) );


Now:
$name exists (per the test in the first line)
$rawFile exists (per the test in line 6)
yet the link fails a couple of lines later.

So unless there is an incredibly precise race condition and assuming
links work on your machine, the 'link' in the final line should
succeed. It is hard to believe that there could be a repeatable race
condition with another backup that is so precise that a file exists in
one line and then no longer exists just a couple of simple lines of
perl code later.

I'm still wondering whether there is some problem with
linking/unlinking on your computer. So the problem is either that the
unlink (i.e., delete) fails in the next to last line or the link fails
in the last line. You may also want to look at ownership/permissions
in your pc tree to make sure that the relevant files and directories
are writable by user backuppc.

Also, why don't you try re-running the manual link line that I gave you but
this time link against a known *existing* (random) pool file. Also try
something like:

su backuppc -c touch 
/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/tempfile
su backuppc -c rm
/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/tempfile

This will test user backuppc's ability to create and delete files in
the pc tree where it failed before.

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list

Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Jeffrey J. Kosowsky
Filipe Brandenburger wrote at about 14:40:34 -0400 on Wednesday, August 12, 
2009:
  Hi,
  
  On Wed, Aug 12, 2009 at 08:49, Steve Blackwellzep...@cfl.rr.com wrote:
   2009-08-12 05:00:08 BackupPC_link got error -3 when calling
   MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml,
   b32585c3cc30b7ebb556d335a08554e3, 1)
  
   followed by 100,000+ of the same error on different files
  
   What is going on here?
  
  I used to have exactly this problem.
  
  I guess you changed TopDir in your config.pl file, right?
  
  Well, BackupPC 3.1.0 has a bug in that TopDir change will not affect
  the pool and cpool directories, so it will try to create a
  hardlink in /var/lib/BackupPC for a file in /media/disk, which are in
  different filesystems, so it fails.
  

Yes - I had suggested that the problem might be that the pool and pc
trees are not on the same filesystem.

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Holger Parplies
Hi,

Jeffrey J. Kosowsky wrote on 2009-08-12 18:12:09 -0400 [Re: [BackupPC-users] 
100,000+ errors in last nights backup]:
 Steve Blackwell wrote at about 14:33:54 -0400 on Wednesday, August 12, 2009:
   Steve Blackwell wrote at about 11:18:36 -0400 on Wednesday, August 
 12, 2009:
 On Wed, 12 Aug 2009 10:06:37 -0400 Jeffrey J. Kosowsky 
 backu...@kosowsky.org wrote:
  Try manually doing something like the following from the
  command line: link
  b32585c3cc30b7ebb556d335a08554e3 
 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
 
 Where do I need to be to run this? 

you need to be in $TopDir/cpool/b/3/2 ... or rather, it should be

sudo -u backuppc ln 
$TopDir/cpool/b/3/2/b32585c3cc30b7ebb556d335a08554e3 
/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml

(or use 'link' if you prefer). You need to get $TopDir right though. See
below.

   # sudo -u backuppc link
   b32585c3cc30b7ebb556d335a08554e3 
 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
   link: cannot create link
   
 `/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml'
   to `b32585c3cc30b7ebb556d335a08554e3': No such file or directory

Yes, most directories won't contain a file with that name ;-).

   Jeffrey, I'm now thinking that two backups have somehow been scheduled
   at the same. See the Les Miskell thread.

I agree with that except for the name. But I don't think it's the problem, at
least not the one you're looking for. I can't imagine why two backups of the
same host would be scheduled simultaneously, and I don't think it's a good
idea to do so :-). BackupPC doesn't usually do this. Have you changed the code
in any way? Have you seen such a thing happen before?

 I don't know. I am perplexed since the code that is creating the error
 code '3' is as follows (from MakeFileLink in Lib.pm):
 
 return -1 if ( !-f $name );
 for ( $i = -1 ; ; $i++ ) {
 return -2 if ( !defined($rawFile = $bpc-MD52Path($d,
 $compress)) );
 $rawFile .= _$i if ( $i = 0 );
 if ( -f $rawFile ) {
 if ( (stat(_))[3]  $bpc-{Conf}{HardLinkMax}
  !compare($name, $rawFile) ) {
 unlink($name);
 return -3 if ( !link($rawFile, $name) );
 
 
 Now:
   $name exists (per the test in the first line)
   $rawFile exists (per the test in line 6)
 yet the link fails a couple of lines later.
 
 So unless there is an incredibly precise race condition

Is there such a thing as a precise race condition? If it always happened in
the same order, would it even be a race condition?

 and assuming links work on your machine, the 'link' in the final line should
 succeed. It is hard to believe that there could be a repeatable race
 condition with another backup that is so precise that a file exists in
 one line and then no longer exists just a couple of simple lines of
 perl code later.

Ah, but it's not just a couple of simple lines of Perl code. Note the
'compare' call in line 8 (File::Compare::compare, if you were wondering),
which will take an arbitrary amount of time (and lead to an arbitrary number
of page faults/task switches, depending only on the size of the files).

But the point really is that between lines *9 and 10* (unlink/link) nothing
significant happens (unless unlink() always leads to a task switch, which I
doubt). Even then, $rawFile continues to -f, and deleting a link and replacing
it with a new link to the same file should succeed any number of times. Only
if interrupted *between unlink and link*, the process *might* find upon being
rescheduled that the link() fails because another process has already created
the file again.

But all of that is really beside the point. Let's take a step back. Where are
we?

We're in BackupPC_link, not in BackupPC_dump. As the log file shows (XferLOG
for host steve), the backup is apparently run twice in parallel, leading to
the failed rename (only one backup can succeed to rename 'new' to '151',
though I'm not sure what will happen to the 'backups' file). The main log file
only indicates one instance of BackupPC_link being run though (and one
instance of BackupPC will never run more than one BackupPC_link command at the
same time in any case).

So, I believe we're back to the issue of what you did wrong when moving
$TopDir. I don't remember reading which version of BackupPC you are using.
What did you do to move $TopDir? Have a look at the old location, wherever
that was. Are there files with recent modification times below the cpool/
directory? Below /media/disk/cpool? BackupPC_nightly reports files there,
but you might have copied them there at some point. If you umount /dev/sdd2,
what's below /media/disk? A cpool/ directory?

 You may also want to look at ownership

Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Steve Blackwell
On Wed, 12 Aug 2009 18:12:09 -0400
Jeffrey J. Kosowsky backu...@kosowsky.org wrote:

 Steve Blackwell wrote at about 14:33:54 -0400 on Wednesday, August
 12, 2009:
   On Wed, 12 Aug 2009 14:18:04 -0400
   Jeffrey J. Kosowsky backu...@kosowsky.org wrote:
   
Steve Blackwell wrote at about 13:27:17 -0400 on Wednesday,
August 12, 2009:
  On Wed, 12 Aug 2009 12:24:04 -0400
  Jeffrey J. Kosowsky backu...@kosowsky.org wrote:
  
   Steve Blackwell wrote at about 11:18:36 -0400 on Wednesday,
   August 12, 2009:
 On Wed, 12 Aug 2009 10:06:37 -0400
 Jeffrey J. Kosowsky backu...@kosowsky.org wrote:
 
  Steve Blackwell wrote at about 08:49:23 -0400 on
  Wednesday, August 12, 2009:
Backuppc has been behaving strangely lately. This is
another instance.
 
 ...
05:00:06 Running BackupPC_link steve (pid=8901) 
2009-08-12 05:00:08 BackupPC_link got error -3 when
calling

 MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml,
b32585c3cc30b7ebb556d335a08554e3, 1)

followed by 100,000+ of the same error on different
files

What is going on here?

  
  Error -3 means that calling the perl function link
  (between a file in the pool and a name in the pc tree)
  failed.
  
  Try manually doing something like the following from
  the command line: link
  b32585c3cc30b7ebb556d335a08554e3 
 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
 
 Where do I need to be to run this? 
   
   From the command line anywhere. Just type the command
   as-is.
   Actually type it as:
   su -u backuppc link ...
   
   so that it runs as user 'backuppc'
   If it works, you can undo it by typing:
   rm 
 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
   (assuming the file didn't exist previously)
  
  su doesn't have a -u option.
  

run: sudo -u backuppc
or su backuppc -c link...
   
   # sudo -u backuppc link
   b32585c3cc30b7ebb556d335a08554e3 
 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml
   link: cannot create link
   
 `/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml'
   to `b32585c3cc30b7ebb556d335a08554e3': No such file or directory
   
   
   Jeffrey, I'm now thinking that two backups have somehow been
   scheduled at the same. See the Les Miskell thread.
   
   Steve
   
 
 I don't know. I am perplexed since the code that is creating the error
 code '3' is as follows (from MakeFileLink in Lib.pm):
 
 return -1 if ( !-f $name );
 for ( $i = -1 ; ; $i++ ) {
 return -2 if ( !defined($rawFile = $bpc-MD52Path($d,
 $compress)) );
 $rawFile .= _$i if ( $i = 0 );
 if ( -f $rawFile ) {
 if ( (stat(_))[3]  $bpc-{Conf}{HardLinkMax}
  !compare($name, $rawFile) ) {
 unlink($name);
 return -3 if ( !link($rawFile, $name) );
 
 
 Now:
   $name exists (per the test in the first line)
   $rawFile exists (per the test in line 6)
 yet the link fails a couple of lines later.
 
 So unless there is an incredibly precise race condition and assuming
 links work on your machine, the 'link' in the final line should
 succeed. It is hard to believe that there could be a repeatable race
 condition with another backup that is so precise that a file exists in
 one line and then no longer exists just a couple of simple lines of
 perl code later.
 
 I'm still wondering whether there is some problem with
 linking/unlinking on your computer. So the problem is either that the
 unlink (i.e., delete) fails in the next to last line or the link fails
 in the last line. You may also want to look at ownership/permissions
 in your pc tree to make sure that the relevant files and directories
 are writable by user backuppc.
 
 Also, why don't you try re-running the manual link line that I gave
 you but this time link against a known *existing* (random) pool file.
 Also try something like:
 
 su backuppc -c
 touch 
 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/tempfile
 su backuppc -c
 rm 
 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/tempfile

su backuppc -c doesn't work but...
# sudo -u backuppc
touch 
/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/tempfile

#
ls 
/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/tempfile
 

Re: [BackupPC-users] 100,000+ errors in last nights backup

2009-08-12 Thread Adam Goryachev
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Holger Parplies wrote:
 We're in BackupPC_link, not in BackupPC_dump. As the log file shows (XferLOG
 for host steve), the backup is apparently run twice in parallel, leading to
 the failed rename (only one backup can succeed to rename 'new' to '151',
 though I'm not sure what will happen to the 'backups' file). The main log file
 only indicates one instance of BackupPC_link being run though (and one
 instance of BackupPC will never run more than one BackupPC_link command at the
 same time in any case).

I've frequently managed to cause two backuppc_dump's to run in parallel
where one was scheduled by backuppc and one was run manually by me from
the command line. It would be nice if backuppc_dump could do a simple
check to see if the new directory already exists, and if so, simple exit
(or error and exit).

Mainly I run backups manually so I can see exactly what is happening
during the backup and where/why it is failing or taking so long.
Sometimes I remember to use the gui to stop backups for that host for a
period of time, and again, sometimes that isn't long enough...

Regards,
Adam
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAkqDp74ACgkQGyoxogrTyiXEQwCgusv36QQNe2aDmeRhQSix7k9T
t8AAnjL/XfeZCeRruovoLvaISc2cLKpE
=zeTZ
-END PGP SIGNATURE-

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/