Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Tyler J. Wagner
On Mon, 2010-12-06 at 10:51 -0800, Robin Lee Powell wrote: IME it's *much* faster that way; you do BackupPC_TarPCCopy, and then rsync the cpoll *without -H*. It shouldn't take any longer than the actual data transfer time itself. So, if you wanted to copy the entire /var/lib/backuppc

Re: [BackupPC-users] Sanity check re: pooling.

2010-12-07 Thread gregwm
hmm, i rather expect the pool check doesn't follow all the transfers, rather is interleaved with the transfers, if i'm right the temporary ballooning you describe should not occur other than a file at a time. On 2010-12-06, Ed McDonagh ed.mcdon...@rmh.nhs.uk wrote: On Mon, 2010-12-06 at 10:47

[BackupPC-users] SPNEGO login failed: invalid parameter

2010-12-07 Thread Frank J . Gómez
A Windows 7 laptop is failing with backup failed (No files dumped for share win7home). Prior to this, one full and three incrementals completed successfully. I verified the username and password, and I've tried with Windows Firewall turned completely off. The password and the machine name

Re: [BackupPC-users] Bizarre form of cpool corruption.

2010-12-07 Thread Jeffrey J. Kosowsky
Robin Lee Powell wrote at about 13:17:43 -0800 on Monday, December 6, 2010: On Mon, Dec 06, 2010 at 03:48:04PM -0500, Jeffrey J. Kosowsky wrote: Robin Lee Powell wrote at about 10:37:52 -0800 on Monday, December 6, 2010: So I'm writing a script to transfer a client from one host to

Re: [BackupPC-users] Bizarre form of cpool corruption.

2010-12-07 Thread Robin Lee Powell
On Tue, Dec 07, 2010 at 01:07:50PM -0500, Jeffrey J. Kosowsky wrote: 2. More importantly, there is no fast way No, there really isn't. that I know of checking whether a pc entry with more than one link is in the pool. You first need to read in the 1st MB of each file, calculate the partial

Re: [BackupPC-users] Bizarre form of cpool corruption.

2010-12-07 Thread Jeffrey J. Kosowsky
Robin Lee Powell wrote at about 23:46:11 -0800 on Monday, December 6, 2010: On Mon, Dec 06, 2010 at 11:33:15PM -0800, Craig Barratt wrote: Robin, Nope; I'm a big tab completion user, so I would have seen it. ;) $ ls -li /backups/cpool/1/5/c/15c0e4b08058ef3704b8fc24887e2bcc*

[BackupPC-users] Feature? Bug? Something. BackupPC_tarPCCopy and fixing links.

2010-12-07 Thread Robin Lee Powell
So, I've made BackupPC_fixLinks do what I want in terms of fixing the problems that caused it to emit hundreds of: Can't find redbubble--tm50-e00145--tm50-s00339---shared/40/f%2f/fshared/fredbubble/fpurchase_order_assets/fbatch_7749/faddresses_dom estic_20101026T01.csv in pool, will copy file

Re: [BackupPC-users] Bizarre form of cpool corruption.

2010-12-07 Thread Robin Lee Powell
On Tue, Dec 07, 2010 at 01:16:32PM -0500, Jeffrey J. Kosowsky wrote: Robin, can you just clarify the context. Did this apparent pool corruption only occur after running BackupPC_tarPCCopy or did it occur in the course of normal backuppc running. I honestly don't know; I've done so much on

Re: [BackupPC-users] jLib bug with md5sum stuff

2010-12-07 Thread Jeffrey J. Kosowsky
Robin Lee Powell wrote at about 21:48:17 -0800 on Monday, December 6, 2010: On Mon, Dec 06, 2010 at 12:32:01PM -0800, Robin Lee Powell wrote: substr outside of string at /usr/local/lib64/BackupPC/jLib.pm line 162. Use of uninitialized value in concatenation (.) or string at

Re: [BackupPC-users] jLib bug with md5sum stuff

2010-12-07 Thread Robin Lee Powell
On Tue, Dec 07, 2010 at 01:34:19PM -0500, Jeffrey J. Kosowsky wrote: OK I was confused for a second there since usually the convention is to use '---' as the original code and '+++' as the new code... Sorry, musta put the diff in the wrong order. Well actually, I had found and fixed that bug

Re: [BackupPC-users] jLib bug with md5sum stuff

2010-12-07 Thread Jeffrey J. Kosowsky
Jeffrey J. Kosowsky wrote at about 13:34:19 -0500 on Tuesday, December 7, 2010: Robin Lee Powell wrote at about 21:48:17 -0800 on Monday, December 6, 2010: On Mon, Dec 06, 2010 at 12:32:01PM -0800, Robin Lee Powell wrote: substr outside of string at

Re: [BackupPC-users] jLib bug with md5sum stuff

2010-12-07 Thread Jeffrey J. Kosowsky
Jeffrey J. Kosowsky wrote at about 13:41:57 -0500 on Tuesday, December 7, 2010: Jeffrey J. Kosowsky wrote at about 13:34:19 -0500 on Tuesday, December 7, 2010: Robin Lee Powell wrote at about 21:48:17 -0800 on Monday, December 6, 2010: On Mon, Dec 06, 2010 at 12:32:01PM -0800,

Re: [BackupPC-users] Feature? Bug? Something. BackupPC_tarPCCopy and fixing links.

2010-12-07 Thread Jeffrey J. Kosowsky
Robin Lee Powell wrote at about 10:21:39 -0800 on Tuesday, December 7, 2010: So, I've made BackupPC_fixLinks do what I want in terms of fixing the problems that caused it to emit hundreds of: Can't find

Re: [BackupPC-users] Another jLib/fixLinks issue.

2010-12-07 Thread Jeffrey J. Kosowsky
Robin Lee Powell wrote at about 15:40:04 -0800 on Monday, December 6, 2010: This is *fascinating*. From the actually-fixing-stuff part of the run, I get: ERROR: tm50-s00292__nfs/68/f%2f/fshared/fthepoint/fsite_images/f0042/f4097/fMULTI_medium.jpg - Too many links if added to

Re: [BackupPC-users] Another jLib/fixLinks issue.

2010-12-07 Thread Robin Lee Powell
On Tue, Dec 07, 2010 at 01:58:28PM -0500, Jeffrey J. Kosowsky wrote: Robin Lee Powell wrote at about 15:40:04 -0800 on Monday, December 6, 2010: This is *fascinating*. From the actually-fixing-stuff part of the run, I get: ERROR:

Re: [BackupPC-users] Another jLib/fixLinks issue.

2010-12-07 Thread Jeffrey J. Kosowsky
Robin Lee Powell wrote at about 11:05:46 -0800 on Tuesday, December 7, 2010: On Tue, Dec 07, 2010 at 01:58:28PM -0500, Jeffrey J. Kosowsky wrote: Robin Lee Powell wrote at about 15:40:04 -0800 on Monday, December 6, 2010: This is *fascinating*. From the actually-fixing-stuff

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Dan Pritts
On Dec 7, 2010, at 2:58 AM, Tyler J. Wagner wrote: So, if you wanted to copy the entire /var/lib/backuppc directory to another filesystem, what commands would you use, for example? Not exactly an answer to your question, but i would do this: umount /var/lib/backuppc dd if=/dev/onedisk

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Robin Lee Powell
On Tue, Dec 07, 2010 at 02:18:51PM -0500, Dan Pritts wrote: umount /var/lib/backuppc dd if=/dev/onedisk of=/dev/someotherdisk bs=1M Only works if you have identical disks, which is hard when you've got a few TiB on a SAN. In practice, rsync -H is the reasonable way to do what you're after,

[BackupPC-users] It's not rsync -H as such, it's BackupPC data.

2010-12-07 Thread Robin Lee Powell
On Tue, Dec 07, 2010 at 11:44:38AM -0800, Robin Lee Powell wrote: On Tue, Dec 07, 2010 at 02:18:51PM -0500, Dan Pritts wrote: In practice, rsync -H is the reasonable way to do what you're after, EXCEPT that there are just too many hard links on a backuppc data store for this to work.

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Tyler J. Wagner
On Tue, 2010-12-07 at 14:18 -0500, Dan Pritts wrote: Not exactly an answer to your question, but i would do this: umount /var/lib/backuppc dd if=/dev/onedisk of=/dev/someotherdisk bs=1M Yes, that's a good way to copy the filesystem. But if you want to move the files to another filesystem,

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Les Mikesell
On 12/7/10 5:19 PM, Tyler J. Wagner wrote: On Tue, 2010-12-07 at 14:18 -0500, Dan Pritts wrote: Not exactly an answer to your question, but i would do this: umount /var/lib/backuppc dd if=/dev/onedisk of=/dev/someotherdisk bs=1M Yes, that's a good way to copy the filesystem. But if you want

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Robin Lee Powell
On Tue, Dec 07, 2010 at 06:19:45PM -0600, Les Mikesell wrote: On 12/7/10 5:19 PM, Tyler J. Wagner wrote: On Tue, 2010-12-07 at 14:18 -0500, Dan Pritts wrote: Not exactly an answer to your question, but i would do this: umount /var/lib/backuppc dd if=/dev/onedisk of=/dev/someotherdisk

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Dale King
On Tue, Dec 07, 2010 at 12:38:00AM -0800, Robin Lee Powell wrote: On Tue, Dec 07, 2010 at 07:58:05AM +, Tyler J. Wagner wrote: On Mon, 2010-12-06 at 10:51 -0800, Robin Lee Powell wrote: IME it's *much* faster that way; you do BackupPC_TarPCCopy, and then rsync the cpoll *without -H*.

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Dan Pritts
On Dec 7, 2010, at 2:44 PM, Robin Lee Powell wrote: On Tue, Dec 07, 2010 at 02:18:51PM -0500, Dan Pritts wrote: umount /var/lib/backuppc dd if=/dev/onedisk of=/dev/someotherdisk bs=1M Only works if you have identical disks, which is hard when you've got a few TiB on a SAN. The disks do not

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Robin Lee Powell
On Wed, Dec 08, 2010 at 12:06:40AM -0500, Dan Pritts wrote: If I had that big a pool, I think I'd not be using a single backuppc instance, but that's just me. I'm guessing it works well for you, I'm glad it does. We aren't; we have 6. The *smallest* is about 4 TiB if disk, most of it in use.

Re: [BackupPC-users] Bizarre form of cpool corruption.

2010-12-07 Thread Craig Barratt
Robin writes: In fact, it was for applications like this that I had suggested a while back adding the partial md5sum to the attrib file so that the reverse lookup can be done more cheaply That would, in fact, be fantastic. (the need for all of this will be obviated when Craig