Re: [BackupPC-users] Bizarre form of cpool corruption.

2010-12-07 Thread Craig Barratt
Robin writes: > > In fact, it was for applications like this that I had suggested a > > while back adding the partial md5sum to the attrib file so that > > the reverse lookup can be done more cheaply > > That would, in fact, be fantastic. > > > (the need for all of this will be obviated when Cr

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Robin Lee Powell
On Wed, Dec 08, 2010 at 12:06:40AM -0500, Dan Pritts wrote: > If I had that big a pool, I think I'd not be using a single > backuppc instance, but that's just me. I'm guessing it works well > for you, I'm glad it does. We aren't; we have 6. The *smallest* is about 4 TiB if disk, most of it in us

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Dan Pritts
On Dec 7, 2010, at 2:44 PM, Robin Lee Powell wrote: > On Tue, Dec 07, 2010 at 02:18:51PM -0500, Dan Pritts wrote: >> umount /var/lib/backuppc >> dd if=/dev/onedisk of=/dev/someotherdisk bs=1M > > Only works if you have identical disks, which is hard when you've > got a few TiB on a SAN. The disks

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Robin Lee Powell
On Wed, Dec 08, 2010 at 11:54:13AM +1100, Dale King wrote: > On Tue, Dec 07, 2010 at 12:38:00AM -0800, Robin Lee Powell wrote: > > On Tue, Dec 07, 2010 at 07:58:05AM +, Tyler J. Wagner wrote: > > > On Mon, 2010-12-06 at 10:51 -0800, Robin Lee Powell wrote: > > > > IME it's *much* faster that wa

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Dale King
On Tue, Dec 07, 2010 at 12:38:00AM -0800, Robin Lee Powell wrote: > On Tue, Dec 07, 2010 at 07:58:05AM +, Tyler J. Wagner wrote: > > On Mon, 2010-12-06 at 10:51 -0800, Robin Lee Powell wrote: > > > IME it's *much* faster that way; you do BackupPC_TarPCCopy, and > > > then rsync the cpoll *witho

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Robin Lee Powell
On Tue, Dec 07, 2010 at 06:19:45PM -0600, Les Mikesell wrote: > On 12/7/10 5:19 PM, Tyler J. Wagner wrote: > > On Tue, 2010-12-07 at 14:18 -0500, Dan Pritts wrote: > >> Not exactly an answer to your question, but i would do this: > >> > >> umount /var/lib/backuppc dd if=/dev/onedisk > >> of=/dev/so

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Les Mikesell
On 12/7/10 5:19 PM, Tyler J. Wagner wrote: > On Tue, 2010-12-07 at 14:18 -0500, Dan Pritts wrote: >> Not exactly an answer to your question, but i would do this: >> >> umount /var/lib/backuppc >> dd if=/dev/onedisk of=/dev/someotherdisk bs=1M > > Yes, that's a good way to copy the filesystem. But i

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Tyler J. Wagner
On Tue, 2010-12-07 at 14:18 -0500, Dan Pritts wrote: > Not exactly an answer to your question, but i would do this: > > umount /var/lib/backuppc > dd if=/dev/onedisk of=/dev/someotherdisk bs=1M Yes, that's a good way to copy the filesystem. But if you want to move the files to another filesystem,

[BackupPC-users] It's not rsync -H as such, it's BackupPC data.

2010-12-07 Thread Robin Lee Powell
On Tue, Dec 07, 2010 at 11:44:38AM -0800, Robin Lee Powell wrote: > On Tue, Dec 07, 2010 at 02:18:51PM -0500, Dan Pritts wrote: > > In practice, rsync -H is the reasonable way to do what you're > > after, EXCEPT that there are just too many hard links on a > > backuppc data store for this to work.

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Robin Lee Powell
On Tue, Dec 07, 2010 at 02:18:51PM -0500, Dan Pritts wrote: > umount /var/lib/backuppc > dd if=/dev/onedisk of=/dev/someotherdisk bs=1M Only works if you have identical disks, which is hard when you've got a few TiB on a SAN. > In practice, rsync -H is the reasonable way to do what you're > after

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Dan Pritts
On Dec 7, 2010, at 2:58 AM, Tyler J. Wagner wrote: > So, if you wanted to copy the entire /var/lib/backuppc directory to > another filesystem, what commands would you use, for example? Not exactly an answer to your question, but i would do this: umount /var/lib/backuppc dd if=/dev/onedisk of=/dev

Re: [BackupPC-users] Another jLib/fixLinks issue.

2010-12-07 Thread Jeffrey J. Kosowsky
Robin Lee Powell wrote at about 11:05:46 -0800 on Tuesday, December 7, 2010: > On Tue, Dec 07, 2010 at 01:58:28PM -0500, Jeffrey J. Kosowsky wrote: > > Robin Lee Powell wrote at about 15:40:04 -0800 on Monday, December 6, 2010: > > > This is *fascinating*. > > > > > > >From the actually-fi

Re: [BackupPC-users] Another jLib/fixLinks issue.

2010-12-07 Thread Robin Lee Powell
On Tue, Dec 07, 2010 at 01:58:28PM -0500, Jeffrey J. Kosowsky wrote: > Robin Lee Powell wrote at about 15:40:04 -0800 on Monday, December 6, 2010: > > This is *fascinating*. > > > > >From the actually-fixing-stuff part of the run, I get: > > > > ERROR: > "tm50-s00292__nfs/68/f%2f/fshared/

Re: [BackupPC-users] Another jLib/fixLinks issue.

2010-12-07 Thread Jeffrey J. Kosowsky
Robin Lee Powell wrote at about 15:40:04 -0800 on Monday, December 6, 2010: > This is *fascinating*. > > >From the actually-fixing-stuff part of the run, I get: > > ERROR: > "tm50-s00292__nfs/68/f%2f/fshared/fthepoint/fsite_images/f0042/f4097/fMULTI_medium.jpg" > - Too many links if ad

Re: [BackupPC-users] Feature? Bug? Something. BackupPC_tarPCCopy and fixing links.

2010-12-07 Thread Jeffrey J. Kosowsky
Robin Lee Powell wrote at about 10:21:39 -0800 on Tuesday, December 7, 2010: > > So, I've made BackupPC_fixLinks do what I want in terms of fixing > the problems that caused it to emit hundreds of: > > Can't find > redbubble--tm50-e00145--tm50-s00339---shared/40/f%2f/fshared/fredbubble/f

Re: [BackupPC-users] jLib bug with md5sum stuff

2010-12-07 Thread Jeffrey J. Kosowsky
Jeffrey J. Kosowsky wrote at about 13:41:57 -0500 on Tuesday, December 7, 2010: > Jeffrey J. Kosowsky wrote at about 13:34:19 -0500 on Tuesday, December 7, > 2010: > > Robin Lee Powell wrote at about 21:48:17 -0800 on Monday, December 6, > 2010: > > > On Mon, Dec 06, 2010 at 12:32:01PM -0

Re: [BackupPC-users] jLib bug with md5sum stuff

2010-12-07 Thread Jeffrey J. Kosowsky
Jeffrey J. Kosowsky wrote at about 13:34:19 -0500 on Tuesday, December 7, 2010: > Robin Lee Powell wrote at about 21:48:17 -0800 on Monday, December 6, 2010: > > On Mon, Dec 06, 2010 at 12:32:01PM -0800, Robin Lee Powell wrote: > > > > > > substr outside of string at /usr/local/lib64/Backup

Re: [BackupPC-users] jLib bug with md5sum stuff

2010-12-07 Thread Robin Lee Powell
On Tue, Dec 07, 2010 at 01:34:19PM -0500, Jeffrey J. Kosowsky wrote: > OK I was confused for a second there since usually the convention > is to use '---' as the original code and '+++' as the new code... Sorry, musta put the diff in the wrong order. > Well actually, I had found and fixed that bu

Re: [BackupPC-users] jLib bug with md5sum stuff

2010-12-07 Thread Jeffrey J. Kosowsky
Robin Lee Powell wrote at about 21:48:17 -0800 on Monday, December 6, 2010: > On Mon, Dec 06, 2010 at 12:32:01PM -0800, Robin Lee Powell wrote: > > > > substr outside of string at /usr/local/lib64/BackupPC/jLib.pm line 162. > > Use of uninitialized value in concatenation (.) or string at > >

Re: [BackupPC-users] Bizarre form of cpool corruption.

2010-12-07 Thread Robin Lee Powell
On Tue, Dec 07, 2010 at 01:16:32PM -0500, Jeffrey J. Kosowsky wrote: > Robin, can you just clarify the context. Did this apparent pool > corruption only occur after running BackupPC_tarPCCopy or did it > occur in the course of "normal" backuppc running. I honestly don't know; I've done so much on

[BackupPC-users] Feature? Bug? Something. BackupPC_tarPCCopy and fixing links.

2010-12-07 Thread Robin Lee Powell
So, I've made BackupPC_fixLinks do what I want in terms of fixing the problems that caused it to emit hundreds of: Can't find redbubble--tm50-e00145--tm50-s00339---shared/40/f%2f/fshared/fredbubble/fpurchase_order_assets/fbatch_7749/faddresses_dom estic_20101026T01.csv in pool, will copy file

Re: [BackupPC-users] Bizarre form of cpool corruption.

2010-12-07 Thread Jeffrey J. Kosowsky
Robin Lee Powell wrote at about 23:46:11 -0800 on Monday, December 6, 2010: > On Mon, Dec 06, 2010 at 11:33:15PM -0800, Craig Barratt wrote: > > Robin, > > > > > Nope; I'm a big tab completion user, so I would have seen it. ;) > > > > > > $ ls -li /backups/cpool/1/5/c/15c0e4b08058ef3704b8f

Re: [BackupPC-users] Bizarre form of cpool corruption.

2010-12-07 Thread Robin Lee Powell
On Tue, Dec 07, 2010 at 01:07:50PM -0500, Jeffrey J. Kosowsky wrote: > 2. More importantly, there is no fast way No, there really isn't. > that I know of checking whether a pc entry with more than one link > is in the pool. You first need to read in the 1st MB of each file, > calculate the partia

Re: [BackupPC-users] Bizarre form of cpool corruption.

2010-12-07 Thread Jeffrey J. Kosowsky
Robin Lee Powell wrote at about 13:17:43 -0800 on Monday, December 6, 2010: > On Mon, Dec 06, 2010 at 03:48:04PM -0500, Jeffrey J. Kosowsky wrote: > > Robin Lee Powell wrote at about 10:37:52 -0800 on Monday, December 6, 2010: > > > > > > So I'm writing a script to transfer a client from one

[BackupPC-users] SPNEGO login failed: invalid parameter

2010-12-07 Thread Frank J . Gómez
A Windows 7 laptop is failing with "backup failed (No files dumped for share win7home)." Prior to this, one full and three incrementals completed successfully. I verified the username and password, and I've tried with Windows Firewall turned completely off. The password and the machine name cont

Re: [BackupPC-users] Sanity check re: pooling.

2010-12-07 Thread gregwm
hmm, i rather expect the pool check doesn't follow all the transfers, rather is interleaved with the transfers, if i'm right the temporary ballooning you describe should not occur other than a file at a time. On 2010-12-06, Ed McDonagh wrote: > On Mon, 2010-12-06 at 10:47 -0500, Ken D'Ambrosio wr

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Robin Lee Powell
On Tue, Dec 07, 2010 at 07:58:05AM +, Tyler J. Wagner wrote: > On Mon, 2010-12-06 at 10:51 -0800, Robin Lee Powell wrote: > > IME it's *much* faster that way; you do BackupPC_TarPCCopy, and > > then rsync the cpoll *without -H*. It shouldn't take any longer > > than the actual data transfer ti

Re: [BackupPC-users] Don't use rsync -H!! (was Re: copying the pool to a new filesystem?!)

2010-12-07 Thread Tyler J. Wagner
On Mon, 2010-12-06 at 10:51 -0800, Robin Lee Powell wrote: > IME it's *much* faster that way; you do BackupPC_TarPCCopy, and then > rsync the cpoll *without -H*. It shouldn't take any longer than the > actual data transfer time itself. So, if you wanted to copy the entire /var/lib/backuppc direct