Hello, I also had the same problem with a USB 1.1. on a P3, 1Ghz. I changed it to 2.0 (PCI card with 2xUSB 2.0) and the problem was solved. So probably upgrading to a P4 will improve, but I think that upgrading your USB will already give a better result.
Serge -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of [EMAIL PROTECTED] Sent: mercredi 2 janvier 2008 11:32 To: backuppc-users@lists.sourceforge.net Subject: BackupPC-users Digest, Vol 21, Issue 2 Send BackupPC-users mailing list submissions to backuppc-users@lists.sourceforge.net To subscribe or unsubscribe via the World Wide Web, visit https://lists.sourceforge.net/lists/listinfo/backuppc-users or, via email, send a message with subject or body 'help' to [EMAIL PROTECTED] You can reach the person managing the list at [EMAIL PROTECTED] When replying, please edit your Subject line so it is more specific than "Re: Contents of BackupPC-users digest..." Today's Topics: 1. Re: How to speed up backup process? (24+ hours for 140GB with no data change) ([EMAIL PROTECTED]) 2. Re: BackupPC_link error ([EMAIL PROTECTED]) 3. Re: SMB protocol and error report ( Jes?s Martel ) 4. Re: How to speed up backup process? (24+ hours for 140GB with no data change) (dan) 5. Re: user permission always reset to root (Arthur Odekerken) ---------------------------------------------------------------------- Message: 1 Date: Tue, 01 Jan 2008 17:21:47 -0500 From: [EMAIL PROTECTED] Subject: Re: [BackupPC-users] How to speed up backup process? (24+ hours for 140GB with no data change) To: backuppc-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset="ISO-8859-1" On Tue, 01 Jan 2008 11:57:45 -0500, "Jinshi" <[EMAIL PROTECTED]> said: > Hello, > > Currently I am using an old PC as backup server. It takes very long > time for BackupPC 3.0 to backup about 140GB data. Even when no file is > changed, it still takes more than 24 hours. I would like to know what > option I have to speed it up. > > The backup server is P3 350MHz, 384M ram, running FreeBSD. The backup > drive is a USB 500GB external. SNIP > There is also a > process "irq9: dc9 uhci0++" (what is that?) is taking 10% cpu. About > 20-30% CPU is idle. All network cards, hub and router are 100Mbps. The > Windows Vista reports network traffic only around 5-8Mbps during backup. > > I want to know how I can find the bottleneck. I am not sure what is > the limiting step for the speed. I have a PC P4 2.4Ghz/756M ram that > can replace the backup server. Will that improve much? Should I use an > internal drive for backup? I would be pretty sure the bottleneck is the use of a USB drive. The uhc* process is the _U_SB _H_ost _C_ontroller. On an older computer, it is probably USB 1.1, not 2.0, so it is quite slow. My backup machine is a P III (faster clock, though, but only 256 MB RAM) and it runs plenty fast enough, currently with over 150G backed up. Jon S. ------------------------------ Message: 2 Date: Tue, 01 Jan 2008 17:22:22 -0500 From: [EMAIL PROTECTED] Subject: Re: [BackupPC-users] BackupPC_link error To: backuppc-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset="ISO-8859-1" On Mon, 31 Dec 2007 17:20:06 -0500, [EMAIL PROTECTED] said: > Thanks for the response Craig. > > I noticed that pool and cpool were getting updated over at > /var/lib/backuppc also (don't understand why I wasn't getting these > link errors before ?!) > > So I moved the var/lib/backuppc versions of the pool, cpool, and log > directories over to the raid volume and remounted it under > /var/lib/backuppc and changed $TopDir back to /var/lib/backuppc in > config.pl. I'll report back tomorrow to see if it works. It worked. ------------------------------ Message: 3 Date: Tue, 1 Jan 2008 23:14:15 +0000 From: " Jes?s Martel " <[EMAIL PROTECTED]> Subject: Re: [BackupPC-users] SMB protocol and error report To: "Craig Barratt" <[EMAIL PROTECTED]> Cc: "backuppc-users@lists.sourceforge.net" <backuppc-users@lists.sourceforge.net> Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=ISO-8859-1 Thank you very much for the patch. Regards. 2007/12/31, Craig Barratt <[EMAIL PROTECTED]>: > Jesus writes: > > > There are more files in the share and the full backup is created > > successful. This is the XferLOG of full backup: > > Ok, this is a bug that I will fix in the next version. > > The fix is simple, just add an increment of the error counter when > NT_STATUS_ACCESS_DENIED is seen. A patch is attached. > > Craig > > --- lib/BackupPC/Xfer/Smb.pm.orig 2007-12-30 19:27:43.578125000 -0800 > +++ lib/BackupPC/Xfer/Smb.pm 2007-12-30 19:27:58.875000000 -0800 > @@ -284,6 +284,7 @@ > $t->{XferLOG}->write(\"$_\n") if ( $t->{logLevel} >= 0 ); > } elsif ( /^\s*NT_STATUS_ACCESS_DENIED listing (.*)/ > || /^\s*ERRDOS - ERRnoaccess \(Access denied\.\) > listing (.*)/ ) { > + $t->{xferErrCnt}++; > my $badDir = $1; > $badDir =~ s{\\}{/}g; > $badDir =~ s{/+}{/}g; > ------------------------------ Message: 4 Date: Tue, 1 Jan 2008 20:37:37 -0700 From: dan <[EMAIL PROTECTED]> Subject: Re: [BackupPC-users] How to speed up backup process? (24+ hours for 140GB with no data change) To: [EMAIL PROTECTED] Cc: backuppc-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset="iso-8859-1" you dmesg indicates that you have 2 USB controllers, 1 is a USB1 and 1 is a USB2. USB1: uhub2: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub2: 2 ports with 2 removable, self powered USB2: uhub3: VIA EHCI root hub, class 9/0, rev 2.00/1.00, addr 1 uhub3: 4 ports with 4 removable, self powered the disk seems to be plugged into the USB1 controller: da0: 40.000MB/s transfers da0: 476940MB (976773168 512 byte sectors: 255H 63S/T 60801C) that 40.000MB/s should been read as 40Mb/s, aka 5MB/s which is MAX for USB1 and will probably only get 50% of that speed in the real world over that bus. i think your bottleneck here is a hard disk interface that is running at something like 2.5MB/s at that speed, 140GB(146,800,640KB) on a 2560KB/s link(USB1) would take 57344 seconds, which translates up to 16Hours under perfect conditions and twice that under more likely conditions. also, you CPU has to run backuppc and will end up causing some wait states where the disk is not being accessed at the potential speed causing even longer backups. rsync should help a lot but you should first try to switch to another USB port, probably in another cluster on the motherboard so you can get the USB2 chip. just watch dmesg and see if it connects at 40Mb/s or 480Mb/s. also, USB in any form is not ideal for backuppc. it uses too much CPU time that backuppc could use instead and using main CPU time to processes disk loads adds a lot of latency which detroys I/O performance so small files will take an order of magnitude more time to manage. also consider that the old machine you are running on has pretty week I/O with because the p3 chipsets are bus-shared meaning that every single bit of data that is moved or manipulated ends up going across the PCI bus and anything that gets processed will hit that bus twice. that bus is just 133MB/s and has to share audio, graphics, memory, hard disk, network, USB. AND the southbridge on an old chipset was designed when BIG data loads we still in the MB range, not the GB range. consider a system upgrade. you dont need much, just more than you have. On Jan 1, 2008 3:21 PM, <[EMAIL PROTECTED]> wrote: > On Tue, 01 Jan 2008 11:57:45 -0500, "Jinshi" <[EMAIL PROTECTED]> said: > > Hello, > > > > Currently I am using an old PC as backup server. It takes very long > > time for BackupPC 3.0 to backup about 140GB data. Even when no file > > is changed, it still takes more than 24 hours. I would like to know > > what option I have to speed it up. > > > > The backup server is P3 350MHz, 384M ram, running FreeBSD. The > > backup drive is a USB 500GB external. > > SNIP > > > There is also a > > process "irq9: dc9 uhci0++" (what is that?) is taking 10% cpu. About > > 20-30% CPU is idle. All network cards, hub and router are 100Mbps. > > The Windows Vista reports network traffic only around 5-8Mbps during backup. > > > > I want to know how I can find the bottleneck. I am not sure what is > > the limiting step for the speed. I have a PC P4 2.4Ghz/756M ram that > > can replace the backup server. Will that improve much? Should I use > > an internal drive for backup? > > I would be pretty sure the bottleneck is the use of a USB drive. The > uhc* process is the _U_SB _H_ost _C_ontroller. On an older computer, > it is probably USB 1.1, not 2.0, so it is quite slow. > > My backup machine is a P III (faster clock, though, but only 256 MB > RAM) and it runs plenty fast enough, currently with over 150G backed up. > > Jon S. > > ---------------------------------------------------------------------- > --- This SF.net email is sponsored by: Microsoft Defy all challenges. > Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > -------------- next part -------------- An HTML attachment was scrubbed... ------------------------------ Message: 5 Date: Wed, 2 Jan 2008 11:32:19 +0100 From: "Arthur Odekerken" <[EMAIL PROTECTED]> Subject: Re: [BackupPC-users] user permission always reset to root To: dan <[EMAIL PROTECTED]> Cc: backuppc-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset="iso-8859-1" Hi Dan, Thank you for your reply. That's really a shame, I really didn't know that. Otherwise I bought a different NAS system than the LaCie Ethernet Disk mini. Does anybody have a compatibilty list of all NAS systems that are compatible with hard links or maybe a tweak to alter any of them? I just think I'm going to use a standard rsync to the disk, because I wouldn't know howto use loopback images. Do you have an howto for this maybe? Thanks, Arthur 2007/12/29, dan <[EMAIL PROTECTED]>: > > i have to add to that, if you want to use loopback images, you will be > stuck with file size limits on the cifs mount and will make this > pretty difficult and require use of raid or LVM. you would need ntfs > on the cifs mount NOT fat* > > On Dec 29, 2007 10:29 AM, dan <[EMAIL PROTECTED]> wrote: > > > well, smb is actually just like cifs, in fact cifs is based heavily > > on smb and you could say that cifs is a newer version of smb and be > > pretty close to right. > > > > really, the problem here is the filesystem on the disk, you need a > > filesystem that supports hard links. no windows filesystem > > does(fat,fat32,ntfs), you need one of the *nix filesystems such as > > ext2/3,ufs,reiserfs,xfs,zfs and you need to be able to mount it by > > nfs at the very least and that is not ideal.. really, for network > > storage, you need something like iscsi or ata over ethernet. > > > > im sorry to say it, but i dont think you are going to get that > > working with backuppc short of putting an image file on it and > > mounting that image by loopback. > > > > i can help you with that if you like. > > > > > > On Dec 29, 2007 2:01 AM, Arthur Odekerken <[EMAIL PROTECTED]> wrote: > > > > > Hi Danile, > > > > > > Thanks for your quick response. > > > Are there any alternatives like smb that I can use? > > > > > > Arthur > > > > > > > > > 2007/12/29, Daniel Denson <[EMAIL PROTECTED]>: > > > > > > > you cannot use a CIFS mounted disk to store backuppc data > > > > because it cannot support hardlinks > > > > > > > > Arthur Odekerken wrote: > > > > > > > > Hi, > > > > > > > > I have a weird problem with my setup. > > > > It consists of a SuSE Linux 10.2 distro in combination with a > > > > LaCie ethernet disk mini, which I mounted on /lacie/backup with cifs. > > > > As topdir I setup /lacie/backup for my backups, but I get > > > > several > > > > errors: > > > > > > > > 2007-12-28 23:20:36 qsbserver<http://10.1.1.100/cgi-bin/BackupPC_Admin?host=qsbserver>: > > > > mkdir /lacie/backup/pc/ qsbserver<http://10.1.1.100/cgi-bin/BackupPC_Admin?host=qsbserver>/new//fPST /: > > > > Permission denied at > > > > /usr/local/BackupPC/lib/BackupPC/Xfer/RsyncFileIO.pm > > > > line 628 > > > > 2007-12-28 23:21:17 Backup failed on > > > > qsbserver<http://10.1.1.100/cgi-bin/BackupPC_Admin?host=qsbserve > > > > r>(Child exited prematurely) > > > > 2007-12-28 23:21:17 Running BackupPC_link > > > > qsbserver<http://10.1.1.100/cgi-bin/BackupPC_Admin?host=qsbserve > > > > r>(pid=8006) > > > > 2007-12-28 23:21:17 qsbserver<http://10.1.1.100/cgi-bin/BackupPC_Admin?host=qsbserver>: > > > > mkdir /lacie/backup/cpool/1/a: Permission denied at > > > > /usr/local/BackupPC/lib/BackupPC/Lib.pm line 741 > > > > 2007-12-28 23:21:17 Finished > > > > qsbserver<http://10.1.1.100/cgi-bin/BackupPC_Admin?host=qsbserve > > > > r>(BackupPC_link qsbserver > > > > <http://10.1.1.100/cgi-bin/BackupPC_Admin?host=qsbserver>) > > > > 2007-12-28 23:22:09 User backuppc requested backup of > > > > qsbserver<http://10.1.1.100/cgi-bin/BackupPC_Admin?host=qsbserve > > > > r>( qsbserver > > > > <http://10.1.1.100/cgi-bin/BackupPC_Admin?host=qsbserver>) > > > > 2007-12-28 23:22:09 Started full backup on > > > > qsbserver<http://10.1.1.100/cgi-bin/BackupPC_Admin?host=qsbserve > > > > r>(pid=8038, share=PST) > > > > 2007-12-28 23:22:26 qsbserver<http://10.1.1.100/cgi-bin/BackupPC_Admin?host=qsbserver>: > > > > mkdir /lacie/backup/pc/ qsbserver<http://10.1.1.100/cgi-bin/BackupPC_Admin?host=qsbserver>/new//fPST /: > > > > Permission denied at > > > > /usr/local/BackupPC/lib/BackupPC/Xfer/RsyncFileIO.pm > > > > line 628 > > > > > > > > When I check permissions several files seem to be created as > > > > root which could explain the errors. > > > > Can anyone help me with this? > > > > > > > > Many thanks, > > > > Arthur > > > > > > > > > > > > > > > > ------------------------------ > > > > > > > > ---------------------------------------------------------------- > > > > --------- This SF.net email is sponsored by: Microsoft Defy all > > > > challenges. Microsoft(R) Visual Studio > > > > 2005.http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > > > > > > > ------------------------------ > > > > > > > > > > > > _______________________________________________ > > > > BackupPC-users mailing [EMAIL PROTECTED] > > > > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > > > > Wiki: http://backuppc.wiki.sourceforge.net > > > > Project: http://backuppc.sourceforge.net/ > > > > > > > > > > > > > > > > > > > > > > > > > > > > -------------- next part -------------- An HTML attachment was scrubbed... ------------------------------ ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ ------------------------------ _______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ End of BackupPC-users Digest, Vol 21, Issue 2 ********************************************* ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
