Re: [BackupPC-users] Stuck in a loop??????

2013-04-13 Thread Holger Parplies 
Hi,

Les Mikesell wrote on 2013-04-12 15:05:27 -0500 [Re: [BackupPC-users] Stuck in 
a loop??]:
 On Fri, Apr 12, 2013 at 2:31 PM, Gregory Malsack
 gmals...@coastalacq.com wrote:
 
  Been having problems with BackupPC backing up our primary storage server
  using rsync. It seems to run, but is taking a ridiculous long time, so I'm
  not sure if it's really working. [...]
  Thus with 2gb of bandwidth I wouldn't expect it to take hours on top of
  hours to backup 1.6tb...

really? I would. You don't mention how fast your storage system is, but a
quick estimation gives me 4.66 hours at a sustained data rate of 100MB/s just
to *read* the data from a source disk, and that is not doing anything with the
data yet (filesystem overhead, calculate block checksums, build directory
tree, network *latency* - raw throughput is not the whole story, compress
files on the server, etc.). I doubt your bottleneck is the network, and that's
the only thing you've given details on. 1.6 TB is a *lot* of data. You
shouldn't forget that.

  [...]
  write(7,
  x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
  82371) = 82371
 
 It does seem to be reading/writing the same blocks.

We see the first few bytes of 80 KiB (for each syscall). That's not really
much to base a comparison on. What would an rsync directory tree exchange look
like? What does a normal data exchange look like?

 Might be worth an fsck to see if the underlying filesystem is corrupted.

That can't hurt in any case.

 Or maybe the file it is working on holds some repeated
 data.

I haven't seen anything surprising so far. How long have you let it run? Does
it complete eventually if you just give it a few days?

Regards,
Holger

--
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis  visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Stuck in a loop??????

2013-04-12 Thread Les Mikesell 
On Fri, Apr 12, 2013 at 2:31 PM, Gregory Malsack
gmals...@coastalacq.com wrote:

 Been having problems with BackupPC backing up our primary storage server
 using rsync. It seems to run, but is taking a ridiculous long time, so I'm
 not sure if it's really working.  However, it is backing up about 30 other
 servers just fine. Some using rsync and some using smb.

 The server is connected to the network using 2 1gb network cards bonded,
 it's connected to a cisco 2948g-ge, from there it talks to the primary
 storage server using 2 1gb network card bonded. Thus with 2gb of bandwidth I
 wouldn't expect it to take hours on top of hours to backup 1.6tb...

 The primary storage server is running freenas
 The backuppc server is running on centos 5.8

 Here's a recent ps and strace... Any thoughts

 backuppc  2449  2407  0 Apr10 ?00:04:23 /usr/bin/perl
 /usr/share/BackupPC/bin/BackupPC_trashClean
 backuppc  4823  2407 15 Apr11 ?02:39:49 /usr/bin/perl
 /usr/share/BackupPC/bin/BackupPC_dump pss.coastalacq.loc
 backuppc  4855  4823 77 Apr11 ?13:10:19 /usr/bin/perl
 /usr/share/BackupPC/bin/BackupPC_dump pss.coastalacq.loc

 [root@backup bin]# strace -p 4855
 Process 4855 attached - interrupt to quit
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371
 read(6,
 \6\f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300`...,
 131072) = 131072
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371
 read(6,
 \200\1\3\6\f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f...,
 131072) = 131072
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371
 read(6,
 \f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300`\300...,
 131072) = 131072
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371
 read(6,
 \1\3\6\f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f\30...,
 131072) = 131072
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371
 read(6,
 `\300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300`\300\200\1\3...,
 131072) = 131072
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371
 read(6,
 \f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300`\300...,
 131072) = 131072
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371
 read(6,
 \300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6...,
 131072) = 131072
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371
 read(6,
 \0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300`\300\200...,
 131072) = 131072
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371
 read(6,
 \3\6\f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300`\300\200\1\3\6\f\0300...,
 131072) = 131072
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371
 write(7,
 x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3...,
 82371) = 82371

Not much to go on...  It does seem to be reading/writing the same
blocks.Might be worth an fsck to see if the underlying filesystem
is corrupted.  Or maybe the file it is working on holds some repeated
data.

--
   Les Mikesell
lesmikes...@gmail.com

--
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis  visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/