Ralf Gross schrieb: > Ralf Gross schrieb: > > Tyler J. Wagner schrieb: > > > > > > > > > On Wednesday 26 May 2010 14:34:40 Sorin Srbu wrote: > > > > >-----Original Message----- > > > > >From: Les Mikesell [mailto:lesmikes...@gmail.com] > > > > >Sent: Wednesday, May 26, 2010 2:55 PM > > > > >To: General list for user discussion, questions and support > > > > >Subject: Re: [BackupPC-users] speed up backups > > > > > > > > > >After the 1st 2 fulls, rsync should be better if you have enabled > > > > >checksum > > > > >caching. You do need plenty of RAM to hold the directory listing if > > > > >you > > > > > > > > have a > > > > > > > > >large number of files. > > > > > > > > That was the checksum= 31thousandsomething to be added somewhere. I > > > > need to > > > > find that mail in the archives... > > > > > > > > > > Add to RsyncArgs and RsyncRestoreArgs: > > > > > > --checksum-seed=32761 > > > > > > The best thing about BackupPC is that all help is available from the web > > > interface. > > > > Ok, I give it a shot. Changed the Xfer method to rsync, updated to > > rsync 3.0.2 (I know I will not benefit much because of BackupPC's own > > rsync perl module) and added the --checksum-seed option. > > > > Right now the rsync process is consuming 370 MB and is still growing. > > The file server has 7.000.000 files. Let's see what happens... > > Hm, after 45 minutes the memory usage stopped growing at 540 MB. But now I > don't see any activity at all. Neither on the file server, nor on the BackupPC > server. Nothing in the BackupPC log since start of the backup. Nothing in the > the NewFileList file. > > On the file server I get this info with lsof: > > # lsof | grep rsync > rsync 31139 root cwd DIR 104,1 4096 > 2 / > rsync 31139 root rtd DIR 104,1 4096 > 2 / > rsync 31139 root txt REG 104,1 384304 > 571696 /usr/bin/rsync > rsync 31139 root mem REG 0,0 > 0 [heap] (stat: No such file or directory) > rsync 31139 root mem REG 104,1 97928 > 2026757 /lib/ld-2.3.6.so > rsync 31139 root mem REG 104,1 26088 > 2023687 /lib/libacl.so.1.1.0 > rsync 31139 root mem REG 104,1 31784 > 2023965 /lib/libpopt.so.0.0.0 > rsync 31139 root mem REG 104,1 1286104 > 2026779 /lib/libc-2.3.6.so > rsync 31139 root mem REG 104,1 15568 > 2023689 /lib/libattr.so.1.1.0 > rsync 31139 root 0u unix 0xffff81020f1ffc80 > 29056104 socket > rsync 31139 root 1u unix 0xffff81020f1ffc80 > 29056104 socket > rsync 31139 root 2u unix 0xffff81020f1ff380 > 29056106 socket > > > strace on the BackupPC server (BackupPC_dump process): > > $strace -f -p 11972 > Process 11972 attached - interrupt to quit > select(8, [7], NULL, [7], NULL > > > strace on the file server (rsync): > > $strace -f -p 31139 > Process 31139 attached - interrupt to quit > select(1, [0], [], NULL, {11, 972000} >
next try # strace -e trace=\!file -f -p 12795 [60 minutes later] fstat(3, {st_mode=S_IFDIR|0755, st_size=12288, ...}) = 0 fcntl(3, F_SETFD, FD_CLOEXEC) = 0 getdents64(3, /* 126 entries */, 4096) = 4096 select(2, NULL, [1], [1], {60, 0}) = 1 (out [1], left {60, 0}) write(1, "\374\17\0\7", 4) = 4 select(2, NULL, [1], [1], {60, 0}) = 1 (out [1], left {60, 0}) write(1, "he/pagelinks\6\0\0\0\35\216\333H:K\ttext_html"..., 4092) = 4092 getdents64(3, /* 85 entries */, 4096) = 2752 select(2, NULL, [1], [1], {60, 0}) = 1 (out [1], left {60, 0}) write(1, "\374\17\0\7", 4) = 4 select(2, NULL, [1], [1], {60, 0}) = 1 (out [1], left {60, 0}) write(1, "rsion:\5\2ip\7\0\0\0\33I\246E\7\0\0\0/bin/ip8\5\6"..., 4092) = 4092 getdents64(3, /* 0 entries */, 4096) = 0 close(3) = 0 fstat(3, {st_mode=S_IFDIR|0700, st_size=16384, ...}) = 0 fcntl(3, F_SETFD, FD_CLOEXEC) = 0 getdents64(3, /* 2 entries */, 4096) = 48 getdents64(3, /* 0 entries */, 4096) = 0 close(3) = 0 fstat(3, {st_mode=S_IFDIR|0755, st_size=0, ...}) = 0 fcntl(3, F_SETFD, FD_CLOEXEC) = 0 getdents64(3, /* 11 entries */, 4096) = 320 getdents64(3, /* 0 entries */, 4096) = 0 close(3) = 0 mmap(NULL, 29110272, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2ac342e63000 munmap(0x2ac342e63000, 29110272) = 0 select(2, NULL, [1], [1], {60, 0}) = 1 (out [1], left {60, 0}) write(1, "N\2\0\7\5\3lvs\r\0\0\0\r\0\0\0lvmiopversion8\5"..., 594) = 594 select(1, [0], [], NULL, {60, 0}) = 0 (Timeout) select(1, [0], [], NULL, {60, 0}) = 0 (Timeout) select(1, [0], [], NULL, {60, 0}) = 0 (Timeout) select(1, [0], [], NULL, {60, 0}) = 0 (Timeout) select(1, [0], [], NULL, {60, 0} smells like a time out, but I don't know where. I found a couple of messages with similar output in the list archives, but none of them had a solution yet. Ralf ------------------------------------------------------------------------------ _______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/