Re: [BackupPC-users] rsync backups: full xferlogs missing
On Thu, Nov 03, 2022 at 02:56:11PM -0300, Guillermo Rozas wrote: >As a result, on V4 only the files that have really changed are logged >(before every file was logged, even if it didn't change). Maybe it's that? >Best regards, >Guillermo I don't see file lists for new files, and even new hosts... -- Ludovic. https://drolez.com/blog/ - Music and Tech Blog ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
[BackupPC-users] rsync backups: full xferlogs missing
Hi! I've noticed, maybe after a migration to v4, that I don't see the full list of transfered files for rsync based backups. Here is what I see: Running: /usr/libexec/backuppc-rsync/rsync_bpc --bpc-top-dir /var/lib/backuppc --bpc-host-name myhost.com --bpc-share-name /var/log/apache2 --bpc-bkup-num 2 --bpc-bkup-comp 3 --bpc-bkup-prevnum 1 --bpc-bkup-prevcomp 3 --bpc-bkup-inode0 62956 --bpc-log-level 1 --bpc-attrib-new -e /usr/bin/ssh\ -l\ toor --rsync-path=/usr/bin/rsync --numeric-ids --perms --owner --group --devices --links --times --block-size=2048 --recursive --timeout=7200 --include=/\*.log --include=/\*.log.1 --include=/\*.log.2 --exclude=/\* myhost.com:/var/log/apache2/ / incr backup started for directory /var/log/apache2 Xfer PIDs are now 551492 This is the rsync child about to exec /usr/libexec/backuppc-rsync/rsync_bpc Xfer PIDs are now 551492,551494 xferPids 551492,551494 Done: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 0 filesTotal, 0 sizeTotal, 6 filesNew, 7971811 sizeNew, 827816 sizeNewComp, 62957 inode DoneGen: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 8 filesTotal, 7972495 sizeTotal, 0 filesNew, 0 sizeNew, 0 sizeNewComp, 62956 inode Maybe I have some bad settings from my v3 install? Do you know which settings I should check? Thanks, -- Ludovic. https://drolez.com/blog/ - Music and Tech Blog https://palmopensource.com - Open Source Tech Blog ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backuppc pool integrity check
Hi! So I found a few dozen corrupt files, and made some scripts to find the original files from the hash. Not sure how to fix the backups... Touch the original file and delete the one in the cpool? Regards, Ludo On Sun, Jul 31, 2022 at 07:22:11PM +0200, Ludovic Drolez wrote: > Hi! > > So I've tried it and I have a few v3 pool files still in the cpool. > I should try to modify your script to ignore them, because they give errors. > > Thanks! > > Ludo > > > On Thu, Jul 28, 2022 at 04:34:40PM -0300, Guillermo Rozas wrote: > >You may try (and modify) > >this: [1]https://github.com/guille2306/backuppc_check_pool > >It's a script I made to periodically check the V4 cpool in my server. > >Best regards, > >Guillermo > > -- > Ludo > > https://drolez.com/blog/ - Music and Tech Blog ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backuppc pool integrity check
Hi! So I've tried it and I have a few v3 pool files still in the cpool. I should try to modify your script to ignore them, because they give errors. Thanks! Ludo On Thu, Jul 28, 2022 at 04:34:40PM -0300, Guillermo Rozas wrote: >You may try (and modify) >this: [1]https://github.com/guille2306/backuppc_check_pool >It's a script I made to periodically check the V4 cpool in my server. >Best regards, >Guillermo -- Ludo https://drolez.com/blog/ - Music and Tech Blog ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backuppc pool integrity check
Many thanks for your script! Ludo On Thu, Jul 28, 2022 at 04:34:40PM -0300, Guillermo Rozas wrote: >You may try (and modify) >this: [1]https://github.com/guille2306/backuppc_check_pool >It's a script I made to periodically check the V4 cpool in my server. >Best regards, >Guillermo -- Ludo https://drolez.com/blog/ - Music and Tech Blog https://palmopensource.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
[BackupPC-users] Backuppc pool integrity check
Hi there! I had to copy a Backuppc pool disk which was failing. DDrescue had to skip a few bad blocks, and now I'd like to check the integrity of the pool. Is there is script to run and check which files do not have a matching MD5 checksum? Best regards, -- Ludo https://drolez.com/blog/ - Music and Tech Blog https://isabelleantoine.be - Coaching and NLP ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] BackupPC 3.3.2 slow file restore
Hi, Did you try this? https://superuser.com/questions/728050/rsync-incredibly-slow-in-cygwin-am-i-doing-something-wrong Did you make a few transfert tests with rsync? BR, -- Ludovic Drolez. https://bwebmarket.com - Marketing automation and Web dev https://chezsandro.com - A cool place in Cape Verde :) ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Updated BackupPC 4 Debian Packages
Hi!
So I've build rsync-bpc and the Perl module without the included
zlib, to make the Debian Security Team happy.
I've sent you a pull request for rsync,
if you want to make this the default compilation option and if
there are no side-effects.
BR,
Ludo
>
> So, is it possible to use the system zlib or not for rsync and the perl
> module? Is it a modified zlib?
>
> Best regards,
>
> Ludovic
>
>
> On Fri, May 26, 2017 at 10:34:11PM -0700, Craig Barratt wrote:
> >Ludo,
> >No, rsync-bpc isn't usable without BackupPC. Your name sounds fine
> >(although it would be good to have a consistent package name across
> > others
> >flavors - are there any already?).
> >No, 3.1.2 isn't ready for use.
> >The main upgrade risk area is around rsync config parameters and
> > arguments
> >not being compatible between 3.x and 4.x. Configure.pl tries to
> >extract $Conf{RsyncSshArgs} (a new 4.x setting) from the
> >old $Conf{RsyncClientCmd} setting.
> >Craig
>
>
> --
> Ludovic Drolez.
>
> https://www.aopensource.com - The Android Open Source Portal
> https://www.drolez.com - Personal site - Linux and Free Software
> https://chezsandro.com - A cool place in Cape Verde :)
>
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
>
--
Ludovic Drolez.
https://www.aopensource.com - The Android Open Source Portal
https://www.drolez.com - Personal site - Linux and Free Software
https://chezsandro.com - A cool place in Cape Verde :)
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Updated BackupPC 4 Debian Packages
Hi !
I've tried to upload the perl module and the modified rsync, but it was
automatically rejected because of the use of an embedded zlib library.
FYI, the error message:
E: backuppc-rsync: embedded-library usr/bin/rsync_bpc: zlib
N:
N:The given ELF object appears to have been statically linked to a
N:library. Doing this is strongly discouraged due to the extra
work needed
N:by the security team to fix all the extra embedded copies or
trigger the
N:package rebuilds, as appropriate.
N:
So, is it possible to use the system zlib or not for rsync and the perl
module? Is it a modified zlib?
Best regards,
Ludovic
On Fri, May 26, 2017 at 10:34:11PM -0700, Craig Barratt wrote:
>Ludo,
>No, rsync-bpc isn't usable without BackupPC. Your name sounds fine
>(although it would be good to have a consistent package name across others
>flavors - are there any already?).
>No, 3.1.2 isn't ready for use.
>The main upgrade risk area is around rsync config parameters and arguments
>not being compatible between 3.x and 4.x. Configure.pl tries to
>extract $Conf{RsyncSshArgs} (a new 4.x setting) from the
>old $Conf{RsyncClientCmd} setting.
>Craig
--
Ludovic Drolez.
https://www.aopensource.com - The Android Open Source Portal
https://www.drolez.com - Personal site - Linux and Free Software
https://chezsandro.com - A cool place in Cape Verde :)
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Updated BackupPC 4 Debian Packages
On Thu, May 25, 2017 at 10:53:05AM -0700, Craig Barratt wrote: >Ludo, >Cool - thanks! >I'm close to releasing new versions for all the components: BackupPC, >backuppc-xs and rsync-bpc. There are several important bug fixes. Ok, I've started to package rsync-bpc as a new package name "backuppc-rsync" to make sure that users do not install rsync-bcp thinking it's a normal "rsync". I don't know if rsync-bcp is usable without backuppc? Is the new package based on rsync 3.1.2 stable enough ? >For BackupPC, will it be a new package new (eg, BackupPC4)? The general >consensus is that would be better since there are some potential >incompatible configuration changes users might have to deal with. Ok, I'll try to see if I can handle them during the upgrade process and try to keep the same package name under Debian. Do you have a list of configuration incompatibilities? Best regards, -- Ludovic Drolez. https://www.aopensource.com - The Android Open Source Portal https://www.drolez.com - Personal site - Linux and Free Software https://chezsandro.com - A cool place in Cape Verde :) -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] backuppc 3.1.0-4/debian: rrd graph missing
On Wed, Apr 29, 2009 at 05:36:17PM +0200, Jonas Meurer wrote:
Intererestingly I do see the correct graph image. It's up-to-date and
displayed correctly. I wonder why it's not included into the backuppc.
The code which decides to show the graph is here:
if (-r $LogDir/pool.rrd $Privileged) { ... }
So the graph is only shown for Privileged users.
Cheers,
--
Ludovic Drolez.
http://www.geeksback.com - Secure File Backups for Geeks
http://www.palmopensource.com - The PalmOS Open Source Portal
--
Register Now Save for Velocity, the Web Performance Operations
Conference from O'Reilly Media. Velocity features a full day of
expert-led, hands-on workshops and two days of sessions from industry
leaders in dedicated Performance Operations tracks. Use code vel09scf
and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] backuppc 3.1.0-4/debian: rrd graph missing
On Sat, Apr 25, 2009 at 06:09:11AM +0200, Jonas Meurer wrote: I just discovered, that www-data, the user that runs apache2, doesn't have read permissions to /var/lib/backuppc/log/pool.rrd at all, and I guess that this is required at least. I changed the permissions, but that didn't help either. Hi ! Because of the suid bit on the CGI script, everything runs as user backuppc, so the files need to be owned by backuppc. Cheers, -- Ludovic Drolez. http://www.geeksback.com - Secure File Backups for Geeks http://www.palmopensource.com - The PalmOS Open Source Portal -- Register Now Save for Velocity, the Web Performance Operations Conference from O'Reilly Media. Velocity features a full day of expert-led, hands-on workshops and two days of sessions from industry leaders in dedicated Performance Operations tracks. Use code vel09scf and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] backuppc 3.1.0-4/debian: rrd graph missing
On Thu, Apr 23, 2009 at 11:22:05PM -0400, Kenneth L. Owen wrote: rrdtool (1.3.1-4) is installed and the rrd-file at /var/lib/backuppc/log/pool.rrd seems to be updated regularly as well. I even checked the command to create the graph image, which is used at /usr/share/backuppc/lib/BackupPC/CGI/GeneralInfo.pm, and it seems to work: $ /usr/bin/rrdtool graph - --imgformat=PNG --start=end-7w --end=-300 --title=BackupPC Pool Size (7 weeks) --base=1000 --height=100 --width=600 --alt-autoscale-max --lower-limit=0 --vertical-label= --slope-mode --font TITLE:10: --font AXIS:8: --font LEGEND:8: --font UNIT:8: -c BACK#FF DEF:ao=/var/lib/backuppc/log/pool.rrd:ckb:AVERAGE CDEF:a=ao,1024,* AREA:a#95B8DB:CPool in bytes GPRINT:a:LAST:Current\\:%8.2lf %s GPRINT:a:AVERAGE:Average\\:%8.2lf %s GPRINT:a:MAX:Maximum\\:%8.2lf %s\\n graph.png (process:14825): Pango-CRITICAL **: pango_context_load_font: assertion `pango_font_description_get_family (desc) != NULL' failed (process:14825): Pango-CRITICAL **: pango_context_load_font: assertion `pango_font_description_get_family (desc) != NULL' failed $ file graph.png graph.png: PNG image, 687 x 180, 8-bit/color RGBA, non-interlaced So I wonder why the image doesn't occur in the webinterface. Does anybody have similar issues? What do you get if you enter this url in the browser: http://localhost_or_your_bcphost/backuppc/index.cgi?image=5 Do you see any error messages ? If you save this page to a file, what do you see (error messages) ? Chhers, -- Ludovic Drolez. http://www.geeksback.com - Secure File Backups for Geeks http://www.drolez.com- Personal site - Linux and PalmOS stuff -- Register Now Save for Velocity, the Web Performance Operations Conference from O'Reilly Media. Velocity features a full day of expert-led, hands-on workshops and two days of sessions from industry leaders in dedicated Performance Operations tracks. Use code vel09scf and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] The backup blog, deduplication
Hi ! Here's an interesting article about deduplication: http://thebackupblog.typepad.com/thebackupblog/2008/07/the-impact-of-deduplication-methodology-on-deduplication-ratios.html This blog is the EMC Avamar's blog, and has some other interesting articles. Deduplication rates are impressive, I hope we will reach them one day with backuppc :-) For the NetBackup puredisk blog, go to https://forums.symantec.com/syment/blog?blog.id=NetBackup And there's also Sepaton's blog : http://www.aboutrestore.com/ It seems that a war has begun in the deduplication world ! Cheers, -- Ludovic Drolez. http://www.palmopensource.com - The PalmOS Open Source Portal http://www.drolez.com - Personal site - Linux, Zaurus and PalmOS stuff - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] improving the deduplication ratio
On Mon, Apr 14, 2008 at 02:31:30PM -0700, Michael Barrow wrote: Introducing file chunking would introduce a new abstraction layer - a file would need to be split into chunks and recreated for restore. You Tino -- thanks for posting this. These issues are exactly what I had in mind when I posted about adding sub-file deduplication. There's a lot more work to do and definitely a bunch more housekeeping. Right now, BackupPC gets off easy by utilizing hardlinks to do the dedupe. Once we delve below the file, a brand new data structure/ mechanism needs to be designed and built to efficiently link all of these blocks together. And what about a mix of the two ? - keep hard links for files less than the chunk size (filenames begin with an 'f' as before) - for files bigger than the chunk size, create a regular file which contains references to the chunks in the cpool (the files could begin with an 'r' for example). It would be backward compatible, it would allow progressive pool conversion to the new 'chunk based' algorithm, and would allow to enable it only for some hosts. It would allow us to experiment with this new feature, from what I have seen in commercial products, I believe that sub-file deduplication would make incrementals 10 or 100 times smaller. Cheers, -- Ludovic Drolez. http://www.palmopensource.com - The PalmOS Open Source Portal http://www.drolez.com - Personal site - Linux, Zaurus and PalmOS stuff - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] [BackupPC-devel] improving the deduplication ratio
On Wed, Apr 16, 2008 at 02:30:11PM +0200, Tino Schwarze wrote: On Wed, Apr 16, 2008 at 02:20:36PM +0200, Ludovic Drolez wrote: And what about a mix of the two ? - keep hard links for files less than the chunk size (filenames begin with an 'f' as before) - for files bigger than the chunk size, create a regular file which contains references to the chunks in the cpool (the files could begin with an 'r' for example). The main problem is that you cannot tell anymore whether a file(chunk) in the pool is still needed or not. You'd need to look into every backup and check if there's still a reference to that chunk. then, instead of the 'r' file containing the references to the chunks, simply create a 'r' directory, which will contain hard links to the chunks, so that cpool chunks are still referenced as before ! Cheers, -- Ludovic Drolez. http://www.palmopensource.com - The PalmOS Open Source Portal http://www.drolez.com - Personal site - Linux, Zaurus and PalmOS stuff - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] improving the deduplication ratio
On Wed, Apr 16, 2008 at 03:23:43PM +0200, Tino Schwarze wrote: While it would work (and I thought about that myself), I'm not keen on having even more directories in the BackupPC file system. We're talking about hundreds of thousands of *additional* files here, if the chunk size is, say 64k. The File::Rsync stuff would need rewriting though (but I'm no developer, I'm just guessing). Yes, and that's why a database would be more efficient than hard links... I've just read that Diligent ProtecTIER can store all the links for a 1 PB pool (yes ! peta bytes !), in just 4GB of memory. With the links in memory, they can achieve very high backup speeds and doing on the fly deduplication. Maybe the way to go for BackupPC ? Cheers, -- Ludovic Drolez. http://www.palmopensource.com - The PalmOS Open Source Portal http://www.drolez.com - Personal site - Linux, Zaurus and PalmOS stuff - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] improving the deduplication ratio
On Wed, Apr 09, 2008 at 06:11:58PM -0700, Michael Barrow wrote: How long are you willing to have your backups and restores take? If you do more processing on the backed up files, you'll take a greater Not true : - working with fixed size chunks may improve speed, because algorithms could be optimized for 1 chunk size (md5, compression, etc) - if you implement block level deduplication to backup only the last 64kb of a log file, instead of the full 5 mb file, do you think it will take longer to write 64 kb than 5 mb ? File + block level deduplication will improve both BackupPC's performance, and space savings. Cheers, -- Ludovic Drolez. http://www.palmopensource.com - The PalmOS Open Source Portal http://www.drolez.com - Personal site - Linux, Zaurus and PalmOS stuff - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] improving the deduplication ratio
On Wed, Apr 09, 2008 at 10:12:09AM -0500, Les Mikesell wrote: I'd probably look at what rdiff-backup does with incremental differences and instead of chunking everything, just track changes where the differences are small. Yes but rdiff-backup has no pooling/deduplication. With that feature, backuppc would be closer to rdiff-backup with pooling on top of that. Cheers, -- Ludovic Drolez. http://www.palmopensource.com - The PalmOS Open Source Portal http://www.drolez.com - Personal site - Linux, Zaurus and PalmOS stuff - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] improving the deduplication ratio
Hi ! I've seen in some commercial backup systems with included deduplication (which often run under Linux :-), that files are split in 128k or 256k chunks prior to deduplication. It's nice to improve the deduplication ratio for big log files, mbox files, binary db not often updated, etc. Only the last chunk of a log file would create a new entry in the backuppc pool. Anybody has idead about how this feature could be added without major changes to backuppc ? (replacing hard links with text files containing the list of chunks ?) cheers, -- Ludovic Drolez. http://www.palmopensource.com - The PalmOS Open Source Portal http://www.drolez.com - Personal site - Linux, Zaurus and PalmOS stuff - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Small patch to graph the pool size (v2 patch)
On Tue, Mar 11, 2008 at 07:41:37PM +0100, Knaupp, Thomas wrote: Hello Ludovic, maybe a stupid question: can I patch backuppc (3.1.0) that is already patched with your first version? No, Nicholas' patch is not compatible with mine. You have to undo the 1st patch (patch -r) and apply Nicholas' one. BTW, I've uploaded a Debian BackupPC package which already includes the 1st patch. I don't know if I'll add Nicholas patch because I find graphs with a log scale, hard to read. If you have any suggestions (2 graphs?), let me know ! Cheers, -- Ludovic Drolez. http://www.palmopensource.com - The PalmOS Open Source Portal http://www.drolez.com - Personal site - Linux, Zaurus and PalmOS stuff - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Small patch to graph the pool size
Le jeudi 28 février 2008 18:50, vous avez écrit : I have an idea. It would be cool if the graphs also showed the total size prior to pooling/compression as a line overlayed on the existing graphs. I think this data is exposed as $fullSizeTot and $incrSizeTot. I'll see if I can figure it out sometime today. Yes it would be nice, but since, there's a 1 to 100 (or more) ratio between the two numbers, I think that you cannot show them on the same graph. Cheers, -- Ludovic Drolez. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Small patch to graph the pool size (v2 patch)
rOn Thu, Feb 28, 2008 at 10:17:43AM -0700, Kimball Larsen wrote:
but the images appear as busted images on the status page.
(With the patch :-D )
Hi !
This new patch should fix this bug. Anyway the graphs will appear
after backuppc nightly has run.
I've also fixed another problem, which comes from the fact that I assumed
that the CGI was index.cgi (only true for Debian users ?).
Cheers,
--
Ludovic Drolez.
http://www.palmopensource.com - The PalmOS Open Source Portal
http://www.drolez.com - Personal site - Linux, Zaurus and PalmOS stuff
--- backuppc-3.1.0.orig/bin/BackupPC
+++ backuppc-3.1.0/bin/BackupPC
@@ -1190,6 +1190,15 @@
$Info{${p}FileRepMax},
$Info{${p}FileLinkMax}, $Info{${p}DirCnt});
}
+ if (-x /usr/bin/rrdtool) {
+ my $date = time() + (24*3600);
+ if (! -f $LogDir/pool.rrd) {
+system(/usr/bin/rrdtool create $LogDir/pool.rrd --step 86400 DS:ckb:GAUGE:172800:0:U RRA:AVERAGE:0.5:1:1400);
+ }
+ system(/usr/bin/rrdtool update $LogDir/pool.rrd --template ckb $date:.($Info{cpoolKb}+$Info{poolKb}));
+ #print(LOG $bpc-timeStamp, RRD data\n);
+ #print(LOG $bpc-timeStamp, RRD data: .($Info{cpoolKb}+$Info{poolKb}).\n);
+ }
}
} else {
$CmdJob = ;
--- backuppc-3.1.0.orig/lib/BackupPC/CGI/GeneralInfo.pm
+++ backuppc-3.1.0/lib/BackupPC/CGI/GeneralInfo.pm
@@ -44,6 +44,14 @@
GetStatusInfo(info jobs hosts queueLen);
my $Privileged = CheckPermission();
+if ($In{image} ne ) {
+ $In{image} =~ /([0-9]+)/;
+ my $weeks = $1;
+ print Content-type: image/png\n\n;
+ print `/usr/bin/rrdtool graph - --imgformat=PNG --start=end-${weeks}w --end=-300 --title=BackupPC Pool Size --base=1000 --height=100 --width=600 --alt-autoscale-max --lower-limit=0 --vertical-label= --slope-mode --font TITLE:10: --font AXIS:8: --font LEGEND:8: --font UNIT:8: -c BACK#FF DEF:ao=$LogDir/pool.rrd:ckb:AVERAGE CDEF:a=ao,1024,* AREA:a#95B8DB:CPool in bytes GPRINT:a:LAST:Current\\:%8.2lf %s GPRINT:a:AVERAGE:Average\\:%8.2lf %s GPRINT:a:MAX:Maximum\\:%8.2lf %s\\n`;
+ return;
+}
+
my($jobStr, $statusStr);
foreach my $host ( sort(keys(%Jobs)) ) {
my $startTime = timeStamp2($Jobs{$host}{startTime});
@@ -122,10 +130,15 @@
ul
$cpoolInfo
/ul
+br/
EOF
} elsif ( $Info{cpoolFileCnt} 0 ) {
$poolInfo = $cpoolInfo;
}
+if (-r $LogDir/pool.rrd) {
+ $poolInfo .= 'img src='.$MyURL.'?image=4img src='.$MyURL.'?image=52br/';
+}
+
my $generalInfo = eval(qq{$Lang-{BackupPC_Server_Status_General_Info}})
if ( $Privileged );
my $content = eval(qq{$Lang-{BackupPC_Server_Status}});
-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Small patch to graph the pool size (v2 patch)
On Thu, Feb 28, 2008 at 10:17:43AM -0700, Kimball Larsen wrote: but the images appear as busted images on the status page. Hi ! This new patch should fix this bug. Anyway the graphs will appear after backuppc nightly has run. I've also fixed another problem, which comes from the fact that I assumed that the CGI was index.cgi (only true for Debian users ?). Cheers, -- Ludovic Drolez. http://www.palmopensource.com - The PalmOS Open Source Portal http://www.drolez.com - Personal site - Linux, Zaurus and PalmOS stuff - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Pool Size is Zero
Nils Breunese (Lemonbit nils at lemonbit.nl writes: The $TopDir relocation after installing a packaged version is discussed pretty regularly on this list (every week?). The easier solution is to mount your backup drive/array on the location used by the packager (/var/lib/backuppc in the case of Ubuntu/Debian) or make this location a symlink to where you mount your backup drive/array. Yes, you're right ! Shame on people who have never read /usr/share/doc/backuppc/README.Debian ! If you do not like the default data directory (/var/lib/backuppc/), you should move this directory where you want and make a symbolic link from the new directory to the default one (all paths are hardcoded so it's the easiest way to change the data directory). Cheers, Ludovic. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Small patch to graph the pool size
dan dandenson at gmail.com writes: this is interesting! what file does this diff apply to? You can 'cd' to the original source directory, or to your installation directory (maybe /usr/share/backuppc) and then run: patch -p1 /tmp/BackupPC.diff Oh yes, I've forgotten, it may only work with BackupPC 3.1.0 ! Cheers, Ludo. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Idea: disk usage graphs
Hi ! I think that the following feature would be nice: - having a graph of the pool size, and remaining disk usage. It would allow us to predict future disk usage and anticipate a disk upgrade. This could be easily added using the rrdtool binary, but I may have not time to do this, so, if someone has more free time :-) Cheers, -- Ludovic Drolez. http://zaurus.palmopensource.com - The Zaurus Open Source Portal http://www.drolez.com - Personal site - Linux, Zaurus and PalmOS stuff - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Idea: disk usage graphs
This was proposed recently on this list, and it was pointed out that there are already tools to do this (you mention rrdtool). The premise of Linux, Yes, I know that lots of other tools can do this (but you still have to write custom cacti scripts for the pool size, while BPC has the information). But, It would be very convenient: from the status page, you would be able to see if all the backups are OK, and if nothing will prevent them to go on for the next weeks. One login. One page. Less wasted time. Cheers, -- Ludovic Drolez. http://zaurus.palmopensource.com - The Zaurus Open Source Portal http://www.drolez.com - Personal site - Linux, Zaurus and PalmOS stuff - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] GUI error after upgrade
Craig Barratt wrote: I do have a question: for your 2.x package you hardcoded the config paths. In 3.x the FHS mode places the config files in places similar to your 2.x package - but not exactly the same. That's why people that started with your 2.x debian package and then upgraded using the vanilla tarball are having problems. What paths did you use for the 3.x package, and will it do the right thing when a user upgrades from the debian 2.x to the debian 3.x package? With my last upload, the paths are the same used for the 2.x package, to make the Debian upgrade very easy. But I'm open to any suggestions: which paths do you think I should use ? Cheers, -- Ludovic Drolez. http://zaurus.palmopensource.com- The Zaurus Open Source Portal http://www.drolez.com - Personal site - Linux and PalmOS stuff - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] GUI error after upgrade
Jim McNamara jim.mcnamara at gmail.com writes: Hello list! My thanks again go out to Craig for a great piece of software! I have been running BackupPC 2.1.1 on a debian box, installed by the apt-get package system. Tonight I upgraded by compiling 3.0.0, and Good news: I've uploaded backuppc 3.0.0 to debian unstable yesterday. Your feedback is welcome ! Cheers, Ludovic Drolez. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
[BackupPC-users] backuppc 3: ARRAY(0x...) in the level column
Hi ! I've upgraded from 2.1 to 3.0 and I have the following problem: Incremental backups are not correctly displayed on the backup summary page. For example I get in the 1st summary table: Backup# TypeFilled Level Start Date Duration/minsAge/daysServer Backup Path ... ... 1365 incrno ARRAY(0x87993cc)2/13 11:10 6.6 0.0 /var/lib/backuppc/pc/xiii/1365 In the /var/lib/backuppc/pc/xiii/backups file, the same ARRAY(0x...) can be found on the last column. Any ideas ? Ludovic Drolez. - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Itunes and BackupPC
Matt sung msung at vanguardrecords.com writes: When I tried to uninstall iTunes, rsync.exe and or cygrunsrv.exe start running at 70 to 85 % C utilization. In order to get iTunes uninstalled to uninstall, I had to Hello, We had the same problem with our Linbox Rescue Server (http://lrs.linbox.org). And we worked with Cygwin to fix the bug a few weeks ago, on a W2K SP4 :-) So, if you download the latest cygwin1.dll for the snapshots page, http://www.cygwin.com/snapshots/, close all cygwin programs and overwrite the dll with the last one, it should fix your problem. Cheers, Ludovic. -- Ludovic DROLEZ Linbox / FreeALter Soft http://www.linbox.com http://www.linbox.org 152 rue de Grigy - Technopole Metz 2000 F-57070 METZ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
[BackupPC-users] Re: Problems restoring a multi-volume backup created with the archive function
Alexander Pohl a.h.pohl at gmail.com writes: tar: This does not look like a tar archive tar: Skipping to next header tar: Archive contains obsolescent base-64 headers tar: Error exit delayed from previous errors Yes, it's a backuppc bug (see also a mail I posted in the -devel list). It has been fixed in latest debian packages but, not for sarge yet... Cheers, Ludovic. --- SF.Net email is Sponsored by the Better Software Conference EXPO September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices Agile Plan-Driven Development * Managing Projects Teams * Testing QA Security * Process Improvement Measurement * http://www.sqe.com/bsce5sf ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
