Re: [rdiff-backup-users] Old versions of files with lots of RDiff-slices

2009-03-20 Thread David Kempe
- "listserv traffic" wrote: > > To get to the year old version, you take the current file, and apply > 200 reverse diffs to get the old one? > (And if any of the 200 rdiffs fail, you're stuck...) > > Do I have it right? no, rdiff-backup keeps a complete snapshot of the file every 10 versi

Re: [rdiff-backup-users] more experiments, + apology

2009-03-14 Thread David Kempe
- "Marcel (Felix) Giannelia" wrote: > Regardless, parts of what I said are still true (very small patches > between increments), but it's looking now more like something's > confusing the rsync algorithm itself, rather than rdiff-backup. There > > are files in the backup set that seem to ch

Re: [rdiff-backup-users] --one-filesystem

2007-07-03 Thread David Kempe
Neal Becker wrote: Would be nice to have a --one-filesystem option. Any thoughts? sorry how is this different from the existing --exclude-other-filesystems option? dave ___ rdiff-backup-users mailing list at rdiff-backup-users@nongnu.org http:/

Re: [rdiff-backup-users] [ANN] SafeKeep

2007-02-06 Thread David Kempe
Hi Dimi, that looks great but there is no way I am going to use it if it has xml for the config files. I have a passionate hate for using xml in config files as do many sysadmins... just check out the low adoption of heartbeat 2 for verification of that :) if you want to reconsider the design,

Re: [rdiff-backup-users] Bundle rdiff-backup

2007-01-29 Thread David Kempe
Hi Daniel, We have done something similar with rdiff-backup. Generally the application you are writing doesn't even need to use rdiff-backup, it can just schedule it to run with certain parameters. For me, the chief role in a GUI would be for file selection and scheduling, and also handling re

Re: [rdiff-backup-users] More patches to get rdiff-backup working under cygwin/windows

2007-01-26 Thread David Kempe
Hi Mark does this mean you are using ssh as the transport? have you happened to test these on unix to cifs(on windows)? dave Marc Dyksterhouse wrote: Note that these fixes are only needed when backing up unix to windows. Windows to windows or windows to unix shouldn't need this. Well, actua

Re: [rdiff-backup-users] Simple nightly script?

2007-01-22 Thread David Kempe
ooks like the script is > invoking nail as a seperate executable to do some kind of work. Is it > a standard tool I need to hunt down? > > Any other idea what I need to do to get this working again? > > Thanks > Greg > > On 10/19/06, David Kempe <[EMAIL P

Re: [rdiff-backup-users] Chinese characters in filenames on Cygwin + Win XP

2007-01-07 Thread David Kempe
It should take a list of chars to quote to override as arguments I think. On windows I have used --override-chars-to-quote '' I think... dave Qiqi Yan wrote: What's wrong? I noticed the semicolons in the file name mentioned in the message, which I guess is the cause. (semicolons are not all

Re: [rdiff-backup-users] [PATCH] Preserve symlink permissions

2006-11-06 Thread David Kempe
I will poke some people I know and see how we go... dave Corey Puffalt wrote: Thanks, Andrew for those patches and thanks Dean for getting them applied to CVS!  Now if only we could get the librsync people to create a new release with the fix for handling files larger than 4GB along with a fr

Re: [rdiff-backup-users] Simple nightly script?

2006-10-23 Thread David Kempe
Yes these are true - however I have had reasonable success with un-dumped mysql files - you loose uncommitted transactions but generally it has been acceptable... Anyway - remember to use the --rsyncable switch to gzip (you may need to modify automysqlbackup). it lets rdiff-backup diff the .tar.

Re: [rdiff-backup-users] Simple nightly script?

2006-10-20 Thread David Kempe
Hi Greg, After much experimentation with various scripts, I am happy with this latest rdiff-backup parser we have written. Script is written by Christian Marie, who also wrote the rdiff-backup nagios plugin on nagiosexchange.org. The script is designed to be passed on stdin the output of an

Re: [rdiff-backup-users] Error backing up to NAS device

2006-09-14 Thread David Kempe
Hi Devraj, how are you mounting the NAS device? dave Devraj Mukherjee wrote: Hi everyone, I am trying to use rdiff-backup to write to an NAS device and this is wha tI get. ___ rdiff-backup-users mailing list at rdiff-backup-users@nongnu.org http:

Re: [rdiff-backup-users] librsync error

2006-08-23 Thread David Kempe
There is a fix in librsync cvs for this librsync problem. There is a patch for the source on the librsync mailing list if you can't find it. dave Rudy Zijlstra wrote: Hello, Can somebody explain the following error to me: python: ERROR: (rs_file_copy_cb) seek failed: Invalid argument python

Re: [rdiff-backup-users] Backup Target Directory Question

2006-08-09 Thread David Kempe
we do it like this all the time. works fine. if you have an already mostly complete destination, you need to use --force in your first rdiff-backup dave patric wrote: Hey guys, New to the list, so hi :-) My question is regarding the target directory for a backup. My problem is that I need

Re: [rdiff-backup-users] Does rdiff-backup unlink before updating target files? (for pooling)

2006-08-08 Thread David Kempe
Dave Eyers wrote: I am happy to have to use commands to reconstruct past versions in return for the storage efficiency. Alternatively - FUSE anyone? ;-) yeah I was considering that. makes the webinterface alot easier as well. Its on my to-do list dave

Re: [rdiff-backup-users] Has anyone managed to run rdiff-backup on windows?

2006-07-22 Thread David Kempe
Karjala wrote: > I have a rule to not install any setup.exe files from sources I don't know. (Is your program GPL? Can the source code be found somewhere on the net?) I have a rule not to help people who don't help themselves. sorry. ___ rdiff-back

Re: [rdiff-backup-users] Has anyone managed to run rdiff-backup on windows?

2006-07-22 Thread David Kempe
did you look at the batch files that are in the setup.exe package I have produced. all these answers are in there. dave Karjala wrote: Okay, but which line should be executed? I ask the same thing in a previous message. How do you execute rdiff-backup through cygwin, from a DOS line? Do you

Re: [rdiff-backup-users] Has anyone managed to run rdiff-backup on windows?

2006-07-11 Thread David Kempe
you are missing librsync. get that and compile and install it first dave Karjala wrote: Thanks! I tried to run the install script and got this: _librsyncmodule.c:25:22: librsync.h: No such file or directory I guess this belongs to one of the packages in cygwin that I didn't install. Is there

Re: [rdiff-backup-users] Has anyone managed to run rdiff-backup on windows?

2006-07-07 Thread David Kempe
http://solutionsfirst.com.au/~dave/backup/rdiff-backup1.0.1w4.exe and you might need a patch from the rdiff-backup wiki to do windows-> windows backups (stops fsyncing) that .exe is for windows -> linux/unix dave Karjala wrote: How do we do that? _

Re: [rdiff-backup-users] moving rdiff-backup data between servers

2006-07-07 Thread David Kempe
Just move it. I do it all the time. the format is \dest \rdiff-backup-data \increments as long as you keep the rdiff-backup-data directory and everything in it and its increments intact, you should be fine. just move the stuff, and update the backup script and it will kick along merrily

Re: [rdiff-backup-users] How to sign up / create a new user for the wiki?

2006-06-28 Thread David Kempe
Its phpwiki being strange in its error - To sign in simply make up a wikiname in the form FirstLast - ie PeterMørch (not sure about the 'ø' character though). You can just make em up as you go along. You can then set a password. Moving the wiki to media-wiki is on my list of things to do. Should

Re: [rdiff-backup-users] rdiff-backup destnation access protocols

2006-06-25 Thread David Kempe
Devraj Mukherjee wrote: Hi everyone, I am a rdiff-backup newbie. Does rdiff-backup support protocols like FTP to fetch files? Hi Devraj, you can do some tricky things with the remote-schema stuff, but the problem is that rdiff-backup expects an rdiff-backup server to be at the other end of a

Re: [rdiff-backup-users] rdiff-backup to LinkStation: *slow*

2006-05-25 Thread David Kempe
Felix E. Klee wrote: * Hardware of the Linkstation: Mipsel CPU at 400MHz, ca. 64MiB RAM, 160GB HD at 7200RPM, 100MBit/s LAN. that would be your problem. i bet its cpu bound dave ___ rdiff-backup-users mailing list at rdiff-backup-users@nongnu.org

Re: [rdiff-backup-users] Re: Alternative temp-directory.

2006-03-30 Thread David Kempe
roland wrote: Is there a solution for this in the meantime ? just export a new TEMP environment variable before you run the backup. should be fine dave ___ rdiff-backup-users mailing list at rdiff-backup-users@nongnu.org http://lists.nongnu.org/ma

Re: [rdiff-backup-users] Problem restoring files overwriting existing files

2006-02-20 Thread David Kempe
Gerard van Dijnsen wrote: I tried several times, under several conditions and I always get this problem. I think it is a bug. Is there a workaround? Or a fix upcoming? Tried restoring to a different location? dave ___ rdiff-backup-users mailing lis

Re: [rdiff-backup-users] Reporting update bug for large files in rdiff-backup (>4Gb)

2006-02-07 Thread David Kempe
Gerard van Dijnsen wrote: This again takes a while and then produces the following output: python: ERROR: (rs_job_iter) internal error: job made no progress [orig_in=23, orig_out=65536, final_in=23, final_out=65536] UpdateError largefile_4096_MB.dat librsync error 107 while in patch cycle pyth

Re: [rdiff-backup-users] rdiff-backup to ncpfs

2006-02-06 Thread David Kempe
Ben Escoto wrote: Can you try this again with the CVS version? Cengiz Gunay reported some errors recently, and one of the changes I made in response I think might help. I tried the CVS version, it did make a little difference, however I am getting a strange OS error 13 on a certain sectio

Re: [rdiff-backup-users] Rdiff-backup Starting to segfault out of nowhere

2006-01-31 Thread David Kempe
Robert Yoon wrote: Now I am getting this error. I am assuming in my last email that its crapping out somewhere after the /usr/lib/libcrypto.so.0 part. Now I see this message. What do you guys think? what did you do to make it do that? did you do the mv thing I suggested? dave ___

Re: [rdiff-backup-users] Rdiff-backup Starting to segfault out of nowhere

2006-01-31 Thread David Kempe
Robert Yoon wrote: I just recently ran into some problems with one of the hosts i am using rdiff-backup on. its on redhat 8 and it was just working fine until recently #rdiff-backup -V Segmentation fault thats not rdiff-backup's fault i don't think --- SIGSEGV (Segmentation fault) --- +++

Re: [rdiff-backup-users] "Corrupted MAC on input" error

2006-01-11 Thread David Kempe
Walter Hop wrote: I grabbed a 500MB file and scp'ed it repeatedly across the network from the problem client to various hosts to see if I could recreate the ssh error outside of rdiff-backup. The error happened here as well, so it seems to be related to large streams of data, and the problem is n

Re: [rdiff-backup-users] exit status

2005-12-30 Thread David Kempe
Jacques Botha wrote: Hi all I am looking for a list of exit status codes for rdiff-backup i.e: I do not want to alert when a non-critical error occurred. Say a file changed while backing up, rdiff-backup make an alert, but ultimately the backup was successful, I don't want to alert. If the b

Re: [rdiff-backup-users] rdiff-backup nagios plugin

2005-12-20 Thread David Kempe
Ben Escoto wrote: Cool. If this actually works it would be a shame if it got lost on this mailing list. It looks like http://www.nagiosexchange.org/ is the main site for holding nagios plugins. Have you considered adding the plugin there? I could also then link to it from the rdiff-backup pag

[rdiff-backup-users] rdiff-backup nagios plugin

2005-12-20 Thread David Kempe
Hi, our plugin for nagios is complete. It is a perl script that parses the current state of the repository. Its designed to be conformant with the nagios plugin spec, so it may need to be tweaked for general use, but its works well with nagios. Saves you getting all those messages saying the b

Re: [rdiff-backup-users] key error - crash on certain file

2005-11-24 Thread David Kempe
Ben Escoto wrote: This may be a silly question, but is possible there are two files in your directory that have exactly the same name (I've seen it before but think it's some kind of directory bug)? As in, maybe cd raid5/Support/temp/lisa/Local Settings/Temporary Internet Files/Content.IE5/IVUD

Re: [rdiff-backup-users] key error - crash on certain file

2005-11-22 Thread David Kempe
David Kempe wrote: Hi, I am getting a crash from backing up an smbfs mounted filesystem to an ext3 system. Here is the trace: I just rsynced the source to the destination, rmed the rdiff-backup-data directory and ran it again with --force and get the same crash on the same file. Any hints

[rdiff-backup-users] key error - crash on certain file

2005-11-22 Thread David Kempe
Hi, I am getting a crash from backing up an smbfs mounted filesystem to an ext3 system. Here is the trace: Processing changed file raid5/Mohammed/cop/build/output/gen-src/au/com/ucw/cop/interfaces/ProductControllerEJBLocal.java Traceback (most recent call last): File "/usr/bin/rdiff-backup"

Re: [rdiff-backup-users] rdiff to SMB share?

2005-11-14 Thread David Kempe
Matt Ettus wrote: I am using rdiff version 1.0.1 from the FC4 rpm. Does rdiff not work in this manner? I don't think it works in this manner yet - we are working on it. Can you try the delevelopment version? It does some extra things that might help SMBFS, CIFS and windows in general dave

Re: [rdiff-backup-users] Version 1.1.1 released

2005-11-06 Thread David Kempe
Ben Escoto wrote: rdiff-backup now writes SHA1 sums into its mirror_metadata file for all regular files, and checks them when restoring. I haven't had a chance to test it yet, but I bet that pounds CPU bound boxes. I have quite a few of these and would love a way to turn this feature off - is

Re: [rdiff-backup-users] cygwin probs fsync again :(

2005-10-27 Thread David Kempe
Ben Escoto wrote: The try...except was added last release to handle exactly this error. So if we are using the same version I don't know why it wouldn't have been caught. Maybe you could just try this code manually, see if you can figure out why cygwin wouldn't be catching the OSError like the e

Re: [rdiff-backup-users] rdiff-backup error handling

2005-10-27 Thread David Kempe
Greg Freemyer wrote: I don't know the answer, but I will say that the current error handling is rdiff-backup's biggest shortcoming in my opinion. Anytime I recommend rdiff-backup, I always warn the potential new user that if they are not comfortable seeing stack dumps, they will get very nerviou

Re: [rdiff-backup-users] Status of rdiff-backup and backup to to CIFS mounted share on Linux

2005-10-24 Thread David Kempe
Adam Tworkowski wrote: Is this a feasible object? If the answer is something like "yes, in theory", I can certainly provide the rdiff-backup errors. the next version might do it. can you check out a copy from cvs and see if that works? dave ___ r

Re: [rdiff-backup-users] New web page alias: http://rdiff-backup.nongnu.org

2005-10-21 Thread David Kempe
Ben Escoto wrote: I plan to use this url as the official homepage from now on. Ben, the offer of hosting and the name rdiff-backup.org is still available. We registered it for this project and can offer hosting etc if needed. Email etc as well if you like. dave ___

Re: [rdiff-backup-users] cygwin fsyncing again

2005-10-17 Thread David Kempe
Ben Escoto wrote: if it works, python won't say anything. That didn't work for some reason. I think this is the same error rdiff-backup gives: Traceback (most recent call last): File "", line 1, in ? OSError: [Errno 13] Permission denied google doesn't show anything obvious as to why thi

Re: [rdiff-backup-users] cygwin fsyncing again

2005-10-15 Thread David Kempe
Ben Escoto wrote: That shouldn't be too hard, but is there really no better solution? Why doesn't windows have fsync? I mean, it must have some system call that does exactly the same thing, but cygwin just doesn't map it? From my reading it seems that the python2.4/cygwin version I have got s

Re: [rdiff-backup-users] file doesn't exist backup bug

2005-10-14 Thread David Kempe
Ben Escoto wrote: Is this a complete traceback? What's the error? Index not found or something? I can't remember now - for the record in this particular instance, the files where so corrupt that windows couldn't read them either. It seems it was the result of a broken My Briefcase thingo.

Re: [rdiff-backup-users] cygwin fsyncing again

2005-10-14 Thread David Kempe
Ben Escoto wrote: It would be easy to add a check and then just disable fsyncing if it's not available, but I don't think this would be entirely safe. since we are using windows, we have come to accept we don't live in an ideal world :) I think we are prepared to accept not entirely safe. P

[rdiff-backup-users] file doesn't exist backup bug

2005-09-29 Thread David Kempe
Hi, I am getting an error on of my cifs mounted backups - There is something strange about the file it is trying to backup - when rsync trys to copy it, it says File has gone away or something to that effect, but it continues on. I would like rdiff-backup to do the same - continue on when stran

Re: [rdiff-backup-users] Re: new windows version

2005-09-29 Thread David Kempe
Chinook wrote: I've since got waylaid on an ObjC task, but at the time I noted that I have Apple's version of "xattr" as well as Apple's Carbon ACL modules. In the ACL modules it specifically notes that some are non-portable. Do you have any intention/leaning towards testing for the OS and u

Re: [rdiff-backup-users] UpdateError

2005-08-19 Thread David Kempe
dean gaudet wrote: (on a related rant: it's unfortunate linux 2.6 LVM2 doesn't have stable snapshots yet... i'm stuck on 2.4 still because i want snapshots.) well 2.6 is the development kernel :) dave ___ rdiff-backup-users mailing list at rdiff-b

[rdiff-backup-users] checking backups in progress

2005-08-17 Thread David Kempe
Hi, how hard would it be for rdiff-backup to write the pid of the rdiff-backup --server process to a file (or the current_mirror_marker) on startup? I have found the section of the source where rdiff-backup writes the current_mirror marker, but don't know enough python on how to write a patch

Re: [rdiff-backup-users] librsync error 100 while in patch cycle

2005-08-16 Thread David Kempe
Troels Arvin wrote: The files (sp_trembl.dat and sp_uni.dat) are rather large (3.6 and 4.2 GB) but otherwise not special. Host receiving data is a CentOS 4.1 (~=RHEL 4.1) host; host sending data is a SuSE Professional 8.1 installation. what version of librsync and python on those? I thought l

Re: [rdiff-backup-users] Version 1.0.0 released

2005-08-14 Thread David Kempe
> Version 1.0.0 has been released. This release comes from the 0.13.x > tree, and could have been called 0.13.7. > > rdiff-backup is more than four years old now, so I thought it's time > it had a version 1+. (Originally I was going to wait until librsync > had their version 1.0, but I'm not sure

[rdiff-backup-users] keyerror

2005-08-09 Thread David Kempe
Hi, anyone know what this error means? One of my backups seems to get it very frequently on certain files only. on the source end: le "/usr/bin/rdiff-backup", line 23, in ? rdiff_backup.Main.Main(sys.argv[1:]) File "/home/tretkowski/rdiff-backup/rdiff-backup-0.13.4/debian/rdiff-backup/usr

Re: [rdiff-backup-users] nagios plugin WAS rdiff-backup fails

2005-08-08 Thread David Kempe
Hi, On this topic, I have been trying to write a nagios plugin to check the state of rdiff-backup repos. Here is the data I have been able to glean off from analysis of backups: # States of backup # # INITIAL_IN_PROGRESS # if repo is in initial backup phase: # there will be 1 file_statis

Re: [rdiff-backup-users] problems backing up to smbmounted dir

2005-07-22 Thread David Kempe
dean gaudet wrote: i wonder what it's trying to fsync... i suppose we could ignore an error there, but you'd probably run into more problems. I thought fsync didn't work on windows file systems at all. - this means smbfs, cifs and cygwin. I think your patch might help, but I would like to even

Re: [rdiff-backup-users] problems backing up to smbmounted dir

2005-07-21 Thread David Kempe
robert breithuber wrote: hello all, please, i need some help, maybe someone can point me to the right solution: i have no success in backing up to a windows machine using a mounted share. I don't think its going to work. we need to do some serious patching to the detection code to make this w

Re: [rdiff-backup-users] rdiff-backup on debian

2005-07-04 Thread David Kempe
Carsten Lorenz wrote: The idea is to backup the data of one server to the raid of the other one. Has anyone experience with ca. 1TB of files? the overall repository size is not going to get you, just the size of the largest files and the length of the paths. see recent posts and the man page

Re: [rdiff-backup-users] restore old backups fails with gzip error -

2005-07-02 Thread David Kempe
Hunter Matthews wrote: CONCLUSION: There's an os.tmpfile() [or similar] call in rdiff-backup thats doing this. Rdiff-backup should be patched either a) to use 'tmp' files in the restoration target, with the assumption that the user requesting restore knew what he/she/it was doing to have enough

Re: [rdiff-backup-users] Re: more info on 25gig files

2005-07-01 Thread David Kempe
Donovan Baarda wrote: I'm now working at google, and am seriously considering making librsync my 20% project... hopefully this means I will do some serious work on it soon. Thats great news. perhaps you can make something to really drive the google conspiricy nuts crazy - Google Offsite Back

Re: [rdiff-backup-users] Switching between compressed and uncompressed increments

2005-06-23 Thread David Kempe
> Is it safe to do either or both of these things to convert an > rdiff-backup directory between having compressed and uncompressed > increments? if you are using the devel versions you probably need to make sure the mirror_metadata has the right information as well. dave

Re: [rdiff-backup-users] Re: Millions of files

2005-05-27 Thread David Kempe
Troels Arvin wrote: - Python+librsync+rdiff-backup ^ - sshd what ssh cipher are you using? arc4 seems to be the fastest. blowfish helps too. How about librsync? - Isn't that code shared between rdiff-backup and rsync? nope dave ___ rd

Re: [rdiff-backup-users] tape drives

2005-05-24 Thread David Kempe
Susanne Hemker wrote: Hi all, I am looking for a new tape drive for backups and couldn't find any good reviews online. Could anyone suggest a good drive for a regular Didn't anyone tell you tape is dead? isn't that why you use rdiff-backup? :) dave ___

Re: [rdiff-backup-users] KIOslave for rdiff-backup

2005-05-07 Thread David Kempe
Thomas Bettler wrote: I just thougt would be great to have a kioslave for rdiff-backup... whats your vision for its use? dave ___ rdiff-backup-users mailing list at rdiff-backup-users@nongnu.org http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users

Re: [rdiff-backup-users] Temporary Files

2005-05-07 Thread David Kempe
Martin Hucht wrote: which would be in the raid, so there wouldn't be any space problems. Any hints? export the correct tmp variable before hand? dave ___ rdiff-backup-users mailing list at rdiff-backup-users@nongnu.org http://lists.nongnu.org/mailman/lis

Re: [rdiff-backup-users] 25gig files

2005-05-04 Thread David Kempe
Clint Silvester wrote: Has anyone looked at the problem when working on files larger than 25Gig? Previous messages about this problem were titled "error 107" and "librsync error 107 while in patch cycle" it looks like a problem with librsync. I get this error I have a client where we do backups o

Re: [rdiff-backup-users] rdiff-backup config files

2005-05-01 Thread David Kempe
Dwayne Hottinger wrote: Is there a set of config files or log files that rdiff-backup has. I inheritated an rdiff-backup backup system that is now broke, and I am trying to figure out why. You probably want to start looking in cron. Most of the rdiff-backup stuff is called straight via the comman

Re: [rdiff-backup-users] Problem running against smb mounted filesystems w/changes in backup directory.

2005-04-27 Thread David Kempe
Joe Baker wrote: I have some scripts which regularly mount windows C drives onto /mnt/machines/machinename. Next an rdiff-backup process runs. are you using smbfs or cifs? I strongly recommend cifs over smbfs dave ___ rdiff-backup-users mailing list at

Re: [rdiff-backup-users] [OT, vserver] was: Backup to chrooted environment

2005-04-27 Thread David Kempe
Marko Faldix wrote: this looks like a free GNU licensed project, but they do not tell anything about licence. Did you figure out their license model? vserver is GPL according to freshmeat. I ran into Paul at linux.conf.au who got me on to it. I will mention it to him. its in debian, so if its goo

Re: [rdiff-backup-users] Backup to chrooted environment

2005-04-26 Thread David Kempe
Michael Schachtebeck wrote: > has anyone succeeded in backing up to a server running a chrooted ssh environment? I tried to do so, but I think I forgot to copy some files to the chroot jail... I considered it, but came to the conclusion it was too hard. I am sure its possible, but a better soluti