[BackupPC-users] Rsyncd cygwin Problem..
So, my goal was going to be rsync on all machines, I seem to have that working fine now on my windows machines, but my work laptop is part of a domain so I figured I would try rsyncd and learn how it worked in the process. It is trying to backup, but it is not following my rules correctly. It is only grabbing one of my directories and I am not sure why! It is only getting the /eng_apps area and not the other two, this was working fine with smb. Start of the LOG file full backup started for directory root (baseline backup #12) Connected to machine:873, remote version 30 Negotiated protocol version 28 Connected to module root Sending args: --server --sender --numeric-ids --perms --owner --group -D --links --hard-links --times --block-size=2048 --recursive --ignore-times . . Sent include: /users Sent include: /users/wzpcnt Sent include: /data Sent include: /eng_apps Sent exclude: /* Sent exclude: /users/* Rsyncd.conf on machine in c:\cygwin\etc gid = users read only = true use chroot = false transfer logging = false log file = /var/log/rsyncd.log log format = %h %o %f %l %b hosts allow = x.x.x.x hosts deny = 0.0.0.0/0 strict modes = false [root] path = /cygdrive/c/ auth users = backuppc secrets file = /etc/rsyncd.secret machine.pl (I did everything via the CGI I see some smb settings are still in the file, I omitted them this paste, I hope they are not causing the issue) $Conf{BackupFilesOnly} = { '*' = [ '/users/me', '/data', '/eng_apps' ] }; $Conf{ClientCharset} = 'cp1252'; $Conf{RsyncShareName} = [ 'root' ]; $Conf{RsyncdPasswd} = 'xxx'; $Conf{RsyncdUserName} = 'backuppc'; $Conf{XferMethod} = 'rsyncd'; So why is it only getting ONE of the directories I specified? -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_jan___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Ubuntu rsync Setup
After setting this up, I had to leave town for work. Looking at the log, I have a question.. Using SMB, a full backup was taking about 3.5 hours and an incremental about 10 minutes on a particular client. When I switched to ssh/rsync (Cygwin on Win7), a full was about the same and so were incrementals! That was a pretty drastic increase in the time for an incremental to complete. But now I think the SMB based full and incrementals have dropped out of the pool and yesterday's incremental was only 2 hours and todays was 20 minutes. Is this normal for rsync to operate this way? I did expect some ssh overhead as Les had mentioned, but I didn't expect it to be large, I was a bit concerned a first but now that it has been running for a week, it seems to be calming down. Just trying to understand what is going on in the background I guess. Thanks. From: Travis Schwenke [mailto:travis.schwe...@gmail.com] Sent: Wednesday, January 23, 2013 06:19 To: General list for user discussion, questions and support Subject: Re: [BackupPC-users] Ubuntu rsync Setup Well.. that was easy! Per all the instructions out there (and the reliable 3 I was reading all say to do it..) had me set the CYGWIN=netsec tty, obviously that wasn't needed. I changed the line to remove the tty option and logins no longer gave me the error banner. Looks like the incremental backup went fine! Now on to the other machines. Thanks ... again ... almost there, but now that this worked the rest SHOULD be easy. On Tue, Jan 22, 2013 at 12:54 PM, Les Mikesell lesmikes...@gmail.com wrote: On Tue, Jan 22, 2013 at 6:02 AM, Travis Schwenke travis.schwe...@gmail.com wrote: Well, I didn't do what I said, I attacked one of the windows boxes first. Then I kicked off a incremental backup. I think the charset setting might be wrong: incr backup started back to 2013-01-19 09:00:00 (backup #7) for directory /cygdrive/c Running: /usr/bin/ssh -q -x -l x tas-travis /usr/bin/rsync --server --sender --numeric-ids --perms --owner --group -D --links --hard-links --times --block-size=2048 --recursive . /cygdrive/c/ Xfer PIDs are now 18410 Got remote protocol 2037675042 Fatal error (bad version): tty option detected in CYGWIN environment variable. CYGWIN=tty is no longer supported. Please remove it from your CYGWIN environment variable and use a terminal emulator like mintty, xterm, or rxvt. Sent include: /Users Backuppc can't deal with any output sent before rsync starts - it is interpreting that message as the rsync protocol version number and nothing is going to work after that. Try to fix your cywin environment so you don't get any messages as you connect. -- Les Mikesell lesmikes...@gmail.com -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnnow-d2d ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnnow-d2d___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Tar exited with error 512, localhost on Ubuntu 12.10
Hey, I might be able to give back to the community!! I have the same stetup (I didn't install Ubuntu Server, not sure if you did) and yes the default gave me the same error out of the box. Did you do this part of the instructions? Add backuppc to the sudoers list 1. Run sudo visudo 2. At the bottom of the file add # Allow backuppc to run tar without a password backuppc ALL=NOPASSWD: /bin/tar 1. If you are unfamiliar with vi editor: Scroll to the end of last line of the file, press a to start adding text, write magic lines mentioned above, hit esc, type :w+enter to save file, :q to quit (:q! to quit without saving changes). I didn't change EVERYTING to match those instructions as them seemed older. I took what seemed to be the important part.. running tar as sudo and applied that to the base-as installed commands. I do everything via the CGI and for localhost, my TarClientCmd is: /usr/bin/env LC_ALL=C sudo $tarPath -c -v -f - -C $shareName --totals By default they only have /etc setup to be backed up, after I got that working, I added a few more directories and it worked fine (well at the next full, it created directories on the incremental, but the files were old so didn't add them). I am switching everything over to rsync, thought I was going to start with localhost, but that is next on the list now. For now TAR is working with no errors. Travis From: Magnus Larsson [mailto:mag...@vista.se] Sent: Tuesday, January 29, 2013 08:05 To: backuppc-users@lists.sourceforge.net Subject: [BackupPC-users] Tar exited with error 512, localhost on Ubuntu 12.10 Hi! I just installed backuppc on a new home server, and am now trying to get first of all localhost to work. The system is ubuntu 12.10, and I use tar for localhost backups. When I start a full backup, it runs for a while and then I get an error (from the log file): 2013-01-29 13:47:33 Got fatal error during xfer (Tar exited with error 512 () status) 2013-01-29 13:47:38 Backup aborted (Tar exited with error 512 () status) And from running (as instructed on the troubleshooting page of the wiki: $ sudo -u backuppc /usr/share/backuppc/bin/BackupPC_dump -v -f localhost (lots of output, then:) Got fatal error during xfer (Tar exited with error 512 () status) Some details from my configuration - config.pl: $Conf{TarFullArgs} = '$fileList+'; $Conf{TarFullArgs} = '$fileList+'; $Conf{TarClientCmd} = 'sudo $tarPath -c -v -f - -C $shareName' . ' --totals'; $Conf{TarClientRestoreCmd} = 'sudo $tarPath -x -p --numeric-owner --same-owner' . ' -v -f - -C $shareName'; $Conf{TarClientPath} = '/bin/tar'; I have edited the TarClientCmd and TarClientRestoreCmd according to the instructions on https://help.ubuntu.com/community/BackupPC. It did not work out of the box. localhost.pl: # $Conf{TarClientCmd} = '/usr/bin/env LC_ALL=C $tarPath -c -v -f - -C $shareName' . ' --totals'; Any ideas on what is wrong? What did I miss? Best, Magnus -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnnow-d2d___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Basic setup issues (Ubuntu 12.10)
I guess one important question I have then is, should I be adding my account to the backuppc group and should I be adding the backuppc user to anything? I don't think the user should be done moved as that seems like it could be a security issue. You mentioned something about your 'only' list being ignored. When you specify this, the 'key' part is the sharename or '*' for all shares, and the value is the path to back up. And with smb you can't specify both backupfilesonly and backupexclude because there is no way to pass both to the client. Yeah, I did some reading last night and I think that was my issue in specifying the backupfilesonly, I think I put it into the wrong part of the form. I did see some others were having issues. I assume this is on a PER host basis? I think it is as it seems the host config file trumps the main config is something was set there. So I was going to create a share that had two directories in it and make sure it was doing it right. I figured that was the cake once I had some larger issues sorted out. And in most cases not issues, just a rookie driver trying to understand and not just randomly type in things and mess up my system. -Original Message- From: Les Mikesell [mailto:lesmikes...@gmail.com] Sent: Friday, January 04, 2013 10:53 To: General list for user discussion, questions and support Subject: Re: [BackupPC-users] Basic setup issues (Ubuntu 12.10) On Fri, Jan 4, 2013 at 9:08 AM, Travis Schwenke mailto:travis.schwe...@gmail.com travis.schwe...@gmail.com wrote: Are you talking about the backuppc system user, which owns the data files and SSH keys, and runs some programs like rsync? Or are you talking about the HTTPauth user? Your example commands seem to indicate that you understand there are two. Well, I figured there were two but wasn't 100% sure. So the frustrating part would be that I seem to NOT know then the password to the backuppc USER that was created on the system. It may not have a valid password and probably doesn't have a valid shell. They aren't necessary and omitting them is good for security. You just need to know how to work around it. After the install it gave me a password and that works for the web page but obviously NOT for the user, since su fails. I also tried su -s /bin/bash backuppc, but the password seemed wrong. If you start as root, you don't need the password. Guess I might need to open a shell as root (or sudo) so that I can force change the password. Just frustrating that on a clean install I can't even RUN the command all the instructions say to run. I am not totally used to the sudo thing since I had Mandriva running for years and would su over to the root to fix/update system things. On ubuntu, the problem is that root doesn't get a password.So, use sudo su - (or maybe the special-case 'sudo -i') with your password to become root. From there you can su -s /bin/bash backkuppc Consider also adding a symlink to your new destination: Not sure what benefit this has if I just point to a new spot?? The /data01 is a 800Gb partition on a separate drive, the other 200Gb is mounted as /www or /ftp (don't remember how I did that 2 weeks ago!). In any case I have /data01, /data02 and /data03 all mounted at the root right now which are all individual drives. (/data02 is the main one I need to backup on this system, has all our music etc!) The simple-minded approach here is to mount your volume at /var/lib/backuppc (where the distribution packager decided it should be) _before_ installing the package. Moving it works, of course, with varying degrees of hassle. 2. Test your SSH key authentication carefully. Consider giving the backuppc user a shell (see sudo chsh backuppc), temporarily, so you can login and test. I give it one permanently, although that could be regarded as a security risk. If you understand the options with sudo and su, you don't need that. Ok, I have to do all this (maybe, might stick with tar). My first thing was to get the BackupPC running and backing up the windows boxes in the house using smb (to the RIGHT SPOT). You mentioned something about your 'only' list being ignored. When you specify this, the 'key' part is the sharename or '*' for all shares, and the value is the path to back up. And with smb you can't specify both backupfilesonly and backupexclude because there is no way to pass both to the client. -- Les Mikesell mailto:lesmikes...@gmail.com lesmikes...@gmail.com -- Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and much more. Get web development skills now with LearnDevNow - 350+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: