[BackupPC-users] Rsyncd cygwin Problem..

2013-01-30 Thread Travis.Schwenke
So, my goal was going to be rsync on all machines, I seem to have that
working fine now on my windows machines, but my work laptop is part of a
domain so I figured I would try rsyncd and learn how it worked in the
process.  It is trying to backup, but it is not following my rules
correctly.  It is only grabbing one of my directories and I am not sure why!
It is only getting the /eng_apps area and not the other two, this was
working fine with smb.

 

Start of the LOG file

full backup started for directory root (baseline backup #12)

Connected to machine:873, remote version 30

Negotiated protocol version 28

Connected to module root

Sending args: --server --sender --numeric-ids --perms --owner --group -D
--links --hard-links --times --block-size=2048 --recursive --ignore-times .
.

Sent include: /users

Sent include: /users/wzpcnt

Sent include: /data

Sent include: /eng_apps

Sent exclude: /*

Sent exclude: /users/*

 

Rsyncd.conf on machine in c:\cygwin\etc

gid = users

read only = true

use chroot = false

transfer logging = false

log file = /var/log/rsyncd.log

log format = %h %o %f %l %b

hosts allow = x.x.x.x

hosts deny = 0.0.0.0/0

strict modes = false

[root]

path = /cygdrive/c/

auth users = backuppc

secrets file = /etc/rsyncd.secret

 

 

machine.pl (I did everything via the CGI I see some smb settings are still
in the file, I omitted them this paste, I hope they are not causing the
issue)

$Conf{BackupFilesOnly} = {

  '*' = [

'/users/me',

'/data',

'/eng_apps'

  ]

};

$Conf{ClientCharset} = 'cp1252';

$Conf{RsyncShareName} = [

  'root'

];

$Conf{RsyncdPasswd} = 'xxx';

$Conf{RsyncdUserName} = 'backuppc';

$Conf{XferMethod} = 'rsyncd';

 

 

So why is it only getting ONE of the directories I specified?

--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_jan___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Ubuntu rsync Setup

2013-01-29 Thread Travis.Schwenke
After setting this up, I had to leave town for work.  Looking at the log, I
have a question..

 

Using SMB, a full backup was taking about 3.5 hours and an incremental about
10 minutes on a particular client.

When I switched to ssh/rsync (Cygwin on Win7), a full was about the same and
so were incrementals!  That was a pretty drastic increase in the time for an
incremental to complete.  But now I think the SMB based full and
incrementals have dropped out of the pool and yesterday's incremental was
only 2 hours and todays was 20 minutes.

 

Is this normal for rsync to operate this way?

 

I did expect some ssh overhead as Les had mentioned, but I didn't expect it
to be large, I was a bit concerned a first but now that it has been running
for a week, it seems to be calming down.

 

Just trying to understand what is going on in the background I guess.
Thanks.

 

From: Travis Schwenke [mailto:travis.schwe...@gmail.com] 
Sent: Wednesday, January 23, 2013 06:19
To: General list for user discussion, questions and support
Subject: Re: [BackupPC-users] Ubuntu rsync Setup

 

Well.. that was easy!  Per all the instructions out there (and the reliable
3 I was reading all say to do it..) had me set the CYGWIN=netsec tty,
obviously that wasn't needed.  I changed the line to remove the tty option
and logins no longer gave me the error banner.  Looks like the incremental
backup went fine!  Now on to the other machines.

 

Thanks ... again ...  almost there, but now that this worked the rest SHOULD
be easy.

On Tue, Jan 22, 2013 at 12:54 PM, Les Mikesell lesmikes...@gmail.com
wrote:

On Tue, Jan 22, 2013 at 6:02 AM, Travis Schwenke
travis.schwe...@gmail.com wrote:
 Well, I didn't do what I said, I attacked one of the windows boxes first.
 Then I kicked off a incremental backup.  I think the charset setting might
 be wrong:

 incr backup started back to 2013-01-19 09:00:00 (backup #7) for directory
 /cygdrive/c
 Running: /usr/bin/ssh -q -x -l x tas-travis /usr/bin/rsync --server
 --sender --numeric-ids --perms --owner --group -D --links --hard-links
 --times --block-size=2048 --recursive . /cygdrive/c/
 Xfer PIDs are now 18410
 Got remote protocol 2037675042
 Fatal error (bad version): tty option detected in CYGWIN environment
 variable.
 CYGWIN=tty is no longer supported.  Please remove it from your
 CYGWIN environment variable and use a terminal emulator like mintty,
 xterm, or rxvt.

 Sent include: /Users

Backuppc can't deal with any output sent before rsync starts - it is
interpreting that message as the rsync protocol version number and
nothing is going to work after that.   Try to fix your cywin
environment so you don't get any messages as you connect.


--
   Les Mikesell
 lesmikes...@gmail.com


--

Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnnow-d2d

___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

 

--
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnnow-d2d___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Tar exited with error 512, localhost on Ubuntu 12.10

2013-01-29 Thread Travis.Schwenke
Hey, I might be able to give back to the community!!

 

I have the same stetup (I didn't install Ubuntu Server, not sure if you did)
and yes the default gave me the same error out of the box.

Did you do this part of the instructions?

 

Add backuppc to the sudoers list

1.   Run sudo visudo

2. At the bottom of the file add

# Allow backuppc to run tar without a password

backuppc ALL=NOPASSWD: /bin/tar

1.   If you are unfamiliar with vi editor: Scroll to the end of last
line of the file, press a to start adding text, write magic lines mentioned
above, hit esc, type :w+enter to save file, :q to quit (:q! to quit
without saving changes).

 

I didn't change EVERYTING to match those instructions as them seemed older.
I took what seemed to be the important part.. running tar as sudo and
applied that to the base-as installed commands.  I do everything via the CGI
and for localhost, my TarClientCmd is:

/usr/bin/env LC_ALL=C sudo $tarPath -c -v -f - -C $shareName --totals

 

By default they only have /etc setup to be backed up, after I got that
working, I added a few more directories and it worked fine (well at the next
full, it created directories on the incremental, but the files were old so
didn't add them).  I am switching everything over to rsync, thought I was
going to start with localhost, but that is next on the list now.  For now
TAR is working with no errors.

 

Travis

 

From: Magnus Larsson [mailto:mag...@vista.se] 
Sent: Tuesday, January 29, 2013 08:05
To: backuppc-users@lists.sourceforge.net
Subject: [BackupPC-users] Tar exited with error 512, localhost on Ubuntu
12.10

 

Hi!

I just installed backuppc on a new home server, and am now trying to get
first of all localhost to work. The system is ubuntu 12.10, and I use tar
for localhost backups. When I start a full backup, it runs for a while and
then I get an error (from the log file):

2013-01-29 13:47:33 Got fatal error during xfer (Tar exited with error 512
() status)
2013-01-29 13:47:38 Backup aborted (Tar exited with error 512 () status)
 
And from running (as instructed on the troubleshooting page of the wiki: 
 
$ sudo -u backuppc /usr/share/backuppc/bin/BackupPC_dump -v -f localhost
(lots of output, then:)
Got fatal error during xfer (Tar exited with error 512 () status)
 

Some details from my configuration - config.pl: 

$Conf{TarFullArgs} = '$fileList+';
$Conf{TarFullArgs} = '$fileList+';
$Conf{TarClientCmd} = 'sudo $tarPath -c -v -f - -C $shareName'
. ' --totals';
$Conf{TarClientRestoreCmd} = 'sudo $tarPath -x -p --numeric-owner
--same-owner'
   . ' -v -f - -C $shareName';
$Conf{TarClientPath} = '/bin/tar';

I have edited the TarClientCmd and TarClientRestoreCmd according to the
instructions on https://help.ubuntu.com/community/BackupPC. It did not work
out of the box. 

localhost.pl:
# $Conf{TarClientCmd} = '/usr/bin/env LC_ALL=C $tarPath -c -v -f - -C
$shareName' . ' --totals';


Any ideas on what is wrong? What did I miss?

Best, 


Magnus




--
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnnow-d2d___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Basic setup issues (Ubuntu 12.10)

2013-01-04 Thread Travis.Schwenke
I guess one important question I have then is, should I be adding my account
to the backuppc group and should I be adding the backuppc user to anything?
I don't think the user should be done moved as that seems like it could be a
security issue.

 

 You mentioned something about your 'only' list being ignored.  When you
specify this, the 'key' part is the sharename or '*' for all

 shares, and the value is the path to back up.   And with smb you can't

 specify both backupfilesonly and backupexclude because there is no way to
pass both to the client.

 

Yeah, I did some reading last night and I think that was my issue in
specifying the backupfilesonly, I think I put it into the wrong part of the
form.  I did see some others were having issues.  I assume this is on a PER
host basis?  I think it is as it seems the host config file trumps the main
config is something was set there. So I was going to create a share that had
two directories in it and make sure it was doing it right.  I figured that
was the cake once I had some larger issues sorted out.  And in most cases
not issues, just a rookie driver trying to understand and not just randomly
type in things and mess up my system.

 

 

-Original Message-
From: Les Mikesell [mailto:lesmikes...@gmail.com] 
Sent: Friday, January 04, 2013 10:53
To: General list for user discussion, questions and support
Subject: Re: [BackupPC-users] Basic setup issues (Ubuntu 12.10)

 

On Fri, Jan 4, 2013 at 9:08 AM, Travis Schwenke 
mailto:travis.schwe...@gmail.com travis.schwe...@gmail.com wrote:

 

 Are you talking about the backuppc system user, which owns the data 

 files and SSH keys, and runs some programs like rsync? Or are you 

 talking about the HTTPauth user? Your example commands seem to 

 indicate that you understand there are two.

 

 Well, I figured there were two but wasn't 100% sure.  So the 

 frustrating part would be that I seem to NOT know then the password to 

 the backuppc USER that was created on the system.

 

It may not have a valid password and probably doesn't have a valid shell.
They aren't necessary and omitting them is good for security.

You just need to know how to work around it.

 

 After the install it gave me a password and that works for the web 

 page but obviously NOT for the user, since su fails.

 I also tried su -s /bin/bash backuppc, but the password seemed wrong.

 

If you start as root, you don't need the password.

 

 Guess

 I might need to open a shell as root (or sudo) so that I can force 

 change the password.  Just frustrating that on a clean install I can't 

 even RUN the command all the instructions say to run.  I am not 

 totally used to the sudo thing since I had Mandriva running for years 

 and would su over to the root to fix/update system things.

 

On ubuntu, the problem is that root doesn't get a password.So, use

sudo su -  (or maybe the special-case 'sudo -i') with your password to
become root.  From there you can su -s /bin/bash backkuppc

 

 Consider also adding a symlink to your new destination:

 Not sure what benefit this has if I just point to a new spot??  The 

 /data01 is a 800Gb partition on a separate drive, the other 200Gb is 

 mounted as /www or /ftp (don't remember how I did that 2 weeks ago!).  

 In any case I have /data01, /data02 and /data03 all mounted at the 

 root right now which are all individual drives.  (/data02 is the main 

 one I need to backup on this system, has all our music etc!)

 

The simple-minded approach here is to mount your volume at /var/lib/backuppc
(where the distribution packager decided it should

be) _before_ installing the package.   Moving it works, of course,

with varying degrees of hassle.

 

 2. Test your SSH key authentication carefully. Consider giving the 

 backuppc user a shell (see sudo chsh backuppc), temporarily, so you 

 can login and test. I give it one permanently, although that could be 

 regarded as a security risk.

 

If you understand the options with sudo and su, you don't need that.

 

 Ok, I have to do all this (maybe, might stick with tar).  My first 

 thing was to get the BackupPC running and backing up the windows boxes 

 in the house using smb (to the RIGHT SPOT).

 

You mentioned something about your 'only' list being ignored.  When you
specify this, the 'key' part is the sharename or '*' for all

shares, and the value is the path to back up.   And with smb you can't

specify both backupfilesonly and backupexclude because there is no way to
pass both to the client.

 

-- 

   Les Mikesell

   mailto:lesmikes...@gmail.com lesmikes...@gmail.com

 


--

Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and much more.
Get web development skills now with LearnDevNow -

350+ hours of step-by-step video tutorials by Microsoft MVPs and experts.

SALE $99.99 this month only -- learn more at: