Feature request for rsync for running scripts

2005-07-19 Thread Evan Harris

I was wondering if others might find it useful to have a parameter in the
rsync daemon config that would allow running a command on the server at
session start or at successful rsync completion.

For instance, this would allow a webpage to be automatically maintained (by
a script called by this method) with the timestamps of the last successful
rsync completion (no errors, all files transferred), which would be very
nice for keeping track of the state of mirrors.

I looked in the patches directory, and see there is already a
pre-post-exec.diff patch to allow for running scripts before and after the
chroot, but I'm more interested in running after successful rsync completion
than after the chroot.

The already present patch also doesn't allow for some method of passing
other useful information like the username of an authenticated user, or the
ipaddress of the rsync client, either of which might be useful in tracking
which mirrors were up to date.  Other info like the module name or even the
number/size of files transferred would also be useful.

This would also be very nice for doing things like queuing a backup job for
the module that was rsynced in the case of dirs pushed to the server for
the purposes of backups.  Maybe also a way to bypass the script if no files
were transferred, but the rsync was otherwise error-free.

Comments appreciated.

Evan

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Feature request for rsync for running scripts

2005-07-19 Thread Andrew Burgess
On Tue, 19 Jul 2005 12:10:18 -0700, Evan Harris [EMAIL PROTECTED]  
wrote:




I was wondering if others might find it useful to have a parameter in the
rsync daemon config that would allow running a command on the server at
session start or at successful rsync completion.

For instance, this would allow a webpage to be automatically maintained  
(by
a script called by this method) with the timestamps of the last  
successful

rsync completion (no errors, all files transferred), which would be very
nice for keeping track of the state of mirrors.


Couldn't you just do this on the client side?

rsync...
ssh commands to run after rsync...

--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Feature request for rsync for running scripts

2005-07-19 Thread Evan Harris

On Tue, 19 Jul 2005, Andrew Burgess wrote:

 On Tue, 19 Jul 2005 12:10:18 -0700, Evan Harris [EMAIL PROTECTED]
 wrote:

  I was wondering if others might find it useful to have a parameter in the
  rsync daemon config that would allow running a command on the server at
  session start or at successful rsync completion.

 Couldn't you just do this on the client side?

 rsync...
 ssh commands to run after rsync...

That requires:

1. Running ssh and enabling it for client traffic.
2. Having a user account for each client and giving it shell access.
3. Giving each client account access to a suid script and/or permission to
do the updates itself.

Basically, it undoes practially all of the advantages of running an rsync
daemon in the first place instead of just using rsync over ssh, as well as
potentially creating some big security issues.  But the biggest one is that
I don't want to give mirror operators/clients shell access.

Evan

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Feature request for rsync for running scripts

2005-07-19 Thread Wayne Davison
On Tue, Jul 19, 2005 at 02:10:18PM -0500, Evan Harris wrote:
 I looked in the patches directory, and see there is already a
 pre-post-exec.diff patch to allow for running scripts before and after
 the chroot, but I'm more interested in running after successful rsync
 completion than after the chroot.

That patch does run a command after the completion of the rsync (whether
it was successful or not).

I've just upgraded it to add more environment variables (such as module
name, module path, host name, host IP, user name, exit status).  I also
changed where the post-rsync exec happens so that both the pre- and
post-xfer are both now run by the user that runs the daemon (not the
module's user) and without any chroot constraints (the old patch was
simpler, and it made the post-xfer command run in a more restricted
setting than the pre-xfer command).  You can see the latest patch here:

http://rsync.samba.org/ftp/unpacked/rsync/patches/pre-post-exec.diff

 Maybe also a way to bypass the script if no files were transferred,
 but the rsync was otherwise error-free.

The current patch doesn't include any info on transfer direction nor any
transfer stats (which might not be easy to do).

..wayne..
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


rsync wont rsync

2005-07-19 Thread Gary Peltola








i am having a problem getting rsync daemon to run
properly. 



on remote server, i can get the list of files OK...(below)
but when i try get them...it flaps out and says connx refused



[EMAIL PROTECTED] [/var]# rsync server:: 

addons Addon Scripts 

abuse Abuse Scripts 



 

[EMAIL PROTECTED] [/var]# rsync av server:addons /usr/local/addons

server: Connection refused 

rsync: connection unexpectedly closed (0 bytes read so
far) 

rsync error: error in rsync protocol data stream (code
12) at io.c(165)





anyone have any ideas?







Please include all past correspondences in your
replies


 
  
  Gary P. - AK Web Hosting
  
  
  
  
 
 
  
  
  
  
  
  
 
 
  
  
  
  
  
  
  
  
  
 











-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

RE: rsync wont rsync

2005-07-19 Thread Gary Peltola








Never mind, I figured it out, forgot the
:: instead of :





















From: Gary Peltola
[mailto:[EMAIL PROTECTED] 
Sent: Tuesday, July 19, 2005 2:08
PM
To: 'rsync@lists.samba.org'
Subject: rsync wont rsync





i am having a problem getting rsync daemon to run
properly. 



on remote server, i can get the list of files OK...(below)
but when i try get them...it flaps out and says connx refused



[EMAIL PROTECTED] [/var]# rsync server:: 

addons
Addon Scripts 

abuse
Abuse Scripts 






[EMAIL PROTECTED] [/var]# rsync av server:addons
/usr/local/addons

server: Connection refused 

rsync: connection unexpectedly closed (0 bytes read
so far) 

rsync error: error in rsync protocol data stream
(code 12) at io.c(165)





anyone have any ideas?







Please include all past correspondences in your
replies


 
  
  Gary P. - AK Web Hosting
  
  
  
  
 
 
  
  
  
  
  
  
 
 
  
  
  
  
  
  
  
  
  
 













-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Feature request for rsync for running scripts

2005-07-19 Thread Evan Harris

 I've just upgraded it to add more environment variables (such as module
 name, module path, host name, host IP, user name, exit status).  I also
 changed where the post-rsync exec happens so that both the pre- and
 post-xfer are both now run by the user that runs the daemon (not the
 module's user) and without any chroot constraints (the old patch was
 simpler, and it made the post-xfer command run in a more restricted
 setting than the pre-xfer command).  You can see the latest patch here:

 http://rsync.samba.org/ftp/unpacked/rsync/patches/pre-post-exec.diff

Thank you very much!  That sounds like it's just what I'm looking for.  Is
it possible that this patch might be added to the mainstream release anytime
soon?

 The current patch doesn't include any info on transfer direction nor any
 transfer stats (which might not be easy to do).

I just threw those in there as suggestions.  I doubt I'll need them.

I did just notice another missing thing (or I've overlooked the option for
doing it).  Is there a way to force creation of any necessary path
components of a stem directory of an rsync?

rsync -av /var/base/testing/ testserver::pushdir/beta5/testing/

This command fails with a no such file or directory error if the beta5
directory doesn't exist.  I would have expected that with the -a option,
it would replicate whatever dirs necessary to do the sync.  Or am I missing
something?

Thanks!

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Verbosity of log messages in daemon mode

2005-07-19 Thread Evan Harris

When running rsync in daemon mode, is there a way to suppress
server-excluded messages in the logfile?  I've tried setting both of

max verbosity = 0
transfer logging = no

but they are still showing up.  Rsync 2.6.5.

Unfortunately, I'm using rsync to get a whole tree every half hour, but
there are a few excluded directories that have several hundreds of files in
them, and its making the logs huge.

Thanks.

Evan

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Verbosity of log messages in daemon mode

2005-07-19 Thread Evan Harris

Aha, I think I answered my own question.  Unfortunately, it appears that the
max verbosity setting is a global parameter that can't be in a module area.
That might be something to change in the future, or at least make clear in
the docs.

Also, speaking of messages, when running with -vn I can't seem to figure a
way to suppress the non-file messages.  It always wants to show:

building file list ... done
sent 6999 bytes  received 16 bytes  14030.00 bytes/sec
total size is 423894309  speedup is 60426.84

I just want ONLY the files to be transferred to be given back on stdout, so
I can get a good approximation of the total bytes to be transferred to
display in a higher level UI.

I can include code to try to ignore the additional messages, but that seems
kludgy and will break if the messages ever change.

Evan


On Tue, 19 Jul 2005, Evan Harris wrote:

 When running rsync in daemon mode, is there a way to suppress
 server-excluded messages in the logfile?  I've tried setting both of

 max verbosity = 0
 transfer logging = no

 but they are still showing up.  Rsync 2.6.5.


-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Feature request for rsync for running scripts

2005-07-19 Thread Wayne Davison
On Tue, Jul 19, 2005 at 06:27:56PM -0500, Evan Harris wrote:
 Is it possible that this patch might be added to the mainstream
 release anytime soon?

I was originally against the idea, but have softened my opposition after
I saw how self-contained and simple the code turned out to be.  One
remaining problem with it as it stands now is that it doesn't have the
proper configure support (we may need to add a putenv() compatibility
function, for instance).  If someone would like to help with the cross-
platform compatibility of putenv(), that would help to speed this idea's
acceptance a bit more.

 Is there a way to force creation of any necessary path
 components of a stem directory of an rsync?

Not without using --relative (and all that implies).  Rsync will only
create the destination directory itself without that.

..wayne..
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Verbosity of log messages in daemon mode

2005-07-19 Thread Wayne Davison
On Tue, Jul 19, 2005 at 07:31:41PM -0500, Evan Harris wrote:
 Unfortunately, it appears that the max verbosity setting is a global
 parameter that can't be in a module area.

This is fixed in 2.6.6pre1.

 I just want ONLY the files to be transferred to be given back on
 stdout, so I can get a good approximation of the total bytes to be
 transferred to display in a higher level UI.

Use --log-format='OPTIONS...' instead of --verbose.  One easy way to
specify a log-format is to use -i (which gives you a log-format of
%i %n%L).  Or choose your own set of format options.

..wayne..
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


QUARANTINED:

2005-07-19 Thread WorkgroupMail Content Filter
The message  from The Post Office, sent on 20/07/2005 23:55 was quarantined 
because it contained either an executable file, a batch file or a screen saver 
file. All of these types of attachments are considered security risks. Please 
consult your mail administrator who can release the message.

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


CVS update: rsync/patches

2005-07-19 Thread Wayne Davison

Date:   Tue Jul 19 21:28:36 2005
Author: wayned

Update of /data/cvs/rsync/patches
In directory dp.samba.org:/tmp/cvs-serv7631

Modified Files:
pre-post-exec.diff 
Log Message:
Added a few more environment variables.


Revisions:
pre-post-exec.diff  1.3 = 1.4

http://www.samba.org/cgi-bin/cvsweb/rsync/patches/pre-post-exec.diff?r1=1.3r2=1.4
___
rsync-cvs mailing list
rsync-cvs@lists.samba.org
https://lists.samba.org/mailman/listinfo/rsync-cvs