DO NOT REPLY [Bug 3491] throttle disk IO during filelist/directory parsing

2010-08-19 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=3491


a...@haveland.com changed:

   What|Removed |Added

 CC||a...@haveland.com




--- Comment #4 from a...@haveland.com  2010-08-19 07:26 CST ---
Is rsync still being maintained?

I support this feature too, and the ability to request that the sender does not
cache files.

My webserver is a social networking site, and has a deep hierarchy of image
files eg, ~/999/999/999/file.jpg with a parallel tree for server generated
thumbnails. This is located on a separate device from the main system
(reiserfs,noatime of course!).

Rsync is amazing - I use it to back up the server over cable, but the problem
is that scanning 50Gb of files in 300,000+ directories hits the server hard,
takes a long time, and saturates linux's cache with files that will rarely be
used.

The option to sleep between dir reads would be useful, although this would
dramatically increase run time!

The most useful thing for me would be an option to tell rsync to tell the
kernel to leave the server's present cache untouched. Is this possible?

If not, then I think I'll have to write something to query the database and
calculate deltas from the local copy and sync on a per file basis.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: using rsync for jar file

2010-08-19 Thread Brian K. White

On 8/18/2010 9:18 PM, Vanitha wrote:

The exact syntax is as below

Rsync -r -a -e “ssh -l u...@host1” -h /home/xx/dir-name 
u...@host2:/home/xx/dir-name


I doubt it.

--
bkw
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 7629] Blank filter file option to ignore whole directory

2010-08-19 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=7629


way...@samba.org changed:

   What|Removed |Added

 Status|NEW |RESOLVED
 Resolution||WORKSFORME




--- Comment #1 from way...@samba.org  2010-08-19 09:54 CST ---
The easiest way to accomplish this is to make that signal file be name
.rsync-filter, put - * into it, and use the -F option for the copy.  Rsync
will then obey any filter rules it encounters in the .rsync-filter files it
finds sprinkled around in the hierarchy.  This idiom will leave an empty
directory, though.  If you want to avoid that, you'd need to put - /dirname
into the .rsync-filter file of the parent directory (the slash anchors the
exclude in the current directory so it doesn't filter a similarly named
file/dir in another directory).  If you want to hide the parent-dir
.rsync-fiter files, you can repeat the -F option.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: using rsync for jar file

2010-08-19 Thread Wayne Davison
On Wed, Aug 18, 2010 at 6:18 PM, Vanitha vani...@stee.stengg.com wrote:

  Rsync -r -a -e “ssh -l u...@host1”  -h /home/xx/dir-name u...@host2
 :/home/xx/dir-name


It looks like you've duplicated the dir name, so you're looking for
deletions in /home/xx/dir-name and they're happening in
/home/xx/dir-name/dir-name.  Either add a trailing slash to the source arg
or remove dir-name from the destination arg.

If your username indeed has an '@' in it, you can just specify it prior to
the 2nd @ for the hostname:

  rsync -ah /src/ u...@host1@host2:/dest/

However, since your above command results in an extra -l user option from
rsync, I assume it's just overriding the -l option you've specified and your
username doesn't actually contain the '@'.  Note that the use of ssh is the
default these days, so you can probably drop the -e and its arg.

..wayne..
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Check/compare modtime before deleting?

2010-08-19 Thread Chris
I need to keep two identical copies of files on my desktop and laptop,
so I want to use the -delete option.  But I don't want to delete files
that are created after last sync.  Is there a way to keep files with
modtime later than a file of a different name (a flag file created
before each sync) when using the -delete option?

Thanks and I appreciate any help.

-Chris
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 7633] New: add support for include/includedir config file directives

2010-08-19 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=7633

   Summary: add support for include/includedir config file
directives
   Product: rsync
   Version: 3.1.0
  Platform: Other
OS/Version: All
Status: NEW
  Severity: enhancement
  Priority: P3
 Component: core
AssignedTo: way...@samba.org
ReportedBy: sa...@askneil.com
 QAContact: rsync...@samba.org


The samba configuration has support for including an external configuration
file into the smb.conf file.

rsync does not support this functionality.

I'm requesting this functionality so rsync server configurations can be
modularly changed without having to edit the main file, by dropping other
config files into a directory and having the main config file reference them.

At some level this is just syntactic sugar: I could just combine all the
other files together at run time.  But it would be convenient if rsync
provided the functionality natively.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


does rsync work in lockstep? parallel could improve high latency performance

2010-08-19 Thread travis+ml-rsync
Just curious if the protocol sends a request and waits for a response,
or whether it can multiplex multiple requests on a single connection.
This could improve performance over high latency links, if a lot of
time is spent waiting for the response (i.e. when the hashes match).
-- 
Travis is an organic computer peripheral.
My emails do not have attachments; it's a digital signature that your mail
program doesn't understand. | http://www.subspacefield.org/~travis/ 
If you are a spammer, please email j...@subspacefield.org to get blacklisted.


pgpcsJe6CbjfX.pgp
Description: PGP signature
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: does rsync work in lockstep? parallel could improve high latency performance

2010-08-19 Thread travis+ml-rsync
Oh, and if it buffers requests sent to its STDIN, that's fine.

To actually complete requests in parallel, you'd need a multithread or
multiprocess app, and that's complicated.

The proper term for what I'm suggesting is probably pipelining.
-- 
Travis is an organic computer peripheral.
My emails do not have attachments; it's a digital signature that your mail
program doesn't understand. | http://www.subspacefield.org/~travis/ 
If you are a spammer, please email j...@subspacefield.org to get blacklisted.


pgptfOifydSQC.pgp
Description: PGP signature
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: does rsync work in lockstep? parallel could improve high latency performance

2010-08-19 Thread Carlos Carvalho
travis+ml-rs...@subspacefield.org (travis+ml-rs...@subspacefield.org) wrote on 
19 August 2010 12:50:
 Oh, and if it buffers requests sent to its STDIN, that's fine.
 
 To actually complete requests in parallel, you'd need a multithread or
 multiprocess app, and that's complicated.
 
 The proper term for what I'm suggesting is probably pipelining.

Yes, and rsync does it. That's why it runs two processes (generator
and receiver) in the destination.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Check/compare modtime before deleting?

2010-08-19 Thread Matt McCutchen
On Thu, 2010-08-19 at 11:31 -0700, Chris wrote:
 I need to keep two identical copies of files on my desktop and laptop,
 so I want to use the -delete option.  But I don't want to delete files
 that are created after last sync.  Is there a way to keep files with
 modtime later than a file of a different name (a flag file created
 before each sync) when using the -delete option?

No.  As soon as you have one side making arbitrary changes that you
don't want to clobber, you need a stateful change-propagation tool such
as unison (http://www.cis.upenn.edu/~bcpierce/unison/).

-- 
Matt

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html