t the same thing
doesn't work under Windows.
(BTW it's "openssl s_client" - which acts as a I/O pipe. I have also
tried socat - same problem)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +1 408 481 8171
PGP Fingerprint: 7A2E 0407 C9A6 CAF
old Unix guy out on Windows? :-)
Thanks
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +1 408 481 8171
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Please use reply-all for most replies to avoid omitting the mailing list.
actually got
80-90Mbs byt itself for all I know)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +1 408 481 8171
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Please use reply-all for most replies to avoid omitting the mailing list.
To un
should - typically there's other
traffic that also needs to co-exist and such a hammering would have
consequences - things have to be thought through. It would be nice to
have the ability, but that doesn't mean everyone would use it all the time
--
Cheers
Jason Haar
Information Security
ite in another country, and can never
get more than (say) 5Mbs. Parallelizing the data transfer could easily
push that up to 20-30Mbs
...and there is a "competitor" to rsync that does this - bbcp. Mirror a
directory from hostA to hostB using 'N' tcp streams. Runs like the
clappe
Hi there
That looks very interesting, but can I make suggestion? Don't call it
"should". That simply means no-one will ever be able to find it using a
search engine. :-)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +1 408 481 8171
PGP Fingerp
backing up laptops over the Internet: an enterprise
competitor to all those cloudy services such as Dropbox/etc. :-) [well,
probably need that VSS patch for rsync-win32 too ;-)]
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +1 408 481 8171
PGP Fingerprint: 7A2E
but will a sparse file copied
somewhere by rsync NOT using the "--sparse" option be 100% equivalent to
the original?
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +1 408 481 8171
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Ple
st
update those against the gluster service?
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +1 408 481 8171
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubs
but it will ensure you have confirmed the copy is
precisely what it says it is (I am ignoring filesystem/hardware caching
of course)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F
did you try scp (although that could be CPU-bound due to crypto), ftp or
wget - ie see how other TCP apps do the same job? If they all show the
same speed - it's not an rsync problem
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax:
x27;s a problem with one of the CIFS mounts?
Jason
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Please use reply-all for most replies to avoid omitt
role separation: it allows our security
group to use the server group infrastructure for backups/storage,
without giving them access to the data...
Jason
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E
ot;--bwlimit". Also, you could try "nice" to lower the
priority rsync runs at
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Please
6 and ignore the problem for
another 10 years ;-) [sometimes more options isn't a good idea...]
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Pleas
are what you want.
I didn't mention I have already done that for some random filenames I
created and it's fine. But I certainly didn't do it for every language
combination. There just seems to be enough historical noise around this
issue that it was worth asking.
--
Cheers
Jason Haar
I
issues? eg I shouldn't have to use the "--iconv" option (all
this language-specific stuff gives me a headache ;-)
Thanks
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8
We NFS mount a share that is backed up, "encfs" over that mountpoint,
and then backup onto the encfs. The end NFS share ends up with fully
encrypted filenames and data. It's no good to anyone without the key...
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigati
d rsync won't see linear changes in them like it can in
text files/etc.
(hope there's nothing too incorrect in the above. I'm sure someone will
shout at me if I'm wrong ;-)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 F
that the initial "file
listing" command is "nearly" compressed and so doesn't need it. However,
in my totally unscientific test I just sniffed a transfer, extracted the
file listing data, and compressed it with gzip. Knocked 66% off the size...)
--
Cheers
Jason Haar
Infor
he throughput of single streamed
transactions? If so, how would you manhandle rsync (a TCP app) to be
able to use them? Any such thing as a TCP-to-SCTP proxy?
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9
uot;hanging" rsync does is right back in the beginning - which doesn't
match your symptoms)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
T
around it by getting the rsync xfre script to throw
the sshfs mount command out as an "at now" script. That works fine -
it's only when called directly that it fails...
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635
d, and even lets the
Windows users know the files have been picked up (as they disappear)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
To unsubscribe or c
#x27;t return an error. It should?
Help? Is this a bug with rsync, or with Samba (perhaps it returned OK on
the rename when it shouldn't have?)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9
Wayne Davison wrote:
> On Thu, Oct 19, 2006 at 03:28:56PM +1300, Jason Haar wrote:
>
>> bash$ rsync /tmp/other.txt file.doc
>> bash$ echo $?
>> 0
>>
>
> Re-run the same command under strace:
>
> strace rsync -av /tmp/other.txt file.doc
>
>
as .file.doc.3s1d3w - but the final rename on top of
the original file failed.
Rsync didn't return an error. It should?
Help? Is this a bug with rsync, or with Samba (perhaps it returned OK on
the rename when it shouldn't have?)
--
Cheers
Jason Haar
Information Security Manager, Trim
Wayne Davison wrote:
> On Fri, Oct 13, 2006 at 01:08:54PM +1300, Jason Haar wrote:
>
>> Looks like rsync "decided" to compress data.gz even though
>> /etc/rsyncd.conf had "*.gz" in it's "dont compress" section...
>>
>
> That
" section... Looking at the packets, I see no
evidence of the rsyncd server telling the client anything regarding the
filenames.
So is there some smoke-n-mirrors going on in there? Why did the client
compress data.gz - even though it was mentioned on the server as "dont
compress"?
En
gregated bandwidth available to single sessions - because that means
users and apps (such as rsync) would experience better throughput.
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C
is due to that. We have fat
pipes and yet a single rsync session cannot saturate it due to the
latency. I'm wondering if SCTP could help? (I'm guessing it would as
running multiple copies of rsync in parallel also "fixes" our problem)
--
Cheers
Jason Haar
Information Secur
use that might help in our high
speed, high latency environment?
Thanks!
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
To unsubscribe or c
Lawrence D. Dunn wrote:
>
> Renater was using rsync to pull large amounts of data from FermiLab
> across a fast,
> long link, and was getting poor throughput (~20mbits/sec).
Man - I wish I had your problem ;-)
--
Cheers
Jason Haar
Information Security Manager, Trimble Na
There's also rsnapshot. Defaults to hourly and 7-day rolling backups,
using hard-links to save diskspace (i.e. if files haven't changed from
one run to the next). Saves a tonne of diskspace :-)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 96
c -nv" first and sorting the output, then splitting into "X"
separate jobs? Even a rough guess at it could make a difference.
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B
Tauya Mhangami wrote:
Can I copy an Oracle database by just copying that Oracle Database
datafiles and moving them to another server with oracle? If
possible can one back up a database using this same method.
Why don't you try it and see?
I don't think it'll work reliably. As you are running Ora
Wayne Davison wrote:
On Fri, Oct 29, 2004 at 07:03:43PM -0700, Rudy Moore wrote:
I noticed in the feature list that rsync pipelines file transfers to
minimize latency - does this only affect transfer of large numbers of
files?
It should be true of any transfer, but I'd estimate that the rou
(Ads/11676 1?6 Ag ad 7.99): No such file or directory (2)
Has anyone figured out how to fix this? I've tried smbmount options like
"unicode" and "codepage=utf8" - but they don't fix anything.
I have tried this under Redhat7 through Fedora Core 2...
Thanks!
--
Cheers
On Thu, Jul 22, 2004 at 07:33:21PM -0700, Wayne Davison wrote:
> On Fri, Jul 23, 2004 at 02:15:04PM +1200, Jason Haar wrote:
> > is there any intention of a "new improved" "--partial" option whereby
> > any failed uploads are kept as temp files
>
> I had
and
ssh to move-on-completely - but that is definitely a kludge and assumes you
have (or want!) ssh access onto the rsync server.
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C
l data transfers over the (much slower) WAN.
Does the "reading" of files in "rsync -a" mode really have that massive an
impact for rsync-over-WAN?
BTW: what would be the best way of running rsync for such an environment? We
currently just do "rsync -az src_dir/ remote::xx
src_dir remote:dst_share
ssh remote "/usr/local/bin/cleanup"
what's the difference?
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
To unsubscri
us...
I would have thought "--partial" could have been written so that any
partially transmitted file could be kept in a dir separate from the real
data, and when the transfer successfully finishes, renamed/copied into the
live area...
Am I missing something obvious here?
--
Cheers
databases as
files - even when they are in use. Whether that's a good idea I leave
for others to discover the hard way... ;-)
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C06
col defintely
passes any locking issues onto the SMB client (Linux in your case) - so if
it's locked under Windows, then it's locked under Linux...
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E
ses locks to the SMB
client...
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
t; > platforms (Windows), the drivers make all filenames uppercase, whereas
> > on others (linux, mac) all the filenames are lowercase.
What's wrong with using "check=relaxed" when mounting the fat partition?
Doesn't that help (see "man mount")
--
Cheers
J
27;d say leave it be. If anyone has issues with it, then THEY can do
network rate-limiting :-)
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
To unsubscribe
db* partitions.
Then when booted under dev, you can mount the production partition under
"/mnt" and rsync the live system onto it, etc.
...should work :-)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2
sing the likes of RAID'ed-NBD, CODA or
Intermezzo for a similar effect?
The NBD (network block device) looks interesting, it allows you to mount a
remote raw partition - so you can effectively RAID over the network.
Supports transaction logs too (which would be necessary in a rsync-style role)
; rsync generates subtree checksums (no network traffic) [quick]
5> rsync transmits files
...etc
That would send a little bit more network traffic, but will it take
up less total dialup time? I don't know...
[guess it's time for a DJB saying: "don't speculate - evaluate!"
The rsync.spec file within the rsync tar package is still broken, so here's
a working rsync.spec file.
Simply (as root) copy rsync-2.5.4.tar.gz into /usr/src/redhat/SOURCES then
run "rpm -ba rsync.spec" to produce rsync-2.5.4-1.i386.rpm
--
Cheers
Jason Haar
Information S
nd carry on in whole-file
mode for the rest of that file. It could really save on CPU and network
cycles if you have a lot of compressed files to sync...
Just a thought...
--
Cheers
Jason Haar
Information Security Manager
Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
--
To
l that happens, all I/O is local...
BTW: if this is an Exchange server being talked about, NEVER, EVER, TOUCH AN
EXCHANGE DATABASE WHEN IT'S RUNNING. You *will* crash it.
I know: I did :-)
[Apparently it's a feature...]
--
Cheers
Jason Haar
Information Security Manager
Trimble Naviga
flushed to disk?
[If you're talking M$ Windows - this just won't be possible BTW - ever hear
of locking? ;-)]
--
Cheers
Jason Haar
Information Security Manager
Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
--
To unsubscribe or change options: http://lists.samba.or
used
by the client, the server controls the permissions; explicitly ensuring the
permissions are always set to that value (setting the umask before starting
rsync doesn't do the same thing, as this should be settable at the module
level).
At the moment doesn't there seem to be a bit too much
7;s just a "pure" SSL transport layer with
nothing else to worry about, whereas sshd implies accounts with
password/access management,etc,etc.
--
Cheers
Jason Haar
Information Security Manager
Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
spec file. Just copy "rpm -ba rsync.spec" to build.
Thanks for the 2.5.0 work guys!
--
Cheers
Jason Haar
Information Security Manager
Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
Summary: Program for efficient remote updates of files.
Name: rsync
Version: 2
listing into memory first, so could that be related to your problem instead?
i.e. if scp can copy the files fine, then it can't be a ext2/reiserfs
problem...
--
Cheers
Jason Haar
Information Security Manager
Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
would definitely be a download-from-scratch repair...
--
Cheers
Jason Haar
Unix/Special Projects, Trimble NZ
Phone: +64 3 9635 377 Fax: +64 3 9635 417
f AV files are out-of-whack and calls it
corruption...
Can rsync copy the files over to a temp dir, and then move them live as one
move? I know I could do this with ssh directly, but the "--compare-dest" and
"--partial" options make me wonder if rsync can do this itself...
Is
bviously other NT network apps
work fine over this link - maybe I should say "NT-specific rsync bug" :-)]
--
Cheers
Jason Haar
Unix/Network Specialist, Trimble NZ
Phone: +64 3 9635 377 Fax: +64 3 9635 417
roblem doesn't occur.
It looks to me like some IP-stack issue, but other than that I'm stumped -
can't really do much debugging on the NT side, so I don't know much more.
This has been seen with rsync from 2.1 - 2.4...
--
Cheers
Jason Haar
Unix/Network Specialist, Trimble
63 matches
Mail list logo