On Mon, Apr 25, 2005 at 03:03:35PM +0200, Paul Slootman wrote:
> On Mon 25 Apr 2005, Jeroen van Wolffelaar wrote:
> >
> > I'm not sure if this bug is fixed, I couldn't verify that, as the woody
> > system I'm using is ia64.
> >
> > The problem is that when rsyncing via ssh tunnel ~ 100MB in 3 files from
> > merkel.debian.org (ia64 woody) to my own computer (sarge i386), and on
> > my own computer the target partition is completely full, merkel eats
> > 45GB of RAM, causing its load to go above 50, and generally effectively
> > DOS'ing the source box.
>
> That's pretty strange, I've never heard of the sending rsync eating
> memory if the receiving end can't write its output. It would be helpful
> if you could check to see what exactly is eating the memory; I rather
> doubt that it was rsync.
It is the rsync --server --sender <bla bla> process for sure.
What exactly do you mean? Cut&pasted from 'top' on merkel from this
morning:
13947 jeroen 20 0 13.2G 12G 1200 R 4.0 26.2 2:02 rsync
(sorry but due to the hurry involved getting merkel responsive again I
killed before copy&pasting the full command line, I did check it though,
and it *was* the recieving part of the above-mentioned sync.
----------
Ok, retried:
[EMAIL PROTECTED] df -h /org/qa.debian.org/data/bts2ldap
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg0-backup
31G 29G 4,0K 100% /org/backup
[EMAIL PROTECTED] rsync -a --delete merkel:/org/qa.debian.org/data/bts2ldap/
/org/qa.debian.org/data/bts2ldap
rsync: write failed on "/org/qa.debian.org/data/bts2ldap/fullindex": No space
left on device (28)
rsync error: error in file IO (code 11) at receiver.c(290)
rsync: connection unexpectedly closed (137 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(420)
[EMAIL PROTECTED]
And while this error was already there, and exited, on merkel the rsync
process was still growing and eating space:
merkel$ ps aux :
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
jeroen 18862 0.0 8.4 4215424 4211296 ? R 16:12 0:23 rsync --server
--sender -logDtpr . /org/qa.debian.org/data/bts2ldap/
That's 4GB in a dozen of seconds.
And I needed to kill -9 it (maybe normal kill would have worked with more
patience though)
> > I hope you're indicently aware of any fix related to this, I couldn't
> > find it in any changelog or something. I do hope this is fixed, this bug
> > is just to be as certain as possible. If you believe this bug is fixed,
> > please close it :).
>
> I'd like to wait to see if you could try reproducing it easily :-)
See above, it still 'works'.
--Jeroen
--
Jeroen van Wolffelaar
[EMAIL PROTECTED] (also for Jabber & MSN; ICQ: 33944357)
http://Jeroen.A-Eskwadraat.nl
--
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
