Re: [SLUG] Problems with rsync
On 6/1/05, Ryan Verner [EMAIL PROTECTED] wrote: On Wed, 2005-06-01 at 07:01 +1000, Howard Lowndes wrote: Ryan Verner wrote: On Tue, 2005-05-31 at 22:28 +1000, David wrote: I have a routine that runs an rsync to sync data from a Linux fs to a vfat fs which I have smbmounted on a linux fs. It runs quite happily for a while, then stalls. the rsync command I an using is: rsync -vrtL --delete /home/ext3fs /home/vfatfs What is the best way to find out why it might be stalling? I know where, but why. I've had a lot of trouble with rsync stalling. I've managed to cure it without understanding the reasons. Try adding --bwlimit= Sounds like packet shaping somewhere is causing packet loss, which rsync tends not to handle very well. This may explain your problem and fits in with a packet shaping issue http://jared.sonicspike.net/pipermail/adsl-qos/2003-November/000477.html and this http://edseek.com/~jasonb/articles/traffic_shaping/scenarios.html you may not be shaping with iptables but your net admin may be shaping you on their switches etc.. I wouldn't be expecting packet shaping on a LAN. Never say never. A lot of switches are now implementing CoS boundaries on their user ports. Then again I could just be firing from the hip ;-) But it is worth a look -- James -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Problems with rsync
James wrote: I wouldn't be expecting packet shaping on a LAN. Never say never. A lot of switches are now implementing CoS boundaries on their user ports. Then again I could just be firing from the hip ;-) But it is worth a look Agreed, but in this case I manage the whole LAN (it's very basic) and it only has hubs, not switches. -- Howard. LANNet Computing Associates - Your Linux people http://lannet.com.au -- When you just want a system that works, you choose Linux; When you want a system that just works, you choose Microsoft. -- Flatter government, not fatter government; Get rid of the Australian states. begin:vcard fn:Howard Lowndes n:Lowndes;Howard org:LANNet Computing Associates adr:;;PO Box 1174;Lavington;NSW;2641;Australia email;internet:howard [AT] lowndes [DOT] name tel;work:02 6040 0222 tel;fax:02 6040 0222 tel;cell:0419 464 430 note:If you want to phone me, you will need to ensure that your phone presents Caller ID, or use access code 9. x-mozilla-html:FALSE url:http://www.lannet.com.au version:2.1 end:vcard -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Problems with rsync
Howard Lowndes wrote: Agreed, but in this case I manage the whole LAN (it's very basic) and it only has hubs, not switches. Theres your problems. get switches dave -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
[SLUG] Problems with rsync
I have a routine that runs an rsync to sync data from a Linux fs to a vfat fs which I have smbmounted on a linux fs. It runs quite happily for a while, then stalls. the rsync command I an using is: rsync -vrtL --delete /home/ext3fs /home/vfatfs What is the best way to find out why it might be stalling? I know where, but why. -- Howard. LANNet Computing Associates - Your Linux people http://lannet.com.au -- When you just want a system that works, you choose Linux; When you want a system that just works, you choose Microsoft. -- Flatter government, not fatter government; Get rid of the Australian states. begin:vcard fn:Howard Lowndes n:Lowndes;Howard org:LANNet Computing Associates adr:;;PO Box 1174;Lavington;NSW;2641;Australia email;internet:howard [AT] lowndes [DOT] name tel;work:02 6040 0222 tel;fax:02 6040 0222 tel;cell:0419 464 430 note:If you want to phone me, you will need to ensure that your phone presents Caller ID, or use access code 9. x-mozilla-html:FALSE url:http://www.lannet.com.au version:2.1 end:vcard -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Problems with rsync
I have a routine that runs an rsync to sync data from a Linux fs to a vfat fs which I have smbmounted on a linux fs. It runs quite happily for a while, then stalls. the rsync command I an using is: rsync -vrtL --delete /home/ext3fs /home/vfatfs What is the best way to find out why it might be stalling? I know where, but why. I've had a lot of trouble with rsync stalling. I've managed to cure it without understanding the reasons. Try adding --bwlimit= I've played with different values for , but perhaps you could try this: $rsync -vrtL --bwlimit=2000 --delete /home/ext3fs /home/vfatfs I have no idea what this is about, and if anyone can tell me I'd be curious to know. I started of with --bwlimit=25 and kept increasing the value until I wasn't game to go any further. Is that scientific? David. -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Problems with rsync
On Tue, 2005-05-31 at 22:28 +1000, David wrote: I have a routine that runs an rsync to sync data from a Linux fs to a vfat fs which I have smbmounted on a linux fs. It runs quite happily for a while, then stalls. the rsync command I an using is: rsync -vrtL --delete /home/ext3fs /home/vfatfs What is the best way to find out why it might be stalling? I know where, but why. I've had a lot of trouble with rsync stalling. I've managed to cure it without understanding the reasons. Try adding --bwlimit= Sounds like packet shaping somewhere is causing packet loss, which rsync tends not to handle very well. R -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Problems with rsync
Ryan Verner wrote: On Tue, 2005-05-31 at 22:28 +1000, David wrote: I have a routine that runs an rsync to sync data from a Linux fs to a vfat fs which I have smbmounted on a linux fs. It runs quite happily for a while, then stalls. the rsync command I an using is: rsync -vrtL --delete /home/ext3fs /home/vfatfs What is the best way to find out why it might be stalling? I know where, but why. I've had a lot of trouble with rsync stalling. I've managed to cure it without understanding the reasons. Try adding --bwlimit= Sounds like packet shaping somewhere is causing packet loss, which rsync tends not to handle very well. I wouldn't be expecting packet shaping on a LAN. -- Howard. LANNet Computing Associates - Your Linux people http://lannet.com.au -- When you just want a system that works, you choose Linux; When you want a system that just works, you choose Microsoft. -- Flatter government, not fatter government; Get rid of the Australian states. begin:vcard fn:Howard Lowndes n:Lowndes;Howard org:LANNet Computing Associates adr:;;PO Box 1174;Lavington;NSW;2641;Australia email;internet:howard [AT] lowndes [DOT] name tel;work:02 6040 0222 tel;fax:02 6040 0222 tel;cell:0419 464 430 note:If you want to phone me, you will need to ensure that your phone presents Caller ID, or use access code 9. x-mozilla-html:FALSE url:http://www.lannet.com.au version:2.1 end:vcard -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
RE: [SLUG] Problems with rsync
Ryan Verner wrote: On Tue, 2005-05-31 at 22:28 +1000, David wrote: I have a routine that runs an rsync to sync data from a Linux fs to a vfat fs which I have smbmounted on a linux fs. It runs quite happily for a while, then stalls. the rsync command I an using is: rsync -vrtL --delete /home/ext3fs /home/vfatfs What is the best way to find out why it might be stalling? I know where, but why. I've had a lot of trouble with rsync stalling. I've managed to cure it without understanding the reasons. Try adding --bwlimit= Sounds like packet shaping somewhere is causing packet loss, which rsync tends not to handle very well. I wouldn't be expecting packet shaping on a LAN. Depends how you think about MTU. :) I had problems copying any large file (rsync or otherwise) in the past because the MTU was set too high for my crappy NIC. It could be a long shot, but something to think about. Try copying a big file using cp and see if it has any trouble. Check what ifconfig says about packet counts before and after reproducing the problem. Of course, the other end of the pipe/s may be the problem. - Rog -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Problems with rsync
On Wed, Jun 01, 2005 at 09:00:50AM +1000, Roger Barnes wrote: Ryan Verner wrote: On Tue, 2005-05-31 at 22:28 +1000, David wrote: I have a routine that runs an rsync to sync data from a Linux fs to a vfat fs which I have smbmounted on a linux fs. It runs quite happily for a while, then stalls. the rsync command I an using is: rsync -vrtL --delete /home/ext3fs /home/vfatfs What is the best way to find out why it might be stalling? I know where, but why. I've had a lot of trouble with rsync stalling. I've managed to cure it without understanding the reasons. Try adding --bwlimit= Sounds like packet shaping somewhere is causing packet loss, which rsync tends not to handle very well. I wouldn't be expecting packet shaping on a LAN. Depends how you think about MTU. :) I had problems copying any large file (rsync or otherwise) in the past because the MTU was set too high for my crappy NIC. It could be a long shot, but something to think about. Try copying a big file using cp and see if it has any trouble. Check what ifconfig says about packet counts before and after reproducing the problem. Of course, the other end of the pipe/s may be the problem. - Rog This is on a LAN, and I'm able to scp large files 8Mb without any problems, so I doubt that it's any sort of shaping problem. When I first had the problem I did some googling and apparently we're not the only ones with the problem, but there were no suggestions as to cause. David. -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Problems with rsync
On Wed, 2005-06-01 at 07:01 +1000, Howard Lowndes wrote: Ryan Verner wrote: On Tue, 2005-05-31 at 22:28 +1000, David wrote: I have a routine that runs an rsync to sync data from a Linux fs to a vfat fs which I have smbmounted on a linux fs. It runs quite happily for a while, then stalls. the rsync command I an using is: rsync -vrtL --delete /home/ext3fs /home/vfatfs What is the best way to find out why it might be stalling? I know where, but why. I've had a lot of trouble with rsync stalling. I've managed to cure it without understanding the reasons. Try adding --bwlimit= Sounds like packet shaping somewhere is causing packet loss, which rsync tends not to handle very well. I wouldn't be expecting packet shaping on a LAN. Right, but you might still be getting packet loss. I just replaced a switch two days ago exactly because of that, and I've had Realtek cards do odd things under certain kernels. Lowering the MTU, as somebody else mentioned, tends to make packet loss more tolerable. Of course, might not be this at all - just a stab in the dark based from lots of previous similar experiences :) R -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
