On Mon, Jun 20, 2011 at 05:28:05PM -0700, Mark Knecht wrote: > On Mon, Jun 20, 2011 at 2:46 PM, Indi <thebeelzebubtrig...@gmail.com> wrote: > > On Mon, Jun 20, 2011 at 08:25:57AM -0700, Mark Knecht wrote: > >> Hi, > >> Is split an appropriate program to use to break a single 10GB file > >> into 100 100MB files to transfer over the net using rsync, and then > >> use cat to reassemble? > >> > >> Is there some better way to do this? > >> > > > > Just using rsync by itself would probably be a great deal faster, > > unless you have some undisclosed reason for wanting to split it up. > > Hi, > Nothing technical that's undisclosed. My original reason was not > knowing what rsync did in the case of errors I simply didn't want to > start over on such a big file. I figured there was little to lose by > stitching it back together are the other end and I could always figure > out exactly what file had failed. > > That said I don't think there's much difference in the speed. In my > case (and I think others will have a similar case) my uploads speeds > are far lower than download. I get about 8MB/S download but only about > 250KB/S upload. It's that low speed that's dominating everything else. > When I first tried transferring the big file the intermediate speeds > rsync was reporting were very similar. >
Of course I was referring to the time taken by the extra steps, not the transfer speed. :) You might check man rsync though, it does what you need without splitting and reassembling files.. -- caveat utilitor ♫ ❤ ♫ ❤ ♫ ❤ ♫
