On Wed 01 Jul 2009 at 07:06PM, Jeppe Fihl Toustrup wrote:
> Shawn Walker wrote:
> >It definitely seems as though there is a bottleneck in processing on one 
> >side or the other, because it typically only takes about a half-hour on 
> >my local system to build the file list.
> 
> I would have started a new rsync process on another server, located in 
> another data center, in order to see if this made any difference in the 
> time taken to perform the entire sync, but I was meet with the "max 
> connections reached". I'll try again later on and post the results from 
> that.

There may be room for us to do better as well-- I've not had time
to invest in a more properly hosted rsync solution.  Right now the
rsync server has to look at the data over NFS, and is running on
server where it contends with other work.  There might be 5-50%
performance on the table just by optimizing the infrastructure, but I'm
sure a much larger win is possible if we rethink the problem :)

        -dp

-- 
Daniel Price, Solaris Kernel Engineering    http://blogs.sun.com/dp
_______________________________________________
pkg-discuss mailing list
[email protected]
http://mail.opensolaris.org/mailman/listinfo/pkg-discuss

Reply via email to