This sounds like the perfect application for BitTorrent. Without getting into too many details, a group I know wanted to distribute a 5GB dataset to ~100 computers. They distributed it via BitTorrent, and they maxed out the bandwidth of their network. (all ports on the switches were saturated bidirectionally)
-Dave > -----Original Message----- > From: [email protected] > [mailto:[email protected]] > On Behalf Of Robin Wood > Sent: Tuesday, February 09, 2010 9:22 PM > To: PaulDotCom Mailing List > Subject: [Pauldotcom] Shmoocon Rainbow Table Swapshop > > So, Shmoocon is over and the swapshop happened. Unfortunately it > wasn't as successful as it could have been but for the first attempt I > think it went OK. > > A number of people donated tables and others leached sets, the problem > turned out to be that the initial donation was about 300GB and to copy > that from one external disk to a second was taking up to 7 hours, when > two people were copying that time shot up even more. > > When I get back home to the UK I'll do an inventory of what I > collected and find some way to share it out to those who want copies. > I'll also have a play with different methods of running the system to > try to drop that time down to something more manageable. > > Thanks to Darren and Larry for donating hardware and the PaulDotCom > crew in general for keeping an eye on the setup while I was running > round doing other con activities. > > Robin > _______________________________________________ > Pauldotcom mailing list > [email protected] > http://mail.pauldotcom.com/cgi-bin/mailman/listinfo/pauldotcom > Main Web Site: http://pauldotcom.com _______________________________________________ Pauldotcom mailing list [email protected] http://mail.pauldotcom.com/cgi-bin/mailman/listinfo/pauldotcom Main Web Site: http://pauldotcom.com
