At 9:22 AM +0300 9/12/2011, Henrik K wrote:
On Sun, Sep 11, 2011 at 04:11:07PM -0400, Dan wrote:
At 11:40 PM +0200 9/7/2011, Luca Gibelli wrote:
>Traffic is around 5TB/month on each mirror.
Short of a paid service, which I doubt any of us want, few have such
bandwidth available to donate.
First of all, I think this whole thread is overreacting. I seriously
doubt the mirror capacity is at maximum.
Noone has suggested "maximum". The issue is that the mirrors are so
overloaded that it's often taking freshclam an excessive amount of
time to do its thing, because of the time-outs / connection failures.
No big deal if it's the update run in the background. But if it's
on-demand update preceding a user-driven scan, it's making the user
sit there, twiddling its thumbs, for up to a minute or two.
Luca's response to the problem is that more mirror capacity is
needed. Hence the discussion of alternatives...
Anyways, 5TB comes at 2MB/s average, which is not that much. I can do it
with my $15 OVH/Kimsufi box and so do probably thousands of others.
Perhaps, where you live. Here, in the good'ole USofA, if I set up a
server to feed 170 GB/day, my ISP would shut me down and bill me big.
> So, I'm thinking that leaves two choices: 1) a cloud, a la Amazon
S3. 2) p2p.
Maybe, someday, when the well-cached cloud services are fully
propagated *and* reliable world-wide, using a cloud in leiu of the
traditional mirror set-up might be viable. But IMO that's years
away and too expensive.
There's nothing wrong with the current method. It's simple and cheap.
You are underestimating the bandwidth available in the world.
I didn't say there's anything wrong with the current method. It's
just overwhelmed, and I doubt that adding a mirror or two will fix it
now or even in the long term. I'm looking to explore ways of
supplementing the current infrastructure.
You do realize that torrents actually need to have central servers
for the .torrent files themselves?
Are you saying that including a 30 KB file in the Clam distro is too
heavy of a burden?
That's just the first step (freshclam would have already downloaded
cdiffs at the same step). Then you actually need to have some
trackers also, unless you are relying on DHT. Hopefully it's not the
main database you end up downloading from some guys slow ADSL link..
The point of a torrent is that noone provides all the data from one
source. It's *distributed*.
- Dan.
--
- Psychoceramic Emeritus; South Jersey, USA, Earth.
_______________________________________________
Help us build a comprehensive ClamAV guide: visit http://wiki.clamav.net
http://www.clamav.net/support/ml
