On Thu, Oct 25, 2001 at 10:24:41AM +0100, degs wrote: > Hi, > > It occurred to me that there might be some benefit to inserting freesites as > a single redundant splitfile containing an archive of the site. (Or two > archives - one for the static portion and one for today's insert). > > This could make both retreiving freesites more reliable due to the splitfile > redunancy and inserting freesites would work or fail atomically rather than > leaving a site half inserted on insert failure. > > Support for this would be fairly easy to add to fproxy - just a matter of > inventing a URI syntax for it I guess and having fproxy break files out of > the archive when requested.
In addition to the chucks of actual data, a few chunks of forward-error-correction coded data should be put on the net too so that if some chunks fail to materialize the full document can still be assembled (such as the way a CD-ROM can hold 700 Meg of clean computer-grade data in 1 Gig of dirty audio-rage data). You will note that with good FEC you get better loss-tolerance/size ratio than you do with mere replication. Not only would this give one redundance, but you would also get better performance, since you could deliver the doc to the user when enough pieces have been received (from faster servers) to fill in the missing pieces. I wonder if one could get error-tolarant encoding without an extra step by merely creating a variant of the encryption algorithm. _______________________________________________ Devl mailing list Devl at freenetproject.org http://lists.freenetproject.org/mailman/listinfo/devl
