On Thursday 25 October 2001 20:00, Tony Godshall wrote: > On Thu, Oct 25, 2001 at 10:24:41AM +0100, degs wrote: > > Hi, > > > > It occurred to me that there might be some benefit to inserting freesites > > as a single redundant splitfile containing an archive of the site. (Or > > two archives - one for the static portion and one for today's insert). > > > > This could make both retreiving freesites more reliable due to the > > splitfile redunancy and inserting freesites would work or fail atomically > > rather than leaving a site half inserted on insert failure. > > > > Support for this would be fairly easy to add to fproxy - just a matter of > > inventing a URI syntax for it I guess and having fproxy break files out > > of the archive when requested. > > In addition to the chucks of actual data, a few chunks of > forward-error-correction coded data should be put on the net > too so that if some chunks fail to materialize the full > document can still be assembled (such as the way a CD-ROM > can hold 700 Meg of clean computer-grade data in 1 Gig of > dirty audio-rage data). You will note that with good FEC > you get better loss-tolerance/size ratio than you do with > mere replication. This was the idea behind my original suggestion but I hadn't realized that the FEC stuff was not incorporated in the splitfile stuff yet (or even written?) so the idea would have to wait on that. I don't fancy diving into the FEC stuff myself - too much maths :(
degs > > Not only would this give one redundance, but you would also > get better performance, since you could deliver the doc to > the user when enough pieces have been received (from faster > servers) to fill in the missing pieces. > > I wonder if one could get error-tolarant encoding without an > extra step by merely creating a variant of the encryption > algorithm. > > > _______________________________________________ > Devl mailing list > Devl at freenetproject.org > http://lists.freenetproject.org/mailman/listinfo/devl _______________________________________________ Devl mailing list Devl at freenetproject.org http://lists.freenetproject.org/mailman/listinfo/devl
