On June 18, 2003 01:22 am, Tom Kaitchuck wrote: > On Monday 16 June 2003 08:25 pm, Toad wrote: > > > Yeah, I agree with you there. But would it be possible to do the > > > following: Suppose larger chunks are accessed in general less > > > frequently. (I'd like to see some hard evidence of that, but bare with > > > me...) Then when a node reseves an insert request for a piece of data, > > > it looks at it's routing table and finds a few nodes that it thinks are > > > fairly good candidates for the data. Then it picks one of them, but in > > > it's decision it weights it's perseption of that nodes available > > > bandwidth. If it thinks that a node has a slow upload rate and it is a > > > large datafile then that node is more luckily to be forwarded the data. > > > This is because we are assuming large data is less popular so it > > > wouldn't need to upload as often. (IE: A node with 1000 1KB chunks in > > > it's data store uploaded an average of 10 times each, generates a LOT > > > more traffic than, a node with 1 1MB chunk in it's data store that is > > > uploaded 9 times.) > > > > We will soon implement a new routing algorithm which decides which node > > to route to based on how fast it expects it to be for that particular > > key. This should make more efficient utilization of nodes of different > > bandwidth and store sizes. The issue with caching is that we have to > > ensure there is space for caching files being transferred, so nodes will > > not cache files larger than approximately 1/100th of the datastore size. > > > > > Is there any reason that we couldn't/shouldn't make the datasize > > > available to the requesting node? > > > > We would have to change the key spec.. we could do it if we had a > > _really_ good reason. > > I understand that changing the spec is a big deal. But if the routing > estimation could be improved by knowing the filesize, and I can't think of > any attacks biased on it, and the network overhead is virtually nothing ... > Then maybe this is something that should be implemented or at least thought > about, but not enabled. This way whenever the key spec does eventually > change this could be added in without upsetting anything.
What is planned for NG routing is to normalize the data size. In other words we will ask how long will it take to get data of a constant size from a node, and update the routing info with the normalized results. Ed Tomlinson _______________________________________________ devl mailing list [EMAIL PROTECTED] http://hawk.freenetproject.org:8080/cgi-bin/mailman/listinfo/devl
