On Sat, 9 Nov 2002, Matthew Toseland wrote:

> Recently I inserted a file at HTL 20 into one of my nodes, and had it
> DNF on the other at HTL 25. For two different files. This worked in the
> past, with lower HTLs. Now, the interesting part is that I have three
> nodes, and it appears that hammering all the nodes other than the one I
> inserted the files into for all the files improves fetchability over
> time... maybe fishtools etc should include an option to fetch from extra
> nodes? The modified loop:
> Insert files.
> For each file:
>  if fetchable on all nodes, continue to next file
>  for each extra node, (in parallel?):
>   try to fetch at current HTL
>   if RNF, retry with same options
>   if DNF, and HTL < max HTL, increase HTL and retry
>  done
>  repeat
> done
> 
> Eventually the files should become available... and the network will
> forge new links to make this happen. The only cost is time and load...

so, I've started implenting some multi-homing into fishtools, but how it
works right now is much simpler than this


loop:
        insert file on random node
        attempt to fetch from different random node
        if(fetched):
                done, next file
        else:
                jump loop

I realise that's not exactly what you were after, but I'll probably get to
adding the code to fetch from each node this weekend - the way the code
works requires some retooling to pull that part off (baiscally, i modified
openFcpPort() to open a random node from a list, instead of always opening
the same node.  I'll need to add support to retrieveKey() to retrieve from
a specified node.  but anyhow...)

question to oskar, who probably hates me right now for implenting this
:-p: I'm actully curious for your input on this, even tho I may or may not
listen to it, whree should I draw the line, given that you consider
retrieving from 3 nodes flooding the network?  Given that you don't like
this approch, how would your recommend handling the problem of trying to
insert content?

anyhow, offtopic, i have a theory that this should also help with the
streaming stuff, too, since the reason why I was getting RNF's is that I
was running into the load balancing code of fred - whereas I used to be
able to stream 16kbps audio at htl=15 with only 20 simeltaneous threads,
now it's needing to push 40 or so, and when I hit 30, bang, RNF city.  
even at 24 threads, i'm often hitting try=5 and similar such largish
numbers, but at least not try=20.

this is all with verification turned off, of course - i think the reason
why it was keeping up before, is I basically wasn't rnfing at all before
the slashdotting :-p.  I find much humour value that mode nodes == less
routes :-p.

(disclaimer: yes, i do know that it's more complicated than that etc etc
etc etc etc etc etc etc.)

        - fish



_______________________________________________
devl mailing list
devl at freenetproject.org
http://hawk.freenetproject.org/cgi-bin/mailman/listinfo/devl

Reply via email to