Re: [freenet-dev] NGrouting Failure Time.

2003-11-26 Thread Jonathan Howard
[EMAIL PROTECTED] wrote: One thing that always bothered me about NGrouting is that we only antisipate having to retry once. Originally I wanted to use a Ramon sum to determine the overall time but Ian pointed out that we don't want to retry infinitely. It occurred to me that NGrouting estimates t

[freenet-dev] NGrouting Failure Time.

2003-11-25 Thread tkaitchuck
One thing that always bothered me about NGrouting is that we only antisipate having to retry once. Originally I wanted to use a Ramon sum to determine the overall time but Ian pointed out that we don't want to retry infinitely. It occurred to me that NGrouting estimates the time for success and t

Re: [freenet-dev] NGrouting questions.

2003-11-10 Thread Tom Kaitchuck
On Saturday 08 November 2003 06:38 am, Ian Clarke wrote: > Tom Kaitchuck wrote: > > OK, so I've finally gotten around to looking at the NGrouting source, and > > I have a few questions. Which are hopefully simple to answer. > > > > First in node/rt/StandardNodeEstimator.java on line 162 ish there i

Re: [freenet-dev] NGrouting questions.

2003-11-08 Thread Ian Clarke
Toad wrote: All in all, it could take a very long time for the estimators to start producing realistic estimates. If so, we should consider having a less dramatic bias towards untested nodes. In which case they won't get routed to and we'll be stuck in false optima - but see my suggestion in the

Re: [freenet-dev] NGrouting questions.

2003-11-08 Thread Toad
On Sat, Nov 08, 2003 at 06:21:23PM +, Ian Clarke wrote: > Toad wrote: > >>Not sure what this code is trying to achieve, but it looks like it is > >>just attempting to have a more intelligent value for pDNF in the event > >>that the estimator doesn't have any data yet, in which case I think yo

Re: [freenet-dev] NGrouting questions.

2003-11-08 Thread Ian Clarke
Toad wrote: Not sure what this code is trying to achieve, but it looks like it is just attempting to have a more intelligent value for pDNF in the event that the estimator doesn't have any data yet, in which case I think you are right. Matthew? Not sure, maybe we WANT a crazy value on new nodes

Re: [freenet-dev] NGrouting questions.

2003-11-08 Thread Toad
On Sat, Nov 08, 2003 at 04:51:55PM +, Ian Clarke wrote: > Ed Tomlinson wrote: > >On November 08, 2003 03:14 am, Tom Kaitchuck wrote: > >>First in node/rt/StandardNodeEstimator.java on line 162 ish there is: > >>if (pDNF==0) > >>pDNF = pLegitDNF; > >>Shouldn't thi

Re: [freenet-dev] NGrouting questions.

2003-11-08 Thread Toad
On Sat, Nov 08, 2003 at 12:38:14PM +, Ian Clarke wrote: > Tom Kaitchuck wrote: > > >OK, so I've finally gotten around to looking at the NGrouting source, and > >I have a few questions. Which are hopefully simple to answer. > > > >First in node/rt/StandardNodeEstimator.java on line 162 ish the

Re: [freenet-dev] NGrouting questions.

2003-11-08 Thread Toad
On Sat, Nov 08, 2003 at 02:14:54AM -0600, Tom Kaitchuck wrote: > OK, so I've finally gotten around to looking at the NGrouting source, and I > have a few questions. Which are hopefully simple to answer. > > First in node/rt/StandardNodeEstimator.java on line 162 ish there is: > if (

Re: [freenet-dev] NGrouting questions.

2003-11-08 Thread Ian Clarke
Ed Tomlinson wrote: On November 08, 2003 03:14 am, Tom Kaitchuck wrote: First in node/rt/StandardNodeEstimator.java on line 162 ish there is: if (pDNF==0) pDNF = pLegitDNF; Shouldn't this be: if (pDNF The above says. If you know nothing about

Re: [freenet-dev] NGrouting questions.

2003-11-08 Thread Ed Tomlinson
On November 08, 2003 03:14 am, Tom Kaitchuck wrote: > OK, so I've finally gotten around to looking at the NGrouting source, and I > have a few questions. Which are hopefully simple to answer. > > First in node/rt/StandardNodeEstimator.java on line 162 ish there is: > if (pDNF==0) >

Re: [freenet-dev] NGrouting questions.

2003-11-08 Thread Ian Clarke
Tom Kaitchuck wrote: OK, so I've finally gotten around to looking at the NGrouting source, and I have a few questions. Which are hopefully simple to answer. First in node/rt/StandardNodeEstimator.java on line 162 ish there is: if (pDNF==0) pDNF = pLegitDNF

[freenet-dev] NGrouting questions.

2003-11-08 Thread Tom Kaitchuck
OK, so I've finally gotten around to looking at the NGrouting source, and I have a few questions. Which are hopefully simple to answer. First in node/rt/StandardNodeEstimator.java on line 162 ish there is: if (pDNF==0) pDNF = pLegitDNF; Shouldn't this be:

Re: [freenet-dev] NGRouting merged into unstable branch: unstablebuild 6163

2003-08-31 Thread Tracy R Reed
On Sun, Aug 31, 2003 at 01:21:46AM +0100, Toad spake thusly: > NGRouting, and a lot of infrastructure work and some major bugfixes, has > been merged into the unstable branch, in build 6163. So that it can have Just so you know I'm running 6163 and still getting RNF's regularly. Not sure what othe

[freenet-dev] NGRouting merged into unstable branch: unstable build6163

2003-08-31 Thread Toad
NGRouting, and a lot of infrastructure work and some major bugfixes, has been merged into the unstable branch, in build 6163. So that it can have wider testing. Please would everyone running the unstable branch upgrade, try it, and report bugs or interesting error messages. Merge was from ngrouting

[freenet-dev] ngrouting

2003-08-27 Thread Niklas Bergh
Using latest CVS: Last connected never Last attempted 3691s ago Connection attempts 60 Connection successes 0 Consecutive failed connections 60 Probability of connection failure 0.984675044593 Successful transfers 32 Does never equal 3691 seconds ago? Can 32 successful transfers have been per

[freenet-dev] NGRouting test suggestion

2003-08-14 Thread Some Guy
Before we turn NGR loose in a release, perhaps it would be a good idea to do one little test, at least if it's not to hard. I've heard NGR has been tested on single nodes and shown good results. Could we measure the results for queries passing throught the node with different HTLs independently.

Re: [freenet-dev] NGRouting formula summary

2003-07-29 Thread Toad
One point. In order to predict accurately, and therefore route accurately, we want to adjust T_success(node, key) by both htl and size - and since the search is separate, we get P_success(node, key) * (T_search_success(node, key)*htl + T_transfer(node, key)/keysize) The other possibility is to

Re: [freenet-dev] NGRouting formula summary

2003-07-24 Thread Ed Tomlinson
On July 24, 2003 11:48 am, Toad wrote: > On Wed, Jul 23, 2003 at 09:34:21PM -0400, Ed Tomlinson wrote: > > On July 23, 2003 05:35 pm, Toad wrote: > > > Another term then: > > > > > > ... + (P(searchFailed(node) * (T_searchFailed(node) + T_req(key))) > > > > > > > > > Where T_searchFailed depends o

Re: [freenet-dev] NGRouting formula summary

2003-07-24 Thread Toad
On Wed, Jul 23, 2003 at 09:34:21PM -0400, Ed Tomlinson wrote: > On July 23, 2003 05:35 pm, Toad wrote: > > Another term then: > > > > ... + (P(searchFailed(node) * (T_searchFailed(node) + T_req(key))) > > > > > > Where T_searchFailed depends on the HTL. > > This one may help. > > > And then ther

Re: [freenet-dev] NGrouting and random first step

2003-07-23 Thread Ed Tomlinson
On July 22, 2003 08:41 pm, Ian Clarke wrote: > On Tue, Jul 22, 2003 at 08:30:16PM -0400, Andrew Rodland wrote: > > Please don't let's forget that random first hop is the only thing that > > makes retrying of any use after we reach HTL=25 and want to keep trying, > > because of ftable. And I think t

Re: [freenet-dev] NGRouting formula summary

2003-07-23 Thread Ed Tomlinson
On July 23, 2003 05:35 pm, Toad wrote: > Another term then: > > ... + (P(searchFailed(node) * (T_searchFailed(node) + T_req(key))) > > > Where T_searchFailed depends on the HTL. This one may help. > And then there is transfer failure. Which theoretically depends on the > > message length... anyw

Re: [freenet-dev] NGRouting formula summary

2003-07-23 Thread Ed Tomlinson
On July 23, 2003 02:15 pm, Ian Clarke wrote: > On Wed, Jul 23, 2003 at 06:56:16PM +0100, Toad wrote: > > Running averages (presumably we would have one global sensitivity > > parameter): > > Not necessarily, but in-practice, there is no reason not to until we > have developed a more enlightened way

Re: [freenet-dev] NGRouting formula summary

2003-07-23 Thread Toad
On Wed, Jul 23, 2003 at 03:13:58PM -0700, Ian Clarke wrote: > One thought - if we are maintaining open connections to all routable > nodes - then surely the NGR routing algorithm shouldn't have to worry > about connectFailed and authFailed problems - as such nodes wouldn't even > be considered?

Re: [freenet-dev] NGRouting formula summary

2003-07-23 Thread Ian Clarke
One thought - if we are maintaining open connections to all routable nodes - then surely the NGR routing algorithm shouldn't have to worry about connectFailed and authFailed problems - as such nodes wouldn't even be considered? Ian. On Wed, Jul 23, 2003 at 10:35:21PM +0100, Toad wrote: > Some

Re: [freenet-dev] NGRouting formula summary

2003-07-23 Thread Toad
Some more terms to add on methinks. out of Routing, connectFailed, authFailed (treated as connectFailed for now), and queryRejected are accounted for. What about timedOut()? Maybe we should treat it as queryRejected. What about timing out mid query? Another term then: ... + (P(searchFailed(node)

Re: [freenet-dev] NGRouting formula summary

2003-07-23 Thread Ian Clarke
On Wed, Jul 23, 2003 at 11:53:55AM -0700, Rudi Cilibrasi wrote: > It seems clear from a simple thought-experiment that for some machines, > network outages may be on the order of ten seconds, and for others on > the order of days. This seems to imply that no single value for > a multiplier in an e

Re: [freenet-dev] NGRouting formula summary

2003-07-23 Thread Ian Clarke
On Wed, Jul 23, 2003 at 06:56:16PM +0100, Toad wrote: > Okay, what seems to me to be the current algorithm: > > E = (1 - (P_connectfailed(node) + P_queryRejected(node))) * > (P_success(node, key) * T_success(node, key) + > (P_DNF(node, key) - P_legit_DNF) * (T_DNF(node, key) + T_req(key

Re: [freenet-dev] NGRouting formula summary

2003-07-23 Thread Rudi Cilibrasi
On Wed, Jul 23, 2003 at 06:56:16PM +0100, Toad wrote: > Okay, what seems to me to be the current algorithm: > > E = (1 - (P_connectfailed(node) + P_queryRejected(node))) * > (P_success(node, key) * T_success(node, key) + > (P_DNF(node, key) - P_legit_DNF) * (T_DNF(node, key) + T_req(ke

Re: [freenet-dev] NGRouting formula summary

2003-07-23 Thread Ian Clarke
On Wed, Jul 23, 2003 at 06:56:16PM +0100, Toad wrote: > Running averages (presumably we would have one global sensitivity > parameter): Not necessarily, but in-practice, there is no reason not to until we have developed a more enlightened way to decide on what the forgetfulness of the running aver

[freenet-dev] NGRouting formula summary

2003-07-23 Thread Toad
Okay, what seems to me to be the current algorithm: E = (1 - (P_connectfailed(node) + P_queryRejected(node))) * (P_success(node, key) * T_success(node, key) + (P_DNF(node, key) - P_legit_DNF) * (T_DNF(node, key) + T_req(key))) + (P_connectfailed(node) * (T_connectfailed(node) + T_re

Re: [freenet-dev] NGrouting and random first step

2003-07-22 Thread Ian Clarke
On Wed, Jul 23, 2003 at 12:05:28AM +0100, Toad wrote: > The main argument put forward at the time was to prevent the network > from dividing into islands, or to stitch it back together when they did > form. Yes, however there has never been a single known instance of this happening, either in rea

Re: [freenet-dev] NGrouting and random first step

2003-07-22 Thread Ian Clarke
On Tue, Jul 22, 2003 at 08:30:16PM -0400, Andrew Rodland wrote: > Please don't let's forget that random first hop is the only thing that > makes retrying of any use after we reach HTL=25 and want to keep trying, > because of ftable. And I think that people will agree with me, that as > it stands

Re: [freenet-dev] NGrouting and random first step

2003-07-22 Thread Juiceman
ly 22, 2003 8:30 PM Subject: Re: [freenet-dev] NGrouting and random first step -BEGIN PGP SIGNED MESSAGE-Hash: SHA1 Ian Clarke wrote:||Bottom line, the whole random routing thing was a solution to a problem|that nobody ever observed, and in all liklihood - would never|actually

Re: [freenet-dev] NGrouting and random first step

2003-07-22 Thread Toad
On Mon, Jul 21, 2003 at 11:45:59AM -0700, Ian Clarke wrote: > On Mon, Jul 21, 2003 at 07:02:46PM +0100, Toad wrote: > > On Thu, Jul 03, 2003 at 11:40:18AM -0700, Ian Clarke wrote: > > > If my memory serves me correctly, we currently select the first step in > > > routing at random as a security me

Re: [freenet-dev] NGrouting and random first step

2003-07-22 Thread Tom Kaitchuck
On Tuesday 22 July 2003 06:05 pm, Toad wrote: > The main argument put forward at the time was to prevent the network > from dividing into islands, or to stitch it back together when they did > form. However, random routing every request on the origin node is not the > only way to deal with it - one

Re: [freenet-dev] NGrouting and random first step

2003-07-22 Thread Andrew Rodland
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Ian Clarke wrote: | |Bottom line, the whole random routing thing was a solution to a problem |that nobody ever observed, and in all liklihood - would never |actually occur in practice. Please don't let's forget that random first hop is the only thing t

Re: [freenet-dev] NGrouting and random first step

2003-07-21 Thread Ian Clarke
On Mon, Jul 21, 2003 at 07:02:46PM +0100, Toad wrote: > On Thu, Jul 03, 2003 at 11:40:18AM -0700, Ian Clarke wrote: > > If my memory serves me correctly, we currently select the first step in > > routing at random as a security measure. > > > > Translating this over to NGrouting, I suggest that f

Re: [freenet-dev] NGrouting and random first step

2003-07-21 Thread Toad
On Thu, Jul 03, 2003 at 11:40:18AM -0700, Ian Clarke wrote: > If my memory serves me correctly, we currently select the first step in > routing at random as a security measure. > > Translating this over to NGrouting, I suggest that for the first hop in > a request, instead of using the RTE to es

Re: [freenet-dev] NGrouting

2003-07-17 Thread Aeloria Resa
Ian Clarke wrote: Well, Ed has what I understand to be a working implementation of NG routing in the experimental branch - and I really want to get the ball rolling with it. To help this along, I have now make the snapshot generation script generate a new snapshot of the experimental branch wh

[freenet-dev] NGrouting

2003-07-17 Thread Ian Clarke
Well, Ed has what I understand to be a working implementation of NG routing in the experimental branch - and I really want to get the ball rolling with it. To help this along, I have now make the snapshot generation script generate a new snapshot of the experimental branch which can be downloa

Re: [freenet-dev] NGRouting for Dummies

2003-07-05 Thread Todd Walton
Thank you for this. Your explanation makes things clear. -todd On Fri, 4 Jul 2003, Ed Tomlinson wrote: > NG is really quite simple. What it does is attempt to find the route that will > respond fastest for a given key. It does this by tracking how long various > events take. > > The curre

RE: [freenet-dev] NGrouting and random first step

2003-07-04 Thread Niklas Bergh
> On July 3, 2003 03:11 pm, Ian Clarke wrote: > > On Thu, Jul 03, 2003 at 01:46:39PM -0500, Tom Kaitchuck wrote: > > > On Thursday 03 July 2003 01:40 pm, Ian Clarke wrote: > > > > step in routing at random as a security measure. > > > > > > Forgive my ignorance, but how does this provide security?

Re: [freenet-dev] NGRouting for Dummies

2003-07-04 Thread Greg Wooledge
[EMAIL PROTECTED] ([EMAIL PROTECTED]) wrote: > Ah, much clearer now. Would the experimental branch be the same as unstable? > If not, how do I get ahold of it? No, it's not. You'd get it by doing a "cvs -z3 update -dP -r experimental" but since you're not a developer, you'd be going through SF'

Re: [freenet-dev] NGRouting for Dummies

2003-07-04 Thread Erendil
Ah, much clearer now. Would the experimental branch be the same as unstable? If not, how do I get ahold of it?

Re: [freenet-dev] NGRouting for Dummies

2003-07-04 Thread Ed Tomlinson
On July 3, 2003 10:24 pm, [EMAIL PROTECTED] wrote: > Alright, can someone give a quick overview of the NGRouting, like Ian gave > at his talk at Stanford...I think it was? > > The idiot sitting here in this chair wishes enlightenment beyond taoism. NG is really quite simple. What it does is attem

Re: [freenet-dev] NGrouting and random first step

2003-07-04 Thread Ed Tomlinson
On July 3, 2003 03:11 pm, Ian Clarke wrote: > On Thu, Jul 03, 2003 at 01:46:39PM -0500, Tom Kaitchuck wrote: > > On Thursday 03 July 2003 01:40 pm, Ian Clarke wrote: > > > If my memory serves me correctly, we currently select the first step in > > > routing at random as a security measure. > > > >

Re: [freenet-dev] NGrouting and random first step

2003-07-04 Thread Ed Tomlinson
On July 3, 2003 02:40 pm, Ian Clarke wrote: > If my memory serves me correctly, we currently select the first step in > routing at random as a security measure. > > Translating this over to NGrouting, I suggest that for the first hop in > a request, instead of using the RTE to estimate the per-key

[freenet-dev] NGRouting for Dummies

2003-07-03 Thread Erendil
Alright, can someone give a quick overview of the NGRouting, like Ian gave at his talk at Stanford...I think it was? The idiot sitting here in this chair wishes enlightenment beyond taoism.

Re: [freenet-dev] NGrouting and random first step

2003-07-03 Thread Toad
On Thu, Jul 03, 2003 at 12:11:59PM -0700, Ian Clarke wrote: > On Thu, Jul 03, 2003 at 01:46:39PM -0500, Tom Kaitchuck wrote: > > On Thursday 03 July 2003 01:40 pm, Ian Clarke wrote: > > > If my memory serves me correctly, we currently select the first step in > > > routing at random as a security m

Re: [freenet-dev] NGrouting and random first step

2003-07-03 Thread Ian Clarke
On Thu, Jul 03, 2003 at 01:46:39PM -0500, Tom Kaitchuck wrote: > On Thursday 03 July 2003 01:40 pm, Ian Clarke wrote: > > If my memory serves me correctly, we currently select the first step in > > routing at random as a security measure. > > Forgive my ignorance, but how does this provide securit

Re: [freenet-dev] NGrouting and random first step

2003-07-03 Thread Tom Kaitchuck
On Thursday 03 July 2003 01:40 pm, Ian Clarke wrote: > If my memory serves me correctly, we currently select the first step in > routing at random as a security measure. Forgive my ignorance, but how does this provide security? ___ devl mailing list [EMA

[freenet-dev] NGrouting and random first step

2003-07-03 Thread Ian Clarke
If my memory serves me correctly, we currently select the first step in routing at random as a security measure. Translating this over to NGrouting, I suggest that for the first hop in a request, instead of using the RTE to estimate the per-key request time estimate, we use a random number betw

[freenet-dev] NGrouting and NIO

2003-06-16 Thread Toad
We ABSOLUTELY MUST NOT implement NGrouting, or edt's new CP algorithm, until NIO is in. Because we do not want to introduce a bias favouring nodes with connections already open, when we have the current situation where nodes cannot keep anything like enough connections open. GJ just fixed a bug lik

[freenet-dev] NGrouting next steps

2003-04-12 Thread Ian Clarke
I think the next step with NGrouting is to optomize the various parameters to ensure that the RoutingTimeEstimator that MJR wrote can produce good estimates. The best way to do this is to add some temporary code which outputs reference/key/routing time data to a file which can be used as a tes