Re: [freenet-dev] RE: Next Generation Routing -- offer to help

2003-07-22 Thread Rudi Cilibrasi
On Tue, Jul 22, 2003 at 12:27:33PM -0400, Zlatin Balevsky wrote: > do you think we could use that to make global estimates across all > nodes, i.e. instead of estimating the response time for each node in the > rt and then choosing the best, could we add the routingTable contents as > a discrete

Re: [freenet-dev] NGrouting and random first step

2003-07-22 Thread Ian Clarke
On Wed, Jul 23, 2003 at 12:05:28AM +0100, Toad wrote: > The main argument put forward at the time was to prevent the network > from dividing into islands, or to stitch it back together when they did > form. Yes, however there has never been a single known instance of this happening, either in rea

Re: [freenet-dev] NGrouting and random first step

2003-07-22 Thread Ian Clarke
On Tue, Jul 22, 2003 at 08:30:16PM -0400, Andrew Rodland wrote: > Please don't let's forget that random first hop is the only thing that > makes retrying of any use after we reach HTL=25 and want to keep trying, > because of ftable. And I think that people will agree with me, that as > it stands

Re: [freenet-dev] weird, probably NIO related bug

2003-07-22 Thread Toad
Is this reproducible? Could you explain what the observed problem is in more detail? On Fri, Jul 18, 2003 at 01:06:24AM +1000, fish wrote: > That bug that no-one else was able to reproduce came back for long enough for me to > investigate it. I think that's good... :-p > > The issue: when readi

Re: [freenet-dev] NGrouting and random first step

2003-07-22 Thread Juiceman
Doesn't this cause less than optimal specialization?  Maybe the data would have been found in less than that 25 htl if your node heads in the right direction in the first place? - Original Message - From: Andrew Rodland To: [EMAIL PROTECTED] Sent: Tuesday, July 22, 20

[freenet-dev] request to client developers

2003-07-22 Thread Edgar Friendly
Calling all client developers: I'm revising the metadata spec to take into account actual usage of metadata in freenet clients. I wish I had time to go through everyone's source code and understand things from that perspective, but instead I'm hoping to just talk to all of you about how you use

[freenet-dev] Re: small debugging feature patch

2003-07-22 Thread Zenaan Harkness
On Wed, 2003-07-23 at 11:39, Zenaan Harkness wrote: > -- > And finally, for the error I face, another feature request (if it makes > sense: perhaps freenet should check to see if /var/lib/freenet/node-tmp > exists and if not, create it ?? I can do this now, but my current setup > has tm

[freenet-dev] small debugging feature patch

2003-07-22 Thread Zenaan Harkness
Well, not quite a patch, but, when Java fails to start, due to the --background option of start-stop-daemon (in /etc/init.d/freenet[-unstable]), _no errors are displayed_. I just spent a couple hours tracking this down (I haven't done much GNU/ Linux development) and so I recommend putting this at

[freenet-dev] Freenet Stable Build 5016

2003-07-22 Thread Toad
Freenet stable build 5016 is now available. Update to it using the update utility or get it from the snapshots page at http://freenetproject.org/snapshots/ . Changes (a ton, mostly not mine): * Implemented support for ZIP containers (fish's work, slightly tweaked by me). Supported by the client

Re: [freenet-dev] RE: Next Generation Routing -- offer to help

2003-07-22 Thread Tom Kaitchuck
On Tuesday 22 July 2003 08:47 pm, Zlatin Balevsky wrote: > To avoid this perhaps its better to use a single SVM for success/failure > which takes into account all previous samples for all nodes. The learning > datums for this SVM should however be 3 dimensional: Then couldn't one node return failur

Re: [freenet-dev] NGrouting and random first step

2003-07-22 Thread Toad
On Mon, Jul 21, 2003 at 11:45:59AM -0700, Ian Clarke wrote: > On Mon, Jul 21, 2003 at 07:02:46PM +0100, Toad wrote: > > On Thu, Jul 03, 2003 at 11:40:18AM -0700, Ian Clarke wrote: > > > If my memory serves me correctly, we currently select the first step in > > > routing at random as a security me

[freenet-dev] RE: Next Generation Routing -- offer to help

2003-07-22 Thread Zlatin Balevsky
The first SVM will predict if the request will succeed or fail. that's going one step ahead of what we thought so far.. interesting idea. However, i'm against using it on nodes for which we have very little learning data. When a new node is introduced to the network, its is very inefficient at f

Re: [freenet-dev] NGrouting and random first step

2003-07-22 Thread Tom Kaitchuck
On Tuesday 22 July 2003 06:05 pm, Toad wrote: > The main argument put forward at the time was to prevent the network > from dividing into islands, or to stitch it back together when they did > form. However, random routing every request on the origin node is not the > only way to deal with it - one

Re: [freenet-dev] node effectively stalled

2003-07-22 Thread Toad
On Tue, Jul 22, 2003 at 03:46:13AM -0400, Mathew Ryden wrote: > My node (5015) is rejecting all connections due to the fact that it thinks > that it is 100% loaded. Most likely that comes from the 63 active pooled > jobs (at 157.5%). Umm, you are running with maximumThreads=40? What did you expect

Re: [freenet-dev] NGrouting and random first step

2003-07-22 Thread Andrew Rodland
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Ian Clarke wrote: | |Bottom line, the whole random routing thing was a solution to a problem |that nobody ever observed, and in all liklihood - would never |actually occur in practice. Please don't let's forget that random first hop is the only thing t

Re: [freenet-dev] Next Generation Routing -- offer to help

2003-07-22 Thread Rudi Cilibrasi
On Tue, Jul 22, 2003 at 09:12:04AM -0700, Ian Clarke wrote: > Thanks for the info. I would be very curious, given your understanding > of what is available in the ML field, how you think it might compare to > our current "home grown" solution? Are there specific advantages you > can identify? Le

Re: [freenet-dev] FCP protocol problems/questions

2003-07-22 Thread Toad
On Wed, Jul 16, 2003 at 10:36:58AM -0500, Edgar Friendly wrote: > [EMAIL PROTECTED] writes: > > > > > Yeah, that's what I'm thinking and I've gone with just ignoring those > > DataChunks. > > > > > The thing is, Restarted messages after the data has started streaming > through should be almost

Re: [freenet-dev] Establishing connections in NG Routing

2003-07-22 Thread Edgar Friendly
Andrew Rodland <[EMAIL PROTECTED]> writes: > IIRC, since the "backoff" deallie went away, the criterion for > dropping nodes is their CP going below minCP (0.01 by default). > > --hobbs > I looked around a lot in the source, and while there's code indicative of this kind of behavior in the past

Re: [freenet-dev] Disconnected Operation

2003-07-22 Thread Greg Wooledge
Todd Walton ([EMAIL PROTECTED]) wrote: > I've fetched all three DBR sites today, so they've passed through my > datastore. So if my node can fetch the edition sites from the local > datastore, shouldn't it also be able to fetch the DBR page? Welcome to probabilistic caching, alias "the big dat

[freenet-dev] no more kaffe bitching pls

2003-07-22 Thread Zlatin Balevsky
hello kaffe zealots, now there's a branch in cvs called "non-nio". Everything non-nio dependend will be backported from branch stable BY YOU!!! Please keep the build numbers the same as the stable build you backported from. I'm not sure whether we'll provide binaries for download, its up to

Re: [freenet-dev] Establishing connections in NG Routing

2003-07-22 Thread Edgar Friendly
Ian Clarke <[EMAIL PROTECTED]> writes: > On Tue, Jul 22, 2003 at 01:52:04PM -0500, Edgar Friendly wrote: > > > Drop nodes? We don't drop nodes based on CP, do we? > > > > > IIRC, the node in the RT with the lowest CP is dropped to make room > > for a new node. > > I hope not, references are supp

Re: [freenet-dev] Establishing connections in NG Routing

2003-07-22 Thread Andrew Rodland
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Ian Clarke wrote: |>IIRC, the node in the RT with the lowest CP is dropped to make room |>for a new node. | | |I hope not, references are supposed to be dropped on an LRU basis, not |on the basis of their CP. If someone change that then it is a miracl

Re: [freenet-dev] Establishing connections in NG Routing

2003-07-22 Thread Ian Clarke
On Tue, Jul 22, 2003 at 01:52:04PM -0500, Edgar Friendly wrote: > > Drop nodes? We don't drop nodes based on CP, do we? > > > IIRC, the node in the RT with the lowest CP is dropped to make room > for a new node. I hope not, references are supposed to be dropped on an LRU basis, not on the basis

Re: [freenet-dev] Establishing connections in NG Routing

2003-07-22 Thread Edgar Friendly
Toad <[EMAIL PROTECTED]> writes: > > This is basicily what the current code tries to do. Quite probably I should > > make nodes that do not have connection have a very low CP. Note about > > the only thing CP is used for the NG code to to drop nodes (and give the > > sort order for the display s

Re: [freenet-dev] Establishing connections in NG Routing

2003-07-22 Thread Toad
On Mon, Jul 21, 2003 at 08:37:14AM -0400, Ed Tomlinson wrote: > On July 20, 2003 03:53 pm, Ian Clarke wrote: > > A thought just occurred to me. It is quite possible, that from the > > perspective of the NG routing algorithm - that it will be preferable to > > send a request to a poorly suited node

Re: [freenet-dev] cli bug regarding SSK entropy?

2003-07-22 Thread Toad
Fixed in unstable. On Thu, Jul 17, 2003 at 01:00:38AM +0100, Toad wrote: > On Wed, Jul 16, 2003 at 10:05:57PM +0200, Michael Schierl wrote: > > Hi, > > > > - > > C:\Programme\Internet\Freenet0.5>java -cp freenet.jar \ > > freenet.client.cli.Main genkeys > > log level: normal - 8 > > Stat

Re: [freenet-dev] Freenet browsing from 12:00-1:00

2003-07-22 Thread Toad
On Tue, Jul 22, 2003 at 07:26:12AM -0400, Ed Tomlinson wrote: > On July 21, 2003 04:22 pm, Ian Clarke wrote: > > On Mon, Jul 21, 2003 at 08:50:33PM +0100, Toad wrote: > > > Umm, no. Random first hop was introduced to avoid the network forking... > > > anyway, how would this improve getting DBRs? >

Re: [freenet-dev] /. story on NG routing imminent - please comment

2003-07-22 Thread Edgar Friendly
Tom Kaitchuck <[EMAIL PROTECTED]> writes: > On Monday 21 July 2003 11:26 am, Frank v Waveren wrote: > > On Sun, Jul 20, 2003 at 09:42:41PM -0500, Tom Kaitchuck wrote: > > > Huh? re-retrieval? Even if we are not the originator of a request and one > > > node returns Data not found, we try another,

[freenet-dev] Re: [freenet-CVS] freenet/src/freenet/interfaces NIOInterface.java,1.4,1.5

2003-07-22 Thread Toad
On Sat, Jul 19, 2003 at 07:25:26AM -0700, Zlatin Balevsky wrote: > Update of /cvsroot/freenet/freenet/src/freenet/interfaces > In directory sc8-pr-cvs1:/tmp/cvs-serv4764/src/freenet/interfaces > > Modified Files: > NIOInterface.java > Log Message: > move closures on LSL thread to avoid IOEs

Re: [freenet-dev] RE: Next Generation Routing -- offer to help

2003-07-22 Thread Ian Clarke
> If its possible to use 3d vectors (3rd dimension being the node that > we'll route to), we'll have only ~10 invocations per second, but the > sample points will be between 500 and 5000, will that yield better cpu time? I don't know if that would make sense since there would be no relation bet

Re: [freenet-dev] Debian issues

2003-07-22 Thread Ian Clarke
On Tue, Jul 15, 2003 at 06:00:07PM +0100, Toad wrote: > We cannot make a non-sun-dependant Freenet. ...at this moment in time, but Kaffe's java.nio stuff is progressing rapidly. > You cannot make a package > of Sun Java, maybe not even an installer package. We apparently care > more about the wi

[freenet-dev] RE: Next Generation Routing -- offer to help

2003-07-22 Thread Zlatin Balevsky
libsvm is really cool, even has a idi^H^H^H beginner's guide to using it ;) do you think we could use that to make global estimates across all nodes, i.e. instead of estimating the response time for each node in the rt and then choosing the best, could we add the routingTable contents as a disc

Re: [freenet-dev] Next Generation Routing -- offer to help

2003-07-22 Thread Ian Clarke
Rudi, Thanks for the info. I would be very curious, given your understanding of what is available in the ML field, how you think it might compare to our current "home grown" solution? Are there specific advantages you can identify? It may also be the case that we have inadvertently re-invented

[freenet-dev] Next Generation Routing -- offer to help

2003-07-22 Thread Rudi Cilibrasi
Greetings Freenet Developers, First, let me congratulate you all on creating the tremendously important Freenet project. I am an open-source developer and PhD student in the Netherlands. I have been following the Freenet project for some years now, and just recently came across Ian's article des

Re: [freenet-dev] nim killer active link on tfe kills mozilla/firebird browsers

2003-07-22 Thread palomitas
On Fri, 18 Jul 2003 23:24:48 -0700 pineapple <[EMAIL PROTECTED]> wrote: >Just wanted to say that there is an active link on TFE >called NIM Killer that crashes mozilla/firebird >browsers. Because of that image I had to change my standard Freenet browser. I've also been using Mozilla Firebird and

Re: [freenet-dev] nim killer active link on tfe kills mozilla/firebirdbrowsers

2003-07-22 Thread Dave Hooper
> The image is malformed - it crashes all broswers (with images) so far, > photoshop, windows preview, windows paint, GIMP, etc..basically anything > that loads an image, it will lock it up and crash it. Right, but I don't see how that's Freenet's fault. I'm guessing that this file could exist on

Re: [freenet-dev] 6508 observations

2003-07-22 Thread Ed Tomlinson
On July 22, 2003 06:10 am, Kevin Steen wrote: I suspect that updating your seed nodes _might_ help here. It also might stabilize with better number after running longer. Most of my testing has been with 8-12hour runs. Thanks for trying it. Ed > After 2 hours running 6508 (freenet-exp-20030

Re: [freenet-dev] 6508 experimental: array index out of bounds when reducing rtMaxNodes

2003-07-22 Thread Ed Tomlinson
On July 22, 2003 03:56 am, Menno Jonkers wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > Hi, > > Had a 6508 node running smoothly with rtMaxNodes at 100. Then reduced > that to 50 (supposedly sufficient for NGR). This caused it to throw > ArrayIndexOutOfBound exceptions, see below. Bac

Re: [freenet-dev] overload!

2003-07-22 Thread Ed Tomlinson
On July 22, 2003 12:09 am, Tom Kaitchuck wrote: > On Monday 21 July 2003 10:24 pm, pineapple wrote: > > Ack! What's happening? My poor, pathetic little node > > is running on default config yet my local load is > > +40K, +280 connections transmitting to! I'm guessing > > that each connection is

Re: [freenet-dev] Freenet browsing from 12:00-1:00

2003-07-22 Thread Ed Tomlinson
On July 21, 2003 04:22 pm, Ian Clarke wrote: > On Mon, Jul 21, 2003 at 08:50:33PM +0100, Toad wrote: > > Umm, no. Random first hop was introduced to avoid the network forking... > > anyway, how would this improve getting DBRs? > > Ah yes, I was trying to remember why that was introduced. Of course

Re: [freenet-dev] Experimental bug in loading seednodes?

2003-07-22 Thread Ed Tomlinson
On July 17, 2003 04:09 pm, Andrew Rodland wrote: > Looks like the experimental branch (build 6507 here) has a problem > loading seednodes. My RT on this system was really stale, so I went to > reseed, and it crashes with an NPE. Checked that it works properly on > the last stable build I have. Retr

[freenet-dev] 6508 observations

2003-07-22 Thread Kevin Steen
After 2 hours running 6508 (freenet-exp-20030722.tgz) here's what the routing stats look like: Number of node references 49 Contacted node references 41 Total Reference Keys 345 Node references requesting ARKs 1 Route Trials 27488 Route Successes 3368 Cached Trials 14302 Cached Succ

Re: [freenet-dev] Freenet browsing from 12:00-1:00

2003-07-22 Thread Kevin Steen
At 22/07/2003 02:19, you wrote: >On Monday 21 July 2003 02:50 pm, Toad wrote: >> > 4. If a site fails, automatically try altdbrurl BEFORE prompting the >> > user. 5. If we are using altdbrurl or a previous dated copy, make that >> > apply to the ENTIRE SITE. There is nothing worse then getting an e

[freenet-dev] 6508 experimental: array index out of bounds when reducing rtMaxNodes

2003-07-22 Thread Menno Jonkers
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi, Had a 6508 node running smoothly with rtMaxNodes at 100. Then reduced that to 50 (supposedly sufficient for NGR). This caused it to throw ArrayIndexOutOfBound exceptions, see below. Back to 100 and life was fine again. Probably also if I reseeded.

[freenet-dev] node effectively stalled

2003-07-22 Thread Mathew Ryden
My node (5015) is rejecting all connections due to the fact that it thinks that it is 100% loaded. Most likely that comes from the 63 active pooled jobs (at 157.5%). The node is actually using something like 3% cpu when it peaks. it's maintaining 343 open connections, but only 12 of them are trans