Re: [freenet-dev] Re: estimate DNF - real DF

2003-11-20 Thread Ken Corson
Martin Stone Davis wrote: I think you're jumping ahead a little too quick. We haven't even seen the potential of QR backoff yet because we haven't upped lastGoodBuild and lots of queries *seem* (Ken?) to be coming from older nodes. That in itself should reduce the number of QRs dramatically.

[freenet-dev] Data disappearing from DS

2003-11-20 Thread Niklas Bergh
I recently started a new node.. After about 4 hrs of uptime it had downloaded about 100 meg data and had accumulated around 290 keys in the store... Then I restarted the node and when it came up again the ds was reported as containing only 37 meg of data and 160 keys... Any idea why this

[freenet-CVS] freenet/src/freenet/support/servlet/http HttpSupport.java, 1.3, 1.4

2003-11-20 Thread Edward J. Huff
Update of /cvsroot/freenet/freenet/src/freenet/support/servlet/http In directory sc8-pr-cvs1:/tmp/cvs-serv17801 Modified Files: HttpSupport.java Log Message: Fix exception in parseCookie: java.lang.StringIndexOutOfBoundsException: String index out of range Couldn't test this because I

Re: [freenet-dev] Re: Backoff on nodes dropped from RT?

2003-11-20 Thread Edgar Friendly
Ian Clarke [EMAIL PROTECTED] writes: Toad wrote: Is there any reason not to keep the backoff data when a node is dropped from the routing table? Provided we delete it sometime, probably not. Ian. Why stop at just keeping backoff data? Keep routing information to nodes we aren't

Re: Ouch was Re: [freenet-dev] Additional ways to reduce load aside from QR.

2003-11-20 Thread Edgar Friendly
Toad [EMAIL PROTECTED] writes: I do now. However, it is a way that a node could hurt the network without being proportionately punished for it in the estimators - if I reinstate it, then nodes that QR with HTL 0, killing the request, will be treated the same as nodes that QR at any other HTL.

Re: [freenet-dev] Data disappearing from DS

2003-11-20 Thread Niklas Bergh
Whops.. I did it again. Before restart: 592 megs in 3764 keys in the ds After restart: 488 megs in 1345 keys in the ds The numbers above are from the enironment page. The next time I restart I'll try to have a look at the actual number of files in the store before I restart (the numbers after

Re: [freenet-dev] Re: Backoff on nodes dropped from RT?

2003-11-20 Thread Toad
On Thu, Nov 20, 2003 at 12:13:17PM -0600, Edgar Friendly wrote: Ian Clarke [EMAIL PROTECTED] writes: Toad wrote: Is there any reason not to keep the backoff data when a node is dropped from the routing table? Provided we delete it sometime, probably not. Ian. Why stop

Re: [freenet-dev] Data disappearing from DS

2003-11-20 Thread Toad
On Thu, Nov 20, 2003 at 10:11:52PM +0100, Niklas Bergh wrote: Whops.. I did it again. Before restart: 592 megs in 3764 keys in the ds After restart: 488 megs in 1345 keys in the ds The numbers above are from the enironment page. The next time I restart I'll try to have a look at the

Re: [freenet-dev] Data disappearing from DS

2003-11-20 Thread Niklas Bergh
Before restart: 592 megs in 3764 keys in the ds After restart: 488 megs in 1345 keys in the ds The numbers above are from the enironment page. The next time I restart I'll try to have a look at the actual number of files in the store before I restart (the numbers after the restart seems

[freenet-CVS] freenet/src/freenet/interfaces FreenetConnectionRunner.java, 1.20, 1.21

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet/interfaces In directory sc8-pr-cvs1:/tmp/cvs-serv24137/src/freenet/interfaces Modified Files: FreenetConnectionRunner.java Log Message: 6343: Logging. Catch and log throwables caught starting up interfaces, rather than killing ALL

[freenet-CVS] freenet/src/freenet/node Main.java,1.309,1.310

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet/node In directory sc8-pr-cvs1:/tmp/cvs-serv24137/src/freenet/node Modified Files: Main.java Log Message: 6343: Logging. Catch and log throwables caught starting up interfaces, rather than killing ALL interfaces when one throws. Add new

[freenet-CVS] freenet/src/freenet/node/states/data SendData.java, 1.35, 1.36

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet/node/states/data In directory sc8-pr-cvs1:/tmp/cvs-serv24137/src/freenet/node/states/data Modified Files: SendData.java Log Message: 6343: Logging. Catch and log throwables caught starting up interfaces, rather than killing ALL interfaces

[freenet-CVS] freenet/src/freenet Version.java, 1.538, 1.539 Core.java, 1.54, 1.55 ConnectionHandler.java, 1.209, 1.210 OpenConnectionManager.java, 1.169, 1.170

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet In directory sc8-pr-cvs1:/tmp/cvs-serv24137/src/freenet Modified Files: Version.java Core.java ConnectionHandler.java OpenConnectionManager.java Log Message: 6343: Logging. Catch and log throwables caught starting up interfaces,

[freenet-CVS] freenet/src/freenet/node/states/request ReceivingInsert.java, 1.29, 1.30 SendingReply.java, 1.29, 1.30

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet/node/states/request In directory sc8-pr-cvs1:/tmp/cvs-serv24137/src/freenet/node/states/request Modified Files: ReceivingInsert.java SendingReply.java Log Message: 6343: Logging. Catch and log throwables caught starting up interfaces, rather

[freenet-CVS] freenet/src/freenet/node/states/data SendData.java, 1.36, 1.37

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet/node/states/data In directory sc8-pr-cvs1:/tmp/cvs-serv1585/src/freenet/node/states/data Modified Files: SendData.java Log Message: 6344: Even more stats. Even more logging. Catch some corner cases in .received(DataReceived)'s. Ignore a

[freenet-CVS] freenet/src/freenet/node/states/request TransferReply.java, 1.20, 1.21 TransferInsert.java, 1.19, 1.20

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet/node/states/request In directory sc8-pr-cvs1:/tmp/cvs-serv1585/src/freenet/node/states/request Modified Files: TransferReply.java TransferInsert.java Log Message: 6344: Even more stats. Even more logging. Catch some corner cases in

[freenet-CVS] freenet/src/freenet/node Main.java,1.310,1.311

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet/node In directory sc8-pr-cvs1:/tmp/cvs-serv1585/src/freenet/node Modified Files: Main.java Log Message: 6344: Even more stats. Even more logging. Catch some corner cases in .received(DataReceived)'s. Ignore a double abort in SendData.

[freenet-CVS] freenet/src/freenet Version.java,1.539,1.540

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet In directory sc8-pr-cvs1:/tmp/cvs-serv1585/src/freenet Modified Files: Version.java Log Message: 6344: Even more stats. Even more logging. Catch some corner cases in .received(DataReceived)'s. Ignore a double abort in SendData. Index:

Re: [freenet-dev] Data disappearing from DS

2003-11-20 Thread Toad
On Fri, Nov 21, 2003 at 12:04:09AM +0100, Niklas Bergh wrote: Before restart: 592 megs in 3764 keys in the ds After restart: 488 megs in 1345 keys in the ds The numbers above are from the enironment page. The next time I restart I'll try to have a look at the actual number of files in

Re: [freenet-dev] Re: Additional ways to reduce load aside from QR.

2003-11-20 Thread Tom Kaitchuck
On Tuesday 18 November 2003 06:41 am, Edward J. Huff wrote: Well, what I want to do is to allow the node to be in control of the backoff time, as follows: When a fluctuation of the success rate results in excess trailers, the node estimates how long they will take to transmit. Then it

Re: Ouch was Re: [freenet-dev] Additional ways to reduce load aside from QR.

2003-11-20 Thread Toad
On Thu, Nov 20, 2003 at 11:58:45AM -0600, Edgar Friendly wrote: Toad [EMAIL PROTECTED] writes: I do now. However, it is a way that a node could hurt the network without being proportionately punished for it in the estimators - if I reinstate it, then nodes that QR with HTL 0, killing the

[freenet-CVS] freenet/src/freenet Version.java,1.540,1.541

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet In directory sc8-pr-cvs1:/tmp/cvs-serv4920/src/freenet Modified Files: Version.java Log Message: 6345: Use the HTL from the QueryRejected. This allows a node to kill requests without any impact in its long term estimators, but we backoff on

[freenet-CVS] freenet/src/freenet/node/states/request Pending.java, 1.82, 1.83

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet/node/states/request In directory sc8-pr-cvs1:/tmp/cvs-serv4920/src/freenet/node/states/request Modified Files: Pending.java Log Message: 6345: Use the HTL from the QueryRejected. This allows a node to kill requests without any impact in its

[freenet-dev] Unstable 6345

2003-11-20 Thread Toad
Unstable 6345 is in CVS and will soon be in the unstable snapshot jar. The main change is the reinstatement of the code to use the HTL value from a QueryRejected. This is because sometimes when we get a QueryRejected, it is because the node sent a query to several nodes and they all rejected it.

[freenet-CVS] freenet/src/freenet/node/states/FNP NewRequest.java, 1.46, 1.47

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet/node/states/FNP In directory sc8-pr-cvs1:/tmp/cvs-serv6962/src/freenet/node/states/FNP Modified Files: NewRequest.java Log Message: 6346: KenMan's patch: Add version to nodes in inboundRequests.txt. Index: NewRequest.java

[freenet-CVS] freenet/src/freenet/node Node.java,1.252,1.253

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet/node In directory sc8-pr-cvs1:/tmp/cvs-serv6962/src/freenet/node Modified Files: Node.java Log Message: 6346: KenMan's patch: Add version to nodes in inboundRequests.txt. Index: Node.java

[freenet-CVS] freenet/src/freenet Version.java, 1.541, 1.542 ContactCounter.java, 1.2, 1.3

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet In directory sc8-pr-cvs1:/tmp/cvs-serv6962/src/freenet Modified Files: Version.java ContactCounter.java Log Message: 6346: KenMan's patch: Add version to nodes in inboundRequests.txt. Index: Version.java

[freenet-CVS] freenet/src/freenet/client/http NodeStatusServlet.java, 1.86, 1.87

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet/client/http In directory sc8-pr-cvs1:/tmp/cvs-serv6962/src/freenet/client/http Modified Files: NodeStatusServlet.java Log Message: 6346: KenMan's patch: Add version to nodes in inboundRequests.txt. Index: NodeStatusServlet.java

[freenet-CVS] freenet/src/freenet/node/states/announcement NewAnnouncement.java, 1.20, 1.21

2003-11-20 Thread Matthew Toseland
Update of /cvsroot/freenet/freenet/src/freenet/node/states/announcement In directory sc8-pr-cvs1:/tmp/cvs-serv6962/src/freenet/node/states/announcement Modified Files: NewAnnouncement.java Log Message: 6346: KenMan's patch: Add version to nodes in inboundRequests.txt. Index:

Re: [freenet-dev] Re: High 'Data waiting to be transfered'

2003-11-20 Thread Ken Corson
Toad wrote: On Wed, Nov 19, 2003 at 04:20:15AM -0800, Martin Stone Davis wrote: Ian Clarke wrote: Niklas Bergh wrote: NGR is designed to take into account a nodes available bw and include that fact in routing decisions. Instead of overloading an already overloaded (bw-wise) node even more NGR

Re: [freenet-dev] Re: High 'Data waiting to be transfered'

2003-11-20 Thread Ken Corson
Ken Corson wrote: trouble. Currently, in my routing table , a significant portion of my routes are backed off for more than 100 seconds. There probably This alone should remind people of the last problem we faced. Namely, that it took several outbound query attempts until it finally got accepted

Re: [freenet-dev] Re: Backoff on nodes dropped from RT?

2003-11-20 Thread Ken Corson
Ian Clarke wrote: Toad wrote: Is there any reason not to keep the backoff data when a node is dropped from the routing table? Provided we delete it sometime, probably not. Yes, there is. Given that it is a completely transient condition, why would we want to remember this unpleasant experience ?

Re: [freenet-dev] Re: Backoff on nodes dropped from RT?

2003-11-20 Thread Ken Corson
Edward J. Huff wrote: On Wed, 2003-11-19 at 17:21, Ian Clarke wrote: Toad wrote: Is there any reason not to keep the backoff data when a node is dropped from the routing table? Provided we delete it sometime, probably not. It seems to me that there is some reasonable maximum backoff period. For

Re: [freenet-dev] Re: Additional ways to reduce load aside from QR.

2003-11-20 Thread Ken Corson
On Tuesday 18 November 2003 06:41 am, Edward J. Huff wrote: Well, what I want to do is to allow the node to be in control of the backoff time, as follows: Can anyone explain how this protocol is vulnerable to attack? Tom Kaitchuck wrote: (Sometimes it's worth while to try a node even if it is

Re: Ouch was Re: [freenet-dev] Additional ways to reduce load aside from QR.

2003-11-20 Thread Ken Corson
Toad wrote: On Thu, Nov 20, 2003 at 11:58:45AM -0600, Edgar Friendly wrote: Toad [EMAIL PROTECTED] writes: I do now. However, it is a way that a node could hurt the network without being proportionately punished for it in the estimators - if I reinstate it, then nodes that QR with HTL 0, killing

[freenet-dev] What to fix next?

2003-11-20 Thread Edward J. Huff
Bottom line: When the expected time to complete a transfer is larger than the expected time before the node is taken down, then that node could just as well stay down permanently. All of the output bandwidth it is consuming is going to be wasted when none of the zillion transfers finish. I think

Re: [freenet-dev] High 'Data waiting to be transfered'

2003-11-20 Thread Ken Corson
Ed Tomlinson wrote: On November 18, 2003 10:06 pm, Toad wrote: On Tue, Nov 18, 2003 at 09:55:54PM -0500, Ed Tomlinson wrote: On November 18, 2003 09:48 pm, Toad wrote: On Tue, Nov 18, 2003 at 09:47:03PM -0500, Ed Tomlinson wrote: On November 18, 2003 05:29 pm, Toad wrote: On Tue, Nov 18, 2003 at