[freenet-dev] CMKs don't work, but there are other options was Re: Easy top block duplication:Content Multiplication Keys

2009-04-24 Thread guido
Am Freitag 24 April 2009 09:50:15 schrieb xor:
> > Multiplication Keys
> >
> > Long CHK keys are ok for me, most important is that they are
> > static and all inserts produces the same key.
>
> I second that. I want the ability to re-insert already inserted files
> without changing the URI.

As I already said, I think the solution for that would be a dedicated FCP heal 
command. This would even allow reinsertion of other people's SSKs

Guido



Re: [freenet-dev] CMKs don't work, but there are other options was Re: Easy top block duplication:Content Multiplication Keys

2009-04-24 Thread guido
Am Freitag 24 April 2009 09:50:15 schrieb xor:
> > Multiplication Keys
> >
> > Long CHK keys are ok for me, most important is that they are
> > static and all inserts produces the same key.
>
> I second that. I want the ability to re-insert already inserted files
> without changing the URI.

As I already said, I think the solution for that would be a dedicated FCP heal 
command. This would even allow reinsertion of other people's SSKs

Guido
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl


[freenet-dev] CMKs don't work, but there are other options was Re: Easy top block duplication: Content Multiplication Keys

2009-04-23 Thread guido
Am Donnerstag 23 April 2009 14:48:43 schrieb Matthew Toseland:
> I would really appreciate input on option 2 i.e. how much of a problem are
> long CHKs?

If CHK key lengths as they are now are not bad enough to keep people from 
using them, then making them 50% longer won't be, either.

Besides, making the pathname of the file a mandatory part of the key is already 
having larger impact on average key lengths then this would.



Re: [freenet-dev] CMKs don't work, but there are other options was Re: Easy top block duplication: Content Multiplication Keys

2009-04-23 Thread guido
Am Donnerstag 23 April 2009 14:48:43 schrieb Matthew Toseland:
> I would really appreciate input on option 2 i.e. how much of a problem are
> long CHKs?

If CHK key lengths as they are now are not bad enough to keep people from 
using them, then making them 50% longer won't be, either.

Besides, making the pathname of the file a mandatory part of the key is already 
having larger impact on average key lengths then this would.
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl


[freenet-dev] FCP "Heal" command (was: Non-convergent encryption kills easy filesharing)

2009-04-22 Thread guido
Am Wednesday 22 April 2009 18:26:05 schrieb Matthew Toseland:
> After a long conversation with p0s, I am fairly sure that our decision at
> last year's summit to use non-convergent encryption for splitfiles (i.e. a
> different set of blocks each time) in order to largely solve our security
> problems will make filesharing on Freenet much less convenient.

I think this could be solved by introducing a "Heal" command to FCP. This 
would take an existing key and a file (or directory) and then try to insert 
that file in exactly the same way in which the given key was inserted, with 
the same mime-type, same compression options and, most importantly, the same 
encryption key for the blocks.

(Obviously that won't do anything for missing top-blocks...)

I'm assuming that non-convergent encryption means to generate a random 
symmetric key every time a file is inserted, encrypt every data block with 
that key and then put the key into the manifest, right next to the metadata.

A potential problem with this is that it could put healers into the same 
uncomfortable position that inserters are in now. Maybe tell people not to 
talk about it if they're reinserting something?

Guido



Re: [freenet-dev] FCP "Heal" command (was: Non-convergent encryption kills easy filesharing)

2009-04-22 Thread guido
Am Wednesday 22 April 2009 18:26:05 schrieb Matthew Toseland:
> After a long conversation with p0s, I am fairly sure that our decision at
> last year's summit to use non-convergent encryption for splitfiles (i.e. a
> different set of blocks each time) in order to largely solve our security
> problems will make filesharing on Freenet much less convenient.

I think this could be solved by introducing a "Heal" command to FCP. This 
would take an existing key and a file (or directory) and then try to insert 
that file in exactly the same way in which the given key was inserted, with 
the same mime-type, same compression options and, most importantly, the same 
encryption key for the blocks.

(Obviously that won't do anything for missing top-blocks...)

I'm assuming that non-convergent encryption means to generate a random 
symmetric key every time a file is inserted, encrypt every data block with 
that key and then put the key into the manifest, right next to the metadata.

A potential problem with this is that it could put healers into the same 
uncomfortable position that inserters are in now. Maybe tell people not to 
talk about it if they're reinserting something?

Guido
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl


[freenet-dev] git/hg hosting

2009-04-08 Thread guido
Am Freitag, 3. April 2009 02:30:09 schrieb Daniel Cheng:
> > NextGen$
> >
> > -BEGIN PGP SIGNATURE-
>
> [..]
>
> > G3IAoIo?
>
> Your pgp signature is charset corrupted.

The pgp signature is pure ASCII, how can it possibly be charset corrupted?

Looks fine to me, btw.

-- 
|  _  | ASCII Ribbon Campaign Against HTML Emails.
| ( ) |
|  X  |
| / \ |



Re: [freenet-dev] git/hg hosting

2009-04-08 Thread guido
Am Freitag, 3. April 2009 02:30:09 schrieb Daniel Cheng:
> > NextGen$
> >
> > -BEGIN PGP SIGNATURE-
>
> [..]
>
> > G3IAoIo⎿伜堏鍙䶞㢈榷㑴
>
> Your pgp signature is charset corrupted.

The pgp signature is pure ASCII, how can it possibly be charset corrupted?

Looks fine to me, btw.

-- 
|  _  | ASCII Ribbon Campaign Against HTML Emails.
| ( ) |
|  X  |
| / \ |
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl

[freenet-dev] 1156 breaks fcp allowed hosts?

2008-08-18 Thread guido
Am Sonntag, 17. August 2008 11:06:06 schrieb Julien Cornuwel:
> digitale a ?crit :
> > I have Frost running on a different machine to the node, it has been
> > working well for many months.
> >
> > I have just noticed that Frost can no longer connect to the node. I can
> > get Frost working by installing it on the same computer as the node.
> >
> > It?s as if the latest update has started to ignore the fcp.allowedHosts
> > setting which lists the ip address of the second machine. I can still
> > access fproxy from the second machine.
> >
> > Both machines are running Windows, no configuration has recently changed.
>
> Same problem here, except both machines are running Linux. Frost always
> says that the node isn't running... Even weirder : jSite works perfectly.

How often have you tested this?

I'm having similar problems, but it seems there is some luck involved there: 
Sometimes it works, sometimes it doesn't. Also, frost gets disconnected 
fairly often during a single session. (Which is obviously bad for board 
updates.)

Guido

-- 
|  _  | ASCII Ribbon Campaign Against HTML Emails.
| ( ) |
|  X  |
| / \ |



Re: [freenet-dev] 1156 breaks fcp allowed hosts?

2008-08-18 Thread guido
Am Sonntag, 17. August 2008 11:06:06 schrieb Julien Cornuwel:
> digitale a écrit :
> > I have Frost running on a different machine to the node, it has been
> > working well for many months.
> >
> > I have just noticed that Frost can no longer connect to the node. I can
> > get Frost working by installing it on the same computer as the node.
> >
> > It’s as if the latest update has started to ignore the fcp.allowedHosts
> > setting which lists the ip address of the second machine. I can still
> > access fproxy from the second machine.
> >
> > Both machines are running Windows, no configuration has recently changed.
>
> Same problem here, except both machines are running Linux. Frost always
> says that the node isn't running... Even weirder : jSite works perfectly.

How often have you tested this?

I'm having similar problems, but it seems there is some luck involved there: 
Sometimes it works, sometimes it doesn't. Also, frost gets disconnected 
fairly often during a single session. (Which is obviously bad for board 
updates.)

Guido

-- 
|  _  | ASCII Ribbon Campaign Against HTML Emails.
| ( ) |
|  X  |
| / \ |
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl

[freenet-dev] Freenet 0.7 build 1135 and 1136

2008-04-11 Thread Guido Winkelmann
Am Freitag, 11. April 2008 17:20:10 schrieb Matthew Toseland:
> On Friday 11 April 2008 16:00, Guido Winkelmann wrote:
> > Am Freitag, 11. April 2008 15:19:57 schrieb Guido Winkelmann:
> >
> > I spoke too early. The wrapper.log looks like this now (see attachment).
> >
> > It looks like if this continues like this, the node will never ever
> > actually start up.
>
> Ouch. That really shouldn't happen... presumably my estimate of 10 blocks
> per second was too high. Try r19187.

Where do I get that from?

And why does this take so long anyway?

-- 
|  _  | ASCII Ribbon Campaign Against HTML Emails.
| ( ) |
|  X  |
| / \ |



[freenet-dev] Freenet 0.7 build 1135 and 1136

2008-04-11 Thread Guido Winkelmann
Am Freitag, 11. April 2008 15:19:57 schrieb Guido Winkelmann:
> Am Freitag, 11. April 2008 04:18:01 schrieb Daniel Cheng:
> > It's rebuilding the database and it would take some time for large
> > datastore. Do you have still any error message _before_ theses lines?
>
> The earliest messages in there look like this:
>
> INFO   | jvm 4| 2008/04/10 07:55:20 | Freed block 29889 (can't
> reconsturct key (freenet.store.SSKStore at 1123d4e))
> INFO   | jvm 4| 2008/04/10 07:55:20 | Bogus or unreconstructible key at
> slot 29890 : freenet.keys.SSKVerifyException: Unknown type byte 0 - lost
> block 29890
> INFO   | jvm 4| 2008/04/10 07:55:20 | Freed block 29890 (can't
> reconsturct key (freenet.store.SSKStore at 1123d4e))
> INFO   | jvm 4| 2008/04/10 07:55:20 | Bogus or unreconstructible key at
> slot 29891 : freenet.keys.SSKVerifyException: Unknown type byte 0 - lost
> block 29891
>
> The node has finished starting up just minutes ago, btw.

I spoke too early. The wrapper.log looks like this now (see attachment).

It looks like if this continues like this, the node will never ever actually 
start up.

Guido

-- 
|  _  | ASCII Ribbon Campaign Against HTML Emails.
| ( ) |
|  X  |
| / \ |
-- next part --
INFO   | jvm 5| 2008/04/11 15:11:01 | Freed block 330164 (duplicate)
INFO   | jvm 5| 2008/04/11 15:11:14 | Freed block 330237 (duplicate)
INFO   | jvm 5| 2008/04/11 15:11:39 | Freed block 330349 (duplicate)
INFO   | jvm 5| 2008/04/11 15:12:56 | Freed block 330547 (duplicate)
INFO   | jvm 5| 2008/04/11 15:12:56 | Freed block 330549 (duplicate)
INFO   | jvm 5| 2008/04/11 15:12:58 | Freed block 330557 (duplicate)
INFO   | jvm 5| 2008/04/11 15:13:49 | Key 330752/460332 OK (2760 dupes, 169 
failures)
INFO   | jvm 5| 2008/04/11 15:13:56 | Freed block 330776 (duplicate)
INFO   | jvm 5| 2008/04/11 15:15:04 | Freed block 331018 (duplicate)
INFO   | jvm 5| 2008/04/11 15:15:14 | Freed block 331064 (duplicate)
INFO   | jvm 5| 2008/04/11 15:15:52 | Freed block 331178 (duplicate)
INFO   | jvm 5| 2008/04/11 15:15:55 | Freed block 331190 (duplicate)
INFO   | jvm 5| 2008/04/11 15:15:57 | Freed block 331197 (duplicate)
INFO   | jvm 5| 2008/04/11 15:16:14 | Freed block 331253 (duplicate)
INFO   | jvm 5| 2008/04/11 15:17:04 | Freed block 331496 (duplicate)
INFO   | jvm 5| 2008/04/11 15:17:08 | Freed block 331514 (duplicate)
INFO   | jvm 5| 2008/04/11 15:17:15 | Freed block 331548 (duplicate)
INFO   | jvm 5| 2008/04/11 15:17:16 | Freed block 331554 (duplicate)
ERROR  | wrapper  | 2008/04/11 15:17:22 | Startup failed: Timed out waiting for 
signal from JVM.
ERROR  | wrapper  | 2008/04/11 15:17:23 | JVM did not exit on request, 
terminated
STATUS | wrapper  | 2008/04/11 15:17:27 | Reloading Wrapper configuration...
STATUS | wrapper  | 2008/04/11 15:17:27 | Launching a JVM...
INFO   | jvm 6| 2008/04/11 15:17:30 | Wrapper (Version 3.2.3) 
http://wrapper.tanukisoftware.org
INFO   | jvm 6| 2008/04/11 15:17:30 |   Copyright 1999-2006 Tanuki 
Software, Inc.  All Rights Reserved.
INFO   | jvm 6| 2008/04/11 15:17:30 | 
INFO   | jvm 6| 2008/04/11 15:17:30 | WARNING - The Wrapper jar file 
currently in use is version "3.2.3"
INFO   | jvm 6| 2008/04/11 15:17:30 |   while the version of the 
Wrapper which launched this JVM is 
INFO   | jvm 6| 2008/04/11 15:17:30 |   "3.2.1".
INFO   | jvm 6| 2008/04/11 15:17:30 |   The Wrapper may appear to 
work correctly but some features may
INFO   | jvm 6| 2008/04/11 15:17:30 |   not function correctly.  
This configuration has not been tested
INFO   | jvm 6| 2008/04/11 15:17:30 |   and is not supported.
INFO   | jvm 6| 2008/04/11 15:17:30 | 
INFO   | jvm 6| 2008/04/11 15:17:30 | WARNING - The Wrapper jar file 
currently in use is version "3.2.3"
INFO   | jvm 6| 2008/04/11 15:17:30 |   while the version of the 
native library is "3.2.1".
INFO   | jvm 6| 2008/04/11 15:17:30 |   The Wrapper may appear to 
work correctly but some features may
INFO   | jvm 6| 2008/04/11 15:17:30 |   not function correctly.  
This configuration has not been tested
INFO   | jvm 6| 2008/04/11 15:17:30 |   and is not supported.
INFO   | jvm 6| 2008/04/11 15:17:30 | 
INFO   | jvm 6| 2008/04/11 15:17:30 | freenet.jar built with 
freenet-ext.jar Build #20 r18484
INFO   | jvm 6| 2008/04/11 15:17:31 |   
INFO   | jvm 6| 2008/04/11 15:17:31 | Created log files
INFO   | jvm 6| 2008/04/11 15:17:31 | INFO: Native CPUID library 
'freenet/support/CPUInformation/libjcpuid-x86-linux.so' loaded from resource
INFO   | jvm 6| 2008/04/11 15:17:31 | INFO: Optimized native BigInteger 
library 'net/i2p/util/libjbigi-linux-athlon.so' loaded from

[freenet-dev] Freenet 0.7 build 1135 and 1136

2008-04-11 Thread Guido Winkelmann
Am Freitag, 11. April 2008 04:18:01 schrieb Daniel Cheng:
> On Fri, Apr 11, 2008 at 10:07 AM, guido  wrote:
> > After one of these updates (probably 1135), my node has restarted. That
> > was yesterday at about 7 am, but I can't say for sure, because the point
> > when this happened is no longer in the logs. It's close to 24 hours later
> > now, and it still hasn't finished restarting.
> >
> >  The wrapper.log is full with lines like these:
> >
> >  INFO   | jvm 5| 2008/04/11 03:25:22 | Freed block 60339 (duplicate)
> >  INFO   | jvm 5| 2008/04/11 03:25:25 | Freed block 60395 (duplicate)
> >  INFO   | jvm 5| 2008/04/11 03:25:27 | Key 60416/460332 OK (460
> > dupes, 35 failures)
>
> It's rebuilding the database and it would take some time for large
> datastore. Do you have still any error message _before_ theses lines?

The earliest messages in there look like this:

INFO   | jvm 4| 2008/04/10 07:55:20 | Freed block 29889 (can't reconsturct 
key (freenet.store.SSKStore at 1123d4e))
INFO   | jvm 4| 2008/04/10 07:55:20 | Bogus or unreconstructible key at 
slot 29890 : freenet.keys.SSKVerifyException: Unknown type byte 0 - lost 
block 29890
INFO   | jvm 4| 2008/04/10 07:55:20 | Freed block 29890 (can't reconsturct 
key (freenet.store.SSKStore at 1123d4e))
INFO   | jvm 4| 2008/04/10 07:55:20 | Bogus or unreconstructible key at 
slot 29891 : freenet.keys.SSKVerifyException: Unknown type byte 0 - lost 
block 29891

The node has finished starting up just minutes ago, btw.

Guido



Re: [freenet-dev] Freenet 0.7 build 1135 and 1136

2008-04-11 Thread Guido Winkelmann
Am Freitag, 11. April 2008 17:20:10 schrieb Matthew Toseland:
> On Friday 11 April 2008 16:00, Guido Winkelmann wrote:
> > Am Freitag, 11. April 2008 15:19:57 schrieb Guido Winkelmann:
> >
> > I spoke too early. The wrapper.log looks like this now (see attachment).
> >
> > It looks like if this continues like this, the node will never ever
> > actually start up.
>
> Ouch. That really shouldn't happen... presumably my estimate of 10 blocks
> per second was too high. Try r19187.

Where do I get that from?

And why does this take so long anyway?

-- 
|  _  | ASCII Ribbon Campaign Against HTML Emails.
| ( ) |
|  X  |
| / \ |
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl


Re: [freenet-dev] Freenet 0.7 build 1135 and 1136

2008-04-11 Thread Guido Winkelmann
Am Freitag, 11. April 2008 15:19:57 schrieb Guido Winkelmann:
> Am Freitag, 11. April 2008 04:18:01 schrieb Daniel Cheng:
> > It's rebuilding the database and it would take some time for large
> > datastore. Do you have still any error message _before_ theses lines?
>
> The earliest messages in there look like this:
>
> INFO   | jvm 4| 2008/04/10 07:55:20 | Freed block 29889 (can't
> reconsturct key ([EMAIL PROTECTED]))
> INFO   | jvm 4| 2008/04/10 07:55:20 | Bogus or unreconstructible key at
> slot 29890 : freenet.keys.SSKVerifyException: Unknown type byte 0 - lost
> block 29890
> INFO   | jvm 4| 2008/04/10 07:55:20 | Freed block 29890 (can't
> reconsturct key ([EMAIL PROTECTED]))
> INFO   | jvm 4| 2008/04/10 07:55:20 | Bogus or unreconstructible key at
> slot 29891 : freenet.keys.SSKVerifyException: Unknown type byte 0 - lost
> block 29891
>
> The node has finished starting up just minutes ago, btw.

I spoke too early. The wrapper.log looks like this now (see attachment).

It looks like if this continues like this, the node will never ever actually 
start up.

Guido

-- 
|  _  | ASCII Ribbon Campaign Against HTML Emails.
| ( ) |
|  X  |
| / \ |
INFO   | jvm 5| 2008/04/11 15:11:01 | Freed block 330164 (duplicate)
INFO   | jvm 5| 2008/04/11 15:11:14 | Freed block 330237 (duplicate)
INFO   | jvm 5| 2008/04/11 15:11:39 | Freed block 330349 (duplicate)
INFO   | jvm 5| 2008/04/11 15:12:56 | Freed block 330547 (duplicate)
INFO   | jvm 5| 2008/04/11 15:12:56 | Freed block 330549 (duplicate)
INFO   | jvm 5| 2008/04/11 15:12:58 | Freed block 330557 (duplicate)
INFO   | jvm 5| 2008/04/11 15:13:49 | Key 330752/460332 OK (2760 dupes, 169 
failures)
INFO   | jvm 5| 2008/04/11 15:13:56 | Freed block 330776 (duplicate)
INFO   | jvm 5| 2008/04/11 15:15:04 | Freed block 331018 (duplicate)
INFO   | jvm 5| 2008/04/11 15:15:14 | Freed block 331064 (duplicate)
INFO   | jvm 5| 2008/04/11 15:15:52 | Freed block 331178 (duplicate)
INFO   | jvm 5| 2008/04/11 15:15:55 | Freed block 331190 (duplicate)
INFO   | jvm 5| 2008/04/11 15:15:57 | Freed block 331197 (duplicate)
INFO   | jvm 5| 2008/04/11 15:16:14 | Freed block 331253 (duplicate)
INFO   | jvm 5| 2008/04/11 15:17:04 | Freed block 331496 (duplicate)
INFO   | jvm 5| 2008/04/11 15:17:08 | Freed block 331514 (duplicate)
INFO   | jvm 5| 2008/04/11 15:17:15 | Freed block 331548 (duplicate)
INFO   | jvm 5| 2008/04/11 15:17:16 | Freed block 331554 (duplicate)
ERROR  | wrapper  | 2008/04/11 15:17:22 | Startup failed: Timed out waiting for 
signal from JVM.
ERROR  | wrapper  | 2008/04/11 15:17:23 | JVM did not exit on request, 
terminated
STATUS | wrapper  | 2008/04/11 15:17:27 | Reloading Wrapper configuration...
STATUS | wrapper  | 2008/04/11 15:17:27 | Launching a JVM...
INFO   | jvm 6| 2008/04/11 15:17:30 | Wrapper (Version 3.2.3) 
http://wrapper.tanukisoftware.org
INFO   | jvm 6| 2008/04/11 15:17:30 |   Copyright 1999-2006 Tanuki 
Software, Inc.  All Rights Reserved.
INFO   | jvm 6| 2008/04/11 15:17:30 | 
INFO   | jvm 6| 2008/04/11 15:17:30 | WARNING - The Wrapper jar file 
currently in use is version "3.2.3"
INFO   | jvm 6| 2008/04/11 15:17:30 |   while the version of the 
Wrapper which launched this JVM is 
INFO   | jvm 6| 2008/04/11 15:17:30 |   "3.2.1".
INFO   | jvm 6| 2008/04/11 15:17:30 |   The Wrapper may appear to 
work correctly but some features may
INFO   | jvm 6| 2008/04/11 15:17:30 |   not function correctly.  
This configuration has not been tested
INFO   | jvm 6| 2008/04/11 15:17:30 |   and is not supported.
INFO   | jvm 6| 2008/04/11 15:17:30 | 
INFO   | jvm 6| 2008/04/11 15:17:30 | WARNING - The Wrapper jar file 
currently in use is version "3.2.3"
INFO   | jvm 6| 2008/04/11 15:17:30 |   while the version of the 
native library is "3.2.1".
INFO   | jvm 6| 2008/04/11 15:17:30 |   The Wrapper may appear to 
work correctly but some features may
INFO   | jvm 6| 2008/04/11 15:17:30 |   not function correctly.  
This configuration has not been tested
INFO   | jvm 6| 2008/04/11 15:17:30 |   and is not supported.
INFO   | jvm 6| 2008/04/11 15:17:30 | 
INFO   | jvm 6| 2008/04/11 15:17:30 | freenet.jar built with 
freenet-ext.jar Build #20 r18484
INFO   | jvm 6| 2008/04/11 15:17:31 |   
INFO   | jvm 6| 2008/04/11 15:17:31 | Created log files
INFO   | jvm 6| 2008/04/11 15:17:31 | INFO: Native CPUID library 
'freenet/support/CPUInformation/libjcpuid-x86-linux.so' loaded from resource
INFO   | jvm 6| 2008/04/11 15:17:31 | INFO: Optimized native BigInteger 
library 'net/i2p/util/libjbigi-linux-athlon.so' loaded from resource
INFO   | jvm 6| 2008/04/11 15:17:31 | Attempting to load t

Re: [freenet-dev] Freenet 0.7 build 1135 and 1136

2008-04-11 Thread Guido Winkelmann
Am Freitag, 11. April 2008 04:18:01 schrieb Daniel Cheng:
> On Fri, Apr 11, 2008 at 10:07 AM, guido <[EMAIL PROTECTED]> wrote:
> > After one of these updates (probably 1135), my node has restarted. That
> > was yesterday at about 7 am, but I can't say for sure, because the point
> > when this happened is no longer in the logs. It's close to 24 hours later
> > now, and it still hasn't finished restarting.
> >
> >  The wrapper.log is full with lines like these:
> >
> >  INFO   | jvm 5| 2008/04/11 03:25:22 | Freed block 60339 (duplicate)
> >  INFO   | jvm 5| 2008/04/11 03:25:25 | Freed block 60395 (duplicate)
> >  INFO   | jvm 5| 2008/04/11 03:25:27 | Key 60416/460332 OK (460
> > dupes, 35 failures)
>
> It's rebuilding the database and it would take some time for large
> datastore. Do you have still any error message _before_ theses lines?

The earliest messages in there look like this:

INFO   | jvm 4| 2008/04/10 07:55:20 | Freed block 29889 (can't reconsturct 
key ([EMAIL PROTECTED]))
INFO   | jvm 4| 2008/04/10 07:55:20 | Bogus or unreconstructible key at 
slot 29890 : freenet.keys.SSKVerifyException: Unknown type byte 0 - lost 
block 29890
INFO   | jvm 4| 2008/04/10 07:55:20 | Freed block 29890 (can't reconsturct 
key ([EMAIL PROTECTED]))
INFO   | jvm 4| 2008/04/10 07:55:20 | Bogus or unreconstructible key at 
slot 29891 : freenet.keys.SSKVerifyException: Unknown type byte 0 - lost 
block 29891

The node has finished starting up just minutes ago, btw.

Guido
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl


[freenet-dev] Freenet 0.7 build 1135 and 1136

2008-04-11 Thread guido
After one of these updates (probably 1135), my node has restarted. That was 
yesterday at about 7 am, but I can't say for sure, because the point when 
this happened is no longer in the logs. It's close to 24 hours later now, and 
it still hasn't finished restarting.

The wrapper.log is full with lines like these:

INFO   | jvm 5| 2008/04/11 03:25:22 | Freed block 60339 (duplicate)
INFO   | jvm 5| 2008/04/11 03:25:25 | Freed block 60395 (duplicate)
INFO   | jvm 5| 2008/04/11 03:25:27 | Key 60416/460332 OK (460 dupes, 35 
failures)

Am Donnerstag, 10. April 2008 17:50:53 schrieb Matthew Toseland:
> Freenet 0.7 build 1136 is now available. Please upgrade. I forgot to
> announce 1135; a big part of 1136 is fixing bugs in 1135. Apologies for the
> recent node crashes...
> Changes:
> 1135:
> - Increase the redundancy on splitfiles from 150% to 200%. Your node only
> needs to download 100% of this to complete the fetch. The practical effect
> is that inserts are 33% slower, and hopefully data persistence will be
> significantly improved. This is partly inspired by Wuala, which uses 500%
> splitfile redundancy. :)
> - Reset node locations less often. Hopefully this will reduce location
> churn and therefore improve data persistence, without causing more keyspace
> clustering as we saw last year.
> - Allow an opennet peer 10 minutes after disconnecting for it to reconnect,
> instead of 5. Many computers take that long to reboot!
> - Don't forget to disconnect from seednodes once we've finished with them.
> - Add Identifier's to most messages in FCP that didn't have them.
> - Hopefully fix changing request priorities causing requests to stall.
> - Lots of minor bugfixes, some in the web interface, including the Method
> Not Allowed bug.
> - Record location changes in loation.log.txt.
> - One bugfix to location swapping (we were resetting our location if we
> swapped with a nearby node).
> - Various internal improvements - comments, synchronization, refactoring
> etc. 1136:
> - 1135 would insert splitfiles with wrong metadata, resulting in the node
> crashing. This is fixed, and we can even download files inserted by 1135.
> - Prevent old nodes which are unable or unwilling to update from spamming
> the seednodes forever.
> - Default to 10% of available disk space in the first time wizard datastore
> size selection page, if we are running java 1.6.
> - Minor bugfixes and internal changes (mostly datastore refactoring).

-- 
Oh my science!



Re: [freenet-dev] Freenet 0.7 build 1135 and 1136

2008-04-10 Thread guido
After one of these updates (probably 1135), my node has restarted. That was 
yesterday at about 7 am, but I can't say for sure, because the point when 
this happened is no longer in the logs. It's close to 24 hours later now, and 
it still hasn't finished restarting.

The wrapper.log is full with lines like these:

INFO   | jvm 5| 2008/04/11 03:25:22 | Freed block 60339 (duplicate)
INFO   | jvm 5| 2008/04/11 03:25:25 | Freed block 60395 (duplicate)
INFO   | jvm 5| 2008/04/11 03:25:27 | Key 60416/460332 OK (460 dupes, 35 
failures)

Am Donnerstag, 10. April 2008 17:50:53 schrieb Matthew Toseland:
> Freenet 0.7 build 1136 is now available. Please upgrade. I forgot to
> announce 1135; a big part of 1136 is fixing bugs in 1135. Apologies for the
> recent node crashes...
> Changes:
> 1135:
> - Increase the redundancy on splitfiles from 150% to 200%. Your node only
> needs to download 100% of this to complete the fetch. The practical effect
> is that inserts are 33% slower, and hopefully data persistence will be
> significantly improved. This is partly inspired by Wuala, which uses 500%
> splitfile redundancy. :)
> - Reset node locations less often. Hopefully this will reduce location
> churn and therefore improve data persistence, without causing more keyspace
> clustering as we saw last year.
> - Allow an opennet peer 10 minutes after disconnecting for it to reconnect,
> instead of 5. Many computers take that long to reboot!
> - Don't forget to disconnect from seednodes once we've finished with them.
> - Add Identifier's to most messages in FCP that didn't have them.
> - Hopefully fix changing request priorities causing requests to stall.
> - Lots of minor bugfixes, some in the web interface, including the Method
> Not Allowed bug.
> - Record location changes in loation.log.txt.
> - One bugfix to location swapping (we were resetting our location if we
> swapped with a nearby node).
> - Various internal improvements - comments, synchronization, refactoring
> etc. 1136:
> - 1135 would insert splitfiles with wrong metadata, resulting in the node
> crashing. This is fixed, and we can even download files inserted by 1135.
> - Prevent old nodes which are unable or unwilling to update from spamming
> the seednodes forever.
> - Default to 10% of available disk space in the first time wizard datastore
> size selection page, if we are running java 1.6.
> - Minor bugfixes and internal changes (mostly datastore refactoring).

-- 
Oh my science!
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl


[freenet-dev] Freenet 0.7 build 1126

2008-03-25 Thread guido
Am Freitag, 21. M?rz 2008 14:53:50 schrieb Matthew Toseland:
> On Friday 21 March 2008 03:32, guido wrote:
> > I noticed that in this build, the "friends" page reports "Other
> > output: -8841846 B (-3%)". That can't be right.
>
> 0% here. Let me know if it increases beyond 3%.

Right now I've got:

Other output: -10177998 B (-8%)

(Build 1128)

How does this number get negative anyway? Does the node substract the "Other 
input" from it?



Re: [freenet-dev] Freenet 0.7 build 1126

2008-03-25 Thread guido
Am Freitag, 21. März 2008 14:53:50 schrieb Matthew Toseland:
> On Friday 21 March 2008 03:32, guido wrote:
> > I noticed that in this build, the "friends" page reports "Other
> > output: -8841846 B (-3%)". That can't be right.
>
> 0% here. Let me know if it increases beyond 3%.

Right now I've got:

Other output: -10177998 B (-8%)

(Build 1128)

How does this number get negative anyway? Does the node substract the "Other 
input" from it?
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl

[freenet-dev] Freenet 0.7 build 1126

2008-03-21 Thread guido
Am Donnerstag, 20. M?rz 2008 schrieb Matthew Toseland:
> Freenet 0.7 build 1126 is now available (sorry). Please upgrade, it will be
> mandatory on Saturday. This contains a series of bugfixes for the last two
> builds, relating to the new SSK messages, and the output bandwidth stats
> (which affect the number of requests the node accepts, so are reasonably
> important). Thanks.

I noticed that in this build, the "friends" page reports "Other 
output: -8841846 B (-3%)". That can't be right.



[freenet-dev] Freenet 0.7 build 1125

2008-03-20 Thread guido
Am Donnerstag, 20. M?rz 2008 schrieb Matthew Toseland:
> On Thursday 20 March 2008 20:37, Guido wrote:
> > Am Donnerstag, 20. M?rz 2008 schrieb Matthew Toseland:
> > > On Thursday 20 March 2008 19:51, guido wrote:
> > > > For me, this build has brought a significant drop in the load caused
> > > > by freenet on my machine. Until now, running freenet has always
> > > > caused an average load of at least 4, slowing down everything else on
> > > > this box. After this upgrade, the load is a much more bearable 0.2,
> > > > and everything else has become much snappier.
> > >
> > > This is very odd. It's probably back to normal with 1126? Is this load
> > > due to CPU or disk access i.e. how high is your typical CPU usage?
> >
> > I think you did not read my message right. I said the load /dropped/ from
> > unreasonably high to reasonably low. This is a good thing, and I really
> > hope it won't go "back to normal" again with 1126.
>
> 1125 had some major problems, it is likely that 1126 will again use lots of
> whatever it was using.

The node has upgraded now, and at first glance it behaves the same as with 
1125. (Fortunately. The load that was caused by the earlier builds was a real 
pain...)

> > The load used to be mainly IO (disk access) and memory usage (causing the
> > machine to swap). It's still swapping, but this time that doesn't seem to
> > have that much of an impact on the overall load.
>
> Java and swapping go together *really* badly. I suppose if you reduce the
> memory limit you get OOMs and 100% CPU usage?

I have reduced memory usage to 120 MB and have not seen either OOMs or 100% 
CPU usage. Also, just because there is swapping, it doesn't necessarily 
follow that it's freenet or Java that's being swapped out.



[freenet-dev] Freenet 0.7 build 1125

2008-03-20 Thread Guido
Am Donnerstag, 20. M?rz 2008 schrieb Matthew Toseland:
> On Thursday 20 March 2008 19:51, guido wrote:
> > For me, this build has brought a significant drop in the load caused by
> > freenet on my machine. Until now, running freenet has always caused an
> > average load of at least 4, slowing down everything else on this box.
> > After this upgrade, the load is a much more bearable 0.2, and everything
> > else has become much snappier.
>
> This is very odd. It's probably back to normal with 1126? Is this load due
> to CPU or disk access i.e. how high is your typical CPU usage?

I think you did not read my message right. I said the load /dropped/ from 
unreasonably high to reasonably low. This is a good thing, and I really hope 
it won't go "back to normal" again with 1126.

The load used to be mainly IO (disk access) and memory usage (causing the 
machine to swap). It's still swapping, but this time that doesn't seem to 
have that much of an impact on the overall load.



[freenet-dev] Freenet 0.7 build 1125

2008-03-20 Thread guido
For me, this build has brought a significant drop in the load caused by 
freenet on my machine. Until now, running freenet has always caused an 
average load of at least 4, slowing down everything else on this box. After 
this upgrade, the load is a much more bearable 0.2, and everything else has 
become much snappier.

Am Donnerstag, 20. M?rz 2008 schrieb Matthew Toseland:
> Freenet 0.7 build 1125 is available, please upgrade as it will be mandatory
> on Saturday. There are a couple of major changes:
> - Transfer backoff. Ordinary backoff was not dealing with transfer
> failures, we now have a separate mechanism for backoff after a transfer
> failure.
> - Split up some SSK messages for increased security against 
> traffic analysis, and for less problems on links with low MTU.
> - Also, a somewhat significant request bug was fixed (we were timing out
> when doing a local request, and unlocking the UID, possibly leading to
> loops and further timeouts).
>
> There have also been a number of changes to the website.
>
> Please upgrade! Thanks.



Re: [freenet-dev] Freenet 0.7 build 1126

2008-03-20 Thread guido
Am Donnerstag, 20. März 2008 schrieb Matthew Toseland:
> Freenet 0.7 build 1126 is now available (sorry). Please upgrade, it will be
> mandatory on Saturday. This contains a series of bugfixes for the last two
> builds, relating to the new SSK messages, and the output bandwidth stats
> (which affect the number of requests the node accepts, so are reasonably
> important). Thanks.

I noticed that in this build, the "friends" page reports "Other 
output: -8841846 B (-3%)". That can't be right.
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl

Re: [freenet-dev] Freenet 0.7 build 1125

2008-03-20 Thread guido
Am Donnerstag, 20. März 2008 schrieb Matthew Toseland:
> On Thursday 20 March 2008 20:37, Guido wrote:
> > Am Donnerstag, 20. März 2008 schrieb Matthew Toseland:
> > > On Thursday 20 March 2008 19:51, guido wrote:
> > > > For me, this build has brought a significant drop in the load caused
> > > > by freenet on my machine. Until now, running freenet has always
> > > > caused an average load of at least 4, slowing down everything else on
> > > > this box. After this upgrade, the load is a much more bearable 0.2,
> > > > and everything else has become much snappier.
> > >
> > > This is very odd. It's probably back to normal with 1126? Is this load
> > > due to CPU or disk access i.e. how high is your typical CPU usage?
> >
> > I think you did not read my message right. I said the load /dropped/ from
> > unreasonably high to reasonably low. This is a good thing, and I really
> > hope it won't go "back to normal" again with 1126.
>
> 1125 had some major problems, it is likely that 1126 will again use lots of
> whatever it was using.

The node has upgraded now, and at first glance it behaves the same as with 
1125. (Fortunately. The load that was caused by the earlier builds was a real 
pain...)

> > The load used to be mainly IO (disk access) and memory usage (causing the
> > machine to swap). It's still swapping, but this time that doesn't seem to
> > have that much of an impact on the overall load.
>
> Java and swapping go together *really* badly. I suppose if you reduce the
> memory limit you get OOMs and 100% CPU usage?

I have reduced memory usage to 120 MB and have not seen either OOMs or 100% 
CPU usage. Also, just because there is swapping, it doesn't necessarily 
follow that it's freenet or Java that's being swapped out.
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl

Re: [freenet-dev] Freenet 0.7 build 1125

2008-03-20 Thread Guido
Am Donnerstag, 20. März 2008 schrieb Matthew Toseland:
> On Thursday 20 March 2008 19:51, guido wrote:
> > For me, this build has brought a significant drop in the load caused by
> > freenet on my machine. Until now, running freenet has always caused an
> > average load of at least 4, slowing down everything else on this box.
> > After this upgrade, the load is a much more bearable 0.2, and everything
> > else has become much snappier.
>
> This is very odd. It's probably back to normal with 1126? Is this load due
> to CPU or disk access i.e. how high is your typical CPU usage?

I think you did not read my message right. I said the load /dropped/ from 
unreasonably high to reasonably low. This is a good thing, and I really hope 
it won't go "back to normal" again with 1126.

The load used to be mainly IO (disk access) and memory usage (causing the 
machine to swap). It's still swapping, but this time that doesn't seem to 
have that much of an impact on the overall load.
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl

Re: [freenet-dev] Freenet 0.7 build 1125

2008-03-20 Thread guido
For me, this build has brought a significant drop in the load caused by 
freenet on my machine. Until now, running freenet has always caused an 
average load of at least 4, slowing down everything else on this box. After 
this upgrade, the load is a much more bearable 0.2, and everything else has 
become much snappier.

Am Donnerstag, 20. März 2008 schrieb Matthew Toseland:
> Freenet 0.7 build 1125 is available, please upgrade as it will be mandatory
> on Saturday. There are a couple of major changes:
> - Transfer backoff. Ordinary backoff was not dealing with transfer
> failures, we now have a separate mechanism for backoff after a transfer
> failure.
> - Split up some SSK messages for increased security against 
> traffic analysis, and for less problems on links with low MTU.
> - Also, a somewhat significant request bug was fixed (we were timing out
> when doing a local request, and unlocking the UID, possibly leading to
> loops and further timeouts).
>
> There have also been a number of changes to the website.
>
> Please upgrade! Thanks.
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl

[freenet-dev] Freenet 0.7 build 1055/1056

2007-09-02 Thread Guido Winkelmann
Am Freitag, 31. August 2007 17:37:30 schrieb Matthew Toseland:
> Freenet 0.7 build 1056 is now available (1055 is mandatory; sorry for the
> long delay between making it available and announcing it, we've been busy).
> Please upgrade. We are still interested in any difficulty you have with the
> auto-update system; please report problems with that and any other bugs you
> find.

Okay, since you're asking...

Auto-update hasn't been working for me for one or two months, simply because 
starting freenet using the wrapper doesn't work for me.

I've posted this problem to freenet-support about one and a half months ago, 
but haven't received any answer to it yet.

Guido



Re: [freenet-dev] Freenet 0.7 build 1055/1056

2007-09-02 Thread Guido Winkelmann
Am Freitag, 31. August 2007 17:37:30 schrieb Matthew Toseland:
> Freenet 0.7 build 1056 is now available (1055 is mandatory; sorry for the
> long delay between making it available and announcing it, we've been busy).
> Please upgrade. We are still interested in any difficulty you have with the
> auto-update system; please report problems with that and any other bugs you
> find.

Okay, since you're asking...

Auto-update hasn't been working for me for one or two months, simply because 
starting freenet using the wrapper doesn't work for me.

I've posted this problem to freenet-support about one and a half months ago, 
but haven't received any answer to it yet.

Guido
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl


[freenet-dev] [freenet-cvs] r14189 - in trunk/apps/new_installer: . langpacks res/unix/bin res/windows/bin

2007-07-21 Thread Guido Winkelmann
Am Samstag, 21. Juli 2007 17:46 schrieb Matthew Toseland:
> Ok. Implemented something like this in the latest code:
>
> Freenet first time wizard! - Friends and strangers
>
> Connect to strangers?
>
> Your node can either automatically find untrusted nodes to connect to
> ("Strangers"), or you can manually add connections to trusted nodes
> ("Friends") run by people you already know. Connecting to total strangers
> ("promiscuous mode" or "opennet") is far less secure (in particular, your
> node can be found relatively easily, and anyone can connect to it), but it
> means your node will start working immediately, rather than you having to
> find some friends to connect to. Even if you do enable promiscuous mode,
> you should try to get some friend connections when your friends start using
> Freenet.
>
> Automatically connect to untrusted strangers' nodes?
> [ ] Yes
> [ ] No

Counter suggestion:

Connect to strangers?

If you let freenet connect to strangers, freenet will be less secure for you 
and everybody can find out that you are using freenet.

If you don't, you will have to manually contact at least three other people 
who are using freenet and connect to them.

Connect to strangers?
[ ] Yes
[ ] No

Keep it simple and to the point. Don't use complicated sentence structures, 
don't use very long sentences, don't throw in stuff in brackets, don't use 
terminology that is not universally understandable. (What is a "node" to 
someone new to networking and P2P?)

Guido



Re: [freenet-dev] [freenet-cvs] r14189 - in trunk/apps/new_installer: . langpacks res/unix/bin res/windows/bin

2007-07-21 Thread Guido Winkelmann
Am Samstag, 21. Juli 2007 17:46 schrieb Matthew Toseland:
> Ok. Implemented something like this in the latest code:
>
> Freenet first time wizard! - Friends and strangers
>
> Connect to strangers?
>
> Your node can either automatically find untrusted nodes to connect to
> ("Strangers"), or you can manually add connections to trusted nodes
> ("Friends") run by people you already know. Connecting to total strangers
> ("promiscuous mode" or "opennet") is far less secure (in particular, your
> node can be found relatively easily, and anyone can connect to it), but it
> means your node will start working immediately, rather than you having to
> find some friends to connect to. Even if you do enable promiscuous mode,
> you should try to get some friend connections when your friends start using
> Freenet.
>
> Automatically connect to untrusted strangers' nodes?
> [ ] Yes
> [ ] No

Counter suggestion:

Connect to strangers?

If you let freenet connect to strangers, freenet will be less secure for you 
and everybody can find out that you are using freenet.

If you don't, you will have to manually contact at least three other people 
who are using freenet and connect to them.

Connect to strangers?
[ ] Yes
[ ] No

Keep it simple and to the point. Don't use complicated sentence structures, 
don't use very long sentences, don't throw in stuff in brackets, don't use 
terminology that is not universally understandable. (What is a "node" to 
someone new to networking and P2P?)

Guido
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl


[freenet-dev] [freenet-cvs] r14189 - in trunk/apps/new_installer: . langpacks res/unix/bin res/windows/bin

2007-07-20 Thread Guido Winkelmann
Hi,

Am Freitag, 20. Juli 2007 17:34:14 schrieb Matthew Toseland:
[...]
> Okay, so what should this question say then exactly? Perhaps:
>
> "Connect to strangers?
>
> Your node can either automatically find untrusted nodes to connect to
> ("Strangers"), or you can manually add connections to trusted nodes
> ("Friends") run by people you already know. Connecting to total strangers
> is far less secure, but it means your node will start working immediately,
> rather than you having to find some friends to connect to. Even if you do
> enable connecting to untrusted nodes, you should try to get some friend
> connections when your friends start using Freenet.
>
> Button: Connect to strangers
>
> Button: Only connect to friends"
>
> I'm a bit worried about the severely informal language we have to use, but
> it's better than freenet jargon, and the whole friends list thing is pretty
> universal post-AIM anyway.

I think it should also be pointed out that the first option means that 
*anybody* can find out that the user is using freenet, while with the second 
option only his or her selected friends will be able to.

Guido



Re: [freenet-dev] [freenet-cvs] r14189 - in trunk/apps/new_installer: . langpacks res/unix/bin res/windows/bin

2007-07-20 Thread Guido Winkelmann
Hi,

Am Freitag, 20. Juli 2007 17:34:14 schrieb Matthew Toseland:
[...]
> Okay, so what should this question say then exactly? Perhaps:
>
> "Connect to strangers?
>
> Your node can either automatically find untrusted nodes to connect to
> ("Strangers"), or you can manually add connections to trusted nodes
> ("Friends") run by people you already know. Connecting to total strangers
> is far less secure, but it means your node will start working immediately,
> rather than you having to find some friends to connect to. Even if you do
> enable connecting to untrusted nodes, you should try to get some friend
> connections when your friends start using Freenet.
>
> Button: Connect to strangers
>
> Button: Only connect to friends"
>
> I'm a bit worried about the severely informal language we have to use, but
> it's better than freenet jargon, and the whole friends list thing is pretty
> universal post-AIM anyway.

I think it should also be pointed out that the first option means that 
*anybody* can find out that the user is using freenet, while with the second 
option only his or her selected friends will be able to.

Guido
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl


[freenet-dev] Beginnings of new low-level spec

2007-03-08 Thread Guido Winkelmann
Am Dienstag, 6. M?rz 2007 20:52 schrieb Matthew Toseland:
> MRogers posted the following on Frost:
>
> http://wiki.freenetproject.org/NewPacketFormat
> http://wiki.freenetproject.org/NewTransportLayer
>
> Any feedback would be welcome. These are the new proposed formats for
> the packet transport layer and the congestion control and retransmission
> layer respectively.

I will at least read those pages.

Something that isn't entirely clear yet: Do these pages describe the protocol 
as it is used right now or with planned changes in the future?



Re: [freenet-dev] Beginnings of new low-level spec

2007-03-08 Thread Guido Winkelmann
Am Dienstag, 6. März 2007 20:52 schrieb Matthew Toseland:
> MRogers posted the following on Frost:
>
> http://wiki.freenetproject.org/NewPacketFormat
> http://wiki.freenetproject.org/NewTransportLayer
>
> Any feedback would be welcome. These are the new proposed formats for
> the packet transport layer and the congestion control and retransmission
> layer respectively.

I will at least read those pages.

Something that isn't entirely clear yet: Do these pages describe the protocol 
as it is used right now or with planned changes in the future?
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl

[freenet-dev] r12003 and futher

2007-03-07 Thread Guido Winkelmann
Hi,

Am Mittwoch, 7. M?rz 2007 15:01 schrieb Florent Daigni?re:
> Hi,
>
>   In r12003 and r12006 I have updated the bdb code to 3.2.13 using
>   the official release from oracle.com.

Could you summarize what benefits we might see from the newer version?

    Guido



Re: [freenet-dev] r12003 and futher

2007-03-07 Thread Guido Winkelmann
Hi,

Am Mittwoch, 7. März 2007 15:01 schrieb Florent Daignière:
> Hi,
>
>   In r12003 and r12006 I have updated the bdb code to 3.2.13 using
>   the official release from oracle.com.

Could you summarize what benefits we might see from the newer version?

    Guido
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl


[freenet-dev] Routing not working? Please post your store stats

2006-11-07 Thread Guido Winkelmann
Hi,

Am Samstag, 7. Oktober 2006 01:01 schrieb toad:
> 1. THE STORE IS *LESS* EFFECTIVE THAN THE CACHE!
> 
>
> Please could people post their store statistics? Cache hits, store hits,
> cached keys, stored keys.

As I said in another message on the freenet-support mailing list, some bug 
with the automated cache shrinking forced me to remove my entire cache. This 
means that I now have a store that is nearly ten times as large as my cache.

Here's my statistics for that:

Store size
Cached keys: 2,221 (69.4 MiB)
Stored keys: 17,473 (546 MiB)
Overall size: 19,694 / 1,227,554 (615 MiB / 37.4 GiB) (1%)
Cache hits: 676 / 9,949 (6%)
Store hits: 25 / 7,698 (0%)
Avg. access rate: 1/s

nodeUptime: 2h54m

Doesn't look very good, does it?

Guido

-- 
Mailing list archives are not a proper form of documentation.



Re: [freenet-dev] Routing not working? Please post your store stats

2006-11-07 Thread Guido Winkelmann
Hi,

Am Samstag, 7. Oktober 2006 01:01 schrieb toad:
> 1. THE STORE IS *LESS* EFFECTIVE THAN THE CACHE!
> 
>
> Please could people post their store statistics? Cache hits, store hits,
> cached keys, stored keys.

As I said in another message on the freenet-support mailing list, some bug 
with the automated cache shrinking forced me to remove my entire cache. This 
means that I now have a store that is nearly ten times as large as my cache.

Here's my statistics for that:

Store size
Cached keys: 2,221 (69.4 MiB)
Stored keys: 17,473 (546 MiB)
Overall size: 19,694 / 1,227,554 (615 MiB / 37.4 GiB) (1%)
Cache hits: 676 / 9,949 (6%)
Store hits: 25 / 7,698 (0%)
Avg. access rate: 1/s

nodeUptime: 2h54m

Doesn't look very good, does it?

Guido

-- 
Mailing list archives are not a proper form of documentation.
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl


[freenet-dev] Routing not working? Please post your store stats

2006-10-28 Thread Guido Winkelmann
Hi,

Am Dienstag, 24. Oktober 2006 02:09 schrieb toad:
> On Sat, Oct 07, 2006 at 03:38:29PM +0200, Guido Winkelmann wrote:
> > Also, what's with this line:
> >
> > ---
> > Overall size: 1,136,650/2,194,293 (~34.6 GiB/66.9 GiB)
> > ---
> >
> > I've configured my node for a maximum store size of 40 GiB. This line
> > seems to indicate that it might use up to 66.9 GiB at some point. This
> > would be a problem for me, as the partition I've installed freenet on
> > isn't even large enough for that.
>
> That's part of the migration from mostly cache to mostly store. It will
> only go over the 40GB through the store growing, and the store grows
> *really* slowly. And when you restart, it will shrink the cache to
> compensate for growth in the store. (Or shrink the store too sometimes).

Hm, but does that really solve the problem? If the node uses more than 50 GiB 
for *any* period of time, there'll be a problem for me. It doesn't matter if 
it'll be only for a short time...

Guido

-- 
Mailing list archives are not a proper form of documentation.



Re: [freenet-dev] Routing not working? Please post your store stats

2006-10-28 Thread Guido Winkelmann
Hi,

Am Dienstag, 24. Oktober 2006 02:09 schrieb toad:
> On Sat, Oct 07, 2006 at 03:38:29PM +0200, Guido Winkelmann wrote:
> > Also, what's with this line:
> >
> > ---
> > Overall size: 1,136,650/2,194,293 (~34.6 GiB/66.9 GiB)
> > ---
> >
> > I've configured my node for a maximum store size of 40 GiB. This line
> > seems to indicate that it might use up to 66.9 GiB at some point. This
> > would be a problem for me, as the partition I've installed freenet on
> > isn't even large enough for that.
>
> That's part of the migration from mostly cache to mostly store. It will
> only go over the 40GB through the store growing, and the store grows
> *really* slowly. And when you restart, it will shrink the cache to
> compensate for growth in the store. (Or shrink the store too sometimes).

Hm, but does that really solve the problem? If the node uses more than 50 GiB 
for *any* period of time, there'll be a problem for me. It doesn't matter if 
it'll be only for a short time...

Guido

-- 
Mailing list archives are not a proper form of documentation.
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl


[freenet-dev] Routing not working? Please post your store stats

2006-10-07 Thread Guido Winkelmann
Hi,

Am Samstag, 7. Oktober 2006 01:01 schrieb toad:
> 1. THE STORE IS *LESS* EFFECTIVE THAN THE CACHE!
>
> 
>
> Please could people post their store statistics? Cache hits, store hits,
> cached keys, stored keys.
>
> So far:
> [23:11]  # Cached keys: 6,389 (199 MiB)
> [23:11]  # Stored keys: 24,550 (767 MiB)
> [23:09]  # Cache hits: 217 / 12,738 (1%)
> [23:09]  # Store hits: 14 / 10,818 (0%)
>
> (Cached hits / cached keys) / (Stored hits / stored keys) = 59.56
[...]

My statistics:

---
Cached keys: 1,121,346 (~34.2 GiB)
Cache hits: 138,092 / 166,603 (82%)
Stored keys: 15,304 (~478 MiB)
Store hits: 1,202 / 160,002 (0%)
---

This is funny, all the statistics posted so far seem to indicate that the 
cache is using several magnitudes more space than the store. Shouldn't it be 
the other way around?

Also, what's with this line:

---
Overall size: 1,136,650/2,194,293 (~34.6 GiB/66.9 GiB)
---

I've configured my node for a maximum store size of 40 GiB. This line seems to 
indicate that it might use up to 66.9 GiB at some point. This would be a 
problem for me, as the partition I've installed freenet on isn't even large 
enough for that.

-- 
Mailing list archives are not a proper form of documentation.



Re: [freenet-dev] Routing not working? Please post your store stats

2006-10-07 Thread Guido Winkelmann
Hi,

Am Samstag, 7. Oktober 2006 01:01 schrieb toad:
> 1. THE STORE IS *LESS* EFFECTIVE THAN THE CACHE!
>
> 
>
> Please could people post their store statistics? Cache hits, store hits,
> cached keys, stored keys.
>
> So far:
> [23:11]  # Cached keys: 6,389 (199 MiB)
> [23:11]  # Stored keys: 24,550 (767 MiB)
> [23:09]  # Cache hits: 217 / 12,738 (1%)
> [23:09]  # Store hits: 14 / 10,818 (0%)
>
> (Cached hits / cached keys) / (Stored hits / stored keys) = 59.56
[...]

My statistics:

---
Cached keys: 1,121,346 (~34.2 GiB)
Cache hits: 138,092 / 166,603 (82%)
Stored keys: 15,304 (~478 MiB)
Store hits: 1,202 / 160,002 (0%)
---

This is funny, all the statistics posted so far seem to indicate that the 
cache is using several magnitudes more space than the store. Shouldn't it be 
the other way around?

Also, what's with this line:

---
Overall size: 1,136,650/2,194,293 (~34.6 GiB/66.9 GiB)
---

I've configured my node for a maximum store size of 40 GiB. This line seems to 
indicate that it might use up to 66.9 GiB at some point. This would be a 
problem for me, as the partition I've installed freenet on isn't even large 
enough for that.

-- 
Mailing list archives are not a proper form of documentation.
___
Devl mailing list
Devl@freenetproject.org
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/devl