[freenet-dev] Freenet 0.7.5 build 1385

[Matthew Toseland]

On Thursday 21 Jul 2011 04:59:50 Evan Daniel wrote:
> On Mon, Jul 18, 2011 at 11:24 AM, Matthew Toseland
>  wrote:
> > Freenet 0.7.5 build 1385 is now available, please upgrade.
> >
> > The main change is merging the store-io branch, aka slot filters. This is a 
> > replacement for the old datastore bloom filters. It keeps 4 bytes in memory 
> > for each slot in the datastore, indicating whether they are full and the 
> > first few bytes of the (hashed, salted) key. This is slightly smaller than 
> > the old bloom filters, but is kept on the heap, not memory mapped, so it 
> > will increase your memory limit in wrapper.conf slightly when you first run 
> > it. It should greatly reduce disk I/O, in particular disk reads caused by 
> > writing a block to the datastore. It will delete the old bloom filters and 
> > build the new slotfilter files, which will take some time, during which the 
> > node will be using the disk quite heavily, but after that it should be much 
> > reduced.
> >
> > Please let us know if there are any problems! There is also a new version 
> > of FlogHelper (which didn't work with the last build), a new load 
> > management fix and some minor stuff.
> 
> Neat to see this feature going in :)
> 
> Upgraded earlier today. I'm showing no writes to store, cache, or
> client cache since then (but yes to slashdot cache). This is true
> across all three key types, even on the nearly empty pubkey stores.

Known bug, fixed in master.

Thanks for suggesting the above, I didn't credit it. (In fact I didn't remember 
who suggested it)
-- next part --
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 198 bytes
Desc: This is a digitally signed message part.
URL: 

Re: [freenet-dev] Freenet 0.7.5 build 1385

[Matthew Toseland]

On Thursday 21 Jul 2011 04:59:50 Evan Daniel wrote:
> On Mon, Jul 18, 2011 at 11:24 AM, Matthew Toseland
>  wrote:
> > Freenet 0.7.5 build 1385 is now available, please upgrade.
> >
> > The main change is merging the store-io branch, aka slot filters. This is a 
> > replacement for the old datastore bloom filters. It keeps 4 bytes in memory 
> > for each slot in the datastore, indicating whether they are full and the 
> > first few bytes of the (hashed, salted) key. This is slightly smaller than 
> > the old bloom filters, but is kept on the heap, not memory mapped, so it 
> > will increase your memory limit in wrapper.conf slightly when you first run 
> > it. It should greatly reduce disk I/O, in particular disk reads caused by 
> > writing a block to the datastore. It will delete the old bloom filters and 
> > build the new slotfilter files, which will take some time, during which the 
> > node will be using the disk quite heavily, but after that it should be much 
> > reduced.
> >
> > Please let us know if there are any problems! There is also a new version 
> > of FlogHelper (which didn't work with the last build), a new load 
> > management fix and some minor stuff.
> 
> Neat to see this feature going in :)
> 
> Upgraded earlier today. I'm showing no writes to store, cache, or
> client cache since then (but yes to slashdot cache). This is true
> across all three key types, even on the nearly empty pubkey stores.

Known bug, fixed in master.

Thanks for suggesting the above, I didn't credit it. (In fact I didn't remember 
who suggested it)


signature.asc
Description: This is a digitally signed message part.
___
Devl mailing list
Devl@freenetproject.org
http://freenetproject.org/cgi-bin/mailman/listinfo/devl

[freenet-dev] Freenet 0.7.5 build 1385

[Evan Daniel]

On Mon, Jul 18, 2011 at 11:24 AM, Matthew Toseland
 wrote:
> Freenet 0.7.5 build 1385 is now available, please upgrade.
>
> The main change is merging the store-io branch, aka slot filters. This is a 
> replacement for the old datastore bloom filters. It keeps 4 bytes in memory 
> for each slot in the datastore, indicating whether they are full and the 
> first few bytes of the (hashed, salted) key. This is slightly smaller than 
> the old bloom filters, but is kept on the heap, not memory mapped, so it will 
> increase your memory limit in wrapper.conf slightly when you first run it. It 
> should greatly reduce disk I/O, in particular disk reads caused by writing a 
> block to the datastore. It will delete the old bloom filters and build the 
> new slotfilter files, which will take some time, during which the node will 
> be using the disk quite heavily, but after that it should be much reduced.
>
> Please let us know if there are any problems! There is also a new version of 
> FlogHelper (which didn't work with the last build), a new load management fix 
> and some minor stuff.

Neat to see this feature going in :)

Upgraded earlier today. I'm showing no writes to store, cache, or
client cache since then (but yes to slashdot cache). This is true
across all three key types, even on the nearly empty pubkey stores.

Evan Daniel

Re: [freenet-dev] Freenet 0.7.5 build 1385

[Evan Daniel]

On Mon, Jul 18, 2011 at 11:24 AM, Matthew Toseland
 wrote:
> Freenet 0.7.5 build 1385 is now available, please upgrade.
>
> The main change is merging the store-io branch, aka slot filters. This is a 
> replacement for the old datastore bloom filters. It keeps 4 bytes in memory 
> for each slot in the datastore, indicating whether they are full and the 
> first few bytes of the (hashed, salted) key. This is slightly smaller than 
> the old bloom filters, but is kept on the heap, not memory mapped, so it will 
> increase your memory limit in wrapper.conf slightly when you first run it. It 
> should greatly reduce disk I/O, in particular disk reads caused by writing a 
> block to the datastore. It will delete the old bloom filters and build the 
> new slotfilter files, which will take some time, during which the node will 
> be using the disk quite heavily, but after that it should be much reduced.
>
> Please let us know if there are any problems! There is also a new version of 
> FlogHelper (which didn't work with the last build), a new load management fix 
> and some minor stuff.

Neat to see this feature going in :)

Upgraded earlier today. I'm showing no writes to store, cache, or
client cache since then (but yes to slashdot cache). This is true
across all three key types, even on the nearly empty pubkey stores.

Evan Daniel
___
Devl mailing list
Devl@freenetproject.org
http://freenetproject.org/cgi-bin/mailman/listinfo/devl

[freenet-dev] Freenet 0.7.5 build 1385

[Matthew Toseland]

Freenet 0.7.5 build 1385 is now available, please upgrade.

The main change is merging the store-io branch, aka slot filters. This is a 
replacement for the old datastore bloom filters. It keeps 4 bytes in memory for 
each slot in the datastore, indicating whether they are full and the first few 
bytes of the (hashed, salted) key. This is slightly smaller than the old bloom 
filters, but is kept on the heap, not memory mapped, so it will increase your 
memory limit in wrapper.conf slightly when you first run it. It should greatly 
reduce disk I/O, in particular disk reads caused by writing a block to the 
datastore. It will delete the old bloom filters and build the new slotfilter 
files, which will take some time, during which the node will be using the disk 
quite heavily, but after that it should be much reduced.

Please let us know if there are any problems! There is also a new version of 
FlogHelper (which didn't work with the last build), a new load management fix 
and some minor stuff.

Thanks.
-- next part --
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 198 bytes
Desc: This is a digitally signed message part.
URL: 

[freenet-dev] Freenet 0.7.5 build 1385

[Matthew Toseland]

Freenet 0.7.5 build 1385 is now available, please upgrade.

The main change is merging the store-io branch, aka slot filters. This is a 
replacement for the old datastore bloom filters. It keeps 4 bytes in memory for 
each slot in the datastore, indicating whether they are full and the first few 
bytes of the (hashed, salted) key. This is slightly smaller than the old bloom 
filters, but is kept on the heap, not memory mapped, so it will increase your 
memory limit in wrapper.conf slightly when you first run it. It should greatly 
reduce disk I/O, in particular disk reads caused by writing a block to the 
datastore. It will delete the old bloom filters and build the new slotfilter 
files, which will take some time, during which the node will be using the disk 
quite heavily, but after that it should be much reduced.

Please let us know if there are any problems! There is also a new version of 
FlogHelper (which didn't work with the last build), a new load management fix 
and some minor stuff.

Thanks.


signature.asc
Description: This is a digitally signed message part.
___
Devl mailing list
Devl@freenetproject.org
http://freenetproject.org/cgi-bin/mailman/listinfo/devl