I've cc'd this reply to freenet devl to see if they have any thoughts on this
issue (gj? anyone else?)
On Sun, Dec 22, 2002 at 07:10:41AM -0500, Jack Byer wrote:
> For some reason, fishsite always crashes my node when I try to insert a site
> with more than one splitfile in it. If I try to insert an edition with a
> bunch of new splitfiles, it will try to encode up to six at the same time.
> This problem happenes with both the windows and the linux versions. I've
> tried varing the number of insert threads and the "FECInstanceCacheSize"
> property in freenet.conf. The freenet log talks about out of memory errors,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> but since I have 1GB installed, I don't think this is really the problem...
At least on linux, the java VM allocates a fixed pool of memory, rather than
growing to fix ram. I assume it also does this on windows, however I don't
know how to solve this there.
I may need to put a big lock around the FEC encoding bit to make sure that
no more than one FEC encode thread is at the node at once. But the node should
still be nicer about this :-p.
> Right now I have to insert all my files one at a time which makes things go
> a lot slower.
>
> Here's what happens on the command line:
>
> X:\WTS>fishsite 1 verify
> Fishsite! CLI v3.0.16.1-final
> (c) 2002, Jaymz Julian aka Fish
> fish at artificial-stupidity.net
>
> ('192.168.0.5', 8481)
> Edition site...
> Inserting manifest site @ SSK at keybits/verify/1//
> Not Cached (content):
> metacache-verify-manifest/xkeybitsExcel-Opening.avi.
> metacache-manifest
> Not Cached (content):
> metacache-verify-manifest/xkeybitsExcel08.part02.rar
> .metacache-manifest
> Spawning thread for verify-files/Excel-Opening.avi(currently running: 0)
> Inserting FEC version 1.2 using FCP
> ('192.168.0.5', 8481)
> CHK@ None
> Spawning thread for verify-files/Excel08.part02.rar(currently running: 1)
> ('192.168.0.5', 8481)
> Inserting FEC version 1.2 using FCP
> ('192.168.0.5', 8481)
> CHK@ None
> ('192.168.0.5', 8481)
> FEC encoding failed for verify-files/Excel-Opening.avi 26105856
> Unhandled exception in thread:
> Traceback (most recent call last):
> File "<string>", line 196, in handleFileThread
> TypeError: cannot concatenate 'str' and 'NoneType' objects
(i really should handle the node barfing out on me in a more
pleasent way....)
> Encoded 32 redundant blocks @ 512 kbytes per block
> Inserting Part 1 of 96 threads: 3 at CHK@, try 1
>
> Here's freenet.log:
>
> Dec 22, 2002 7:01:44 AM (freenet.node.Main, main): starting node
> Dec 22, 2002 7:01:44 AM (freenet.node.Main, main): loading service: mainport
> Dec 22, 2002 7:01:44 AM (freenet.node.Node, main): Starting ticker..
> Dec 22, 2002 7:01:44 AM (freenet.node.Node, main): Starting interfaces..
> C:\Documents and Settings\Administrator\.onionnetworks\lib\win32\fec16.dll:
> Attempt to access invalid address
> null
> null
> Encoding stripe: 0 [131072]
> Made 50 131072 byte check blocks in 2797ms.
> Encoding stripe: 0 [262144]
> Encoding stripe: 1 [131072]
> Made 32 262144 byte check blocks in 2281ms.
> Dec 22, 2002 7:02:17 AM (freenet.node.Node, QThread-4): Error while
> receiving message freenet.Message: FECEncodeSegment @fab3a5683c90800d in
> state New FEC Encode Segment @ fab3a5683c90800d
> java.lang.OutOfMemoryError
> Encoding stripe: 1 [262144]
> Dec 22, 2002 7:02:18 AM (freenet.ConnectionHandler, Finalizer): I
> (freenet.ConnectionHandler at b3f8f6) wasn't terminated properly! Doing it
> now..
>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 230 bytes
Desc: not available
URL:
<https://emu.freenetproject.org/pipermail/devl/attachments/20021223/621389b2/attachment.pgp>
