On Sunday 22 December 2002 18:18, you wrote:
Your client should serialize the encodes/decodes. Each one could take up to
24MB of RAM.
Of course fred shouldn't just die either. I will put a hard limit on the
number of concurrent encodes/decodes fred tries to handle this weekend.
--gj
> > I've cc'd this reply to freenet devl to see if they have any thoughts on
> this issue (gj? anyone else?)
>
> On Sun, Dec 22, 2002 at 07:10:41AM -0500, Jack Byer wrote:
> > For some reason, fishsite always crashes my node when I try to insert a
> > site with more than one splitfile in it. If I try to insert an edition
> > with a bunch of new splitfiles, it will try to encode up to six at the
> > same time. This problem happenes with both the windows and the linux
> > versions. I've tried varing the number of insert threads and the
> > "FECInstanceCacheSize" property in freenet.conf. The freenet log talks
> > about out of memory errors,
>
>
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>
> > but since I have 1GB installed, I don't think this is really the
> > problem....
>
> At least on linux, the java VM allocates a fixed pool of memory, rather
> than growing to fix ram. I assume it also does this on windows, however I
> don't know how to solve this there.
>
> I may need to put a big lock around the FEC encoding bit to make sure that
> no more than one FEC encode thread is at the node at once. But the node
> should still be nicer about this :-p.
>
> > Right now I have to insert all my files one at a time which makes things
> > go a lot slower.
> >
> > Here's what happens on the command line:
> >
> > X:\WTS>fishsite 1 verify
> > Fishsite! CLI v3.0.16.1-final
> > (c) 2002, Jaymz Julian aka Fish
> > fish at artificial-stupidity.net
> >
> > ('192.168.0.5', 8481)
> > Edition site...
> > Inserting manifest site @ SSK at keybits/verify/1//
> > Not Cached (content):
> > metacache-verify-manifest/xkeybitsExcel-Opening.avi.
> > metacache-manifest
> > Not Cached (content):
> > metacache-verify-manifest/xkeybitsExcel08.part02.rar
> > .metacache-manifest
> > Spawning thread for verify-files/Excel-Opening.avi(currently running: 0)
> > Inserting FEC version 1.2 using FCP
> > ('192.168.0.5', 8481)
> > CHK@ None
> > Spawning thread for verify-files/Excel08.part02.rar(currently running: 1)
> > ('192.168.0.5', 8481)
> > Inserting FEC version 1.2 using FCP
> > ('192.168.0.5', 8481)
> > CHK@ None
> > ('192.168.0.5', 8481)
> > FEC encoding failed for verify-files/Excel-Opening.avi 26105856
> > Unhandled exception in thread:
> > Traceback (most recent call last):
> > File "<string>", line 196, in handleFileThread
> > TypeError: cannot concatenate 'str' and 'NoneType' objects
>
> (i really should handle the node barfing out on me in a more
> pleasent way....)
>
> > Encoded 32 redundant blocks @ 512 kbytes per block
> > Inserting Part 1 of 96 threads: 3 at CHK@, try 1
> >
> > Here's freenet.log:
> >
> > Dec 22, 2002 7:01:44 AM (freenet.node.Main, main): starting node
> > Dec 22, 2002 7:01:44 AM (freenet.node.Main, main): loading service:
> > mainport Dec 22, 2002 7:01:44 AM (freenet.node.Node, main): Starting
> > ticker.. Dec 22, 2002 7:01:44 AM (freenet.node.Node, main): Starting
> > interfaces.. C:\Documents and
> > Settings\Administrator\.onionnetworks\lib\win32\fec16.dll: Attempt to
> > access invalid address
> > null
> > null
> > Encoding stripe: 0 [131072]
> > Made 50 131072 byte check blocks in 2797ms.
> > Encoding stripe: 0 [262144]
> > Encoding stripe: 1 [131072]
> > Made 32 262144 byte check blocks in 2281ms.
> > Dec 22, 2002 7:02:17 AM (freenet.node.Node, QThread-4): Error while
> > receiving message freenet.Message: FECEncodeSegment @fab3a5683c90800d in
> > state New FEC Encode Segment @ fab3a5683c90800d
> > java.lang.OutOfMemoryError
> > Encoding stripe: 1 [262144]
> > Dec 22, 2002 7:02:18 AM (freenet.ConnectionHandler, Finalizer): I
> > (freenet.ConnectionHandler at b3f8f6) wasn't terminated properly! Doing it
> > now..
----------------------------------------
Content-Type: application/pgp-signature; charset="us-ascii";
name="Attachment: 1"
Content-Transfer-Encoding: 7bit
Content-Description:
----------------------------------------
_______________________________________________
devl mailing list
devl at freenetproject.org
http://hawk.freenetproject.org/cgi-bin/mailman/listinfo/devl
