Re: [freenet-dev] Re: [kaffe] Kaffe and Freenet, round (N+1)

2003-06-06 Thread Greg Wooledge
Helmer Krämer ([EMAIL PROTECTED]) wrote:

> I still doubt that it's working, because that would be too good
> to be true ;) IIRC, there were some errors that only showed up
> after freenet was running for a while, right?

It still leaks memory, but I've learned to stop worrying about that.

Whether it still crashes on assertions, I can't say yet.  Even with
1.0.7 I could often run for hours or days between crashes.  In the
last almost-a-day, I've restarted it twice due to out-of-memory
problems, and it hasn't crashed yet.  Whether that's good or bad
is, I suppose, a matter of taste.

I suppose I should test it with a transient Freenet node on Linux,
too, just to see if any weird bugs crawl out of it.  It won't get
the same kind of unpredictable hammering that a permanent node gets,
but it's worth a try.

-- 
Greg Wooledge  |   "Truth belongs to everybody."
[EMAIL PROTECTED]  |- The Red Hot Chili Peppers
http://wooledge.org/~greg/ |


pgp0.pgp
Description: PGP signature


Re: [freenet-dev] Re: [kaffe] Kaffe and Freenet, round (N+1)

2003-06-06 Thread Dalibor Topic
Hallo Helmer,

--- Helmer Krämer <[EMAIL PROTECTED]> wrote:
> On Thu, 5 Jun 2003 07:53:15 -0700 (PDT)

> > So we have working jetty, freenet, nice, jython, gzz ...
> 
> What about a simple web page to list all the applications
> that work with kaffe?

http://www.kaffe.org/compatibility_applications.shtml . definitely needs an
update to show the latest advances.

cheers,
dalibor topic





__
Do you Yahoo!?
Yahoo! Calendar - Free online calendar with sync to Outlook(TM).
http://calendar.yahoo.com

___
kaffe mailing list
[EMAIL PROTECTED]
http://kaffe.org/cgi-bin/mailman/listinfo/kaffe


Re: [freenet-dev] Re: [kaffe] Kaffe and Freenet, round (N+1)

2003-06-06 Thread Helmer Krämer
On Thu, 5 Jun 2003 07:53:15 -0700 (PDT)
Dalibor Topic <[EMAIL PROTECTED]> wrote:

Hey,

> --- Greg Wooledge <[EMAIL PROTECTED]> wrote:
> 
> > Here is it a bit later, closer to "normal":
> > 
> >   PID USERNAME PRI NICE  SIZE   RES STATE WAIT TIMECPU COMMAND
> > 19688 greg 103   20  752K  616K run   -   20.0H 92.33% dnetc
> > 15010 freenet20  108M  103M run   -5:09  3.91% kaffe-bin
> > 
> > At some point I'll probably update back to the newer gmp just to
> > keep things up to date, then rebuild Kaffe again with that.  But
> > as far as I'm concerned, it's working!  Ship it! ;-)

I still doubt that it's working, because that would be too good
to be true ;) IIRC, there were some errors that only showed up
after freenet was running for a while, right?
 
> So we have working jetty, freenet, nice, jython, gzz ...

What about a simple web page to list all the applications
that work with kaffe?

Greetings,
Helmer

___
kaffe mailing list
[EMAIL PROTECTED]
http://kaffe.org/cgi-bin/mailman/listinfo/kaffe


Re: [freenet-dev] Re: [kaffe] Kaffe and Freenet, round (N+1)

2003-06-06 Thread Dalibor Topic
Hi all,

--- Greg Wooledge <[EMAIL PROTECTED]> wrote:

> Here is it a bit later, closer to "normal":
> 
>   PID USERNAME PRI NICE  SIZE   RES STATE WAIT TIMECPU COMMAND
> 19688 greg 103   20  752K  616K run   -   20.0H 92.33% dnetc
> 15010 freenet20  108M  103M run   -5:09  3.91% kaffe-bin
> 
> At some point I'll probably update back to the newer gmp just to
> keep things up to date, then rebuild Kaffe again with that.  But
> as far as I'm concerned, it's working!  Ship it! ;-)

So we have working jetty, freenet, nice, jython, gzz ... yes, I think we should
ship it before I start breaking things all over again ;)

cheers,
dalibor topic

__
Do you Yahoo!?
Yahoo! Calendar - Free online calendar with sync to Outlook(TM).
http://calendar.yahoo.com

___
kaffe mailing list
[EMAIL PROTECTED]
http://kaffe.org/cgi-bin/mailman/listinfo/kaffe


Re: [freenet-dev] Re: [kaffe] Kaffe and Freenet, round (N+1)

2003-06-06 Thread Greg Wooledge
Helmer Krämer ([EMAIL PROTECTED]) wrote:

> this is actually my bad. Kaffe's BigInteger.longValue() gave wrong
> results for negative values. While trying to fix that, I managed
> to get some errors in it that I didn't notice because my testcases
> succeeded :((( 


Kaffe CVS ([EMAIL PROTECTED]) wrote:

> * libraries/javalib/java/math/BigInteger.java:
> (intValue, longValue): fixed my broken patch


I think it's actually working!  I've got gmp 3.1.1 installed (the
old OpenBSD 3.2 port, since the early-May Kaffe I was using is still
dynamically linked against it).  I built today's CVS Kaffe using
this configuration, and it hasn't crashed or gone comatose yet!

  PID USERNAME PRI NICE  SIZE   RES STATE WAIT TIMECPU COMMAND
15010 freenet   590   91M   93M run   -2:45 65.38% kaffe-bin
19688 greg 104   20  752K  616K run   -   19.9H 29.30% dnetc

The unusually high %CPU on the Kaffe process is because I'm hammering
on it, loading several high-number-of-images pages plus an FEC
splitfile download that's already pretty well cached.

Here is it a bit later, closer to "normal":

  PID USERNAME PRI NICE  SIZE   RES STATE WAIT TIMECPU COMMAND
19688 greg 103   20  752K  616K run   -   20.0H 92.33% dnetc
15010 freenet20  108M  103M run   -5:09  3.91% kaffe-bin

At some point I'll probably update back to the newer gmp just to
keep things up to date, then rebuild Kaffe again with that.  But
as far as I'm concerned, it's working!  Ship it! ;-)

-- 
Greg Wooledge  |   "Truth belongs to everybody."
[EMAIL PROTECTED]  |- The Red Hot Chili Peppers
http://wooledge.org/~greg/ |


pgp0.pgp
Description: PGP signature


Re: [freenet-dev] Re: [kaffe] Kaffe and Freenet, round (N+1)

2003-06-04 Thread Helmer Krämer
On 04 Jun 2003 09:17:14 +0200
Mark Wielaard <[EMAIL PROTECTED]> wrote:

Hi,

> > So, the upshot is, I'm still running early-May CVS Kaffe.  It's the
> > only thing that still works.
> 
> But I didn't know that it already worked with an older kaffe version.
> Can you determine on which date it actually broke?
> The strange thing is that the last work on the kaffe implementation of
> BigInteger is from Januari.

this is actually my bad. Kaffe's BigInteger.longValue() gave wrong
results for negative values. While trying to fix that, I managed
to get some errors in it that I didn't notice because my testcases
succeeded :((( 

Sorry for all the trouble,
Helmer 

___
kaffe mailing list
[EMAIL PROTECTED]
http://kaffe.org/cgi-bin/mailman/listinfo/kaffe


Re: [freenet-dev] Re: [kaffe] Kaffe and Freenet, round (N+1)

2003-06-04 Thread Mark Wielaard
Hi,

On Wed, 2003-06-04 at 05:08, Greg Wooledge wrote:
> Toad ([EMAIL PROTECTED]) wrote:
> > On Tue, Jun 03, 2003 at 01:58:58AM +0200, Mark Wielaard wrote:
> > > You might want to try to configure kaffe with --enable-pure-java-math
> > > that will give you another (the GNU Classpath) java.math.BigInteger
> > > implementation (which doesn't use the native libgmp).
> > 
> > Eeek. Slw. But I suppose if it's all that works.
> [...]
> Next, I tried with --enable-pure-java-math.  This seemed to be working
> better; I could run the node and retrieve documents via fproxy (the
> web interface) without "Negative bit address" errors.  But, as Toad
> said, it's incredibly slow compared to gmp.  Running top, I saw
> kaffe-bin take about 30-40% (with spikes up to 90%) of the CPU when
> I hit a few image-heavy pages.  Normally I don't see it get over
> 50% even when it's doing FEC decoding -- under normal conditions,
> like retrieving a few pages of images, it never got over 20% or so.

Good it works (more or less, haven't a clue about the coma thing).
Bad it is slow.
The same code is used in gcj where is doesn't seeem slow at all but that
might be because gcj is an ahead-of-time compiler that can much better
optimize this code then the kaffe just in time compiler.
The GNU Classpath implementation is based on the pure java gnu.math.MPN
class which says:

/** This contains various low-level routines for unsigned bigints.
 * The interfaces match the mpn interfaces in gmp,
 * so it should be easy to replace them with fast native functions
 * that are trivial wrappers around the mpn_ functions in gmp
 * (at least on platforms that use 32-bit "limbs").
 */

So one approach might be to create a gnu.math.MPNNative that actually
wraps the gpm functions.

> So, the upshot is, I'm still running early-May CVS Kaffe.  It's the
> only thing that still works.

But I didn't know that it already worked with an older kaffe version.
Can you determine on which date it actually broke?
The strange thing is that the last work on the kaffe implementation of
BigInteger is from Januari.

Cheers,

Mark


___
kaffe mailing list
[EMAIL PROTECTED]
http://kaffe.org/cgi-bin/mailman/listinfo/kaffe


Re: [freenet-dev] Re: [kaffe] Kaffe and Freenet, round (N+1)

2003-06-04 Thread Greg Wooledge
Toad ([EMAIL PROTECTED]) wrote:
> On Tue, Jun 03, 2003 at 01:58:58AM +0200, Mark Wielaard wrote:
> > You might want to try to configure kaffe with --enable-pure-java-math
> > that will give you another (the GNU Classpath) java.math.BigInteger
> > implementation (which doesn't use the native libgmp).
> 
> Eeek. Slw. But I suppose if it's all that works.

OK, here we go.

I started by updating from OpenBSD 3.2 to 3.3.  Then I ran Freenet
with Kaffe from early May, which is what I've been using normally
with rather good results.  This seemed to be OK, just as it was
before the OS upgrade.

Then I tried building recent CVS Kaffe (I think it's about 2 days
old now).  I got the same results as before: "Negative bit address",
whatever that means, whenever I tried to access a document.

Then I upgraded gmp from 3.1.1 (the OpenBSD 3.2 port) to 4.1.1 (the
3.3 port).  I rebuilt Kaffe with that version of gmp, and still got
the same results: "Negative bit address".

Next, I tried with --enable-pure-java-math.  This seemed to be working
better; I could run the node and retrieve documents via fproxy (the
web interface) without "Negative bit address" errors.  But, as Toad
said, it's incredibly slow compared to gmp.  Running top, I saw
kaffe-bin take about 30-40% (with spikes up to 90%) of the CPU when
I hit a few image-heavy pages.  Normally I don't see it get over
50% even when it's doing FEC decoding -- under normal conditions,
like retrieving a few pages of images, it never got over 20% or so.

Then, after about 1:30 of CPU time, the node went into a "comatose"
state.  I see this fairly often even with the early-May Kaffe; the
node just sits there, not eating any CPU; sometimes it pulls out by
itself after a few *minutes*(!), but usually it's time to restart it.
After waiting about 5 minutes, I restarted it.

Meanwhile, stdout/stderr had this:

kaffe-bin in malloc(): warning: recursive call.
kaffe-bin in malloc(): warning: recursive call.
kaffe-bin in malloc(): warning: recursive call.

And freenet.log had this:

03-Jun-03 10:42:16 PM (freenet.interfaces.PublicInterface, Interface # tcp/36963, 
NORMAL): Getting thread to dispatch in PublicInterface took more than 10 seconds! If 
this happens frequently, report it to [EMAIL PROTECTED] Waited 101231 millis.
java.lang.Exception: debug
at java.lang.Throwable.fillInStackTrace(Throwable.java:native)
at java.lang.Throwable.(Throwable.java:44)
at java.lang.Exception.(Exception.java:24)
at freenet.interfaces.PublicInterface.dispatch(PublicInterface.java:109)
at freenet.interfaces.Interface.acceptConnections(Interface.java:220)
at freenet.interfaces.Interface.run(Interface.java:172)
at java.lang.Thread.run(Thread.java:334)

(This occurred several times.)

Pretty soon, the restarted node had ground itself down into a coma
just like the first time.  top showed the CPU usage had dropped to
nothing, with about 1:33 elapsed CPU.  No more images were coming
through on the web interface.  There weren't any messages in the
logs this time, though.

So, the upshot is, I'm still running early-May CVS Kaffe.  It's the
only thing that still works.

-- 
Greg Wooledge  |   "Truth belongs to everybody."
[EMAIL PROTECTED]  |- The Red Hot Chili Peppers
http://wooledge.org/~greg/ |


pgp0.pgp
Description: PGP signature