RE: Performance (was Re: [JBoss-user] JBoss verses Orion)
Tom coleman was working with a guy from SUN directly. We can ping them ... how is ECPerf catching on in the market place I am not hearing anything about it... in fact is it still alive? marc |-Original Message- |From: [EMAIL PROTECTED] |[mailto:[EMAIL PROTECTED]]On Behalf Of James Cook |Sent: Monday, April 02, 2001 1:33 PM |To: [EMAIL PROTECTED] |Subject: Re: Performance (was Re: [JBoss-user] JBoss verses Orion) | | |Marc, | |Have you guys published the appropriate deployment descriptors to use with |ECPerf yet? So we can try it out. | |jim | |- Original Message - |From: "marc fleury" [EMAIL PROTECTED] |To: [EMAIL PROTECTED] |Sent: Monday, April 02, 2001 12:38 PM |Subject: RE: Performance (was Re: [JBoss-user] JBoss verses Orion) | | |One word... | |ECPerf, | |the rest is BS and we can't go down and look at every little "home brew" |test going on. | |marc | | | ||-Original Message- ||From: [EMAIL PROTECTED] ||[mailto:[EMAIL PROTECTED]]On Behalf Of danch ||Sent: Monday, April 02, 2001 10:56 AM ||To: [EMAIL PROTECTED] ||Subject: Re: Performance (was Re: [JBoss-user] JBoss verses Orion) || || ||Rickard berg wrote: || || danch wrote: || || I've spent the day running some test similiar to Paul's. || || My environment is Linux on a PIII 500, running Sun's 1.3 and ||1.3.1beta JDKs. || || || My environment is Athlon 650MHz, Sun 1.3, HotSpot Client (i.e. standard || install). || || || In the case of a standalone client looping and repeatedly calling the || same method on a stateless session bean, I found that Orion averaged || about 3ms. per invocation where JBoss was averaging 6-10 ms/invocation. || || || With the HelloWorld test in the "jbosstest" module I get 3ms/call, || consistently. ||What concerns me isn't the absolute number, but the differential. ||Comparing how fast your machine runs to how fast mine runs doesn't tell ||us much, really. How fast does Orion run HelloWorld on your machine? || || || || I also made a servlet which performs an equivalent test in-VM. This was || even more disturbing, with Orion taking 10-50 ms to perform 5000 || invocations and JBoss/Tomcat taking 2250 or thereabouts. This is such a || huge difference that I have to believe that optimized invocations are || broken in my configuration. ||Well, I was wrong there - it does correctly optimize calls. || || || || Running the Tomcat test EAR, which does in-VM calls to a HelloWorld type || bean I get 0.08ms per invocation, i.e. 400ms for 5000 calls. ||Which would still be over 8 times longer than orion. || || || I don't know what's responsible for our differences, but the ones you || quote point to either bad environment or bad configuration (since JBoss || *can* do much better). ||Bad environment would handicap Orion as well (although it may be that it ||would be handicapped differently. || ||-danch || || ||___ ||JBoss-user mailing list ||[EMAIL PROTECTED] ||http://lists.sourceforge.net/lists/listinfo/jboss-user | | |___ |JBoss-user mailing list |[EMAIL PROTECTED] |http://lists.sourceforge.net/lists/listinfo/jboss-user | | | |___ |JBoss-user mailing list |[EMAIL PROTECTED] |http://lists.sourceforge.net/lists/listinfo/jboss-user ___ JBoss-user mailing list [EMAIL PROTECTED] http://lists.sourceforge.net/lists/listinfo/jboss-user
Re: Performance (was Re: [JBoss-user] JBoss verses Orion)
It is still considered "early release". http://java.sun.com/j2ee/ecperf/ The JSR's public review is closed. I think we will see a lot more of it when it is finalized, but now is the time to start getting instructions together for deployment. This will entail the same items that you have provided for the PetStore demo. Hopefully just some deployment descriptors, and a program/script to creat/populate database tables. It is my belief that there is a great disparity in performance among the many ejb containers. I think ECPerf will be a huge success if it is easily deployed and if it works! ;-) jim - Original Message - From: "marc fleury" [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Monday, April 02, 2001 2:08 PM Subject: RE: Performance (was Re: [JBoss-user] JBoss verses Orion) Tom coleman was working with a guy from SUN directly. We can ping them ... how is ECPerf catching on in the market place I am not hearing anything about it... in fact is it still alive? marc |-Original Message- |From: [EMAIL PROTECTED] |[mailto:[EMAIL PROTECTED]]On Behalf Of James Cook |Sent: Monday, April 02, 2001 1:33 PM |To: [EMAIL PROTECTED] |Subject: Re: Performance (was Re: [JBoss-user] JBoss verses Orion) | | |Marc, | |Have you guys published the appropriate deployment descriptors to use with |ECPerf yet? So we can try it out. | |jim | |- Original Message - |From: "marc fleury" [EMAIL PROTECTED] |To: [EMAIL PROTECTED] |Sent: Monday, April 02, 2001 12:38 PM |Subject: RE: Performance (was Re: [JBoss-user] JBoss verses Orion) | | |One word... | |ECPerf, | |the rest is BS and we can't go down and look at every little "home brew" |test going on. | |marc | | | ||-Original Message- ||From: [EMAIL PROTECTED] ||[mailto:[EMAIL PROTECTED]]On Behalf Of danch ||Sent: Monday, April 02, 2001 10:56 AM ||To: [EMAIL PROTECTED] ||Subject: Re: Performance (was Re: [JBoss-user] JBoss verses Orion) || || ||Rickard berg wrote: || || danch wrote: || || I've spent the day running some test similiar to Paul's. || || My environment is Linux on a PIII 500, running Sun's 1.3 and ||1.3.1beta JDKs. || || || My environment is Athlon 650MHz, Sun 1.3, HotSpot Client (i.e. standard || install). || || || In the case of a standalone client looping and repeatedly calling the || same method on a stateless session bean, I found that Orion averaged || about 3ms. per invocation where JBoss was averaging 6-10 ms/invocation. || || || With the HelloWorld test in the "jbosstest" module I get 3ms/call, || consistently. ||What concerns me isn't the absolute number, but the differential. ||Comparing how fast your machine runs to how fast mine runs doesn't tell ||us much, really. How fast does Orion run HelloWorld on your machine? || || || || I also made a servlet which performs an equivalent test in-VM. This was || even more disturbing, with Orion taking 10-50 ms to perform 5000 || invocations and JBoss/Tomcat taking 2250 or thereabouts. This is such a || huge difference that I have to believe that optimized invocations are || broken in my configuration. ||Well, I was wrong there - it does correctly optimize calls. || || || || Running the Tomcat test EAR, which does in-VM calls to a HelloWorld type || bean I get 0.08ms per invocation, i.e. 400ms for 5000 calls. ||Which would still be over 8 times longer than orion. || || || I don't know what's responsible for our differences, but the ones you || quote point to either bad environment or bad configuration (since JBoss || *can* do much better). ||Bad environment would handicap Orion as well (although it may be that it ||would be handicapped differently. || ||-danch || || ||___ ||JBoss-user mailing list ||[EMAIL PROTECTED] ||http://lists.sourceforge.net/lists/listinfo/jboss-user | | |___ |JBoss-user mailing list |[EMAIL PROTECTED] |http://lists.sourceforge.net/lists/listinfo/jboss-user | | | |___ |JBoss-user mailing list |[EMAIL PROTECTED] |http://lists.sourceforge.net/lists/listinfo/jboss-user ___ JBoss-user mailing list [EMAIL PROTECTED] http://lists.sourceforge.net/lists/listinfo/jboss-user ___ JBoss-user mailing list [EMAIL PROTECTED] http://lists.sourceforge.net/lists/listinfo/jboss-user
RE: Performance (was Re: [JBoss-user] JBoss verses Orion)
One word... ECPerf, the rest is BS and we can't go down and look at every little home brew test going on. marc |-Original Message- |From: [EMAIL PROTECTED] |[mailto:[EMAIL PROTECTED]]On Behalf Of danch |Sent: Monday, April 02, 2001 10:56 AM |To: [EMAIL PROTECTED] |Subject: Re: Performance (was Re: [JBoss-user] JBoss verses Orion) | | |Rickard Öberg wrote: | | danch wrote: | | I've spent the day running some test similiar to Paul's. | | My environment is Linux on a PIII 500, running Sun's 1.3 and |1.3.1beta JDKs. | | | My environment is Athlon 650MHz, Sun 1.3, HotSpot Client (i.e. standard | install). | | | In the case of a standalone client looping and repeatedly calling the | same method on a stateless session bean, I found that Orion averaged | about 3ms. per invocation where JBoss was averaging 6-10 ms/invocation. | | | With the HelloWorld test in the jbosstest module I get 3ms/call, | consistently. |What concerns me isn't the absolute number, but the differential. |Comparing how fast your machine runs to how fast mine runs doesn't tell |us much, really. How fast does Orion run HelloWorld on your machine? | | | | I also made a servlet which performs an equivalent test in-VM. This was | even more disturbing, with Orion taking 10-50 ms to perform 5000 | invocations and JBoss/Tomcat taking 2250 or thereabouts. This is such a | huge difference that I have to believe that optimized invocations are | broken in my configuration. |Well, I was wrong there - it does correctly optimize calls. | | | | Running the Tomcat test EAR, which does in-VM calls to a HelloWorld type | bean I get 0.08ms per invocation, i.e. 400ms for 5000 calls. |Which would still be over 8 times longer than orion. | | | I don't know what's responsible for our differences, but the ones you | quote point to either bad environment or bad configuration (since JBoss | *can* do much better). |Bad environment would handicap Orion as well (although it may be that it |would be handicapped differently. | |-danch | | |___ |JBoss-user mailing list |[EMAIL PROTECTED] |http://lists.sourceforge.net/lists/listinfo/jboss-user ___ JBoss-user mailing list [EMAIL PROTECTED] http://lists.sourceforge.net/lists/listinfo/jboss-user
Performance (was Re: [JBoss-user] JBoss verses Orion)
I've spent the day running some test similiar to Paul's. My environment is Linux on a PIII 500, running Sun's 1.3 and 1.3.1beta JDKs. In the case of a standalone client looping and repeatedly calling the same method on a stateless session bean, I found that Orion averaged about 3ms. per invocation where JBoss was averaging 6-10 ms/invocation. There was no logging output from either app. server or the beans. Something interesting about the spread of numbers in JBoss' case is that the low numbers were where it was running off of a local drive, whereas the high numbers where off of an NFS share. What prompted me to make that shift (from NFS in my home to a local /usr/local) was seeing some classloader and unix filesystem activity with very high 'count' values in a hprof output (from 'java -Xrunhprof' that is). At any rate, it seems that something in JBoss might be hitting disk a bit more than i'd expect once it gets into a steady running state: shouldn't classes be loaded at that point? Is it possible that some configuration of classloaders is still searching jar files even when the class is loaded? Paul, had you written tests where the bean actually did work? I'm curious to see if the ~3-6 second differention in invocation times is a constant or not. I also made a servlet which performs an equivalent test in-VM. This was even more disturbing, with Orion taking 10-50 ms to perform 5000 invocations and JBoss/Tomcat taking 2250 or thereabouts. This is such a huge difference that I have to believe that optimized invocations are broken in my configuration. At this point, I'm about at the end of what I can find from the standard runhprof output. I'm trying to get JProbe installed, but that isn't going all that well. I should be able to post my client and bean tommorrow, if anyone is curious. thanks, danch Fink, Paul wrote: Oh sorry I should have said. Jboss 2.1 binary (down loaded March 22) Orion is 1.3.8 performance dependent the JBoss version ran very slow. After playing with cache setting, etc. It seemed like the communications was the main bottle neck. To test this I wrote a simple session bean with one get method that returns a Long. The client looped 10,000 times calling the getter. The Orion version was 6 times faster! Other tests we ran had Orion running 4x faster. It seems that JBoss certainly is performance limited. I'm running on a 900 MHz PIII under Linux with Sun's JDK 1.3 ___ JBoss-user mailing list [EMAIL PROTECTED] http://lists.sourceforge.net/lists/listinfo/jboss-user
RE: [JBoss-dev] Performance (was Re: [JBoss-user] JBoss verses Orion)
And who after this will have the guts to argue that we don't need a full time dedicated core that professionally integrates and QAs the code. It was running beautifully not so long ago... I rest my case. Stuff like this is killing us, makes us look like amateurs...the answer to our problem is $$$ And I am working on it, as hard as i can... marc PS: The Apache web server went through the same. |-Original Message- |From: [EMAIL PROTECTED] |[mailto:[EMAIL PROTECTED]]On Behalf Of marc |fleury |Sent: Saturday, March 31, 2001 11:09 PM |To: danch; [EMAIL PROTECTED]; |[EMAIL PROTECTED] |Subject: RE: [JBoss-dev] Performance (was Re: [JBoss-user] JBoss verses |Orion) | | ||I've spent the day running some test similiar to Paul's. || ||My environment is Linux on a PIII 500, running Sun's 1.3 and ||1.3.1beta JDKs. || ||In the case of a standalone client looping and repeatedly calling the ||same method on a stateless session bean, I found that Orion averaged ||about 3ms. per invocation where JBoss was averaging 6-10 ms/invocation. | |It is very broken we have been running the stuff at well below those |numbers. | |In fact we ran around 1-2 ms (depending on stateless). we will see. | |Pf, tired... | |marc | | |___ |Jboss-development mailing list |[EMAIL PROTECTED] |http://lists.sourceforge.net/lists/listinfo/jboss-development ___ JBoss-user mailing list [EMAIL PROTECTED] http://lists.sourceforge.net/lists/listinfo/jboss-user
