I don't believe publishing TPC-C results is a sound idea. TPC-C has been tuned to the point where it doesn't resemble an application that any real customer would implement. If a new technology such as EJB as to compete with existing TPC-C numbers, it is an uphill task. Not to forget the point that the power and flexibility of EJB will not be showcased by this simple benchmark. For a workload to credibly test EJB, it must include multiple databases and distributed transactions - a feature that is missing from most current workloads. Several key vendors are working together with Sun to create an industry-standard, heavy-weight workload to test EJB server products. This workload is called ECperf and is based on a real-world business problem that customers can relate to. The benchmark will contain TPC-like rules for pricing, publishing etc. Shanti ECperf lead > From [EMAIL PROTECTED] Sat Feb 5 03:25:17 2000 > X-Accept-Language: en > MIME-Version: 1.0 > Content-Transfer-Encoding: 7bit > From: Eric Williams <[EMAIL PROTECTED]> > Subject: Re: EJB Server Comparison (WebLogic, > WebSphere,NetDynamics,GemS tone) > To: [EMAIL PROTECTED] > > I totally agree with you on this one. Vendors (ie, the developers) are > the > only ones who are capable of this sort of tuning. And in large, complex > benchmark tests you will often see several vendors (hardware, software, > and database) collaborate to achieve the best results. > > > I would propose that EJB server vendors start working on TPC-C benchmark > testing with their products. There has been considerable time and effort > spent in making the TPC-C benchmark fair and unbiased. And the test > auditing > process is rigorous. > > TPC-C not only focuses on raw performance, but on the cost of that > performance. And it gives you a fuller picture of hardware, application > server, and database required to get the performance. > > > Sure, everyone can do their own benchmark. Hell, I've done them. But it > would be nice to have standard, objective, audited, and published TPC-C > results for today's crop of EJB servers. I would guess that this will > eventually help "cull the herd" that is filled with too many mediocre > and non-scalable products. > > > -eric > > =========================================================================== To unsubscribe, send email to [EMAIL PROTECTED] and include in the body of the message "signoff EJB-INTEREST". For general help, send email to [EMAIL PROTECTED] and include in the body of the message "help".
