Re: [Fwd: DaCapo Benchmark Suite and Paper]

[Christian Thalinger]

On Mon, 2006-09-04 at 23:02 +0200, Mark Wielaard wrote:
 We looked at it but builder is a shared, multi-user machine. Although it
 is great as an autobuilder and tester for various things it isn't great
 for running benchmarks. We would need a more dedicated machine for
 benchmarking to get reliable/comparable results. Note that the cacao
 hackers do have dacapo setup as part of tgolem:
 http://www.complang.tuwien.ac.at/cacaojvm/tgolem/

Right.  Today, and the next days, we have a small cacao hacker meeting.
I'll try to get the new dacapo version into our tests.

- twisti

[Fwd: DaCapo Benchmark Suite and Paper]

[Mark Wielaard]

Hi,

For those that haven't seen it. There is a new release of the DaCapo
Benchmark Suite and a paper describing perfromance evaluation and
benchmarking methodologies. The suite itself is a collection of real
world, free software programs and datasets.
http://www.dacapobench.org/

Cheers,

Mark

---BeginMessage---
The DaCapo research group is pleased to announce a new beta release of 
the DaCapo benchmark suite, an accompanying set of performance 
evaluation methodologies for dynamically compiled languages [Blackburn 
et al., OOPSLA 2006], and mailing lists for community participation and 
feedback. All are available at http://www.dacapobench.org.
 

The DaCapo benchmark suite is a set of 11 non-trivial, real-world, open 
source Java benchmarks. This release contains numerous substantial 
improvements over earlier beta releases of the suite, including new, 
larger benchmarks and a greatly improved harness.  We encourage 
researchers and developers from industry and academia working with Java 
to use the DaCapo suite and apply the methodologies presented in the 
accompanying paper (http://www.dacapobench.org/dacapo-oopsla-2006.pdf).  
The paper recommends performance evaluation and benchmarking 
methodologies for dynamically compiled languages, describes and analyzes 
the suite, and critiques the current state of measurement methodology in 
the field. The web site also contains a link to a companion 30-page 
technical report which includes comparative data for SPEC benchmarks.
 

The suite and paper represent the culmination of five years of work from 
around twenty individuals across eight institutions.
 

We anticipate that this will be the final beta release.
 

Enjoy!
 

Steve Blackburn, on behalf of the DaCapo research group 
(http://www-ali.cs.umass.edu/DaCapo/)


-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Jikesrvm-researchers mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/jikesrvm-researchers


---End Message---


signature.asc
Description: This is a digitally signed message part

Re: [Fwd: DaCapo Benchmark Suite and Paper]

[Dalibor Topic]

Mark Wielaard wrote:


Hi,

For those that haven't seen it. There is a new release of the DaCapo
Benchmark Suite and a paper describing perfromance evaluation and
benchmarking methodologies. The suite itself is a collection of real
world, free software programs and datasets.
http://www.dacapobench.org/
 

Great! Many thanks to Steve and the DaCapo team for putting the work 
into it.


Could this go on builder.classpath.org?

cheers,
dalibor topic

Re: [Fwd: DaCapo Benchmark Suite and Paper]

[Mark Wielaard]

Hi Dalibor,

On Mon, 2006-09-04 at 16:26 +0200, Dalibor Topic wrote:
 For those that haven't seen it. There is a new release of the DaCapo
 Benchmark Suite and a paper describing perfromance evaluation and
 benchmarking methodologies. The suite itself is a collection of real
 world, free software programs and datasets.
 http://www.dacapobench.org/
   
 Great! Many thanks to Steve and the DaCapo team for putting the work 
 into it.
 
 Could this go on builder.classpath.org?

We looked at it but builder is a shared, multi-user machine. Although it
is great as an autobuilder and tester for various things it isn't great
for running benchmarks. We would need a more dedicated machine for
benchmarking to get reliable/comparable results. Note that the cacao
hackers do have dacapo setup as part of tgolem:
http://www.complang.tuwien.ac.at/cacaojvm/tgolem/

Cheers,

Mark


signature.asc
Description: This is a digitally signed message part