We are pleased to announce the beta release of the forthcoming major
release of the DaCapo benchmark suite. We apologize if you receive
this email more than once.
Please note that this BETA release is NOT SUITABLE AS A RESEARCH
TOOL. The purpose of the release is to invite researchers
(particularly JVM developers) to evaluate the it and give us feedback
(see links below for mailing list and bug trackers). Please be sure
to note known bugs and limitations (see end of release notes) before
sending in feedback.
This will be the first of a number of beta releases. Please check
the web site for updates.
We welcome your feedback and thank many of you for the contributions
you've made already.
Best wishes,
Steve Blackburn, ANU
John Zigman, ANU
Kathryn McKinley, UT Austin
(On behalf of the DaCapo project).
-
Key information:
1. Source and binary downloads are available here:
https://sourceforge.net/projects/dacapobench/files/dacapobench/9.10-beta0
2. Release notes are available below and here:
http://www.dacapo-bench.org/RELEASE_NOTES.txt
3. Bug tracker and feature requests here:
http://sourceforge.net/projects/dacapobench/develop
http://sourceforge.net/tracker/?group_id=172498atid=861957
http://sourceforge.net/tracker/?group_id=172498atid=861960
4. Mailing list here:
https://sourceforge.net/mail/?group_id=172498
5. Regression results here:
http://dacapo.anu.edu.au/regression/sanity/latest/index.html
http://dacapo.anu.edu.au/regression/perf/head.html
-
dacapo-9.10-beta0
RELEASE NOTES 2009-09-10
* IMPORTANT: This beta release is NOT SUITABLE AS A RESEARCH TOOL. *
* *
* Please wait for the full release before using the suite for research *
* purposes. The benchmarks in this beta release are: *
* *
*1) not fully tuned, *
*2) not fully evaluated, *
*3) known to have various limitations and bugs, and*
*4) subject to change without notice. *
* *
This is the first beta release of the anticipated 9.10 release of the
DaCapo benchmark suite. These notes are structured as follows:
1. Purpose
2. Overview
3. Usage
4. Changes
5. Known problems and limitations
1. Purpose
--
This beta release exists specifically (and only) to allow community
feedback and contribution to the upcoming major release, and to allow
JVM vendors to test against the suite prior to the final release. We
strongly encourage the community to explore and evaluate these
benchmarks and to send feedback to the dacapo research group via the
mailing list and/or bug tracker. Please check the list of known issues
(below) before sending feedback.
mailing list: dacapobench-research...@lists.sourceforge.net
(subscribe via: http://sourceforge.net/mail/?group_id=172498)
bug tracker:
http://sourceforge.net/tracker/?group_id=172498atid=861957
or navigate to it from
http://sourceforge.net/projects/dacapobench/develop
We are particularly interested in feedback on the following:
o The decision to add benchmarks avrora, batik, derby,
sunflow, tomcat, tradebeans, and tradesoap (see 4.1
below).
o The decision to retire benchmarks antlr, bloat, chart,
and hsqldb (see 4.2 below).
o The tuning / running time of each of the benchmarks in their
default settings.
o The structure and behavior of the tradebeans, tradesoap and
tomcat client/server benchmarks.
o Any issues associated with building, running and usability of
the suite.
2. Overview
---
The DaCapo benchmark suite is slated to be updated every few years.
The 9.10 release will be the first major update of the suite, and is
strictly incompatible with previous releases: new benchmarks have been
added, old benchmarks have been removed, all other benchmarks have
been substantially updated. It is for this reason that in any
published use of the suite, the version of the suite must be
explicitly stated.
The release sees the retirement of a number of single-threaded
benchmarks (antlr, bloat and chart), the replacement of hsqldb by
derby, the addition of six completely new benchmarks, and the upgrade
of all other benchmarks to reflect the current release state of the
applications from which the benchmarks were derived. These changes are
consistent with the original goals of the DaCapo project, which
include the desire
