The non-profit Standard Performance Evaluation Corp. (SPEC) has
formed a group to spark research on
new benchmarking methodologies and tools.
The SPEC Research Group is designed to encourage exchange among
representatives from industry, academia
and research institutes. Planned research efforts include techniques
and tools for performance measurement,
load testing, profiling, workload characterization, and dependability
and efficiency evaluation of computing
systems.
A major component of the SPEC Research Group will be working groups
that develop standard
scenarios and workloads – called research benchmarks – for emerging
technologies and applications.
Benchmarks from the research group will be used primarily for in-depth
analysis and evaluation of early
prototypes and research results. This differentiates them from
conventional benchmarks used for direct
comparison and marketing of existing products.
The first of the research working groups will address cloud computing
and peer-to-peer systems.
Besides developing research benchmarks, other projected activities of
the SPEC Research Group include
publishing a newsletter and journal, establishing a portal for
benchmarking-related resources, recognizing
outstanding contributions to benchmarking research, and organizing
conferences and workshops.
Members of the SPEC Research Group include AMD; Charles University,
Prague, Czech Republic;
Cisco Systems; Coimbra University, Portugal; Hewlett-Packard; Ghent
University, Belgium; IBM;
IIT Bombay, India; Intel; Kiel University, Germany; Karlsruhe
Institute of Technology, Germany;
NICTA (National ICT Australia); Northeastern University, Boston, MA,
USA; Oracle; Purdue University,
West Lafayette, IN, USA; Red Hat; RWTH Aachen University, Germany; SAP;
SFSU - San Francisco State University, CA, USA; TU Darmstadt, Germany;
University of Alberta, Canada;
University of Mannheim, Germany; University of Pavia, Italy;
University of Texas at Austin, TX, USA;
VMware; Yahoo, Inc.; Zhejiang University, China
Membership in the SPEC Research Group is $100 for organizations that
are not members of
SPEC and free to current SPEC members.
Contact:
- Samuel Kounev (Chair) - [email protected]
- Kai Sachs (Vice Chair) - [email protected]
Webpage: http://research.spec.org/
----
[[ Petri Nets World: ]]
[[ http://www.informatik.uni-hamburg.de/TGI/PetriNets/ ]]
[[ Mailing list FAQ: ]]
[[ http://www.informatik.uni-hamburg.de/TGI/PetriNets/pnml/faq.html ]]
[[ Post messages/summary of replies: ]]
[[ [email protected] ]]
