I don't think a subproject is needed; we should be able to do this as an additional module in the Avro Java implementation.
On Mon, Nov 3, 2014 at 3:17 PM, Zoltan Farkas <zolyfar...@yahoo.com.invalid> wrote: > Sean, suggested I bring this up on the dev mailing list: > > Hi gentlemen, Can we create a subproject for avro with standard benchmarks > with JMH? > Jmh, is a good benchmarking framework that mitigates some of the common > benchmarking pitfalls (http://openjdk.java.net/projects/code-tools/jmh/ < > http://openjdk.java.net/projects/code-tools/jmh/>) > these benchmarks results, can then be reported on (trends, detail..) > jenkins with https://github.com/blackboard/jmh-jenkins < > https://github.com/blackboard/jmh-jenkins> > Here is how I do it in a project that I maintain: > > https://code.google.com/p/spf4j/source/browse/#svn%2Ftrunk%2Fspf4j-benchmarks > < > https://code.google.com/p/spf4j/source/browse/#svn%2Ftrunk%2Fspf4j-benchmarks > > > I also publish the results to the project site: > http://zolyfarkas.github.io/spf4j/spf4j-benchmarks/index.html < > http://zolyfarkas.github.io/spf4j/spf4j-benchmarks/index.html> > In my case I also collect profiling information during benchmarking, which > allows be to have the data ready when I see a performance degradation. (I > also publish them to the project site, both spf4j stack sample data and > java flight recorder data) > I use this approach and it is really really useful. > let me know what you think, cheers > > —Z -- Sean
