Hello Kazuaki! I recommend you read and take a look at the benchmark sub-library [1] of archery and how it's glued [2]. You will need to implement:
- A runner for the framework you intend to use [3] and [4], it also implies capturing the output into a class that implements the "Benchmark" interface. - Tweak the glue code such that it doesn't assume that there's only a CppBenchmarkRunner [5] and probably some change in the command line UX, e.g. `--language=<lang>` with default to cpp such that it doesn't break the current workflow. Once you have that and it's working locally, you can ask Krizstian help on how to integrate it with ursabot. François [1] https://github.com/apache/arrow/tree/master/dev/archery/archery/benchmark [2] https://github.com/apache/arrow/blob/master/dev/archery/archery/cli.py#L349-L577 [3] https://github.com/apache/arrow/blob/master/dev/archery/archery/benchmark/runner.py#L133-L207 [4] https://github.com/apache/arrow/blob/master/dev/archery/archery/benchmark/google.py#L33-L175 [5] https://github.com/apache/arrow/blob/master/dev/archery/archery/benchmark/runner.py#L51-L86 On Thu, Aug 27, 2020 at 1:59 PM Kazuaki Ishizaki <ishiz...@jp.ibm.com> wrote: > > I am new to the Ursabot benchmark framework like > https://github.com/apache/arrow/pull/7940#issuecomment-673183390. > > How can we run benchmark programs written in other languages (e.g. Java) > beyond C++? If it is not supported yet, what do we need to support to run > benchmark programs in other languages? > > Best Regards, > Kazuaki Ishizaki, >
