Is someone interested in creating the scripts and dashboards for the other
runners? They can be created by copying the
existing scripts and dashboards and changing one gradle parameter in the
scripts and the table name in the dashboards.
I have created the
tickets:https://issues.apache.org/jira/browse/BEAM-4763https://issues.apache.org/jira/browse/BEAM-476
2https://issues.apache.org/jira/browse/BEAM-4761https://issues.apache.org/jira/browse/BEAM-4760
Etienne Le mercredi 11 juillet 2018 à 15:13 +0200, Etienne Chauchot a écrit :
> Hi guys,
>
> I'm glad to announce that the CI of Beam has much improved ! Indeed Nexmark
> is now included in the perfkit
> dashboards.
>
> At each commit on master, nexmark suites are run and plots are created on the
> graphs.
>
> I've created 2 kind of dashboards:
> - one for performances (run times of the queries)
> - one for the size of the output PCollection (which should be constant)
>
> There are dashboards for these runners:
> - spark
> - flink
> - direct runner
>
> Each dashboard contains:
> - graphs in batch mode
> - graphs in streaming mode
> - graphs for the 13 queries.
>
> That gives more than a hundred of graphs (my right finger hurts after so many
> clics on the mouse :) ). It is detailed
> that much so that anyone can focus on the area they have interest in.
> Feel free to also create new dashboards with more aggregated data.
>
> Thanks to Lukasz and Cham for reviewing my PRs and showing how to use perfkit
> dashboards.
>
> Dashboards are there:
>
> https://apache-beam-testing.appspot.com/explore?dashboard=5084698770407424
> https://apache-beam-testing.appspot.com/explore?dashboard=5699257587728384
> https://apache-beam-testing.appspot.com/explore?dashboard=5138380291571712
>
> https://apache-beam-testing.appspot.com/explore?dashboard=5099379773931520
> https://apache-beam-testing.appspot.com/explore?dashboard=5731568492478464
> https://apache-beam-testing.appspot.com/explore?dashboard=5163657986048000
>
>
> Enjoy,
>
> Etienne
>
>
