First catch of the nexmark-CI:It seems that there was a change in the direct
runner.
Query3 (exercise state and timers) - output size should be constant but has
increased today => Was there a change in
state and timer related code?- the output size of this query is different
between batch and streaming modes on direct
runner.
Etienne
Le mercredi 11 juillet 2018 à 15:25 +0200, Etienne Chauchot a écrit :
> Is someone interested in creating the scripts and dashboards for the other
> runners? They can be created by copying the
> existing scripts and dashboards and changing one gradle parameter in the
> scripts and the table name in the
> dashboards.
> I have created the
> tickets:https://issues.apache.org/jira/browse/BEAM-4763https://issues.apache.org/jira/browse/BEAM-4
> 762https://issues.apache.org/jira/browse/BEAM-4761https://issues.apache.org/jira/browse/BEAM-4760
> Etienne Le mercredi 11 juillet 2018 à 15:13 +0200, Etienne Chauchot a écrit :
> > Hi guys,
> >
> > I'm glad to announce that the CI of Beam has much improved ! Indeed
> > Nexmark is now included in the perfkit
> > dashboards.
> >
> > At each commit on master, nexmark suites are run and plots are created on
> > the graphs.
> >
> > I've created 2 kind of dashboards:
> > - one for performances (run times of the queries)
> > - one for the size of the output PCollection (which should be constant)
> >
> > There are dashboards for these runners:
> > - spark
> > - flink
> > - direct runner
> >
> > Each dashboard contains:
> > - graphs in batch mode
> > - graphs in streaming mode
> > - graphs for the 13 queries.
> >
> > That gives more than a hundred of graphs (my right finger hurts after so
> > many clics on the mouse :) ). It is
> > detailed that much so that anyone can focus on the area they have interest
> > in.
> > Feel free to also create new dashboards with more aggregated data.
> >
> > Thanks to Lukasz and Cham for reviewing my PRs and showing how to use
> > perfkit dashboards.
> >
> > Dashboards are there:
> >
> > https://apache-beam-testing.appspot.com/explore?dashboard=5084698770407424
> > https://apache-beam-testing.appspot.com/explore?dashboard=5699257587728384
> > https://apache-beam-testing.appspot.com/explore?dashboard=5138380291571712
> >
> > https://apache-beam-testing.appspot.com/explore?dashboard=5099379773931520
> > https://apache-beam-testing.appspot.com/explore?dashboard=5731568492478464
> > https://apache-beam-testing.appspot.com/explore?dashboard=5163657986048000
> >
> >
> > Enjoy,
> >
> > Etienne
> >
> >
