Hi David, Thanks for replying! Sorry, I forgot to mention I am using Flink Version: 1.11.1, Commit ID: 7eb514a. Is it possible that the default SocketWindowWordCount job is too simple to generate Latency metrics? Or that the latency metrics disappear from the output JSON when the data ingestion is zero?
Thanks, Pankaj On Wed, Sep 9, 2020 at 6:27 AM David Anderson <da...@alpinegizmo.com> wrote: > Pankaj, > > The Flink web UI doesn't do any visualizations of histogram metrics, so > the only way to access the latency metrics is either through the REST api > or a metrics reporter. > > The REST endpoint you tried is the correct place to find these metrics in > all recent versions of Flink, but somewhere back before Flink 1.5 or 1.6 > (if I recall correctly) these metrics were task metrics. So if you are > using an older version of Flink you'll need to dig deeper. I believe you'll > find them in > > /jobs/<jobid>/vertices/<vertexid>/subtasks/metrics > > Regards, > David > > > > On Tue, Sep 8, 2020 at 10:52 PM Pankaj Chand <pankajchanda...@gmail.com> > wrote: > >> Hello, >> >> How do I visualize (or extract) the results for Latency Tracking for a >> Flink local cluster? I set "metrics.latency.interval 100" in the >> conf/flink-conf.yaml file, and started the cluster and >> SocketWindowWordCount job. However, I could not find the latency >> distributions anywhere in the web UI, nor are there any latency metrics in >> the Metrics dropdown box for either task. >> >> I also set "metrics.latency.granularity "operator"" in >> conf/flink-conf.yaml, but that did not help. >> >> When I tried to query the REST endpoint, I got the following output which >> did not seem to contain anything related to latency: >> >> $ curl -s >> http://localhost:8081/jobs/5d0e348eb68588646dece3654d846cf3/metrics >> >> >> [{"id":"numberOfFailedCheckpoints"},{"id":"lastCheckpointSize"},{"id":"lastCheckpointExternalPath"},{"id":"totalNumberOfCheckpoints"},{"id":"lastCheckpointRestoreTimestamp"},{"id":"uptime"},{"id":"restartingTime"},{"id":"numberOfInProgressCheckpoints"},{"id":"downtime"},{"id":"numberOfCompletedCheckpoints"},{"id":"numRestarts"},{"id":"fullRestarts"},{"id":"lastCheckpointDuration"}] >> >> Thanks, >> >> Pankaj >> >
