[ https://issues.apache.org/jira/browse/BEAM-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kenneth Knowles updated BEAM-7605: ---------------------------------- Labels: stale-assigned (was: ) > Provide a way for user code to read dataflow runner stats > --------------------------------------------------------- > > Key: BEAM-7605 > URL: https://issues.apache.org/jira/browse/BEAM-7605 > Project: Beam > Issue Type: Improvement > Components: runner-dataflow > Reporter: Steve Niemitz > Assignee: Steve Niemitz > Priority: P2 > Labels: stale-assigned > Time Spent: 3h > Remaining Estimate: 0h > > The dataflow runner collects (and publishes to the dataflow service) a large > number of useful stats. While these can be polled from the dataflow service > via its API, there are a few downsides to this: > * it requires another process to poll and collect the stats > * the stats are aggregated across all workers, so per-worker stats are lost > It would be simple to provide a hook to allow users to receive stats updates > as well, and then do whatever they want with them. -- This message was sent by Atlassian Jira (v8.3.4#803005)