[
https://issues.apache.org/jira/browse/BEAM-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17052041#comment-17052041
]
Ismaël Mejía commented on BEAM-5212:
------------------------------------
Is this still valid / worth?
> Update native spark metrics
> ---------------------------
>
> Key: BEAM-5212
> URL: https://issues.apache.org/jira/browse/BEAM-5212
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
> Reporter: Etienne Chauchot
> Priority: Major
>
> Native engine metrics are updated on {{finishBundle}} by DoFnRunners. Spark
> uses {{SimpleDoFnRunner}} that is in runner-core and thus contains nothing
> spark native. It might be good to extend {{SimpleDoFnRunner}} to add native
> metrics support just like it was done in Flink with {{DoFnRunnerWithMetrics}}
> class.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
