[jira] [Commented] (SPARK-33359) foreachBatch sink outputs wrong metrics

2020-11-05 Thread John Wesley (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227064#comment-17227064 ] John Wesley commented on SPARK-33359: - Thanks for the clarification. How about numInputRows? >

[jira] [Commented] (SPARK-33359) foreachBatch sink outputs wrong metrics

2020-11-05 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227029#comment-17227029 ] Jungtaek Lim commented on SPARK-33359: -- That's by design. The metric is available only for V2 sink.