Github user arunmahadevan commented on the issue: https://github.com/apache/spark/pull/21721 @zsxwing @gatorsmile , this PR does not add new APIs as such. It builds on the existing StreamingQueryProgress and adds custom metrics to it. StreamingQueryProgress as such is not reported for continuous mode. When its reported this would be part of that. Are you proposing to not report StreamingQueryProgress at all for micro-batch until things are figured out for continuous mode.? Otherwise I don't see how adding this would break things. cc @jose-torres
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org