Hi Does spark have built in possiblity of exposing current value of Accumulator [1] using Monitoring and Instrumentation [2]. Unfortunately I couldn't find anything in Sources which could be used.
Does it mean only way to expose current accumulator value is to implement new Source which would hook to Accumulator in the driver process, or listen for events on the bus? Many thanks! [1] https://spark.apache.org/docs/1.1.0/api/scala/index.html#org.apache.spark.Accumulator [2] http://spark.apache.org/docs/1.1.1/monitoring.html