Unless I am unaware some latest changes, the SparkUI shows stages, and
jobs, not accumulator results. And the UI not designed to be pluggable for
showing user-defined stuff.
TD
On Fri, Feb 20, 2015 at 12:25 AM, Tim Smith <secs...@gmail.com> wrote:
> On Spark 1.2:
>
> I am trying to capture # records read from a kafka topic:
>
> val inRecords = ssc.sparkContext.accumulator(0, "InRecords")
>
> ..
>
> kInStreams.foreach( k =>
> {
>
> k.foreachRDD ( rdd => inRecords += rdd.count().toInt )
> inRecords.value
>
>
> Question is how do I get the accumulator to show up in the UI? I tried
> "inRecords.value" but that didn't help. Pretty sure it isn't showing up in
> Stage metrics.
>
> What's the trick here? collect?
>
> Thanks,
>
> Tim
>
>
