Did you have a look at https://spark.apache.org/docs/1.0.2/api/scala/index.html#org.apache.spark.scheduler.SparkListener
And for Streaming: https://spark.apache.org/docs/1.0.2/api/scala/index.html#org.apache.spark.streaming.scheduler.StreamingListener Thanks Best Regards On Tue, Feb 24, 2015 at 10:29 PM, Josh J <joshjd...@gmail.com> wrote: > Hi, > > I plan to run a parameter search varying the number of cores, epoch, and > parallelism. The web console provides a way to archive the previous runs, > though is there a way to view in the console the throughput? Rather than > logging the throughput separately to the log files and correlating the logs > files to the web console processing times? > > Thanks, > Josh >
