Hi Josh, SPM will show you this info. I see you use Kafka, too, whose numerous metrics you can also see in SPM side by side with your Spark metrics. Sounds like trends is what you are after, so I hope this helps. See http://sematext.com/spm
Otis > On Feb 24, 2015, at 11:59, Josh J <joshjd...@gmail.com> wrote: > > Hi, > > I plan to run a parameter search varying the number of cores, epoch, and > parallelism. The web console provides a way to archive the previous runs, > though is there a way to view in the console the throughput? Rather than > logging the throughput separately to the log files and correlating the logs > files to the web console processing times? > > Thanks, > Josh --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
