Let me ask like this, what would be the easiest way to display the throughput in the web console? Would I need to create a new tab and add the metrics? Any good or simple examples showing how this can be done?
On Wed, Feb 25, 2015 at 12:07 AM, Akhil Das <ak...@sigmoidanalytics.com> wrote: > Did you have a look at > > > https://spark.apache.org/docs/1.0.2/api/scala/index.html#org.apache.spark.scheduler.SparkListener > > And for Streaming: > > > https://spark.apache.org/docs/1.0.2/api/scala/index.html#org.apache.spark.streaming.scheduler.StreamingListener > > > > Thanks > Best Regards > > On Tue, Feb 24, 2015 at 10:29 PM, Josh J <joshjd...@gmail.com> wrote: > >> Hi, >> >> I plan to run a parameter search varying the number of cores, epoch, and >> parallelism. The web console provides a way to archive the previous runs, >> though is there a way to view in the console the throughput? Rather than >> logging the throughput separately to the log files and correlating the logs >> files to the web console processing times? >> >> Thanks, >> Josh >> > >